John Battelle's Searchblog

Microsoft is taking its homegrown engine outta beta and going live today, adding a few neat bells and whistles along the way. I was under embargo till 9 pm tonight, but come on, the NYT is reporting it already.

I can't offer a reasonable review of the site out of the box, but a list of the new features is at least a start:

- Even more focus on "answers" via Encarta Premium content, which is now free (well, for first use anyway. The engine has added more Encarta content in general).
- Support for RSS search feeds.
- New design, and incorporation into all of MSN, the Messenger IM client, and the MSN Toolbar.

MSFT will be spending some marketing money on promoting its new search engine, I was told in a briefing last week. Let's hope it's better than the MSN marketing of past years...

Net net: Watch for Microsoft to start really cranking now that it has a platform upon which to build. (In the Times piece, Gates is quoted: "There is a tremendous opportunity for rapid innovation here...and the great thing about the launch of MSN Search is that we now have a strong platform in place that will enable us to begin to deliver those innovations to consumers.")

(Also, and aside, I missed this Davos session as I had to leave early, but Gates apparently once again took search as his pitard, then hoisted away. Last year, he said "Google kicked our butt," this year, it was "We were as stupid as hell.")

Like Yahoo before it, Microsoft can now embark on its own path, and I expect we'll see a lot of innovation coming out of Redmond. That's good for everyone. Welcome to the party (officially), MSFT! Now it gets interesting....

So asks Craig Silverstein, my favorite JAM* quotemiester, in this FT article.

"It's clear that a list of links, though very useful, doesn't match the way people give information to each other," says Mr Silverstein. The question that he says Google - like others - is now trying to address is: "How can the computer become more like your friend when answering your questions?"

That means giving direct answers to questions, extracting data from online sources rather than giving links to web pages. It also means doing a better job of divining what the searcher is looking for, tailoring results more closely to what, based on past experience, appear to be the user's particular interests.

A focus on answers? Hmmm. Sounds like Yahoo, AOL, and MSFT's approach. Not to mention, Ask...

*JAM: Joints After Midnight.

Fark is having a Google photoshop hack contest.
These are priceless.

(thanks, Rick!)

Thanks to Ross Mayfield for pointing this one out to me - a meta directory search engine.

Earlier this month we set the dates fro Web 2.0, the second edition. So mark your calendars - Oct. 5-7th, in San Francisco. Details to come!

Meanwhile, I want to use this space to plug another great event. It's called eTech, and it's pretty much the kissing cousin of Web 2.0. eTech is where the seeds of new and interesting technologies are first discovered, whilst Web 2.0 is where they take root in the soil of business. Of course you should go to both, but eTech is coming up first. It's another conference from the great folks at O'Reilly, who I work with on Web 2.0.

In any case, Rael Dornfest, program chair and O'Reilly CTO, has graciously given me a registration discount code to pass along to you all for the event, which will be held March 14-17 in San Diego.

The code is "et05sb" - just head to the registration site and plug it in. It will add another 5% discount to the already discounted early reg fee.

And by the way, Rael has a great site, and riffed on A9/Amazon's news last week. He has a cool idea for Amazon - check it out!

The ever wonderful Steven Johnson riffs in the NYT about a tool he's been using for a few years in his writing, one that we probably all wish we had.

The raw material the software relies on is an archive of my writings and notes, plus a few thousand choice quotes from books I have read over the past decade: an archive, in other words, of all my old ideas, and the ideas that have influenced me....

...The other day I ran a search that included the word ''sewage'' several times. Because the software knows the word ''waste'' is often used alongside ''sewage'' it directed me to a quote that explained the way bones evolved in vertebrate bodies: by repurposing the calcium waste products created by the metabolism of cells.

That might seem like an errant result, but it sent me off on a long and fruitful tangent into the way complex systems -- whether cities or bodies -- find productive uses for the waste they create. It's still early, but I may well get an entire chapter out of that little spark of an idea.

Steven emailed me that he has a longer explanation of his software and process on his site, here.

Man. Traveling for 28 hours straight, then staying up two nights in a row for a best friend's 40th can certainly get in the way of work. But I'm back, and much to report.

I'll be chewing through old news over the next day or so, but honestly, won't report much of it, as my book is due very shortly and I have another, final chapter to finish. However, a few things to note.

Cnet reports from a Harvard conference. Quote: " "Google led the way in clarity in advertising," said Mark Kroese, general manager of information services at Microsoft's MSN. "We weren't separating results (from ads) a year and a half ago, and since we've begun doing so, the response from both users and advertisers has been huge. Google proved that if you have clarity, people respond.""

Cnet also reports on how Google must be losing its cutting edge status, because the "OC" cast is now using A9. OK. In any case, Apple beat out Google for top brand this year, more a statement of Apple's prominence with the mini and the iPod than any failing of Google's, which had the top spot since 2002.

Details here and here. More when I get back.

I'm on my way back from Davos, after four days of mind bending interaction. I'd love to do a long post, but I have to leave shortly to drive to Zurich, then fly to SF. So perhaps later. Suffice to say, search was all over this conference, in ways both subtle and overt. Larry, Sergey and Eric of Google were all here, I got to spend some quality time with Sergey today, finishing the last part of my reporting on the book's final chapter.

The number of extraordinary folks here, combined with their diversity of view points and backgrounds - I met folks from all parts of the world - really does mitigate the otherwise rather unnerving reality of the world's leaders all conferring in an exclusive ski resort in Switzerland.

Tonight I attended a Davos dinner on blogging, it was a great conversation, more on Davos in general here.

In any case, I will be traveling for the next 36 hours, so posting will be...light.

Interesting - search for business professionals...Here's my search. I had no idea.

A9 has debuted a neat new local search product today, which I am covering for Business 2.0 (the actual story will post shortly, this link is to a blog entry about the story on B 2's blog). This is a big deal for A9, and for Amazon - a blending of search and commerce models that has some interesting implications. Excerpt:

In short, Manber and co. (urged on by Jeff Bezos, who Manber says was "very involved") strapped GPS-enabled digital video camera-cum-terabyte server rigs to the top of a bunch of SUVs, then drove them around the commercial areas of major US metropolitan areas, recording what then became composite still pictures of entire cities, one address at a time. A9 took more than 20 million images of 14 million+ businesses across ten cities (more are coming soon), then created a local search application they call Block View.

UPDATE: Here's the actual story I wrote....

Thomas Hawk wonders.

Now I know that Google was criticized a while back regarding the staleness of their images and that an upgrade was promised but I'd yet to see anything official announced. Over the past two weeks the traffic being driven to my site from Google's Image Search has continued to grow and (if you combine their various international sites) Google Image Search has now become my top referring entity to thomashawk.com......

...If I do a search for "rain" under large images, my photo titled "San Francisco Rain" (see below) is on the first page of over 270,000 large images of "rain." Wow, how did I get so lucky? Is it because the picture is actually pretty good as I'd like to believe? Is someone manually reviewing and ranking images at Google? Or is it because I publish using blogger or that I upload my photos to the internet using Hello Picasa (both Google properties)?

UPDATE: Reader Miguel Cuesta shows that Google Image has been updated - it now has Abu Gharib images, the source of the original posting on how stale the image index had gotten.

Via GB'd: Hmmm. Check this out. Philipp found a Google employee who was posting openly about Google, and has some excerpts from the posts on his site. Am getting smart on this but...Seems a fellow started at Google, starting blogging about Google, said some not so nice things and probably violated internal policies to boot, and then quickly blanked his posts. This is his site (ninetyninezeroes - get it?). Empty, for the most part. And no Google cache or URL info. Clearly his site is not in Google's index - I searched for some of the strings in the text Phillip has on his site, not there. His site is on Blogger, and had been up long enough for Google to index it, certainly. So, it seems, the site has been taken out manually, something Google claims to never do.

However, I did find it in Yahoo's cache.

And here is even more - including a discourse on Google's benefits, and an overview of a Google party at last week's sales conference in SF. Highlights:

"google demands employees that are 90th percentile material, so what's with the 50th percentile compensation? the packages would've been decent when the company was pre-IPO, but let's be honest here... a stock option with a strike price of $188 just doesn't have the same value as the ones of yesteryear. even microsoft adjusted their base salaries to 66th percentile years ago when it was clear that their stock options weren't as much a part of the total compensation package as it used to be. for a post-IPO company like google, it only seems fair that they adjust things accordingly."

"i must say, 1500+ sales people getting drunk at a company sponsored party feels remarkably like a frat party."

I am trying to confirm this guy actually worked at Google, and that this is not some elaborate hoax...the fact that it's not in Google's index certainly indicates something is up...

So I do wonder. How is it that Yahoo has it indexed, and Google does not? I'm asking. More when/if I hear more.

UPDATE: The fellow is for real, I am told by Google. Awaiting further explication on the index issue...it'd be relatively simple to test how quickly a normal blogger blog is indexed by Google.... UDPATE 2: A Google source on good authority tells me A/This was a new employee who violated some internal legal and financial policies (in his original post he talked about financial information and hinted at cool products coming up), B/He was called on it by Google management, and reacted by instantly taking down his posts and C/After sleeping on it, folks at Google sat down with him and agreed that he would take some of the more sensitive stuff out and then repost his musings. I'm told a side by side comparison of before and after exists somewhere out there on the web, but I have not found it....As for D/ whether or not Google actually pulled him from the cache or the index, the answer from Google is a definitive no, Google says that in fact their bot simply had not found the site, which had few to no inbound links - not an easy admission certainly, but one that I will take at face value. If anyone has any data about how quickly the average blog is found by indices, I'd be interested. I'm also curious how Yahoo found it so quickly. In any case, the site sure has juice now, and both the original post, as well as the new one and all the commentary, will be in the amber of the index forevermore.

My, it's a busy time in the search biz. I'm still in Europe and the schedule is quite demanding here, so my postings will be light. I will have some news tonight, and hope to get to a longer analysis of video search shortly. Meantime, much buzz about this Sci Am article...thanks to the many readers who have pinged me asking where the hell I am...

I am sure this will re-ignite the browser speculation, but I think the thing after the browser, whatever it may be, is far more interesting to speculate upon.

Thanks for the tip, Steve.

Interesting piece in B'week online on how this hardware company prospered by building servers for Google and Yahoo...the company is set to file for an IPO shortly...

I was briefed on this last week, and will have a longer report later today. Suffice to say, Google Video Search launched today. It's quite distinct from Yahoo and other's approach....

Coverage here.

BTW, Yahoo Video Search beta is now on the home page. I am sure this had nothing to do with the Google news....

It's all over the web today. Look, I was the one to pooh pooh GMail on April 1st, so I'll stay away from saying this is ridiculous speculation.

I've been meaning to write about adMarketplace, a new advertising service, ever since I spoke to its CEO a month or so ago. But I wanted to try it out for myself first, much as I have AdBrite (the network you see on the right over there, which by the way announced (sub req'd) its funding from Sequoia Capital today). I haven't had the time to do that yet, though I certainly intend to shortly. In any case, today adMarketplace announced an interesting affiliate program that allows publishers to earn revenue for introducing advertisers into the network - if you, as a publisher, are responsible for getting an advertiser signed up, you get a piece of that advertiser's revenue across the network, even if the ads are not on your site. An interesting idea and one that feels like a step toward my Publisher Driven (nee Sell Side) Advertising model.

AdMarketplace is the company behind eBay's ad market, a background which serves as both an endorsement and a limitation, when it debuted last year, reviews were mixed. Jim Walton of adMarketplace tells me that it is his intention to quickly grow his network, and he hopes to implement a self service sign up a la AdSense shortly. More when I actually find the time to grok the system, probably later in Feb.

PS - In Davos now, jetlagged but happy to be in the snow...

A quick heads up - the coming week promises to be a big one in the world of search, if the birds flying around my in box are any indication. However, I am away the entire week in Europe, so posting might be light (I'm told there will be WiFi where I will be, but you never know...). In case any readers might also be there, I'll be at the World Economic Forum in Davos. This is my second trip there - I first went in 2001, but couldn't afford it over the past few years. This year they have been kind enough to extend me a pass, and I will be posting as I can. On the first day a group of "Young Global Leaders" (how they come up with these names...) will be at a meeting "aimed at establishing a framework for understanding the problems and risks we face in the coming decades and beyond." I am honored to be one of them, though a bit baffled how it all came about.

The WEF has a blog, as well, though for more personal coverage, you might watch Loic LeMeur's.

This week much of the Googleplex is off on the company ski vacation. So Ask pokes fun by showing Jeeves sitting at his desk, clearly working, but dreaming of snowboarding. When you click on Jeeves, you see a smart answer showing the current conditions at Squaw Valley, where the Google ski trip is taking place. Fun!

SIliconValleyWatcher has the scoop: Google is opening up API support for AdWords. This is a big deal (I hope) in that it lets new ecologies of AdWord-based plays begin to thrive - ideally, this will extend to AdSense, and let publishers start to actually help Google make AdSense work well enough to provide more than just beer money. (Gary Stein notes that Rich at Topix is doing some work along those lines via a premium program).

From the coverage:

The release of the API marks a transition for Google, from an online services company towards that of an IT platform for global ad delivery. The types of sophisticated management tools that will be available from Google and third parties should also help tie advertisers into its ad network.

via GB'd

Isohunt is a BitTorrent search engine, one of the many sites the MPAA is attempting to scare and/or litigate out of business. But the fellow behind Isohunt isn't folding his tent and going home, he's fighting. As Boing Boing points out, so far, he seems to have a far better grasp of the legal issues than does the MPAA. Isohunt simply helps people find stuff, it doesn't host it. But the MPAA is trying to use the DMCA to force the site down. From the site owner's response:

You repeatedly mention the "representative" list of works, which serves only to intimidate us as a search service. If you look at the Betamax vs. Universal case, the VCR was not deemed illegal since it is capable of legal use. isohunt.com is a content agnostic search service on indexing torrent links over the net, which is very much capable of legal use.

The implications here are significant, and this overall story is worth watching. Among other things, the dunderheads at the MPAA are trying to make linking to something illegal. That's a dangerous precedent.

Tickers have been around for while - I remember during Push 1.0 everyone was downloading a stock or news ticker app for their desktop. Then everyone uninstalled it - it crashed the PC or made it unbearably slow, or was simply irritating and a waste of screen real estate.

Well, every good idea deserves another chance, and this time Yahoo's on the case with a beta of a new kind of ticker, one that rolls not just stock info, but just about anything in RSS - so you can monitor, say, Technorati tags or Yahoo News alerts. Oh, and it has a search box, natch. As usual, it's PC only, IE only. Sigh. More on the Yahoo Search Blog.

I'm writing today (the book again!) but this is interesting. From Cnet: Google loses trademark dispute in France.

As I worked on my book over the past year or so, AOL was quite significant for its absence. It didn't seem to have a strategy to speak of when it came to search, its focus on its own walled garden of access customers kept it from influencing the broader conversation of web-based search.

That all seems to be changing now, as AOL last Fall announced it was opening up its service and was taking a more web-centric approach to its business. First major step seems to be in search: it too is throwing its hat into the ring, and the approach it's taking should be familiar to anyone who has a Yahoo login - yup, it looks like Yahoo, with an AOL twist.

(NB: The new search is not available as I write this, I will update when is goes live. Full release is in extended entry.)

First, AOL has used Google as its core index for sometime, and this is not changing. What is changing, and what I find most interesting, is that AOL is throwing open its "Search Experience" to the general web user. AOL has developed any number of interesting tools layered on top of Google - think A9, and Yahoo till they dropped Google for their own index last year. But until now, AOL has focused on its access base - i.e. its access clients, who use PC-based client software to access the AOL service. AOL wasn't really a search destination for anyone who wasn't already an AOL member.

No longer. Last Fall AOL announced a business strategy shift which predicated today's annoucement. It gave up the walled garden model, and - not surprisingly for those who feel search is critical to all things internet - their first big move toward paying off that announcement is in search.

As one might expect, AOL has joined Yahoo in taking what might be called the "media model" of search. The media model takes a person's query and salts the results with all manners of human edited results - mostly from content the service owns, or content that the service access from partners, or content from the web that the service edits together to create what has been called "smart search", "search shortcuts," "programmatic search," and the like. (To be fair, Yahoo, of all the players, is actually pursuing both a Head and a Tail approach - with their algorithmic index and in particular their approach to RSS and video search, for example, they are very much playing in the tail as well).

But AOL is taking "programmed search" to the extreme. It is, after all, a major division of a gigantic content player, and up until now, that content was locked away behind the failing access business model. No longer. AOL Search is taking the media model of search to the maximum - they have 60 full time employees creating edited "snapshots" which respond to what AOL Search chief Gerry Campbell says are 20% of all queries. That's 2.5 million snapshots preloaded, so when you type in a popular query, you get an "answer, not just a list of results." I imagine that number will only continue to grow. Yahoo circa 1995, anyone? This time, however, AOL only has to pre-load queries which prove out to be worth the time - the log files will tell them which ones. As will the economy. "We won't have a smart box for a query like 'birds of the Maldives'" Campbell told me. " But that's why we have Google."

Yow! It's not like Google is against "smart search boxes" - they do add Froogle, News, and Mapquest links when they deem it appropriate. But AOL (and Yahoo) have taken an far more aggressive approach. AOL "without a doubt" wants to to be a major web destination, Campbell says. Which will win? Eh, both.

AOL and Yahoo are playing to the head - where the money is, where the commercial value is - honestly, where most of the most popular content is. Google is playing, as a service, more to the tail. And the stuff they are adding to their new web search, combined with the stuff they plan to add, will, i think, push AOL into being a full throated contestant in the ongoing search scrum. Yippee!!!

Campbell said something interesting as we chewed through this: that AOL is creating a "query driven navigation interface," as opposed to just another search engine.

To the particulars (and I'd love to have screen shots, but I never got the deck mailed to me that I saw online when AOL briefed me earlier today. When/if I get em, you'll see em.)

AOL is adding a lot to its search play. First they have a new and much improved interface. Probably most impressive, at least in concept (I have not played with it) is the "SmartBox" feature which is sort of like Yahoo's "Also Try" or Google's search suggestion tool, but in real time as you type a query. Cool idea.

They're adding clustering, via a deal with Vivisimo. They're adding pay-per-call, via a deal with Ingenio (I'd love to write more about this, but I'm beat, it's late, maybe later in the week!). They're adding those smart boxes I was talking about. They're adding search history - but only your last 50 searches. I think that's lame, but Campbell told me the average AOL user searches just 20 times a month - same as your typical web surfer. They plan to watch that and possibly add more. And they're planning on adding robust local search that integrates some of their properties - MapQuest, Moviefone, Yellow Pages, City Guides, etc.

And, of course, they will be adding desktop search, through a deal with Copernic, which is, I hear, a great desktop search tool.

Soon, Campbell told me, they plan to add localized indexing, so you can search just the part of the web that is in your region. That will be through a partnership with FAST.

And, oh yeah, they will be integrating vertical search, travel, shopping, etc. Oh, and they have added the ability for "AOL partner advertisers" to buy their own trademarks as ad terms, boxing out others. Hmmm, that smells a bit opportunistic given all the legal stuff swirling around trademarks, but hey, gotta make a buck.

Man, they've been busy. I can't wait to play with it. I'll update this post once I do.

Update: Boston.com points out that AOL's use of FAST for local is a blow to Google. Also, my friends at Ask remind me that they had clustering, smart search, and suggest tools for years.

Continue reading "News: AOL Puts A Stake In The Ground" »

I am still not sure how I feel about this, everyone in the comments field of the last post have valid points to make. As I understand it from the Google Guy post (and I am not sure this really is a "Google Guy" - when will Google just stop being coy and let actual real people make comments?) the rel = tag will possibly extend how comment URLs can be understood, built upon, etc. That sounds like a good thing.

But certainly then one question is, do we default to "no follow"?

Now, I'm not questioning No Follow simply because I want to ensure that those who leave URLs in a blog's comment space get more search juice. For the most part, I agree with Danny's approach on this question. But what bothers me is that there may well be an ecology that evolves based on the link mojo in comments which we can't imagine, but that would be important and wonderful, and that will not develop if every comment has a tag telling search engines to ignore it. Like it or not, search engines are now processors of our collective reality, and fiddling with that requires some comtemplation.

My gut take on this yesterday was "We're making a decision without thinking through the implications." My second gut take was "We can't possibly imagine all the implications." So my third gut take is "Don't do it if we can't imagine what consequences it might have."

OTOH, there is much to recommend any system that foils spammers, and ecologies always evolve through a rubicon of conscious choice and unconscious wandering. I have found, however, that using the tools provided by MT, comment spam is no longer a big deal for me. I manage the problem on my end (with able help from my webmaster), and that's that.

In the end, I remain unsure how I feel about this, and will continue to grok it, and if I come to some conclusion, I'll share it, but for now, I'm still pondering it. Meanwhile, my webmaster has installed the software, but I'm going to ask him to take it off mine, till I figure out how I feel about it.

Update: I'm told by my webmaster that "No Follow" also applies to Trackbacks. I totally disagree with that, so for now, I won't be No Following. If I have this wrong, can someone clue me in? I know there is trackback spam, but it's about 1% the problem of comment spam....

Update 2: Anil has a good post on all this here. But as I read through it, I realized I really wanted to read the comments too. And bingo, they were great. Danny chimed in, as did many others, and I learned something. The comments themselves were very valuable information. Let's imagine a scenario five years from now when someone - perhaps a student doing his thesis on the early growth of blogs - wants to do a search for intelligent commentary on the emergence of post-PageRank relevance schema. Assuming that everyone follows No Follow, does that mean that the comments in Anil's post, which I found very good, will have less juice in the index, even though they use linking to make posts? What if the comments brought up entirely new ideas, ones that deserve to be found later, or linked to important concepts which elucidate the discussion?

In other words, here is one of the unintended consequences I worried about already becoming apparent: No Follow will discourage people from doing what I'll call "fully web-expressed writing" on other people's blogs - where they write in that rather post-modern way of linking as they write, which is what we all do in this bloggy world we live in. A deft web writer is like a spider pulling strands to support his or her central thesis - it's an emerging form of communication, and from what I can tell, it's going to be very important long term to our culture.

If as a commentator on someone's blog, you know that you're spending ten, twenty, or more minutes crafting a response, and that response - because it lives in someone's comments field - will be ignored by the conferrers of future societal attention (ie - search indexes) - then I can imagine many folks will simply avoid writing thoughtful responses in comemnts altogether. Instead, they'll post on their own site. It seems that one of the things No Follow will do - subtley or not - is discourage active and intelligent dialog on a post. That is not, to my mind, a good thing.

So far what I have read seems to frame the folks who are unsure about No Follow as not wanting to lose the ability to gain PageRank from comments they might post elsewhere. Danny pointed out in Anil's comments that there is something rather seamy about using comments to announce your blog, or point to your favorite post, or whatever. With exceptions, I agree with that. But I don't think this is about that - it's not why I am still unsure. It's more subtle - what am I locking down here that otherwise might flourish? What am I cutting off that might prove important in the future?

Also, the idea that we need to get "back to PageRank as it was in the beginning" feels a bit off - that was then, this is now. We can't go back.

I would have liked to have posted this on Anil's site, but he has TypeKey registration set up, and I'm not against it per se, but I just don't like the siging up proceess getting in the way of thinking out loud as the impulse hit me. Sorry about that, but there you have it, proof in the process. As I have said many times, f*ing spammers.

Lastly, I sense that this is more about the search engines and their need to despam their indexes (important certainly), than it is about the bloggers and the need to despam our sites (which as I said before, we all are getting reasonably good at). Note that Ask - which takes a different indexing approach from the more PageRank-centric MSN, Google, and Yahoo - is on the sidelines on this one. Not that we don't all live in an intertwingled ecology, and not that we don't all potentially benefit from this move, but ... this felt rushed and rather unilateral.

Anyway, yet more to chew on. This is drawing an amazing array of responses, far more than I can read right now. My apologies in advance if I missing some obvious advancements in the discussion, or have my facts dead wrong.

I'm not entirely sure how I feel about this yet, because what ends up happening is folks who leave URLs in comment fields get no search juice at all. This creates an early lock down in the blog space that I am not sure won't have unexpected consequences. On the other hand, I love the idea of f*ing with comment spammers...

Last week I had a chance to speak with Lars Perkins, once CEO of Picasa and now GM of Google's Picasa unit. He was brimming with the news of his new product's features, so let's do a quick overview of what's new, and then I'll add a few thoughts as to what all this means. At least, what it seems to mean from where I stand.

First, Picasa is a major upgrade, the first since its release. It adds features in four areas:

- Editing. Version 2 has more and deeper editing features, including new filters, new lighting effects and masks, new color correction, etc.
- Backup. Picasa now lets you back up to CD or DVD, and create "gift CDs" for family and friends.
- Organization. You can now tag pictures with metadata and organize them in new ways.
- Integration with other sites. Picasa announced a deal that allows you to get prints of your Picasa photos through four major photo sites: Ofoto, Shutterfly, Snapfish, and Walmart.

Ok, for more on the features, there's always PCWorld. What I'm interested in is the more joints after midnight stuff, what does Picasa *mean*, man?

It was odd - almost weird - to be having the discussion I did with Lars. It felt like I was back at MacWeek in the late 1980s and there I was, talking to a product manager at - well, a company like Microsoft about his new product - just one of scores the company was working on at given time. The whole thing struck me as very...traditional. Google was introducing a new software application, touting its new features...Wow, i thought to myself, this is how things are going to be with Google, going forward. Just one more product, one more set of features, one more cog in the machine. I don't know why that struck such a dissonant note, but it seems to me it's apt - the company is getting big, and every product can't have the entire impact of the Google brand, so to speak.

But every product does carry that brand's influence and potential. And to that end Picasa has many implications. First, let's consider the business model. I asked Lars what it was, and he admitted "We don't have one." Since Google bought Picasa, the software is now free - it used to cost around $30 to download.

"That's kind of took some getting used to," Perkins added. "I had to unlearn some of my entrepreneurial instincts...For now, the focus is entirely on creating the best user experience. Like most things Google has done, we'll figure out the business model down the road."

OK, I can swing with that, but ... really. What about selling prints and calendars, like Ofoto does? "I don't think you'll see Google offering end user products like printing or mugs," Perkins replied.

Well, then, what about getting a piece of the referral action? If you are sending Picasa members to Walmart or Ofoto for printing services, don't you at least get a piece of that action? "No."

Huh. Why not? "We are interested in working with all partners, and when you try to cut these business development deals, there are always exceptions they want...."

It seems to me that if you're Google, you can set the terms of a deal: make it the same for everyone, for example. But regardless of the "we'll figure it out later" approach to business, which I at once admire and find rather disingenuous (will Google really send its Picasa customers to YahooPhoto?), there are any number of reasons why Picasa makes sense for Google.

1. Photos are data, and Google loves data. The more, the better. Sure, it's not in the *web* index, but that can come later, as the definition of the PersonalWeb and the PublicWeb start to overlap.
2. Photos are personal, and photos are shared - both trends that allow for search to be better and more important to individuals and groups. This also binds a user to Google, over any other service.
3. Having a photo service will help a search company understand trends in non-textual search, and messy taxonomies of grassroots-driven tagging in particular.
4. And Picasa can be a business, in particular a referral-driven business. Once Google establishes Picasa as an application with its own momentum, I expect the company will reconsider its business model neutrality and start to charge commerce-related fees, much as it most likely will with Google Print.

As I think about Picasa, Google Desktop, Print, Keyhole, Blogger, and Google Groups come to mind, as does Google's long held aversion to consumer marketing. And I've come to the conclusion that Google can no longer afford to avoid consumer marketing. In order for these services to really scale, to get to where they need to go, Google will have to start promoting them. It's unavoidable - even if you do have the best product in the world, you need to tell people about it before they get locked into other options - Yahoo, for example, promotes Travel, Photo, and other services it owns. That's what marketing is, after all. Sure, you probably don't need to market Google search, nor do you need to market in traditional ways. But you sure do need to promote Picasa if you want it to be anything more than a footnote in its space. So I revise what I've said in the past about Google hiring an agency. I don't think they'll do it to launch a big "We're Google and we rock" TV campaign, but it makes a whole lotta sense that they might hire an agency to promote the growing number of services and applications the company owns or will own in the future. I don't know how many GDS downloads there have been, but given how many competitors there are in the desktop search space, I can only guess the number isn't as high as Google would like, for example. I would not be surprised to see a campaign sometime later this year that reminds consumers that Google has more to offer than just a wicked fast search engine.

Oh, and I did ask Lars if we'd see a Mac version of Picasa, and he asked me if I had used iPhoto. Yup. Enough said.

PS - The Picasa site is very slow today - I imagine it's getting hammered.

PPS - Danny has a nice piece comparing Picasa to Adobe, and check out this post on an idealized photo site from Thomas Hawk.

I noticed the news has leaked - Picasa version 2 has shipped, a major upgrade to the photo app - purchased by Google last year. More on this shortly. Congrats to Lars Perkins and his team.

As most of you know, last Friday I posted a plea for help on the subtitle for my book. I never imagined I’d get so many responses – 90 comments so far and still climbing, and more than 150 discrete suggestions. Thank you!

So as to hone your subtitlin’ skills, many of you asked me what the hell the book was really about, and that certainly is a reasonable question. So let me attempt to outline the thing, given that I just sent chapter 9 of 10 to my editor, and I need a break from writing it. (Instead, of course, I’m writing about it, but there you have it.)

The book breaks into ten discrete chapters, and attempts to tell the story of search through any number of major narrative actors, as well as via a few key Big Ideas. One of them is the Database of Intentions, which was one of the first posts on Searchblog, but others include the idea of Intent over Content as well as the power of the Search Economy. As one might expect, Google plays a significant role in the book – I devote three chapters to the company.

In any case, here’s the outline (subject to change, of course).

Chapter One I’m calling “Why Search.” I attempt to lay out why I think search is such a big deal. If you’ve read my immortality or eternal/ephemeral riff, or the DoI post, you’ll find some familiar stuff in here. I preface some of the bigger issues – privacy, shifts in business, etc. – that I go more deeply into in subsequent chapters. I end with a pretty far fetched scenario around AI, but that’s kind of the point of the first chapter – get you interested in all manner of things, and hopefully pay it off later on.

Chapter Two I’ve come to call “Who What Where Why When (and How Much)” – this is the chapter many of you search vets might skip, as it introduces how search works, what its basic business model is, how we came to where we are in search, and so on.

Chapter Three I’m calling “History” – it tells the story of early search, from Archie to AltaVista, and the rise of the portals. There’s a fair amount of Yahoo in there (of course, if you count AltaVista, there’s a lot of Yahoo in there).

Chapter Four is called “Google Is Born.” This was a lot of fun to research.

Chapter Five chronicles the birth of Overture and profiles Bill Gross. Also, very fun.

Chapter Six might as well be called “Google’s middle years” – 2000-2004, roughly.

Chapter Seven I’m calling “The Search Economy” and it goes into the amazing growth of the search industry and its impacts on all forms of commerce, on and offline.

Chapter Eight discusses the impact of search on society – from privacy to The China Question.

Chapter Nine I’m calling “Google Now.” A sort of meditation on the company post IPO.

And Chapter Ten, finally, is “The Future of Search”, which I posted on earlier.

Well, there you have it. Reading over this, it seems a bit dry, but there's a lot of fun stuff in there, I think.

So, does that help with any more subtitle ideas? So far, there have been some great ones, some hilarious ones, and some pretty terrible ones to boot. But I love 'em all. Some of my favorites so far, at least in terms of informing the final choice or making me laugh out loud:

The Search: The Web's Killer App
I'M FEELING LUCKY: Knowledge and Wealth in the Age of Google
The Search: How Google Made Us Forget How Little We Really Know
Results 1-10 of about 17,300,000
Google Trek III: The Search for Stock
The Inside Story of How Google Taps the Global Brain (and Our Wallets, Too)
The Search: Intellectual Capitalism in the Age of Google
GETTING EVERYTHING: Search in the Age of Google
Inside Google and the birth of a new industry
Search: The Battle for Digital Dominance in the Age of Google (this one came via email)

Keep those cards and letters coming, and thanks again!

Cnet investigates whether Google might be up to something. I dunno. This is starting to feel like overcoverage. But then again, we're all interested...

UDATE: Doing some research on my last chapter, I re-read this interview in Fortune(sub required). Sheds some light on the subject of Google's interest in fiber: SCHMIDT: Let me tell you some things about broadband. The first is that we see broadband users use Google a lot more. Now, we don't know what is the causality. We don't know whether it's the broadband that allows it, or whether it's a demographic profile or something, but we do know that broadband users use Google much more and they buy more things. They live on the Internet because of broadband. So, it is strategic for Google to have broadband deployment worldwide. Every person who converts from narrowband to broadband is more likely to be using Google and its services. I think Ross is probably right, Google just needs someone to help them negotiate their internal needs. But then again...

Metadata addicts rejoice, Technorati has launched tag-based search and alerts. For more, read Dave's post here.

Interesting post on Traffick positing the theory that Google's AdSense "faces extinction" unless Google does something about it. The author notes that AdSense doesn't work so well for publishers with strong repeat audiences (I can attest to that), that click fraud is growing (I sure have proof of that with folks I've spoken to lately), and that new options are threatening AdSense's base (like AdBrite and BlogAds). net net, I don't think we'll see AdSense going anywhere, but I agree that upgrades are due, and I sense they are coming shortly. First up might be verticalization - so you can buy in large consumer verticals like autos, travel, etc. Second might be opeing up the network to let developers build mini-networks of endemically related sites. Now that'd be nice, eh?
(Thanks, Bill!)

UPDATE: Slashdot picks up this Newsweek article on click fraud, and my post above as well. Welcome, slashdotters, if you want to know more about Searchblog, head here.

Phillipp Lenssen recently reviewed sites that are filtered out of Google's German and French indexes for reasons of internal national politics. This is not news - this has been so for some time, but it's very interesting nonetheless, and it reminds us that all search sites find themselves in these kind of dilemmas, given they are in the business of human knowledge. In France and Germany it's mainly hate sites which are filtered, but in China, it's certainly going to be a lot more. Currently Google does not maintain a site based inside China, though it does serve Google in Chinese from outside the mainland. That will most likely change (the market is so large, and Google is now beholden to public shareholders who want profits), and when it does, the Don't Be Evil motto will once more hang around Google's neck, a length of rope that Microsoft and Yahoo have managed to avoid (though they are already in China in major ways).

Like many others, I find myself drawn to BitTorrent, but in my case, it's due to the implications of its distribution model on the rise of my video-as-grammar riff. (Quick refresher: I eagerly await the day our culture starts to cite and annotate video the way we do text.) A reader pointed me to his analysis of BitTorrent traffic given the whole SuprNova.com MPAA smackdown. His post is interesting - using data from a BitTorrent search engine (TowerSeek), he analyzed torrent file distribution across the web. The conclusions are not easily summarized, but two things jump out - one, there is a lot of centralization in torrents to date (hence the MPAA going after SuprNova and other large sites), but also, there is an *extremely* long tail - one that I would guess will only grow.

Many of you may have noticed that last night Searchblog was hacked, apparently by someone in Albania (!). For a brief period of time my site redirected to a very odd page, and it appeared I had entirely lost my mind. All is well now, though we have some backend housekeeping to do. Thanks to the many readers who alerted me.

Here's something to do instead of working on a Friday afternoon - help me come up with a good subtitle for my book!

Up till now, the book I've been laboring over has had this title/subtitle combo:

The Search: Business and Culture in the Age of Google

A week or so ago the marketing team at my publisher came to life and informed me that this subtitle, while not exactly terrible, didn't really say much - it didn't *sell* the book, it didn't declare how big a deal this search thing really is. Not to mention, it didn't say anything about money, or inside access, or any of the other things which seem to sell books these days.

Now, I've been on this planet too long to throw a tantrum and declare that it's my way or the highway when it comes to subtitles. Long ago, for example, I stopped expecting that the headlines on a magazine's cover were really about the stories inside - no, they are about selling the stories inside, and that is an important distinction.

OK, so in the book, there's a lot of stuff that has not been reported anywhere else (so far anyway). This is, in the main, because no one else was insane enough to care as much as I have, nor to interview the hundreds of people I interviewed over the past 18 months. And it's also true that there is a fair bit of narrative about how big a deal search is in terms of economic impact - from the Google IPO to the entire Search Economy in general.

In any case, from what I can divine, there are a few words or concepts that any normal publisher might want included in the subhead of The Search.

1. Google. Most publishers would probably want the book to be called "Google: Google Google Google Money Sex Google" - but thankfully my Editor is more enlightened than most.

2. Money. As in, lots of it at risk, being made, exchanging hands.

3. Inside Access. As in - this book tells a story no one else has.

But when I saw the marketing team's first try at a new subhead - "The Quest for Perfect Knowledge and Infinite Wealth in the Age of Google" - I thought to myself - surely we can do better. I mean - Infinite Wealth? ("Big Bucks" was also tossed around....) So I asked if I could turn it over to you guys (understand that when it comes to titles and covers, publishers tend to get pretty territorial). And proving that even New York publishers can swing with the times, they said "Why not?"

So what do you think a good subtitle would be?

Thanks to Doug Cutting, news of Filangy, a Nutch-based personal search engine that watches where you go and creates your own web index of sites you've seen (and incorporates general web search as well). It's still in early beta, you have to sign up to use it.

Notes on a BayCHI/PARC talk given by Google's Marissa Mayer are posted here. Thanks, Rick!.

A new study from Keynote shows gains for Yahoo and MSN over Google when it comes to various metrics of search engine usage. A write up from Chris over at SEW chews through it. Ask Jeeves also gained, Keynote says.

I think this is pretty predictable - search has been a very hot story for a year or two, and it's starting to trickle down to the average consumer - hey, there's more than one player out there! Also, MSN and Yahoo have made a lot of noise lately, and Ask has certainly gotten better.

I have not been able to review the actual study yet, but if/when i do, I'll post more.

Two MediaPost Items:

Online Ad Spend Could Grow By 30% in 2005

and

Search Engine Marketing ROI Soared In Decemeber.

Google today launches the Google Mini search appliance, for enterprise search. Cnet coverage.

I'm a bit late to this, but there you have it. Exalead, a company that powers AOL France's search (I was introduced to its founder by Alta Vista founder Louis Monier - yup, he's French) announced today that its stand alone search engine has surpassed the 1-billion-pages-indexed mark. (The engine launched in October).

Why do I like it? Because when I do a vanity search, my interview with Richard Linklater and Douglas Coupland in Wired, way back in the mid 1990s, is the second result.

But seriously, it's great to see yet another search play out there. Exalead's CEO Francois Bourdoncle tells me that a desktop application is on the way, and the engine has all manner of neat features, including categories, bookmarks, related terms, thumbnails, and more.

SEW covers it here.

As nearly everyone knows, Dan Gillmor has moved to the entrepreneurial world, and I'm tickled he's out here in the wild now, figuring out his next thing and just hanging it out and seeing what might come. Today there's news that he has been appointed a fellow at Stanford Law's Center for Internet & Society, and is organizing a conference on the idea of the citizen journalist. At the end of the day, I sense that the citizen journalist equates with my fundamental definition of a journalist, regardless of credentials: a person who both has the talent and the desire to report, investigate, question, and care about something that others in a community also care about. As an industry and over time, we may have forgotten this fundamental truth, but I see it every time I teach at Berkeley - students with an itch to communicate what they see, regardless of the outcome. Given the fall of icons such as CBS and the NYT, it's a good thing that we can still honor such an impulse in our culture, and I look forward to seeing what Dan will do next.

A birdy with an abiding interest has told me that MSN, through its MyMSN service, will tonight "quietly launch several new features for MyMSN, one of which is the ability to discover, read and search through blog and RSS content." You will also be able to add RSS feeds to your MyMSN page, just like MyYahoo. Innaresting, no?

Apparently this will be powered by Moreover.

Meanwhile, Dave Winer has launched a conversation about standardizing this whole RSS "Add to" clutter...for more, see here.

Daniel Brandt, Google's most relentless thorn, has released code which scrapes Google, sans ads. Techdirt covers it here. The Register (also a Google thorn) covers it here. Highlights:

Brandt fully expects Google to throw legal and technical resources at him, but says he welcomes the challenge if only to clarify copyright issues.

Google took people's free stuff and made a $50 billion business from it, he argues.

"The commercialization of the web became possible only because tens of thousands of noncommercial sites made the web interesting in the first place," he writes. "All search engines should make a stable, bare-bones, ad-free, easy-to-scrape version of their results available for those who want to set up nonprofit repeaters. Even if it cuts into their ad profits slightly, there's no easier way to give back some of what they stole from us."

OK, there are a lot of issues here, and I really must write the book. Really...must...write...aww hell. I'll say this, in any case: Google hasn't stolen anything from anyone. Has the company profited from innovation in assembly and the architecture of participation? Hell yes. But that's OK, after all, those who innovate in assembling data, and those who take the patterns from the aggregate and make sense of them for the individual, well, they deserve the rewards of the marketplace.

But the question of public data as a copyrightable fact is an interesting one. It's been around the legislative maypole (as noted here) and I don't have time to get fully smart on it, but it is an interesting dilemma.

Think of the implications for the public domain material in the Google Print/Library project, for instance....

I like Mark Cuban's blog, it's a fun window into the sports world, but as we all know, Mark is also a big fan of search, having invested in both Mamma.com and IceRocket. So I was interested to read his latest rant on Randy Moss's silly (and fake) bare ass in the playoff game last Sunday. In it, he dresses down the media for making a big deal of the incident, then talks about the search implications:

We are about to enter an era where kids can do a search on google, icerocket.com, yahoo and other search engines and get all the video they want of TV broadcasts. Put in a topic. Boom. All the video you could ever want. Put in a name. There it is. Video and transcripts to go with it.

How much fun is it going to be to be sitting in a Sports Management or Journalims class starting next year when the Prof discusses “dealing with controversy” or “dealing with players in the spotlight”, or any derivation of the topic.

I can hear it now. “Ok class, I want you to pick a player that you think did or might have created some controversy in the past. Do a search and provide me video of the player and the controversial event. Then provide clips of how the media covered the event and we will discuss it.”

You know EVERY kid is going to pick Randy Moss....

....We do live in interesting times. We are the first generation to memorialize everything that we do on video. We are entering the first generation that will able to search through all of that video and find what ever they want.

Future generations will thank us for the entertainment we are offering them.

I tried to find video of Randy Moss' BA using Yahoo Video Search, but struck out. And a cursory look on Feedster didn't turn up much either, but I bet in a few weeks, it'll find its way into the Index. Come to think of it, this dovetails nicely into a conversation I was having with Barry Diller of IAC this morning (for the book and my column in Business 2.0). I asked him if he thought video over IP was an inevitability, and he answered with an emphatic yes. Diller and Cuban both agree: most video will be searchable, and relatively soon.

A long overdue props to Erik and Otis, the folks behind Lucene In Action, a recently completed book on the open source search app. Congrats to them both!

From Erik's email to me, a cool approach to the ebook:

Here's what the site is: a blog along with a "search inside" the book feature. I indexed per-section the book contents. There are two indexes under the covers, one for the blog and another for the book. Searches are searching across both indexes, so you'll see book snippets (though only partial content) and blog (full-content) highlighted with the terms you searched on. We've got cool plans to expand this (take *that* Amazon "search inside" and Google Print!).

Good luck and congrats again on finishing the book!

Well, the embargo is off, and YDS has launched, or will Tuesday. Here's where to find it. (I think - it only works with the PC)

Initial coverage here (Silicon Beat), and I am sure far more places will cover it as the day rolls on.

Meanwhile, Blinkx' Mac version is now out as well, I have downloaded the client and look forward to trying it out. It's called an "0.5 beta" so if it erases my entire hard drive....

No company is immune to this story. From Cnet:

Employee complaints aren't exactly piling up about Google's generous stock grant policies, which have helped create an estimated 1,000 new millionaires, on paper at least. But the SEC filings have struck something of a nerve inside the company by offering an unusually candid look into the wealth of co-workers. That's creating unaccustomed tensions inside a workplace that has long projected an image of collegial egalitarianism to the outside world, some people said....

...The culture has reflected that kind of college-kid humility, with its hallmark lava lamps, colored balls and on-campus free food. Many Google employees outwardly project the role of starry-eyed believers, carrying the ideal of a grand mission in the mold of early Apple Computer days.

A soaring share price won't necessarily destroy such ideals, but it also won't necessarily help sustain them.

Smart move by Google: Publish a 20 Year Usenet Timeline to promote the new Groups. Fun stuff. Slashdot chews on it here.

UPDATE: As my astute readers have noted, this is not new, though it is to me, and apparently to the initial posters at /.

The Google IPO has given at least one company the courage to stand up to the Big Banks. Morningstar has selected WR Hambrecht over Morgan Stanley to be their lead underwriter. From Bizweek:

Morningstar is a marquee deal for Hambrecht, one that could potentially bring the auction process into the mainstream. Of course, Hambrecht may not want to start celebrating just yet. Wall Street will still have the last word

.

Ken Lay, infamous Enron executive, has begun a paid search campaign to tell his side of the story. The Houston Chronicle says his CPC is about 5-12 cents a click. I sense a Dave Pell opportunity here. Anyone want to get into a bidding war for "Ken Lay" on Overture or Google?

(image from Wall St. Most Wanted)

Huh. This is an interesting post from Google. The timing is interesting, the text is interesting, and, well, the rather honest tone is interesting. Basically, Google is saying - we're having trouble hiring folks. We want more applications.

Now, some will read it this way: We hope those of you that may have passed us over - perhaps when we were a bit arrogant and full of ourselves - will take a look again. Or - we hope those of you that we passed over - perhaps when we weren't so well organized, and all had our hair on fire, and basically were only hiring our friends - well we hope you'll take a look at us again too. At least, that's how it will read to the scores of folks I have spoken to in the past 18 months who had an interview there, but didn't end up at the company.

But there's an elephant in this post which is not discussed. The IPO is over, the first thousand or so have gotten rich. Why come and work at Google when the stock's at 200? That'd be like taking a package at Yahoo in early 2000, right? I wonder if this reality has slowed the torrent of resumes that has flooded Google from the get go. Or, more likely, I wonder if it's slowed the flood of resumes that they want to get.

In the course of my conversations with folks at Google, hiring has been the one constant obsession - both in how its done, and what might be done about it. Everyone talks about how hard it is to hire the right people, and how the company's main constraint is talent. And those I've spoken with have admitted that hiring was not always done fairly - especially in the middle years of the company's life. It's oddly refreshing to see Google reaching out like this. While it still feels pinched, this is quite possibly the most revealing post I've yet to see on Google's often uninspiring blog.

It's been in the works for a long while, but the news is now out - Google is taking moves to restrict how affiliates use AdWords. SEW has commentary here.

With the change, Google will allow only one ad to lead to a particular web page per query, whether that ad be from an affiliate of the web site or the web site owner.

"We've seen and heard from users that there are many cases where we are showing the same creative with the same visible URL linking to the same page," said Salar Kamangar, director of product management at Google, explaining users don't like this. "Just like with search where we have duplicate removal, we want to make sure we aren't showing duplicated ads."

ClickZ coverage here.

Slightly off topic, but not so much as you might think: via PVR Blog, I see that Videora, a BitTorrent RSS reader, has launched. Om noted it here.

So why do we care? Well, I've long theorized that video over IP will come from the bottom up, as opposed to the top down, much as it has with blogs, and with music before that. This feels right along those lines. I very much hope that we see folks starting to make really cool video and ripping it, some rights reserved, to the web, CC style. The business models will come, let's see the good stuff now!

Of course, we'll need a way to find all that stuff, and categorize it, and make sense of it. Search, ho!

MediaPost covers keyword pricing trends courtesy Fathom Online.

Search engine advertisers on average paid 24 percent more for keywords in the fourth quarter than they did at the end of September 2004, according to estimates being released today by Fathom Online. The price hike, one of the steepest since Fathom began publishing its so-called Keyword Price Index (KPI) earlier this year, may have been influenced by increased demand during the fourth quarter holiday marketing season, or it may have simply been organic price inflation as more advertisers enter the marketplace and increase their bids for top placements on search engines.

Blinkx announced today that it is launching a version of its popular desktop search tool for the Mac (it will be ready Monday). I can't wait to try it. Release in extended entry.

Continue reading "Happy Day: Desktop Search for Mac" »

Philip at Google Blogoscoped notices that Google is testing incorporating image thumbnails into its web searches. This represents an evolution of Google's sacred SERP interface - the company has already begun to incorporate News, Froogle, and other "smart" search results at the top of some queries, a la Yahoo.

I have not been able to duplicate this, it could just be an ephemeral test, not to be incorporated. A9 has a nifty approach to images, where you can turn images off or on as part of a multi-framed interface.

Via MetaFilter, this post which shows anyone how to search for live webcams which have not been secured. The results are interesting - a bunch of presumably private network cameras, which anyone with a browser can query for video images. Comments in the original post show all manner of things found live, via the web, from rodents to security guards. I imagine this is a hole that will soon be closed, one way or the other.

If you've been reading this site for a while you may recall my earlier post on MusicPlasma, a cool site that uses Amazon's web services to build a visual search engine for music based on collaborative filtering data. It shows bands as "orbs" or planets, each with their own "solar system" of related bands. (Play with it, it's pretty cool.)

Recently a colleague contacted me and asked if I had anything interesting to say about blogs and how they might shape the media world in the next year or so. My initial thought was "Why of course I do!" - but the fact is, it's not easy to have something interesting to say about blogs that doesn't require a hell of a lot of throat clearing, groundwork laying, and general hand waving. Try to explain to an intelligent layperson the power of blogs - it's not easy. The perfect piece has yet to be written on the true power and impact of blogs; at least, I haven't seen it.

Sure, the examples are there - from the tsunami coverage to Trent Lott. But my colleague was looking for a visual high order bit - a way to see what the big deal was, after all. I thought about Dave Sifry's slides from Web 2.0, but that was still too inside-the-blogway.

The I thought of MusicPlasma. The thing I like about it is how intuitive it is - put in the name of a band you like, and you find more that you might like but had never heard of.

Hey, I thought, what if we did that with blogs, and instead of Amazon data, we used Technorati cosmos data, or Feedster data, or Findory, or Bloglines, or some combination of all of that plus more? "Folks who read this blog also read that one," for example. Or "Blogs who link to this blog also link to that one." If we put a sophisticated interface with some dials and levers, it could really be a neat tool for exploring relationships in the blogosphere. I could imagine some cool slices that might parse this wildly growing ecosystem in interesting ways. (I've always been fascinated by the visualization of data, I was the force behind the Standard's metrics section, if any of you recall that.)

So I think I'm going to try to do it. But the honest truth is, I have no idea how to. I've contact the folks behind the various sites listed above, and they all stand ready to help. I just need a technical lead, and ideally, to talk with the MusicPlasma guys, to see if we might share their skin, so to speak. Anyone know them?

What do you all think? Would this tool be a valuable addition to the conversation?

Search for Yahoo on Google. Get 38 results. Huh?
Danny is checking on it....
He asks the right question: Filter, bug, or feature? The answer will be interesting in terms of how Google is starting to tweak its approach to SERPs.

FWIW, "Google" on Yahoo (55 million or so results).

UPDATE: I have it on very good authority that Google is fiddling with its "results crowding" algorithms, and not targeting Yahoo or filtering in any way.

Threadwatch has a summary of an ongoing tempest between Adam Bosworth, eminence gris of Google and the man who most of the world seems to expect will lead-develop "The Google OS," and some folks at MSFT who clearly are itching for a fight. The topic: Google and Open Source. Late last month Bosworth posted a plea on his site for the Open Source community to finish the job with regard to robust databases, and the MSFT folks saw an opening: Google has taken a lot from the open source community, but what has it given back? Here are the MSFT response - this post is from Dare Obasanjo, this one is from Krzysztof Kowalczyk. Both are very entertaining reads (Dare's is mostly a reposting of Krzysztof's, but there are a few zingers and his has comments turned on.)

Highlight:

In those days of focus on corporate profits (where there any other days?), Google’s motto “Do no Evil” is refreshing. Or is it? It’s a nice soundbite, but when you think about it, it’s really a low requirement. There are very little things that deserve to be called Evil. If a senior citizen is taking a nap outside his house on a sunny day and you kick him in the groin - that’s Evil. Most other things are bad or neutral. Not doing Evil is easy. Doing Good is the hard thing.

To his credit, Adam Bosworth responds, in the comments. Keep in mind, Adam worked at Microsoft for a long time:

For Microsoft to condemm those of us who benefit from Open Source is rich. Honestly, it is like the Nazi's condeming the Swiss from benefiting from the refugees.

Yow....

As I understand it, when it comes to giving back to the Open Source community, the Microsofties may have a point, at least strictly speaking. But then again, Google took open source and, well, built Google, and it's free for all to use. That's not such a bad thing, is it?

It's very interesting (and rather odd) to see MSFT employees take pole position on nobility and open source goodness. Those in the know tell me that Google has made significant and quite valuable modifications to various open source tools. Perhaps it's time they shared some of that wealth back to the community from whence it originated.

UPDATE: Adam has posted a response on his site. Highlights: We all benefit from those who came before us. We benefit most when the knowledge is free and generally accessible., but we benefit either way. It would seem that these cacophonous critics, yammering about giving back and sweepingly ignoring the 100's of billions of times people use and appreciate what Google gives them for free every day from Search to Scholar to Blogger to gMail to Picasa, do not understand this basic fact.

Gurunet, which I and many others have lauded in the past, is shedding its subscription model and is now free, at Answers.com. Cool!

I know how much that phrase - "Tivo-like" - burns at Tivo. Well, in my predictions for 2004, I guessed that by year's end, a new Tivo competitor would emerge, possibly from Apple. I was wrong, it's from the phone company - with an assist from Yahoo. Interesting.

I'm catching up on my reading, and I came across this post from Adam Rifkin. It's a great melange of 2004, with a touch of JAM (joints after midnight) to boot. Sorry Adam, but now there are three hits for "Googlecalifragilisticexpialidocious." Er, four.

This just in from Topix founder Rich Skrenta;

Topix.net has added news channels to track any stories for 2,500 privately-held startups, scanned from the 10,000 sources Topix.net is crawling. The tracking channel was designed in association with Bob Karr's LinkSV.com, which maintains the database of private company profiles which we're using for the automated news scan. There is also a related channel which tracks press releases from any of the same 2,500 startups. In addition we've got a general Venture Capital industry news channel.

topix.net/startups
topix.net/startups/pr
topix.net/vc

This is an interesting development - a good example of innovation in assembly, one of the main themes of Web 2.0.

Analysts are jumping onboard - online advertising is poised for a huge year, they say, and YHOO and GOOG are responding in kind.

From a Reuters story:

Google gained as much as 5.15 percent and Yahoo rose as high as 3.3 percent in Nasdaq trading after Goldman Sachs increased its forecasts, citing strong Internet advertising trends. In a report, Goldman Sachs analyst Anthony Noto said that his firm's recent talks with media buyers demonstrated that "the strength in online advertising demand did not appear to abate" in the quarter.

Brian Dear imagines a search engine where all user-generated tag information is searchable - an engine that confederates the various nations of Flickr, iTunes, etc. Neat idea, and certainly another step toward the semantic web vision.

. . . if more and more services in 2005 add user-generated tagging, will "federated tagging" be far behind? And if someone were to index all the tags from these various sites.... would the result be Taggle? Imagine: a service where you type in a keyword, and you get back all the hits that have that word as a tag. If Flickr, del.icio.us, and umpteen other sites cooperated, then an uber-tag-search service might just work . . .

I'm late on this, but in case you did not see it last week, Pew released a study on blogs. Gary has the highlights. Net net: It's happening, folks.

Highlights:
• 7% of the 120 million U.S. adults who use the internet say they have created a blog or web-based diary. That represents more than 8 million people. • 27% of internet users say they read blogs, a 58% jump from the 17% who told us they were blog readers in February. This means that by the end of 2004 32 million Americans were blog readers.
• 5% of internet users say they use RSS aggregators or XML readers to get the news and other information delivered from blogs and content-rich Web sites as it is posted online. This is a first-time measurement from our surveys and is an indicator that this application is gaining an impressive foothold.

60 Minutes aired a long piece on Google last night, and instead of summarizing, I'll just link to the transcript. For avid watchers of all things Google, the piece did not go very deep, but then again, as Leslie Stahl told me during our interview, they have to make this stuff make sense to people who have never given Google a second thought.

I'm tempted to Monday morning quarterback my participation in the piece, but I'll simply state this: I've never been entirely happy with the quotes someone has chosen when it comes to a piece of journalism that includes me, and I imagine that will also be true of the sources in my book. Journalists do their best to be true to a source's intent, but it's an imperfect craft. Of course I thought I said all sort of interesting things that didn't make it into the piece (we spoke for nearly an hour), but on the other hand, many friends have assured me I didn't make an ass of myself, so I'm happy with that result. I was surprised that I was the only "outside voice," but given that Google cooperated with the program and gave them lots of access, I guess it makes sense that they gave as much airtime as they could to the actual subjects. They did show actual paper copies of the GLAT (Google Labs Aptitude Test) and Slashdot is tearing through the piece here.

Thanks to all of you for bearing with the extended hiatus I took over the past ten or so days, I got a lot of work done on the book, and am closing in - just 2 chapters to go, for the most part. I'm trying to get a full first draft done by the end of this month. My publisher is now weighing whether to push the book out quickly - late spring - or wait until September - which would be a "normal" amount of time given the completion date of the manuscript.