Recent Comment
Spotlight
- Reader Michael Megalli writes: It is difficult to engage in genuine conversations with the marketplace when you can't change the reality of how a company does business, what it sells, how it works with partners, etc. [go]
Recent Comments
- Steve Rhodes: " Google did underwrite Nova in 2005/6. ..." [go]
- Joel Fugazzotto: " What a nice post! It's a reminder to us ..." [go]
- nmw: " OMG -- not YET another post! :O (the pr ..." [go]
- SorenG: " Works for me. Curious how often the Zapr ..." [go]
- nmw: " Yes, I have to admit -- we still ..." [go]
- John Battelle: " @michael - I think there is a difference ..." [go]
- Michael Cohn: " Don't you think there's a difference bet ..." [go]
- JG: " This is one point, JG, where I think ..." [go]
- pz: " Glad ya'll are out there to inform us of ..." [go]
- David Mullings: " I know that if someone created a fan pag ..." [go]
- nmw: " This is one point, JG, where I think< ..." [go]
- JG: " google lets you play with the machine ..." [go]
- Matt: " I don't believe in it and don't accept i ..." [go]
- JG: " I will second tim's comments. And it wa ..." [go]
- nmw: " Good point, Doug -- and that doesn't< ..." [go]
- nmw: " Mr. Hittel, I think I understand what y ..." [go]
PERFECT FOR THAT PERSON WITH EVERYTHING
Order 'The Search'
Yup, it makes the perfect gift for that officemate or colleague who you thought had everything....including you! If you order here, I promise to sign it, assuming we can figure out the shipping...
You can also buy the audio version here.
Check my book page for more info.
Blogger's Rights
Top Posts
- The Database of Intentions (or how this all got started)
- From Pull to Point(or the first post where I riff on the "Point-To Economy")
- Google As Builder (or the point at which Google stopped being simply a search engine)
- On Google v. Yahoo
- TV and Search Merge
- On Sell Side Advertising
- Battelle Gets Searchstreams
- Search and Immortality
- Toward the Endemic (on endemic advertising)
More coming soon...
Active Topics
- 35 comments: WTF??!!! (04.17)
- 26 comments: Twitter. Oh God. (04.30)
- 16 comments: The Future of Search Series (05.08)
- 16 comments: The Music In Magazines (05.07)
- 13 comments: The Best Minds of the Web... (05.05)
Monthly Archives
- May 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
- October 2007
- September 2007
- August 2007
- July 2007
- June 2007
- May 2007
- April 2007
- March 2007
- February 2007
- January 2007
- December 2006
- November 2006
- October 2006
- September 2006
- August 2006
- July 2006
- June 2006
- May 2006
- April 2006
- March 2006
- February 2006
- January 2006
- December 2005
- November 2005
- October 2005
- September 2005
- August 2005
- July 2005
- June 2005
- May 2005
- April 2005
- March 2005
- February 2005
- January 2005
- December 2004
- November 2004
- October 2004
- September 2004
- August 2004
- July 2004
- June 2004
- May 2004
- April 2004
- March 2004
- February 2004
- January 2004
- December 2003
- November 2003
- October 2003
About John Battelle
Searchblog Newsletter
Enter email to subscribe to Searchblog's newsletter:
Calendar
| Su | Mo | Tu | We | Th | Fr | Sa |
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | ||||
| 4 | 5 | 6 | 7 | 8 | 9 | 10 |
| 11 | 12 | 13 | 14 | 15 | 16 | 17 |
| 18 | 19 | 20 | 21 | 22 | 23 | 24 |
| 25 | 26 | 27 | 28 | 29 | 30 | 31 |
Syndicate
Powered by
June 17, 2004 2:30 PM
A Morning With Danny Hillis
Have had a very productive couple of days recently on the book, talking at length with various folks who in one way or another have very unique views on the search world. Before I get to Tim Koogle, who I spoke to this morning, or Shana Fisher and Geoff Yang (yesterday afternoon), I wanted to talk about my visit with Danny Hillis.
On Tuesday I flew down to LA to visit with Danny, who founded Thinking Machines. After that he became an imagineer at Disney for five or so years ("The best 'real job' you can have," he quipped). Danny has a million great ideas and is something of a polymath. He recently founded Applied Minds as a way to put that skill to work (he partnered with Bran Ferren, himself a scary smart polymath).
Danny has a lot of things to say about search, it's an area he finds rich in implications, in particular as it relates to some of the long-term projects he's involved in, such as the Clock of the Long Now. We spent some time riffing on the future of search, and its current limitations, but ... I get ahead of myself. What I really thought was incredible was the playground Danny and Bran have created for themselves at Applied Minds.
You pull up to Applied Minds unimpressed. It's in an industrial area of Glendale (who knew there even were industrial areas of Glendale?) - windowless one-story warehouses with nameplates like "Airfoil Distribution, Ltd" or "Light Plumbing Fixture Manufacturing, Inc." Once inside the non-descript edifice, you're greeted by a low-ceilinged version of an internet start up - the requisite espresso maker, late-modern furniture, flat-screen displays, etc. But really, nothing worth writing home about. In fact, the place felt a bit cramped and claustrophobic.
That all changed once Danny came out to meet me. After chit chatting for a few minutes, he took me to a small room - no wider than my outstretched arms - at the far end of which stood one of those classic red English phone booths. We stepped inside - a bit cramped - and Danny lifted the receiver and dictated a passphrase of some sort. Presto - the rear wall of the booth opened, and we stepped into - nerdvana.
From a cramped phone booth into massive pure-white-lit space two-stories high, adorned with all manner of things strange and beautiful. Over to one side stood the Terminator-like skeleton of a forty-foot dinosaur, it's 15-foot pneumatic legs gleaming and exposed. Nearly blending into the walls, itself painted movie-set white, was a tricked out Hummer-like RV refitted as a communications/command center - complete with built-in kitchen and bedroom. The space was a great big project lab, with happy geeks combing over various assemblages of wiring, motors, processors and plans like ants on a summer picnic. It's Willy Wonka's chocolate factory for geeks.
Applied Minds works this way: Bram and Danny and any number of partners contract with Very Large Companies or Organizations to think outside the box and come up with solutions to problems they might have. The dinosaur, for example, was a solution to Disney's problem of overlong lines for its rides (solution: make the non-ride portions of the park more interesting by having dinosaurs roaming the streets...). Danny and Bram have, in essence, created a lab where they get paid to think orthogonal to a problem, and invent/design/prototype just about any kind of solution they can dream up. I toured at least four massive warehouses full of projects (and they have more buildings up in SF), many of which I am bound to not report upon, but all followed this basic ethic: let's imagine a new way to approach what otherwise is an intractable/frustrating/unglamorous business problem. Clients include GM, Herman Miller, and many others, including some defense contractors. The company employs a studio model, with only 50 full time staffers, but hundreds involved at any given time on dozens of projects.
So one can imagine when Danny and I did sit down to talk about search, we'd have an interesting conversation. Besides the fact that his designs for Thinking Machines are now de facto standards for platforms like Google, we ranged from his idea of Aristotle, a Primer like AI tutor, to creating an economy of ideas through a new kind of search infrastructure. It's fun to live in the future for a while, after so much reporting in the past and present.
For the details of our talk, well, the book is coming along slowly but surely...
- Posted by John Battelle on June 17, 2004 2:30 PM
TrackBack
Listed below are links to weblogs that reference A Morning With Danny Hillis:
» RE: John Battelle visits Applied Minds, a Willy Wonka-esque nerdvana from Zaphod's BigBlog(tm)
[Read More]
- Tracked on June 18, 2004 6:04 AM
» John Battelle visits Danny from NearWalden
Nice teaser for Applied Minds. [Read More]
- Tracked on June 19, 2004 7:18 PM
» Babble On and On from Gothamist
When Gothamist read about the electronic silencer that can muffle phone calls you get in your office cubicle, we instantly thought of WKRP in Cincinnati's Les Nessman. We've long attempted to create our own special space in our office cubicle, but we h... [Read More]
- Tracked on May 31, 2005 11:45 AM
» bran ferren at web2 from fredshouse.net
The first time I saw Bran Ferren speak, he talked about how he helped take the Declaration of Independence on a tour of the USA for the 1976 bicentennial. Yes, that declaration, the real original document. It was an engineering... [Read More]
- Tracked on October 6, 2005 4:37 PM
» Metaweb, another Danny Hillis nerdvana? from SiliconBeat
Danny HillisMore on MetaWeb, the secretive San Francisco start-up we pointed to yesterday. It has raised $15 million from big-name venture capital firm Benchmark and others. As we mentioned, the company is a spinout of from Applied Minds, and was found... [Read More]
- Tracked on March 15, 2006 12:04 PM



Comments
That's fascinating. Does anyone remember the title sequence of the old TV show, "Get Smart", in which Don Adams enters the secret headquarters of CONTROL through the phone booth at the end of a corridor?
I actually bought and read Hillis's book on the Connection Machine, but I can't really see any resemblance to Google. Can you elaborate?
Hmmm. I wonder how this compares to, say, Interval Research? (http://www.wired.com/wired/archive/7.12/interval.html)
Google runs what I suspect is a data-parallel architecture - thousands of nodes crawling and searching largely independently of one another. Thinking Machines used a data-parallel architecture in its CM-2 design.
Thinking Machines also made one of the first distributed search engines, WAIS. The index was distributed across multiple processors.
Full disclosure: I'm an Applied Minds employee and was affiliated with Thinking Machines in the mid-90s.
--Pat / zippy@cs.brandeis.edu
I was thinking of the original CM, which was very fine-grained parallelism, with a hypercube routing topology between nodes. Much more systolic than the usual today. The model at that time was Navier-Stokes, or finite-element analysis, with a fair amount of cross-traffic between pieces.
Google is more of a shared-nothing, massively parallel processor - hack the data up into big chunks, put them on separate nodes, and ship the query to every node. Ethernet is the bus that holds it all together, and the limiting factor - bandwidth per MIP is fairly low, etc.
IMHO this is about the bottom of the scale for parallelism - more distributed processing.
Yes, the CM-2 did have a hypercube network. One could program the CM-2 using a data-parallel model, which is what the *Lisp (starlisp) programming language used. In this model, the CM-2 was treated as a SIMD (single instruction, multiple data) computer. Data was spread across the processors or, more accurately, the memory associated with each processor, and then a single instruction was run by all the processors on its local data.
Now, not all computation can be done this way. FFTs require lots of comparisons between data, which is best done by processor to processor communication, so there were operators to do local data comparisons and moves, along with system wide computations like "find the maximum value of this variable among all the processors."
Search can be cast as a data parallel process with a scatter operation at the beginning (send the query to all processors) and a gather operation at the end (collect the results from all the processors and sort from best to worst).
--Pat / zippy@cs.brandeis.edu
Actually the results can be sorted from best to worst on each node and the top few merged into the top 10 list by the requester, to save a lot of data shipping.
That's assuming that no holistic inter-result calculations like HITS are being done. Localrank is Google's version of that idea; I think they do the calculation with only highly-ranked pages to save overhead.
(I've been trying to infer this process recently, so bear with my detail-stickling.)
Kendall - What I meant to infer was that the idea of massively parallel processing - ie having tens of thousands of CPUs working at once - is now defacto.
There's another interesting thread along these lines. Brewster Kahle was one of the designer/architects of the CM-2, and at the end of that project started spending most of his time on search capabilities. The output of that work was WAIS (early net-heads may remember it), and led to his work at Alexa (sold to Amazon) and now the Internet Archive.
Leave a comment