free html hit counter October 2011 | John Battelle's Search Blog

Government By Numbers: Some Interesting Insights

By - October 28, 2011

As part of the work I’m doing for my book, I’ve been working with my research manager, LeeAnn Prescott, staring at various charts and graphs related to how we’ve funded our “Commons” over the past half century or so. I’ve got a working hypothesis that we are in the process of transitioning very important portions of our “public lives” to private corporations, and that this transfer is related to our adoption of digital technologies and platforms. Examples include identity (from driver’s licenses and SSNs to Visa, MasterCard, Amex, and Facebook), delivery of important information and items (from the Post Office to Telcos, Internet, and FedEx and UPS), and protection (outsourcing both prisons and military jobs to private companies). Not to mention retirement (from Social Security to 401ks, etc.).

Of course, were such a hypothesis true, one might imagine that the over percentage of GDP represented by government workers would have gone *down* over the past few decades. However, as this chart shows, that’s not the case:

If we’re depending on government less and less, as I hypothesize, how on earth could government employees go *up* by ten percent in the past six decades?

Either my hypothesis is wrong, or there are devils in the details. And indeed, as you drill down further, some interesting things start to pop up.

For example, check out this chart of what’s growing in our government, and what’s not:

Aha! Turns out, the Federal Government has actually shrunk by more than half, but we, as a society, have simply moved the burden to State and Local Governments. I wonder how the folks at the Tea Party HQ would respond to this data: They spend an awful lot of time talking about Big Government, but they seem overly focused on the Big Bad Feds. They might take aim at their own backyards instead.

Let’s take a look at some detail:

Ahh….Education. Very interesting. As local governments have taken over the once Federally run education system, payroll there has skyrocketed (has performance? Nope. But that’s another story).

Also interesting to note how dramatically our Military spending has dropped, but, given we’re comparing to Cold War, Korean War and WWII eras, that’s not too surprising.

Now let’s compare Government as a percent of GDP to private Industry. If my hypothesis is to hold water, I’d wager that private industry is taking over more and more of our GDP over time. Is it? Yep.

As one might expect, the numbers show the rise of the services industry, and the decline of manufacturing in our economy. But they also show a rise in percent of GDP by government, due in the main to state and local increases.

Here is more detail by industry on what’s growing and shrinking:

Check out that first item: Financial services has nearly doubled and now leads our nation in terms of contribution to GDP. No wonder 2008 was such a (continuing) disaster.

But it’s clear to me we have an education and healthcare problem on our hands (quite a surprise, eh?). Now, education is, in the main, a government enterprise. Healthcare, not so much (Obama’s plan is in essence private, folks). So the question then becomes, will education make the transition from public to private sector in the digital era, and might Healthcare move the other way? I can imagine an argument for both. I post these charts not to draw conclusions, but to open debate.

One last chart of detai on how our Federal Government spends money:

Huh. Social security has risen a lot. So has Treasury and Health. One might reasonably conclude that 1. Our population is aging, creating the demand for more Social Security services. And the two dominant private industries in our country – finance and health – require significant regulation, hence the rise of Treasury and Health.

But I’m not a government economist, so I’m just guessing. I look forward to interviewing many of them as I dig in. Meantime, I just thought it’d be fun to share these data points with you. Enjoy.

 

 

 

  • Content Marquee

Only Connect: Facebook, From The Eyes of an Old Newbie

By - October 27, 2011

I recently joined Facebook. Have you heard of it?

I know, I know, that sounds crazy, given that I’m “an Internet guy.”  If you search for me on Google, say “John Battelle Facebook,” you see that I am already there, and that I have nearly 5000 “friends.” (The interplay between Google search and Facebook is worthy of an entire treatise, I’ll leave that for later). You’ll see I also have a fan page, which has about 5400 “fans” – I think that’s the terminology, though now I think Facebook has turned those fans to “Likes.”

But as many of you know from reading my past posts on the subject, I’ve been essentially “Facebook bankrupt” for years. The service has never been of much value to me, in the main because I made an early and fatal decision to accept any and all folks who asked to be my friend. (For details on that, see this post: I Blew It On Facebook.)

So this week, as both research for my next book and because I’ve been meaning to do it for more than two years, I re-joined Facebook under a slightly different name. I created a new account from scratch, and I promised myself I’d really curate this one so that it’d be meaningful to me personally.

It’s not turning out to be easy.

I’m sure this process will yield more posts, so consider this the first chapter. What I’ve experienced so far, however, only strengthens my belief that Facebook hasn’t even crawled out of the sea when it comes to understanding the nuances of how people communicate with each other. Sure, it’s an extraordinary service and platform, etc. etc. And I know and respect a ton of people who work there. But it’s a testament to how utterly thirsty we are to connect that Facebook, in five short years, has captured the attention of nearly everyone in the online world.

Because, let’s face it. The initial experience with Facebook is pretty bad, from a social point of view.

Here’s why I feel that way.

First is what I’ll call The Guilt of Not Connecting. When you sign up for the first time, Facebook bludgeons you relentlessly to connect to others. It’s beyond irritating – a newcomer to the system (like me) gets constant reminders to find friends before you even get a page going. And once you do, it continues, like an irritating beep in the background – all over your page. “People you may know” stare out at you on the right side of my page, forlorn, as if to ask “How could you NOT want to be my friend?!” Large ads at the top of my page, replete with beckoning profile pics, ask “Are They Your Friends Too?”

And you know what? These are certainly people I know. But being forced to chose if you care enough about them to add them as friends is an intrusion at this early point. I’m just figuring this thing out, Facebook. There’s gotta be more to it than just adding friends, right? Right?!

The second thing I’ve noticed that feels broken is The Forced Rudeness. When I set up my page, I did add a few friends – mostly family members. I added my wife, my kids (the ones who are on the service), and my Dad, who recently joined. Come to think of it, I think I started this whole process because my Dad joined and tried to “friend” my old account, the bankrupt one. I knew if I accepted his request, his voice would be lost in the cacophony that was my old identity.

I also searched for a few folks who came to mind – really close and true pals of mine. All in all, I think I sent out about ten “friend requests” under my new name (which is pretty much the same as my old name, I just added my middle initial). I’m pleased to report that everyone accepted my request pretty much on day one, which I kind of expected (I would have grounded my daughter if she refused, after all). But as soon as the first few folks added me as a friend, the Facebook friend machine went into overdrive, and all of a sudden, I began to get new friend requests. From people I know. But…not that well.

And here’s where Facebook utterly falls down. Because while I do know these people, and I even like them, I may not want to connect with them right now. I have my reasons as to why, and I’d sure like to explain myself to these folks.

But Facebook doesn’t really enable me to do this. In the email notification, I can’t even say no. It’s either “Confirm” or “See All Requests”, which forces me back to Facebook to manage my next steps. Since I don’t want to connect, I pick the second choice. On the site, I am given the choice of either accepting, or pushing a button that says “not now” or somesuch. I have *no idea* what that rejected friend on the other end of this transaction is told once I hit “not now.” And that’s a big problem – is the person notified that I’ve said no? How? If not, I’d like to know that – and ideally, before I see them in real life. These kind of nuanced signals are pretty much table stakes in a “real” relationship. But on Facebook, you get black or white. And that’s just not good enough.

Unlike with a real email request from a real person (not the service), or a phone call, or a face to face conversation,  there’s no simple way to respond to the friend request with a short note like “Hi (name) – Thanks for reaching out to connect with me. I’m restarting a new Facebook account, and for now, I’m limiting it to family and a very small group of really close pals. As I figure out how to navigate the service, I’ll be sure to add you. For now, I want to make sure I don’t overshare!”

Now, my messaging would change depending on the recipient. That one above might be for a business colleague who found me through my close friendship with someone who also happens to be in my industry. But I’d modify my message for the mother of my son’s high school pal. This is a person I see at school functions from time to time but who, to be utterly honest, isn’t someone with whom I’d otherwise spend much time (or share personal experiences with via an online platform). I’d wager she feels the same way about me (but I don’t know! It’d be nice if Facebook allowed her to explain why she’s friending me, but … it doesn’t!) We like each other, we’re cordial when we see each other, but why is Facebook forcing me to be rude to her by telling her “not now” (if, in fact, she’s even told – which I don’t know!).

This is going to make for a pretty awkward soccer party next month, I can tell you that.

Because, really, that’s what it feels like should I decide not to accept her request. It’s rude. So I am going to go out on a limb here, and say that Facebook seems to be counting on this fact to drive connections. And you know what? That’s a house of cards. It insures a lack of truly honest social instrumentation when it comes to building your “social graph,” and down the line, I’m going to predict that will come back to haunt Facebook, if it hasn’t already.

Now, I know many of you are snickering at this post, because most of these issues have been raised and settled, so to speak, over the past few years. Heck, I’ve even made similar points on this site from time to time. But through the fresh eyes of my recent experience, I sense something far deeper is at work. Most folks only take one run at crafting their digital identity on Facebook. I’d reckon most of us don’t want to spend hours going back to rejigger our “graph” once it’s created. That’d be way too much work.

But that graph is based on a extremely rudimentary set of social rules that break down over time, and will fail to reflect our true selves as we extend our identity online. And as Facebook moves to leverage that identity through the Open Graph to nearly every action we take online, I can’t help but think the brittleness of this system will be exposed. It then becomes a race – between Facebook’s ability to reverse engineer more nuanced social interaction back into its platform (and it is, I can see attempts in the interface already), and some new startup (or, OK, maybe Google) that allows us to do the same with far less work.

Of course, Facebook has what amounts to a “moat” around social platforms due to its network effects – as Sean Parker pointed out in our conversation at Web 2 last week. It’s really hard to leave, because you want to bring your “real friends” with you, and asking them to step over to a new service is too much of an imposition. If they leave, they will want to bring their friends, and now you have a real shampoo problem on your hands.

But I predict that we’re racing headlong into a cultural moment when we realize we need more control and nuance in our lives when it comes to what Facebook currently represents for us (if you think this isn’t related to #occupywallstreet, it is, in a really interesting way. That post is coming). Facebook works really well for folks who are just beginning to define who they are in the world, like my kids, or college kids just learning what it means to be out on their own. But those kids ultimately grow up, and become deeply refined social creatures. The question is, can Facebook?

I’m not sure. The DNA and core driving principles of the company have been set. The entire system seems driven by the maxim “only connect.” I wonder how our culture will interpret the first word of that phrase, and whether Facebook, as it’s set up today, has the capacity to redefine it.

There’s so much more to say, but I’m pushing two thousand words. Best to press “publish,” and hear from you.

Slice – A Step Toward Metaservices That Matter

By - October 25, 2011

Readers will recall my multiple calls for “metaservices” that begin to unify our disparate online worlds of data. Today’s announcement of Slice, which does just that for online purchases, albeit through an email hack, is a step in that direction. Readers will also recall that “Purchases” are one of the key fields in my “Database of Intentions” graph. I wish Slice worked because Amazon and others provided us our data easily through an API, but hey, that will come, I think. For now, the email approach is an elegant workaround.

More at TNW. Interesting to note that Eric Schmidt, Exec. Chair of Google, is an investor.

The Web 2 Summit Playlist

By - October 23, 2011

Tons of folks have asked me for the “official” playlist this year. Each year I choose music to sample while folks are coming on or off stage, or as the audience comes in or out of the main room. This year I was hit with a wave of nostalgia – for reasons that I’ll explain later – and I made a list that spanned nearly all eight years I’ve been programming the event.

I have to say, I’m really, really proud of how the event came off, of all the folks who made it happen (including our speakers, staff, advisory board, and my partners at TechWeb and O’Reilly).

The playlist is 109 songs, and I’m way too lazy (or tired) to figure out how to put them into an actual live app. So here’s a picture of them. If any of you have suggestions for how I might create a playlist, I’m all ears. I’ve been looking for a good app for that for some time, and I keep not finding the right one….


A Big Issue: Taking Control of Your Own Identity and Data – Singly Founder Responds

By -

If there was a theme to Day One at Web 2 Summit, it was this: We have to start taking control of our own identity and data. And this is not just because we might be worried about how the government or large platforms might use our data (though both issues certainly came up in talks with Chris Poole, Senator Ron Wyden, Genevieve Bell, and Sean Parker, among others). But also because of the value and benefits that will accrue to us and to society in a culture that values individual control of data. Problem is, it’s not simple or natural to do so….yet.

This reminded me of a post I did a couple of weeks ago, called I Wish “Tapestry” Existed. It elicited a very thoughtful response from Jason Cavnar, co-founder of the important Lockers Project and Singly, the startup which hopes to drive this trend forward. So for a bit of light reading, go back to that link and peruse my musings, then read this, which Jason was kind enough to write up based on the points I made (in bold) and agree to let me post:

JB: Services don’t communicate with each other; and # of services (apps) we use is skyrocketing
Cavnar: they don’t talk to each other, but what all apps do talk to, is you. You should be the protocol around which those things are built and data flows.

Also important: data doesn’t do us justice. This is about LIFE. Our lives. Or as our colleague Lindsay (@lschutte) says — “your story”. Not data. Data is just a manifestation of the actual life we are leading. Our data (story) should be ours to own, remember, re-use, discover with and share.

JB: Cool idea…but Tapestry would be hard to do b/c of policy, not tech
Cavnar: the technology actually isn’t trivial – most startups are spending 3-6+ months just doing data aggregation and cleaning — creating common reference points between data sets; (we have talked to 3 dozen + startups about this including sophisticated folks like the people down at SRI). More important than data reclamation and organization would be: how it gets stored; where it gets stored; who do you trust to hold onto it; ensuring the format “operable” (can developers do things with that data?) no matter where it lives; etc. The Locker Project (a placeholder name) is a community that will make sure the data structure gets figured out — the standards for “me” data. Singly is going to be the storage and access brand that you trust to store and empower you with your digital life.

JB: Tapestry = snapshot of what Dr. J is up to; Dr. J doesn’t use social services b/c value doesn’t exceed time invested
Cavnar: the point about Dr. J using those services more if Tapesty existed is very true and interesting — I wish more people recognized that; Also cool: if Dr. J were assured permanence of the data he is creating, he would likely create more liberally.

JB: I have only 5 social platforms
Cavnar: a ton of the data we create as individuals doesn’t take place on those 5 platforms first. The growth of apps is outpacing the growth of those platforms. Ex: most of my photos on Facebook are now originating from Instagram. My listening on Rdio/Spotify. My location data takes place at the service provider level (ATT, Verizon) first. Health Data…Car data…purchase data, etc.

What I really hear you asking are these questions:

Where do we combine and take with us all of our data?
Where is our data home? (a phrase coined by @mdzimm)
What will be our data address?
Shouldn’t that address be mine?
How is that related to our identity?
Shouldn’t the life I lead wind up with all of it’s memories stored in my home?
Shouldn’t someone provide me with home security?
Who is watching the kids when they are home alone and someone (app) wants to borrow milk (data)?
Does the proverbial USPS decide who I am? Or do they just ensure I can be found and send/receive?

JB: An option = pour all of this into Facebook
Cavnar: the problem is not just that it isn’t under your control, but that a 3rd party with interests other than solely and objectively empowering us then dictates how that data is structured and re-used, if at all. Should we, as a society, around such an important issue (our lives), trust a single company to decide / perform those functions? We haven’t, as a society, decided to all live within the same planned communities, home models and use the same interior decorators.

Tapestry can only be built if Facebook decides to enable them to develop it’s own feel/look/value. And you’d only be able to instrument Tapestry to you to the degree that Facebook decided. IE: not developers and not the end user. No home remodeling allowed. Facebook wants to empower developers and is grappling with how to create a win-win for developers and FB. As an industry, we’re at a point where we need to start thinking about win-win-wins (companies with data, developers and you/me/us). Your Tapestry example is one of thousands.

JB: If Tapestry gains traction, I’m worried Facebook would ban it
Cavnar: A few thoughts:

1) Facebook has actually expressed (including this year at f8) their conviction that people own their data. (Mark Zuckerberg’s blog post). John Doerr at KPCB (a Facebook investor) reiterates this belief (37:20) Facebook allows people to download their data from them because of this belief, and their TOS is a license of your data. And there will be more solutions they can offer people coming into play that will let them live out this belief even more elegantly.

2) Ecosystems win: Given that Dr. J, and a lot of other people don’t use Facebook zealously, would Tapestry suffer without Facebook as an experience? And if Tapestry took off, or Dr. J uses Facebook more because of Tapestry, won’t it behoove Facebook to be a part of that experience rather than absent from it?

3) Empowerment wins: once each of us have a digital home, and Tapestry is built on top of that data, along with a whole world of useful, personalized apps, this worry fades. What Jeremie experienced with Jabber is not dissimilar. Utility and empowering people to do more, connect more, etc will win the day and I don’t see Facebook ignoring the AOL history lesson, especially after they go public. Their leadership is sharp.

4) Inalienable rights win: I refuse to believe we are at a point in history where it is a forgone conclusion that people aren’t fundamentally entitled to the data they create. At the foundation of our country’s heritage is the Lockean notion of “Lives, Liberties and Property which Men have in their Persons as well as Goods”. In a worse case scenario, this issue goes to Washington. The folks there are deeply aware of people’s rights in this space. Look no further than Aneesh Chopra and Danny Weitzner and you find people who truly “get it”. Not just on a policy level but an innovation/economic opportunity/systemic problem-solution level.

5) We’re in this together: the leaders of our industry are decent people. We innovate because we care about people’s stories. And making the world better through technology. We are all part of a narrative far greater than those spelled out in Terms of Service. Not only has Facebook said people own their data, but of course Google is starting to make that easier (Takeout) and Dick Costolo tonight reaffirmed Twitter’s core belief that people should have a copy of their Tweets and it’s simply a matter of time to get the history off disk.

6) Innovation wins: Nobody in the business of innovation and human advancement/potential would argue that innovation takes place at the edge of the network. Closest to people. From mainframes to PCs. From landlines to smartphones. The closer to people that you put information, processes (apps), and power (tech), the more creative and economically productive we get. It’s that simple. We need our data. Closest to us. Apps, running on that data. Building Tapestry shouldn’t be hard. Tapestry existing makes the world a better place. Again, Terms of Service cannot argue with that narrative.

What’s Next:
Let’s suspend belief for a minute that we all got a digital home. What we then need is:

- a standard way to organize our data (this is why Singly is open source – so structure isn’t a point of control)

- a place to store all of our data (a home) that we trust and who is aligned to protect us, not use our data for other means. This doesnt have to be a single company, by any means.

- a medium you trust through which you can transmit the data

- a platform that can “address” your data home and mine all the same no matter where we choose to host it, so that Tapestry can have both of us as users and neither of us have to be locked into a single storage choice. Don’t trust Apple anymore? Cool, go to Singly. Don’t trust Singly? Go host your Data on your home server. Etc.

- a rich developer ecosystem adding value time and time again both to the underlying core software, as well as at the application layer.

Me On Bloomberg: Talking Google, FM, Web 2 Summit

By - October 14, 2011

Yesterday I went over the the Bloomberg West studios to talk with my old pal Cory Johnson. In six short minutes we covered a lot of ground. Video is below.

 

Web 2: But Wait, There's More (And More….) – Best Program Ever. Period.

By - October 13, 2011

I appreciate all you Searchblog readers out there who are getting tired of my relentless Web 2 Summit postings. And I know I said my post about Reid Hoffman was the last of its kind. And it was, sort of. Truth is, there are a number of other interviews happening as well, ones that I am not personally doing. And I wanted to post a last chance for any of you to ask any of these folks questions as well. I’ll be in touch with the winners of the contest (details below) soon, but here are some other interviews of note:web2.png

U.S. Senator Ron Wyden, Oregon Interviewed by best-selling author of Game Change, John Heilemann.

Paul Otellini, CEO, Intel I am doing this one, but it’s quite short as Paul is also doing a short presentation, so I figured a call for questions might not be needed.

Read More Read More

Help Me Interview Reid Hoffman, Founder, LinkedIn (And Win Free Tix to Web 2)

By - October 12, 2011

hoffman.jpegOur final interview at Web 2 is Reid Hoffman, co-founder of LinkedIn and legendary Valley investor. Hoffman is now at Greylock Partners, but his investment roots go way back. A founding board member of PayPal, Hoffman has invested in Facebook, Flickr, Ning, Zynga, and many more.

As he wears (at least) two hats, I’ll be asking Reid to not only discuss LinkedIn’s business and industry (think jobs), but also ask him to ponder the culture of our industry, and the current economic and investment client.

Read More Read More

Help Me Interview the Founders of Quora (And Win Free Tix to Web 2)

By - October 11, 2011

cheever.jpegNext up on the list of interesting folks I’m speaking with at Web 2 are Charlie Cheever and Adam D’Angelo, the founders of Quora. Cheever and D’Angelo enjoy (or suffer from) Facebook alumni pixie dust – they left the social giant to create Quora in 2009. It grew quickly after its public launch in 2010, inspiring some to claim it was the best structured Q&A site ever. They’ve also snagged funding led by Benchmark. As far as I know, this is the duo’s first major on stage interview together.

I’ve used Quora, a bit, and probably will be using it a lot as I start researching my book in earnest. But I’m curious as to how the service scales beyond its current place as a repository of quality – yet incomplete – knowledge. I’m also curious about its business model.

Read More Read More