Mapping Data Flows: Help Us Ask the Right Questions

I’ve been quiet here on Searchblog these past few months, not because I’ve nothing to say, but because two major projects have consumed my time. The first, a media platform in development, is still operating mostly under the radar. I’ll have plenty to say about that, but at a later date. It’s the second where I could use your help now, a project we’re calling Mapping Data Flows. This is the research effort I’m spearheading with graduate students from Columbia’s School for International Public Affairs (SIPA) and Graduate School of Journalism. This is the project examining what I call our “Shadow Internet Constitution” driven by corporate Terms of Service.

Our project goal is simple: To visualize the Terms of Service and Data/Privacy Policies of the four largest companies in US consumer tech: Amazon, Apple, Facebook, and Google. We want this visualization to be interactive and compelling – when you approach it (it’ll be on the web), we hope it will help you really “see” what data, rights, and obligations both you and these companies have reserved. To do that, we’re busy turning unintelligible lines of text (hundreds of thousands of words, in aggregate) into code that can be queried, compared, and visualized. When I first imagined the project, I thought that wouldn’t be too difficult. I was wrong – but we’re making serious progress, and learning a lot along the way.

Read More
1 Comment on Mapping Data Flows: Help Us Ask the Right Questions

SIGN UP FOR THE NEWSLETTER

Stay up to date on the latest from BattelleMedia.com

With Privacy as Its Shield, Facebook Hopes To Conquer the Entire Internet.

Never mind that man behind the privacy curtain.

I’ll never forget a meal I had with a senior executive at Facebook many years ago, back when I was just starting to question the motives of the burgeoning startup’s ambition. I asked whether the company would ever support publishers across the “rest of the web” – perhaps through an advertising system competitive with Google’s AdSense. The executive’s response was startling and immediate. Everything anyone ever needs to do – including publishing – can and should be done on Facebook. The rest of the Internet was a sideshow. It’s just easier if everything is on one platform, I was told. And Facebook’s goal was to be that platform.

Those words still ring in my ears as we celebrate the 30th anniversary of the web today. And they certainly should inform our perspective as we continue to digest Facebook’s latest self-involved epiphany.

Read More
Leave a comment on With Privacy as Its Shield, Facebook Hopes To Conquer the Entire Internet.

Our Industry Is Failing. Will We Fix It?


If the latest tech revelations have proven anything, it’s that the endless cycle of jaw-dropping headlines and concomitant corporate apologetics has changed exactly nothing.

Over and over, the pattern repeats. A journalist, researcher, or concerned citizen finds some appalling externality associated with one of our largest technology platforms. Representatives from the indicted company wring their hands, take down the offending content and/or de-platform the offending accounts, all the while assuring us “we actively police violations of our terms of service and are always looking to improve our service.”

Read More
1 Comment on Our Industry Is Failing. Will We Fix It?

Our Data Governance Is Broken. Let’s Reinvent It.

This is an edited version of a series of talks I first gave in New York over the past week, outlining my work at Columbia. Many thanks to Reinvent, Pete Leyden, Cap Gemini, Columbia University, Cossette/Vision7, and the New York Times for hosting and helping me.

Prelude. 

Read More
7 Comments on Our Data Governance Is Broken. Let’s Reinvent It.

Predictions 2019: Stay Stoney, My Friends.

If predictions are like baseball, I’m bound to have a bad year in 2019, given how well things went the last time around. And given how my own interests, work life, and physical location have changed of late, I’m not entirely sure what might spring from this particular session at the keyboard.

But as I’ve noted in previous versions of this post (all 15 of them are linked at the bottom), I do these predictions in something of a fugue state – I don’t prepare in advance. I just sit down, stare at a blank page, and start to write.

So Happy New Year, and here we go.

1/ Global warming gets really, really, really real. I don’t know how this isn’t the first thing on everyone’s mind already, with all the historic fires, hurricanes, floods, and other related climate catastrophes of 2018. But nature won’t relent in 2019, and we’ll endure something so devastating, right here in the US, that we won’t be able to ignore it anymore. I’m not happy about making this prediction, but it’ll likely take a super Sandy or a king-sized Katrina to slap some sense into America’s body politic. 2019 will be the year it happens.

2/ Mark Zuckerberg resigns as Chairman of Facebook, and relinquishes his supermajority voting rights. Related, Sheryl Sandberg stays right where she is. I honestly don’t see any other way Facebook pulls out of its nosedive. I’ve written about this at length elsewhere, so I will just summarize: Facebook’s only salvation is through a new system of governance. And I mean that word liberally – new governance of how it manages data across its platform, new governance of how it works with communities, governments, and other key actors across its reach, and most fundamentally, new governance as to how it works as a corporate entity. It all starts with the Board asserting its proper role as the governors of the company. At present, the Board is fundamentally toothless.

3/ Despite a ton of noise and smoke from DC, no significant federal legislation is signed around how data is managed in the United States. I  know I predicted just a few posts ago that 2019 will be the year the tech sector has to finally contend with Washington. And it will be…but in the end, nothing definitive will emerge, because we’ll all be utterly distracted by the Trump show (see below). Because of this, unhappily, we’ll end up governed by both GDPR and California’s homespun privacy law, neither of which actually force the kind of change we really need.

4/ The Trump show gets cancelled. Last year, I said Trump would blow up, but not leave. This year, I’m with Fred, Trump’s in his final season. We all love watching a slow motion car wreck, but 2019 is the year most of us realize the car’s careening into a school bus full of our loved ones. Donald Trump, you’re fired.

5/ Cannabis for the win. With Sessions gone and politicians of all stripes looking for an easy win, Congress will pass legislation legalizing cannabis. Huzzah!!!! Just in time, because…

6/ China implodes, the world wobbles. Look, I’m utterly out of my depth here, but something just feels wrong with the whole China picture. Half the world’s experts are warning us that China’s fusion of capitalism and authoritarianism is already taking over the world, and the other half are clinging to the long-held notion that China’s approach to nation building is simply too fragile to withstand democratic capitalism’s demands for transparency. But I think there may be other reasons China’s reach will extend its grasp: It depends on global growth and optimistic debt markets. And both of those things will fail this year, exposing what is a marvelous but unsustainable experiment in managed markets. This is a long way of backing into a related prediction:

7/ 2019 will be a terrible year for financial markets. This is the ultimate conventional wisdom amongst my colleagues in SF and NY, even though I’ve seen plenty of predictions that Wall St. will have a pretty good year. I have no particular insight as to why I feel this way, it’s mainly a gut call: Things have been too good, for too long. It’s time for a serious correction.

8/ At least one major tech IPO is pulled, the rest disappoint as a class. Uber, Lyft, Slack, Pinterest et al are all expected this year. But it won’t be a good year to go public. Some will have no choice, but others may simply resize their businesses to focus on cash flow, so as to find a better window down the road.

9/ New forms of journalistic media flourish. It’s well past time those of us in the media world take responsibility for the shit we make, and start to try significant new approaches to information delivery vehicles. We have been hostages to the toxic business models of engagement for engagement’s sake. We’ll continue to shake that off in various ways this year – with at least one new format taking off explosively. Will it have lasting power? That won’t be clear by year’s end. But the world is ready to embrace the new, and it’s our jobs to invest, invent, support, and experiment with how we inform ourselves through the media. Related, but not exactly the same…

10/A new “social network” emerges by the end of the year. Likely based on messaging and encryption (a la Signal or Confide), the network will have many of the same features as the original Facebook, but will be based on a paid model. There’ll be some clever new angle – there always is – but in the end, it’s a way to manage your social life digitally. There are simply too many pissed off and guilt-ridden social media billionaires with the means to launch such a network – I mean, Insta’s Kevin Systrom, WhatsApp’s Jan and Brian, not to mention the legions of mere multi-millionaires who have bled out of Facebook’s battered body of late.

So that’s it. On a personal note, I’ll be happily busy this year. Since moving to NY this past September, I’ve got several new projects in the works, some still under wraps, some already in process. NewCo and the Shift Forum will continue, but in reconstituted forms.  I’ll keep up with my writing as best I can; more likely than not most of it will focus the governance of data and how its effect our national dialog. Thanks, as always, for reading and for your emails, comments, and tweets. I read each of them and am inspired by all. May your 2019 bring fulfillment, peace, and gratitude.

Previous predictions:

Predictions 2018

2018: How I Did

Predictions 2017

2017: How I Did

Predictions 2016

2016: How I Did

Predictions 2015

2015: How I Did

Predictions 2014

2014: How I Did

Predictions 2013

2013: How I Did

Predictions 2012

2012: How I Did

Predictions 2011

2011: How I Did

Predictions 2010

2010: How I Did

2009 Predictions

2009 How I Did

2008 Predictions

2008 How I Did

2007 Predictions

2007 How I Did

2006 Predictions

2006 How I Did

2005 Predictions

2005 How I Did

2004 Predictions

2004 How I Did

2 Comments on Predictions 2019: Stay Stoney, My Friends.

Predictions 2018: How I Did. (Pretty Damn Well, Turns Out)

Mssr. Nostradamus.

Every year I write predictions for the year ahead. And at the end of that year, I grade myself on how I did. I love writing this post, and thankfully you all love reading it as well. These “How I Did” posts are usually the most popular of the year, beating even the original predictions in readership and engagement.

What’s that about, anyway? Is it the spectacle of watching a guy admit he got things wrong? Cheering when I get it right? Perhaps it’s just a chance to pull back and review the year that was, all the while marveling at how much happened in twelve short months. And 2018 does not disappoint.

Here we go:

Prediction #1: Crypto/blockchain dies as a major story. Cast yourself back to late 2017 when Bitcoin was pushing $20,000 and the entire tech sector was obsessed with blockchain everything. ICOs were raising hundreds of millions of dollars, the press was hyping (or denigrating) it all, and the fools were truly rushing in. In my prediction post, I struck a more measured tone: “…there’s simply too much real-but-boring work to be done right now in the space. Does anyone remember 1994? Sure, it’s the year the Mozilla team decamped from Illinois to the Valley, but it’s not the year the Web broke out as a mainstream story. That came a few years later. 2018 is a year of hard work on the problems that have kept blockchain from becoming what most of us believe it can truly become. And that kind of work doesn’t keep the public engaged all year long.” I think I got that right. Bitcoin has crashed to earth, and those who remain in the space are deep in the real work – which I still believe to be fundamentally important to the future of not only tech, but society as well. Score: 10/10

Prediction #2: Donald Trump blows up. I don’t usually make political predictions, but by 2017, Trump was the story, bigger than politics, and bigger than tech. I wrote: “2018 is the year [Trump] goes down, and when [he] does, it will happen quickly (in terms of its inevitability) and painfully slowly (in terms of it actually resolving). This of course is a terrible thing to predict for our country, but we got ourselves into this mess, and we’ll have to get ourselves out of it. It will be the defining story of the year.” I think I also got this one right. Trump is done – nearly everyone I trust in politics agrees with that statement. I won’t recount all the reasons, but here are a few: No fewer than 17 ongoing investigations of the President and/or his organizations. A tanking stock market that has lost all faith in the President’s leadership. Nearly 40 actual indictments and several high profile guilty verdicts. A Democratic majority in the House preparing an endless barrage of subpoenas and investigations. And a Republican party finally ready to abandon its leader. Net net: Trump is toast. It’s just going to take a while for that final pat of butter. Score: 10/10

Prediction #3: Facts make a comeback. Here’s what I wrote in support of this assertion: “2018 is the year the Enlightenment makes a robust return to the national conversation. Liberals will finally figure out that it’s utterly stupid to blame the “other side” for our nation’s troubles. Several viral memes will break out throughout the year focused on a core narrative of truth and fact. The 2018 elections will prove that our public is not rotten or corrupt, but merely susceptible to the same fever dreams we’ve always been susceptible to, and the fever always breaks. A rising tide of technology-driven engagement will help drive all of this.” I’d like to claim I nailed this one, but I think the trend lines are supportive. Real journalism had a banner year, with subscriptions to high-integrity publications breaking records year on year. Most smart liberals have realized that the politics of blame is a losing game. And I was happily right about the 2018 elections, which was one of the most definitive rebukes of a sitting President in the history of our nation. As for those “viral memes” I predicted, I’m not sure how I might prove or disprove that assertion – none come to mind, but I may have missed something, given what a blur 2018 turned out to be. Alas, that “rising tide of technology-driven engagement” was a pretty useless statement. Everything these days is tech-driven…so I deserve to be dinged for that pablum. But overall? Not bad at all. Score: 7/10

Prediction #4: Tech stocks overall have a sideways year. It might be hard to give me credit for this one, given how the FANG names have tanked over the past few months, but cast your mind back to when I wrote this prediction, in late December: Tech stocks were doing nothing but going up. And where are they now? After continuing to climb for months, they’re….mostly where they started the year. Sideways. Apple started at around 170, and today is at … 156. Google started at 1048, and is now at…1037. Amazon and Netflix did better, rising double digit percentages, but plenty of other tech stocks are down significantly year on year. The tech-driven Nasdaq index started the year at around 7000, as of today, it’s down to 6600. So, some up, some down, and a whole lot of … sideways. As I wrote: “All the year-in-review stock pieces will note that tech didn’t drive the markets in the way they have over the past few years. This is because the Big Four have some troubles this coming year.” Ummm….yep, and see the next two predictions… Score: 9/10.

Prediction #5: Amazon becomes a target. Oh man, YES. 2018 was the year Amazon’s ridiculous city-vs-city beauty pageant blew up in the company’s face, it was the year lawmakers and academics started calling for the company to be broken up, the year the company was called out for its avaricious business and employment practices, and recently, the first quarter in a decade that its stock has been wholeheartedly mauled by Wall St. Not to mention, 2018 is the year just about everyone who sells stuff on Amazon realized the company was creating its own self-serving and far more profitable brands. Sure, the company raised wages for its workers, but even that move turned out to have major caveats and half truths. 2018 is the year Amazon joined Google and Facebook as a major driver of surveillance capitalism (try asking Alexa what data she passes to her master, it’s hilarious…). And it’s the year the company took a black eye for selling its facial recognition technology (wait, Amazon has facial recognition technology?!) to, of all awful places, ICE. Yep, 2018 is the year Amazon became a target all right. Score: 10/10.

Prediction #6: Google/Alphabet will have a terrible first half (reputation wise), but recover after that. Well, in my original post, I predicted a #MeToo shoe dropping around Google Chairman Eric Schmidt. That didn’t happen exactly, though the whisper-ma-phone was sure running hot for the first few months of the year, and a massive sexual misconduct scandal eventually broke out later in the year. But even if I was wrong on that one point, it’s true the company had a bad first half, and for the most part, a pretty terrible year overall. In March, it had a government AI contract blow up in its face, leading to employee protests and resignations. This trend only continued throughout the year, culminating in thousands of employees walking out in protest of the company’s payouts to alleged sexual harassers. Oh, and that empty chair at Congressional hearings sure didn’t help the company’s reputation.  I also predicted more EU fines: Check! A record-breaking $5 billion fine, to be exact. Further, news the company was creating a censored version of its core search engine in China also tarnished big G. But I whiffed when I mulled how the company might get its mojo back: I predicted it would consider breaking itself up and taking the parts public. That didn’t happen (as far as we know). Instead, Google CEO Sundar Pichai finally relented, showing up to endure yet another act in DC’s endless string of political carnivals. Pichai acquitted himself well enough to support my assertion that Google began to recover by year’s end. But as recoveries go, it’s a fragile one. Score: 8/10.

Prediction #7: The Duopoly falls out of favor. This was my annual prediction around the digital advertising marketplace, focused on Facebook and (again) Google. In it, I wrote: “This doesn’t mean year-on-year declines in revenue, but it does mean a falloff in year-on-year growth, and by the end of 2018, a increasingly vocal contingent of influencers inside the advertising world will speak out against the companies (they’re already speaking to me privately about it). One or two of them will publicly cut their spending and move it to other places.” This absolutely occurred. I’ve already chronicled Google’s travails in 2018, and there’s simply not enough pixels to do the same for Facebook. This New York Times piece lays out how advertisers have responded: No Morals. In the piece, and many others like it, top advertisers, including the CEO of a major agency, went on the record decrying Facebook – giving me cause for a #humblebrag, if I do say so myself.  Oh, and yes, both Facebook and Google posted lower revenue growth rates year on year. Score: 10/10.

Prediction #8: Pinterest breaks out. As I wrote in my original post: “This one might prove my biggest whiff, or my biggest “nailed it.” Well, near the end of 2018, a slew of reports predicted that Pinterest is about to file for a massive IPO. As if by magic, the world woke up to Pinterest. It seems I was right – but as of yet, the IPO has not been confirmed. So…I’ll not score myself a 10 on this one, but if Pinterest does have a successful IPO early next year, I reserve the right to go back and add a couple of points. Score: 8/10.

Prediction #9: Autonomous vehicles do not become mainstream. Driverless cars have been “just around the corner” for what feels like forever. By late 2017, everyone in the business was claiming they’d breakout within a year. But that didn’t happen, regardless of the hype around the first “commercial launch” by Waymo in Phoenix a few weeks ago. I’m sorry, but a “launch” limited to 400 pre-selected and highly vetted beta ain’t mainstream – it’s not even a service in any defensible way. We’re still a long, long way off from this utopian vision. Our cities can’t even figure out what to do with electric scooters, for goodness sake. It’ll be a coon’s age before they figure out driverless cars.  Score: 9/10.

Prediction #10: Business leads. I think I need to avoid these spongy predictions, because it’s super hard to prove whether or not they came true. 2018 showed us plenty of examples of business leadership along the lines of what I predicted. Here’s what I wrote: “A crucial new norm in business poised to have a breakout year is the expectation that companies take their responsibilities to all stakeholders as seriously as they take their duty to shareholders“All stakeholders” means more than customers and employees, it means actually adding value to society beyond just their product or service. 2018 will be the year of “positive externalities” in business.” Well, I could list all the companies that pushed this movement forward. Lots of great companies did great things – Salesforce, a leader in corporate responsibility, even hired a friend of mine to be Chief Ethics Officer. Imagine if every major company empowered such a position? And a powerful Senator – Elizabeth Warren, who likely will run for the presidency in 2019 – laid out her vision for a new approach to corporate responsibility in draft legislation called the Accountable Capitalism Act. But at the end of the day, I’ve got no way to prove that 2018 was “a break out year” for “a crucial new norm in business.” I wish I did, but…I don’t. Score: 5/10. 

Overall, I have to say, this was one of the most successful reviews of my predictions ever – and that’s saying something, given I’ve been doing this for more than 15 years. Nine of ten were pretty much correct, with just one being a push. That sets a high bar for my predictions for 2019…coming, I hope, in the next week or so. Until then, thanks as always for being a fellow traveler. And happy new year – may 2019 bring you and yours happiness, health, and gratitude.

Related:

Predictions 2018

Predictions 2017

2017: How I Did

Predictions 2016

2016: How I Did

Predictions 2015

2015: How I Did

Predictions 2014

2014: How I Did

Predictions 2013

2013: How I Did

Predictions 2012

2012: How I Did

Predictions 2011

2011: How I Did

Predictions 2010

2010: How I Did

2009 Predictions

2009 How I Did

2008 Predictions

2008 How I Did

2007 Predictions

2007 How I Did

2006 Predictions

2006 How I Did

2005 Predictions

2005 How I Did

2004 Predictions

2004 How I Did

 

3 Comments on Predictions 2018: How I Did. (Pretty Damn Well, Turns Out)

It’s Not Facebook’s Fault: Our Shadow Internet Constitution

Those of us fortunate enough to have lived through the birth of the web have a habit of stewing in our own nostalgia. We’ll recall some cool site from ten or more years back, then think to ourselves (or sometimes out loud on Twitter): “Well damn, things were way better back then.”

Then we shut up. After all, we’re likely out of touch, given most of us have never hung out on Twitch. But I’m seeing more and more of this kind of oldster wistfulness, what with Facebook’s current unraveling and the overall implosion of the tech-as-savior narrative in our society.

Hence the chuckle many of us had when we saw this trending piece suggesting that perhaps it was time for us to finally unhook from Facebook and – wait for it – get our own personal webpage, one we updated for any and all to peruse. You know, like a blog, only for now. I don’t know the author – the editor of the tech-site Motherboard – but it’s kind of fun to watch someone join the Old Timers Web Club in real time. Hey Facebook, get off my lawn!!!

That Golden Age

So as to not bury the lead, let me state something upfront: Of course the architecture of our current Internet is borked. It’s dumb. It’s a goddamn desert. It’s soil where seed don’t sprout. Innovation? On the web, that dog stopped hunting years ago.

And who or what’s to blame? No, no. It’s not Facebook. Facebook is merely a symptom. A convenient and easy stand in  – an artifact of a larger failure of our cultural commons. Somewhere in the past decade we got something wrong, we lost our narrative – we allowed Facebook and its kin to run away with our culture.

Instead of focusing on Facebook, which is structurally borked and hurtling toward Yahoo-like irrelevance, it’s time to focus on that mistake we made, and how we might address it.

Just 10-15 years ago, things weren’t heading toward the our currently crippled version of the Internet. Back in the heady days of 2004 to 2010 – not very long ago – a riot of innovation had overtaken the technology and Internet world. We called this era “Web 2.0” – the Internet was becoming an open, distributed platform, in every meaning of the word. It was generative, it was Gates Line-compliant, and its increasingly muscular technical infrastructure promised wonder and magic and endless buckets of new. Bandwidth, responsive design, data storage, processing on demand, generously instrumented APIs; it was all coming together. Thousands of new projects and companies and ideas and hacks and services bloomed.

Sure, back then the giants were still giants – but they seemed genuinely friendly and aligned with an open, distributed philosophy. Google united the Internet, codifying (and sharing) a data structure that everyone could build upon. Amazon Web Services launched in 2006, and with the problem of storage and processing solved, tens of thousands of new services were launched in a matter of just a few years. Hell, even Facebook launched an open platform, though it quickly realized it had no business doing so. AJAX broke out, allowing for multi-state data-driven user interfaces, and just like that, the web broke out of flatland. Anyone with passable scripting skills could make interesting shit! The promise of Internet 1.0 – that open, connected, intelligence-at-the-node vision we all bought into back before any of it was really possible – by 2008 or so, that promise was damn near realized. Remember LivePlasma? Yeah, that was an amazing mashup. Too bad it’s been dormant for over a decade.

After 2010 or so, things went sideways. And then they got worse. I think in the end, our failure wasn’t that we let Facebook, Google, Apple and Amazon get too big, or too powerful. No, I think instead we failed to consider the impact of the technologies and the companies we were building. We failed to play our hand forward, we failed to realize that these nascent technologies were fragile and ungoverned and liable to be exploited by people less idealistic than we were.

Our Shadow Constitution

Our lack of consideration deliberately aided and abetted the creation of a unratified shadow Constitution for the Internet – a governance architecture built on assumptions we have accepted, but are actively ignoring. All those Terms of Service that we clicked past, the EULAs we mocked but failed to challenge, those policies have built walls around our data and how it may be used. Massive platform companies have used those walls to create impenetrable business models. Their IPO filings explain in full how the monopolization and exploitation of data were central to their success – but we bought the stock  anyway.

We failed to imagine that these new companies – these Facebooks, Ubers, Amazons and Googles – might one day become exactly what they were destined to become, should we leave them ungoverned and in the thrall of unbridled capitalism.  We never imagined that should they win, the vision we had of a democratic Internet would end up losing.

It’s not that, at the very start at least, that tech companies were run by evil people in any larger sense. These were smart kids, almost always male, testing the limits of adolescence in their first years after high school or college. Timing mattered most: In the mid to late oughts, with the winds of Web 2 at their back, these companies had the right ideas at the right time, with an eager nexus of opportunistic capital urging them forward.

They built extraordinary companies. But again, they built a new architecture of governance over our economy and our culture – a brutalist ecosystem that repels innovation. Not on purpose – not at first. But protected by the walls of the Internet’s newly established shadow constitution and in the thrall of a new kind of technology-fused capitalism, they certainly got good at exploiting their data-driven leverage.

So here we are, at the end of 2018, with all our darlings, the leaders not only of the tech sector, but of our entire economy, bloodied by doubt, staggering from the weight of unconsidered externalities. What comes next?

2019: The Year of Internet Policy

Whether we like it or not, Policy with a capital P is coming to the Internet world next year. Our newly emboldened Congress is scrambling to introduce multiple pieces of legislation, from an Internet Bill of Rights  to a federal privacy law modeled on – shudder – the EU’s GDPR. In the past month, I’ve read draft policy papers suggesting we tax the Internet’s advertising model, that we break up Google, Facebook, and Amazon, or that we back off and just let the market “do its work.”

And that’s a good thing, to my mind – it seems we’re finally coming to terms with the power of the companies we’ve created, and we’re ready to have a national dialog about a path forward. To that end, a spot of personal news: I’ve joined the School of International and Public Affairs at Columbia University, and I’m working on a research project studying how data flows in US markets, with an emphasis on the major tech platforms. I’m also teaching a course on Internet business models and policy. In short, I’m leaning into this conversation, and you’ll likely be seeing a lot more writing on these topics here over the course of the next year or so.

Oh, and yeah, I’m also working on a new project, which remains in stealth for the time being. Yep, has to do with media and tech, but with a new focus: Our political dialog. More on that later in the year.

I know I’ve been a bit quiet this past month, but starting up new things requires a lot of work, and my writing has suffered as a result. But I’ve got quite a few pieces in the queue, starting with my annual roundup of how I did in my predictions for the year, and then of course my predictions for 2019. But I’ll spoil at least one of them now and just summarize the point of this post from the start: It’s time we figure out how to build a better Internet, and 2019 will be the year policymakers get deeply  involved in this overdue and essential conversation.

2 Comments on It’s Not Facebook’s Fault: Our Shadow Internet Constitution

Zuckerberg In A Bunker

Mark Zuckerberg is in a crisis of leadership. Will he grasp its opportunity?

Happier times.

It seems like an eternity, but about one year ago this Fall, Uber had kicked its iconic founding CEO to the curb, and he responded by attempting a board room coup. Meanwhile, Facebook was at least a year into crisis mode, clumsily dealing with a spreading contagion that culminated in a Yom Kippur apology from CEO Mark Zuckerberg. “For those I hurt this year, I ask forgiveness and I will try to be better,” he posted. “For the ways my work was used to divide people rather than bring us together, I ask for forgiveness and I will work to do better.”

More than one year after that work reputedly began, what lesson from Facebook’s still rolling catastrophe? I think it’s pretty clear: Mark Zuckerberg needs to do a lot more than publish blog posts someone else has written for him.

And while I’m not much of a fan of the company he’s built, I think Facebook’s CEO can change. But only if he’s willing to truly lead, and take the kind of action that today may seem insane, but ten years from now, just might look like genius. What actions might those be? Well, let’s review.

Admit you have a problem. Yes, over and over and over, Facebook executives have copped a plea. But they’ve never acknowledged the real problem is the company’s core DNA. More often than not, the company plays the pre-teen game of admitting a small sin so as to cover a larger one. The latest case in point is this post-modern gem: Elliot Schrage On Definers. The headline alone says all you need to know about Facebook’s latest disaster: Blame the guy who hired the firm, have him fall on a sword, add a bit of Sandbergian mea culpa, and move along. Nope, this time is different, Facebook. It’s time for fundamental change. And that means….

Submit to real governance. Like Google, Uber, Snap, and other controversial tech companies, Facebook implemented a two-class system of shares which canonizes their founder as an untouchable god, rendering the company board toothless in moments of true crisis (and in appeasement mode the rest of the time). Following Uber’s lead, it’s time for Mark to submit to the governance of the capital markets and abandon his super majority voting powers. He must stand before his board naked and afraid for his job. This and this alone will predicate the kind of change Facebook needs.

Bring in outsiders. Facebook’s core problem is expressed through its insular nature. This is also the technology industry’s problem – an engineer’s determination that every obstacle can be hacked to submission, and that non-engineers are mainly good for paint and powder afterward. This is simply not the case anymore, either at Facebook or in tech more broadly. Zuckerberg must demand his board commission a highly qualified panel to review his company’s management and product decisions, and he must commit to implementing that panel’s recommendations. Along those lines, here are a two major thought starters:

Embrace radical change. Remember “Bringing People Closer Together” and the wildly misappropriatedTime Well Spent“? This was supposedly a major new product initiative to change Facebook’s core mission, designed to shift our attention from what was wrong with the platform – data breaches, the newsfeed, false news and election meddling – to what could be right about it: Community pages and human connection. Has it worked? Let’s just be honest: No. Community doesn’t happen because a technology company writes a blog post or emphasizes a product suite it built for an entirely different purpose. Facebook can’t be fixed unless it changes its core business model. So just do it, already. Which leads to:

Free the data. Facebook has so far failed to enable a truly open society, despite its embrace of lofty mission statements. I’ve written about this at length, so I’ll just summarize: Embrace machine-readable data portability, and build a true, Gates-line compliant platform that is governed by the people, companies, and participants who benefit from it. Yes, actually governing  is a messy pain in the ass, but failing to govern? That’s a company killer.

Many brilliant observers are calling for Mark’s head, and/or for the company to be broken up. I’m not sure either of these solutions will do much more than insure that the company fails. What tech needs now is proof that it can lead with bold, high-minded vision that gives back more than it takes. Mark Zuckerberg has the power to do just that. The only question now is whether he will use it.

1 Comment on Zuckerberg In A Bunker

After the Token Act: A New Data Economy Driven By Small Business Entrepreneurship

Gramercy Tavern in New York City

If Walmart can leverage data tokens to lure Amazon’s best customers away, what else is possible in a world of enabled by my fictional Token Act?

Well, Walmart vs. Amazon is all about big business – a platform giant (Amazon) disrupting an OldBigCo (Walmart and its kin). Over the past two decades, Amazon bumped Walmart out of the race to a trillion-dollar market cap, and the OldCo from Bentonville had to reset and play the role of the upstart. The Token Act levels the playing field, forcing both to win where it really matters: In service to the customer.

But while BigCos are sexy and well known, it’s the small and medium-sized business ecosystem that determines whether or not we have an economy of mass flourishing.  So let’s explore the Token Act from the point of view of a small business startup, in this case, a new neighborhood restaurant. I briefly touched upon this idea in my set up post, Don’t Break Up The Tech Oligarchs. Force Them To Share Instead.  (If you haven’t already, you might want to read that post before this one, as I lay out the framework in which this scenario would play out.) What I envision below assumes the Token Act has passed, and we’re at least a year or two into its adoption by most major data players. Here we go…

***

Fresh off her $2,700 win from Walmart, Michelle decides she’s ready to lean into a lifelong dream: Starting a restaurant in her newly adopted neighborhood of Chelsea in New York City. Since moving to the area from California, she’s noticed two puzzling trends: First, a dearth of interesting mid- to high-end dinner spots walking distance from her new place, and second, what appears to be higher-than-average vacancy rates for the retail storefronts in the same general area. It appears to be a buyer’s market for retail restaurant space in Chelsea. So why aren’t new places launching? She read the Times’ piece on vacancies a few years ago (before the Token Act passed) and was left just as puzzled as before – seems like there’s no rhyme or reason to the market.

Michelle wants to start a high end American gastro pub – the kind of place she loved back when she lived in Northern California (she’s fond of Danny Meyers’ Gramercy Tavern, pictured above, but it’s a bit too far away from her new place). She has a strong hunch that such a place would be a hit in her new neighborhood, but she’s not sure her new neighbors will agree.

Now starting a restaurant requires a certain breed of insanity – they say the best way to make a small fortune in the business is to start with a large one. The truth is, launching restaurants has historically been a crap shoot – you might find the best talent, the best designer, and the best location – but if for some reason you don’t bring the je ne sai quois, the place will fail within months, leaving you and your partners millions of dollar poorer.

It’s that  je ne sai quois that Michelle is determined to reveal.  The tools she will leverage? The newly liberated resources of data tokens.

Before we continue, allow me to draw your attention back to the rise of search, indeed, the very era which begat Searchblog in the early 2000s. Google Adwords launched in 2000, and within a few years, the media world had been turned upside down by what I termed The Database of Intentions.  As if by magic, people everywhere could suddenly ask new kinds of questions, finding themselves both surprised and delighted by the answers they received.

Gates-Line compliant ecosystem quickly developed on top of this new platform, driven by an emerging industry of search engine marketing and optimization. SEO/SEM sprung into existence to help small and medium sized businesses take advantage of the Google platform – by 2006 the industry stood at nearly $10 billion in spend, growing more than 60 percent year on year. Adwords grew from zero to millions of advertisers by connecting to a long tail of small businesses that took advantage of an entirely new class of revealed information: The intents, desires, and needs of tens of millions of consumers, who relentlessly poured their queries into Google’s placid and unblinking search box.

Were you a limo service in the Bronx looking for new customers? It paid huge dividends to purchase Adwords like “car service bronx” and “best limo manhattan.” Were you a dry cleaner in West LA hoping to expand? Best be first in line when customers typed in “best cleaners Beverly Hills.” Selling heavy machinery to construction services in the midwest? If you don’t own keywords like “caterpillar dealer des moines” you’d lose, and quick, to whoever did optimize to phrases like that.

My point is simply this: Adwords was a freaking revolution, but it ain’t nothing compared to what will happen if we unleash data tokens on the world.

***

Ok, back to Michelle and her new restaurant. Of course Michelle will leverage Adwords, and Facebook, and any other advertising service to help her new business grow. But none of those services can help her figure out her je ne sai quois – for that, she needs something entirely novel. She needs a new question machine. And the ecosystem that develops around data tokens will offer it.

Thanks to her Walmart experience, Michelle has become aware of the power of personal data. She’s also read up on the Token Act, the new law requiring all data players at scale to allow individuals to create machine-readable data tokens that can be exchanged for value as directed by the consumer. After doing a bit of research, she stumbles across a startup called OfferExchange, which manages “Token Offers” on behalf of anyone who might want to query TokenLand. OfferExchange is a spinout from ProtocolLabs, a pioneer in secure blockchain software platforms like Filecoin. It’s still early in TokenLand, so an at-scale Google of the space hasn’t emerged. OfferExchange works more like a bespoke yet platform-based research outfit – the firm has a sophisticated website and impressive client list. It uses Facebook, Twitter, LiveRamp, and Instagram to identify potential token-creating consumers, then solicits those individuals with offers of cash or other value in exchange for said tokens.

Michelle does a Crunchbase search for OfferExchange and sees it’s backed by Union Square Ventures and Benchmark, which gives her some comfort – those firms don’t fund fly-by-night hucksters. And OfferExchange site is impressive – in less than five minutes, it guides her through the construction of an elegant query. Here’s how the process works:

First, the site asks Michelle what her goal is. “Starting a restaurant in New York City,” she responds. The site reconstructs around her answer, showing suggested data repositories she might mine. “Restaurants, New York City,” reads the top layer of a directory-like page. Underneath are several categories, each populated with familiar company names:

  • Restaurant Reservation and Review Services
    • OpenTable Google Resy Yelp Eat24 Facebook (more)
  • Food Delivery Services
    • GrubHub Uber Eats PostMates InstaCart (more)
  • Transportation Services
    • Uber Lyft Juno Via (more)
  • Real Estate Services (Commercial)
    •  LoopNet DocuSign CompStak (more)
  • Location Services 
    • Foursquare Uber Lyft Google NinthDecimal (more)
  • Financial Services
    • American Express Visa Mastercard Apple Pay Diners Club (more)

And so on – if she wished, Michelle could dig into dozens of categories related to her initial “restaurant New York City” search.

Michelle’s imagination sparks – the kinds of queries she could ask of these services is mind blowing. She could  limit her query to people who live within walking distance of her neighborhood, asking her *actual neighbors* for tokens that tell her what restaurants they eat at, when they eat there, the size of their checks, related reviews, abandoned reservations, the works. She might discover that folks like Indian takeout on Mondays, that they rarely spend more than $100 on a meal on Tuesdays, but that they splurge on the weekends. She could discover the percentage of diners in Chelsea who travel more than two miles by car service to eat out at a place similar to the one she has in mind, and what the size of the check might be when they do. She can also check historical average rents for restaurants in her zip code, over time, which will certainly help with negotiating her lease. The possibilities are endless.

Put another way, with OfferExchange’s services, Michelle can litigate the merde out of her je ne sai quois.

*** 

This post is getting long, so I’ll stop here and pull back for a spot of Thinking Out Loud. I could continue the story, imagining the process of the token offer Michelle would put out through OfferExchange’s platform, but suffice to say, she’d be willing to pay upwards of $5-20 per potential customer for their data. The marketing benefit alone – alerting potential customers in the neighborhood that she’s exploring a new restaurant in the area – is worth tens of thousands already. And of course, OfferExchange can connect anyone who offers their tokens to Michelle’s new project a discount on their first meal at the restaurant, should it actually launch. Cool!

But let’s stop there and consider what happens when local entrepreneurs have access to the information currently silo’d across thousands of walled garden services like Uber, LoopNet, Resy, and of course Facebook and Google. While better data won’t insure that Michelle’s restaurant will succeed, it certainly increases the odds that it won’t fail. And it will give both Michelle and her investors – local banks, savvy friends and family members – much more conviction that her new enterprise is viable. Take this local restaurant example and apply it to all manner of small business – dry cleaners, hardware stores, bike shops – and this newly liberated class of information enables an explosion of efficiency, investment, and, well, flourishing in what has become, over the past four decades, a stagnant SMB environment.

Is this Money Ball for SMB? Perhaps. And yes, I can imagine any number of downsides to this new data economy. But I also believe the benefits would far outweigh the downsides. Under the Token Act as I envision it, co-creators of the data – the services like Uber, OpenTable, or Facebook – have the right to charge a vig for the data being monetized. Sure, it’d be possible for an entrepreneur to steal customers via tokens, but I’m going to guess the economic value of allowing your customers to discover new use cases for their data will dwarf the downside of possibly losing those customers to a new competitor. Plus, this new competitive force will drive everyone to play at a higher level, focusing not on moats built on data silos, but instead on what really matters: A highly satisfied customer. That’s certainly Michelle’s goal, and the goal of every successful local business. Why shouldn’t it also be the goal of the data giants?

1 Comment on After the Token Act: A New Data Economy Driven By Small Business Entrepreneurship

This Is How Walmart Beats Amazon

A scenario from the future

(cross posted from NewCo Shift)

In my last post I imagined a world in which large data-driven platforms like Amazon, Google, Spotify, and Uber are compelled to share machine-readable copies of data to their users. There are literally scores, if not hundreds of wrinkles to iron out around how such a system would work, and in a future post I hope to dig into some of those questions. But for now, come with me on a journey into the future, where the wrinkles have been ironed out, and a new marketplace of personally-driven information is flourishing. We’ll return to one of the primary examples I sketched out in the aforementioned post: A battle for the allegiance – and pocketbook – of one online shopper, in this case, my wife Michelle.

***

It’s a crisp winter mid morning in Manhattan when the doorbell rings. Michelle looks up from her laptop, wondering who it might be. She’s not expecting any deliveries from Amazon, usually the source of such interruptions. She glances at her phone, and the Ring app (an Amazon service, naturally) shows a well dressed, smiling young woman at the door. She’s holding what looks like an elegantly wrapped gift in her hands. Now that’s unusual! Michelle checks the date – no anniversaries, no birthdays, no special occasions – so what gives?

Michelle opens the door and is greeted by a woman who introduces herself as Sheila. She tells Michelle she’s been sent over by Walmart. Walmart? Michelle’s never set foot in a Walmart store, and has a less than charitable view of the company overall. Why on earth would Walmart be sending her a special delivery gift box?

Sheila is used to exactly this kind of response – she’s been trained to expect it, and to manage the conversation that ensues. Sheila is a college-educated Walmart management associate, and delivering these gift boxes is a mandatory part of her company training. In fact, Sheila’s future career trajectory is based, in part, on her success at converting Michelle into becoming a Walmart customer, and she’s learned from her colleagues back at corporate that the best way to succeed is to be direct and open while engaging with a top-level prospect.

“Michelle, I know this seems a bit strange, but Walmart has identified you as a premier ecommerce customer – I’m guessing you probably have at least three or four packages a week delivered here?”

“More like three or four a day,” Michelle answers, warming to Sheila’s implied status as a premium customer.

“Yes, it’s amazing how it’s become a daily habit,” Sheila answers. “And as you probably know, Walmart has an online service, but truth be told, we never seem to get the business of folks like you. I’m here to see if we might change that.”

Michelle becomes suspicious. It doesn’t make sense to her – sending over a manager bearing gifts? Such tactics don’t scale – and feel like an intrusion to boot.

Sensing this, Sheila continues. “Look, I’m not here to sell you anything. I’ve got this special gift for you from Doug McMillon, the CEO of Walmart. You’ve been selected to be part of a new program we’re testing – we call it Walton’s Circle. It’s named after Sam Walton, our founder, who was pretty fond of the personal touch. In any case, the gift is yours to keep. There’s some pretty cool stuff in there, I have to say, including La Mer skin cream and some Neuhaus chocolate that’s to die for.”

Michelle smiles. Strange how the world’s biggest retailer, a place she’s never shopped, seems to know her brand preferences for skin care and chocolate. Despite herself, she relaxes a bit.

“Also inside,” Sheila continues, “is an invitation. It’s entirely up to you if you want to accept it, but let me explain?”

“Sure,” Michelle answers.

“Great. Have you heard of the Token Act?”

Michelle frowns. She read about this new piece of legislation, something to do with personal data and the right to exchange it for value across the internet. In the run up to its passage, her husband wouldn’t shut up about how revolutionary it was going to be, but so far nothing important in her life had changed.

“Yes, I’ve heard of it,” Michelle answers, “but it all seems pretty abstract.”

“Yeah, I hear that all the time,” Sheila responds. “But that’s where our invitation comes in. Inside the box is an envelope with a code and a website. I imagine you use Amazon…” Sheila glances toward an empty brown box in the hallway with Amazon’s universal smiling logo. Michelle laughs. “Of course you do! I was a huge Amazon customer for years. And that’s what our invitation is about – it’s an invitation to see what might happen if you became a Walmart customer instead. If you go to our site and enter your code, a program will automatically download your Amazon purchase history and run it through Walmart’s historical inventory. Within seconds, you’ll be given a report detailing what you would have saved had you purchased exactly the same products, at the same time, from us instead of Jeff Bezos.”

“Huh,” Michelle responds. “Sounds cool but…that’s my information on Amazon, no? I don’t want you to have that, do I?”

“Of course not,” Sheila says knowingly. “All of your information is protected by LiveRamp Identity, and is never stored or even processed on our servers. You maintain complete control over the process, and can revoke it at any time.”

Michelle had heard of LiveRamp Identity, it was a third-party guarantor of information safety she’d used for a recent mortgage application.  She also came across it when co-signing for a car loan for her college-aged daughter.

“When you put that code into our site, a token is generated that gives us permission to compare our data to yours, and a report is generated,” Sheila explained. “The report is yours to keep and do with what you want. In fact, the report becomes a token in and of itself, and you can submit that token to third party services like TokenTrust, which will audit our work and tell you if our results can be trusted.”

TokenTrust was another service Michelle had heard of, her husband had raved about it as one of the fastest growing new entrants in the tech industry. The company had recently been featured on 60 Minutes – it played a significant role in a story about Google’s search results, if she recalled correctly. Docusign had purchased the company for several billion just last year. In any case, Michelle’s suspicions were defused – may as well check this out. I mean, why would Walmart risk its reputation stealing her Amazon data? It was worth at least seeing that report.

Sheila sensed the opening. “The reports are pretty amazing,” she says. “I’ve had clients who’ve discovered they could have saved thousands of dollars a year. And here’s the best part: If, after reviewing and validating the report, you switch to Walmart, we’ll credit your account with those savings – in essence, we’ll retroactively deliver you the savings you would have had all along.”

“Wow. That almost sounds too good to be true!” Michelle says. “But… OK, thanks. I’ll check it out. Thanks for coming by.”

“Absolutely,” Sheila responds. “And here’s my card – that’s my cell, and my email. Let me know if you have any questions.”

***

Michelle heads back inside and places the gift box on the table next to her laptop. Before opening the box, she wants to be sure this thing is for real. She Googles “Walmart Walton Circle Savings Token”  – and the first link is to a Business Insider article: “These Lucky Few Amazon Customers Are Paid Thousands to Switch – By Walmart.” So Sheila wasn’t lying – this program is for real!

Michelle tugs on the satin ribbon surrounding her gift box and raises its sturdy lid. Nestled on straw inside are two jars of La Mer, several samples of Neuhaus chocolates, two of her favorite bath salts, and various high end household items. The inside lid of the box proclaims “Welcome to Walton’s Circle!” in elegant script. At the center of the box is an creamy envelope engraved with her name. Michelle opens it, and just as Sheila mentioned, a URL and code is included, along with simple instructions.

What the hell, may as well see what comes of it. Turning to her laptop, Michelle heads to Walmart.com – for the first time in her life – and enters her code. Almost instantaneously a dialog pops up, informing her that her report is ready. Would she like to review it?

Why not?! Michelle clicks “Yes” and up comes a side-by-side comparison of her entire Amazon purchase history. She notices that during the early years – roughly until 2006 –  there’s not much on the Walmart side of the report. But after that the match rates start to climb, and for the past five or so years, the report shows that 98 percent of the stuff she’s bought at Amazon was also available on Walmart.com. Each purchase has a link, and she tries out one – a chaise lounge she purchased in 2014 (gotta love Prime shipping!). Turns out Walmart didn’t have that exact match, but the report shows several similar alternatives, any of which would have worked. Cool.

Michelle’s eye is drawn to the bottom of the report, to a large sum in red that shows the difference in price between her Amazon purchases and their Walmart doppelgangers.

$2,700.

Holy….cow. Michelle can’t believe it. Is this for real? Anticipating the question, Walmart’s report software pops up a dialog. “Would you like to validate your token’s report using TokenTrust? We’ll pay all fees.” Michelle clicks yes, and a TokenTrust site appears. The site shows a “working” icon for several seconds, then returns a simple message: “TokenTrust has reviewed Walmarts claims and your Amazon token, and validates the accuracy of this report.”

Michelle is sold. Next to the $2700 figure at the bottom of her report is one line of text, and a “Go” link. “Would you like to become a founding member of the Walton Circle? We’ll take care of all your transition needs, and Sheila, who’ve you already met, will be named as your personal shopping concierge.”

Michelle hovers momentarily over “Go.” What the hell, she thinks. I can always switch back. And with one click, Michelle does something she never thought she would: She becomes a Walmart customer.

Satisfied, she turns her eyes back to her work. Several new emails have collected in her inbox. One is from Doug McMillon, welcoming her to Walton’s Circle. As she hovers over it, mail refreshes, and a new message piles on top of McMillon’s.

Holy shit. Did Jeff Bezos really just email me?! 

***

Is such a scenario even possible? Well, that question remains unexplored, at least for now. As I wrote in my last post, I’m not certain Amazon’s terms of service would allow for such an information exchange, though it’s currently possible to download exactly the information Walmart would need to stand up such a service. (I’ve done it, it takes a bit of poking around, but it’s very cool to see.) The real question is this: Would Walmart spend the thousands of dollars required to make this kind of customer acquisition possible?

I don’t see why not. A high end e-commerce customer spends more than ten thousand dollars a year online. Over a lifetime, this customer is worth thousands of dollars in profit for a well-run commerce site like Walmart. The most difficult and expensive problem for any brand is switching costs – it’s at the core of the most sophisticated marketing efforts in the world – Ford spends hundreds of millions each year trying to  convince customers to switch from GM, Verizon spends equal amounts in an effort to pull customers from AT&T. Over the past five years, Walmart has watched Amazon run away with its customers online, even as it has spent billions building a competitive commerce offering. What Walmart needs are “point to” customers – the kind of people who not only become profitable lifelong buyers, but who will tell hundreds of friends, family members and colleagues about their gift box experience.

But to get there, Walmart needs that Amazon token. Wouldn’t it be cool if such a thing actually existed?

2 Comments on This Is How Walmart Beats Amazon