Posts about newspapers

News(paper) in the cloud

I think it’s possible today to run a news organization — up to the point of publishing — from the cloud, changing not only the production process of news but also its culture. John Paton, CEO of Journal Register, is about to prove it with his Ben Franklin Project.

John and I were sitting in my CUNY office as he told me about the technology he’s saddled with at this orphaned newspaper company where he just took the helm. He used a term I swear I hadn’t heard in well more than a decade: “VDT.” That stand for “video display terminal,” the old, dumb box that was wired into newspaper mainframes. I was talking with a bunch of young journalists shortly afterwards and they’d never heard of VDTs (though they thought it could be cured with a shot). Well, Paton still has VDTs.

And so, as he was talking about having to buy new computers, I took to the whiteboard and drew out how I think a news(paper) can be produced from WordPress, Google Docs, and Flickr (or their equivalents). We’ll get to the other functions shortly.

This up-in-the-air production is made possible by Paton’s edict at JRC (as he dictated at ImpreMedia before) that digital comes first, print last. If print comes first, newspaper people will worry about H&J (hyphenation & justification — that is, fitting text to finite holes in print designs). That dictated their process.

But not JRC. By putting print at the end of the line, production for paper won’t dictate the rest of the line. So now a reporter can start blogging at the beginning of a story. And that makes a profound shift in the culture of news: it opens up the process to the public. “Here’s what I think I’ll work on,” the reporter says to the community she covers. “Good idea? Is there something else you think I should do instead? What’s the best use of my time? What do you want me to find out for you? If I do this story, what questions do you have? What do you know? Whom should I call?” As the process continues, the reporter can share what she learns — and doesn’t learn — and the community can help fill in blanks and make the reporting better.

At some point in this process, the reporter likely will write what we’d still recognize as an article. Indeed, writing it before publication opens the possibility of the community still helping by correcting and enhancing.

Then a print editor can grab the story and fit it for print. No longer a big deal.

At the same time, the reporter and editor can ask the community for photos to illustrate the story. They can be shared via Flickr. When it’s time to print, an editor can copy the high-resolution version of an image. If the photographer chooses, he can make the photo available under Creative Commons. If the paper chooses to (as Bild does in Germany), it can pay. That’s up to them. The taking of photos can become competitive: a reader says “I can beat that.”

There are still bureaucratic details that must be handled: schedules of stories, who’s working on what, and so on. Google Docs is perfect for that. My CUNY colleague Jeremy Caplan showed our faculty how much more Docs can do: enabling reporters to, for example, graph data and create their own illustrations. Docs can be used to publish documents to the web.

From these three streams, content can come to a print editor — who is now, remember, at the end of the line — to fill the paper (which my friend and fellow JRC advisor Jay Rosen points out, is the most expensive space). The readers can even help the editor decide what deserves ink.

Note the profound cultural shift this new process brings to a news organization. Rather than doing everything we do and then sharing it with the public — and allowing them to comment on (or snark at) our work — we become transparent, we view news as a process instead of a product, and we open up our process to constructive collaboration with the community we serve. Hallelujah.

The rest of the process of publishing a newspaper is more complicated — at least to me, as I don’t know the tools. I’m not sure all that can be done with free tools but I’ll bet it can all be done in the cloud. At a Salesforce.com event last week, I talked with an exec who said that his service can be used to handle ad order entry. Other systems can handle business tracking, payroll, H&R, and such. I don’t think JRC needs to be dogmatic about living in the cloud but I do think it can avoid huge expense of buying and integrating new systems and hardware.

All this is why I’m delighting in advising JRC and Paton. They are going to try to do the things I’ve been wanting to see news(papers) do — I’ve been writing about this since at least 2005 — the things that tradition and fear prevented other papers from doing. They’re not alone. AnnArbor.com (which I also advised) is entirely on Movable Type. Online news organizations, of course, operate on blogs. But here’s the chance to jump a newspaper company from the past — from the age of VDTs and discs — to the future. I can’t wait to watch and help.

What is content, then?

In the discussion about the iPad, much has been made of its nature as a content consumption — versus creation — device. I lament its limitations as a tool of creation. Howard Owens, speaking for many, tells me that most people don’t want to create content.

But what’s content?

We in media have a bad habit of viewing the world in our image. We think the internet is a medium (I say instead it’s a place; this Cisco post says it is a language). We in media also think we get to define what content is: It’s what we make.

But Google, for one, doesn’t define content that way. It sees content everywhere, in everyone’s words and actions and it gains signals, knowledge, and value from that. We in media are blind to that value because we can’t see the content in that.

When we email a link to a friend, that act creates content. When we comment on content, we create content. When we mention a movie in Twitter — that’s just useless chatter, right? — our tweets add up to valuable content: a predictor of movie box office that’s 97.3% accurate. When we take a picture and load it up to Flickr — 4 billion times — that’s content. When we say something about those photos — tagging them or captioning them or saying where they were taken — that’s content. When we do these things on Facebook, which can see our social graph, that creates a meta layer that adds more value to our content. On Foursquare, our actions become content (the fact that this bar is more popular than that bar is information worth having). When we file a health complaint about a restaurant, that’s content. Our movements on highways, tracked through our cellphones, creates content: traffic reports. Our search queries are content (that awareness — that new ability to listen to the public’s questions — led Demand Media to a big business).

Do we all make content? Absolutely.

So when I complain about the iPad hampering our ability to create content, I mean that it makes it harder to share links and thoughts and images when I wish it had made it easier. And the apps media companies are making also make it hard to share our views and link into or out of their closed worlds. When they do that, they are shutting themselves off from the content people create every day and the value it holds.

There is content everywhere. You just have to be able to see it. And respect it.

Serendipity is unexpected relevance

Serendipity is not randomness. It is unexpected relevance.

I constantly hear the fear that serendipity is among the many things we’re supposedly set to lose as news moves out of newsrooms and off print to online. Serendipity, says The New York Times, is lost in the digital age. Serendipity, it is said, is something we get from that story we happen upon as we flip pages, the story we never would have searched for but find only or best in print. Serendipity, it is also said, is the province and value of editors, who pick the fluky and fortuitous for us. Without serendipity, as I hear it, we’ll be less-well informed (all work, no play, makes Jack a dull boy; all relevance, not serendipity, makes Jill a predictable girl).

A few days ago, a Guardian guy, inspired by Clay Shirky hacked together a serendipity generator: just a random story served up on a click. It wasn’t a serious solution, just fun. But it focused the serendipity question for me.

What is serendipity? It’s not a story from left field. It’s not, I think, “the opposite of what you normally consumed.” There’s a reason we find value in the supposedly serendipitous. When I started Entertainment Weekly, I said that our features had to satisfy a curiosity you didn’t know you had — but you end up having it. When we read a paper and find a good story that we couldn’t have predicted we’d have liked, we think that is serendipity. But there’s some reason we like it, that we find it relevant to us. Maybe that relevance is the unknown but now fed curiosity, maybe it’s enjoyment of good writing or a certain kind of tale, maybe the gift of some interesting fact we want to share and gain social equity for, maybe it’s a challenge to our ideas, maybe an answer to a question that has bugged us. In the end, it has value to us; it’s relevant.

Can that relevance be analyzed and served? Can we still get serendipity online? Of course, we can and do — mostly on Twitter and Facebook. Serendipity comes from friends who find that story and — like an editor — pass it on. If we share their judgment, we may like what they share and call that serendipity. But there’s plenty that passes me by on Twitter that I don’t like; it’s serendipitous by the usual definitions but it doesn’t work for me because it has no value; it’s not relevant.

Can an algorithm serve us serendipity? Maybe, if it has enough signals of what we and people we trust like, what interests us, what we need, our context. It can calculate and predict and try to serve our relevance and serendipity. I think serendipity comes not from one-size-fits-all editing but from better targeting across a larger pool of possibilities. If Google can intuit intent, I think it can also serve surprise and serendipity.

MORE: See also Chris Anderson and Matthew Ingram on serendipity.

The money graph

A new Pew study on the economics of news does not give comfort to news sites planning pay schemes. It also does not give me comfort that we’re wasting precious time futzing over walls when we should be paying attention to the big problems we have — one of which this Pew study points out: dreadful engagement and loyalty — and should be looking at other ways to give and gain value in our relationships with the public. The Pew data:

Over all, the evidence suggests the outlook is difficult both for paywalls and for online display advertising. While most people have not been asked to pay for content, even among the most avid news consumers online, only about one in five at this point say they would be willing to pay, and this does not include less voracious news consumers. At the same time, the vast majority of those online, 8 out of 10, say they basically ignore online ads.

In short, a good deal must change, the data suggests, before the digital age will begin to sustain itself.

About 71% of internet users, or 53% of all American adults, get news online today, a number that has held relatively steady in recent years.

Most of these online news consumers graze across multiple sites without having a primary one that they rely on. Only 35% of online news consumers have a favorite site.

To put it another way, 65% of online news consumers do not have a site that is so important to them that it stands out in their minds above all other sites they visit.

The users who do have a favorite site are pretty faithful. Some 65% of them check in with that favorite site at least once a day.

Yet even among these most loyal news consumers, only a minority (19%) said they would be willing to pay for news online, including those who already do so and those who would be willing to if asked.

Instead, a large majority – 82% – of those with a favorite site said they would find somewhere else to get the news.

Because so few online news consumers even have a favorite site this translates to only 7% of all people who get news online having a favorite online news source that they say they would pay for.

This is a sign of just how much initial difficulty the movement toward pay walls could have.

In sum, there appears to be only a very small cohort of voracious news consumers who have to have their news from a particular site, even if they have to pay for it. The vast majority of online news consumers, though, seem willing to browse for news from many sites, do not have a favorite online news source, and even if they do, are not willing to pay for that site’s content.

This is not to say that resistance might breakdown over time. . . .

All these findings speak to the natural disadvantage of news content: Most news is covered by more than one organization and people do not place enough value on the difference between the various reports. In other words, if a user had to pay for a New York Times article on Haiti, evidence suggests that he or she would just look for another source that could provide the basic information. The nuances of depth or breadth in the pay story may not be valued enough to induce payment over a free alternative.

Thus, if the news industry is going to make headway with pay-walls, they are going to have to break through what for now appears to be continuing reluctance, even among its most avid consumers.

News(paper)

Friend Michael Rosenblum forwarded word that the Star-Ledger in New Jersey was just nominated for seven local Emmys for its video work. Bravo for my old friends there and for Rosenblum, who trained them .

I remember when my old colleague Jim Willse, then editor of the Ledger, told me he wanted to get the paper into video and I begged him not to do what other papers had done: turn out pale copies and unintentional parodies of local TV news, something that deserves no emulation. I introduced him to Rosenblum, who came in an politely toured the TV studio the paper had just built and then said, “This is bullshit.” Nobody wants to see fake TV, he said. The newsroom is the story; it’s where the action is. So he had them set up cameras in the newsroom and he trained staffers to make video stories with a small camera and a Mac. I’ve watched my own students learn the Rosenblum Method and come out empowered, like the Ledger’s old paper people. Yes, anyone can make TV.

If I had it to do over again, I’d do one thing differently: bring in ad people to train them so they would understand the power of making TV and would sell it to advertisers and make video for them: so they, too, would think video.

Media’s evolving spheres of discovery

Here’s another in an occasional series of posts to that try to examine, explain, and illustrate the new structure of media. This one looks at how we discover content now.

Back in the day, a decade (to 50 decades) ago, we discovered media — news, information, or service — through brands: We went and bought the newspaper or magazine or turned on a channel on its schedule. That behavior and expectation was brought to the internet: Brands built sites and expected us to come to them.

Now there are other spheres of discovery — new spheres that are shifting in importance, effectiveness, and share. I believe they will overlap more and more to provide better — that is, more relevant, timely, and authoritative — means of discovery. These evolving spheres also change the relationships of creators and customers and the fundamental economics of media.

Start with brands. They decide what we want or should want and they succeed or fail based on that judgment. (They also succeeded because they controlled distribution and access.) They create the content and bear the risk. They depend on critical mass and economies of scale. One-way, one-size-fits-all, fleeting — these are the characteristics of branded media. Brands are disrupted by the spheres that follow, which disaggregate and disintermediate them, challenge their authority, compete on much lower cost bases (thanks to automation and collaboration), and provide better targeting and relevance (thanks to new means of gathering and analyzing data).

Next came search. Fundamental to search’s impact is that it shifted media from supply side to demand side: We, the people formerly known as the audience, initiate the sequence of a media transaction. In branded media, creators, editors, and producers decided what they’d give us and then we bought or didn’t. In search, we begin with our needs and curiosities. That theme of a reversed sequence carries through to other spheres. Search also provided the means to intuit intent and improve relevance, which is what feeds its higher value. Once a large universe of content became available to us all, value shifted from creator to curator. Content wasn’t scarce; organization was. The definition of scale was also upended: small could now succeed — highly specialized media can find its highly targeted public — but big became bigger than ever (see: Google). Search also commodified brands; it didn’t matter so much where we found an answer so long as we could search for it.

AlgorithmsGoogle News or Daylife (where I’m a partner) — also meet the organizational challenge of abundant content and they tackle the challenge of timeliness. For search to infer content’s relevance, it must gather data from our use — that was Google’s key insight — but that won’t work for news, whose value is perishable. So algorithmic aggregators use other signals — source, content analysis, timing, location, association — to cluster and present coverage in a nest of relevance. These algorithms enable content to coalesce into stories and topics that search will find because it gains depth and attracts links and clicks. Algorithmic aggregators exposed a key conflict in old v. new media worldviews: The old-media view is that aggregators extract value from content by displaying it; the new-media view is that they add value by creating audiences and causing links — this is the essence of the misunderstanding of the link economy.

Thanks to new tools — Twitter, Facebook, Buzz — human linksare exploding as a means of discovery, which gives lie to the old-media complaints of Rupert Murdoch et al that aggregators are stealing their content. When your own readers recommend and link to your content, is that stealing? Do you want to turn those people away and call them worthless? Facebook, according to Hitwise, is the fourth largest referrer of audience to media. Bit.ly alone causes two billion clicks a month, double Google News’ impact. Soon Buzz will be causing many links (teaching Google what’s hot and relevant, which is a key reason to start the service). And, of course, bloggers have shown the way as curators. Thanks to our newer, easier tools that enable links, humans are becoming a huge force in content discovery, reducing search’s and algorithms’ share and dominance.

Now we need to better understand the quality of those links and linkers. Clay Shirky craves algorithmic authority. Azeem Azhar is one of many entrepreneurs trying to systematize the annointing of more authoritative tweeters (read: linkers) at Viewsflow. On the latest This Week in Google, Google’s Matt Cutts talked about efforts to find more signals of quality so it can send us not to the crops of lowest-cost content farms but instead to original work. (The good news is that quality will out.) In the link economy, sending traffic to original work becomes an ethical imperative as links are the means to support that work. But it’s an old-media mistake — a leftover of the brand era — to think that authority can or should be one-for-all or that it’s the creator who establishes authority. Authority will vary by context and need as well as opinion (one man’s New York Times is another’s Fox News). Branded media was one-size-fits-all as was search and algorithmic aggregation. Now discovery will become personalized based on context (who you are, where you are, what you’re doing, what you’ve done, what you like…) as well as timing, taste, and quality.

That personalization will disarm the dark art of search-engine optimization — because it will be hard to game everyone’s search results and will already disrupt even the farms and make critical mass harder to reach (and not soon enough for some tastes). But I remind people not to miss a key insight that underpins the most prominent factory farm, Demand Media: predictive creation. That is, Demand listens to us — via search queries — and to the market — via ad demand — and enables the public to assign its writers (assuring its success, reducing its risk). Return to the point above about the reversed sequence of the media transaction: now creation does not start with the creator but with the consumer (pardon my use of the term; it fits in this context). Isn’t that the way it should be (and not just in content but for most any product or service)?

There’s another dimension I didn’t include in my silly little diagram: being distributed instead of merely discoverable (serving the fabled young woman who said, “if the news is that important, it will find me“). We can no longer expect our consumers/readers/users to come to us and wait for us; we must anticipate their needs by listening to their signals and go to them.

That reversal of the distribution pipe will force content creators to break out of the silos I’ve described above and mix the best of all these methods. Brand can still matter; it will be a signal of authority (or the lack of it) once content is discovered. Search will still matter but it will be sensitive to many signals and demands, from each of us and from the market. Algorithms will also use these signals to target and add relevance to content, helping us to prioritize our hyperpersonal news streams. We will discover more and more content through people we trust. We will wish that someone would create content to answer a question or cover an event and if content creators are listening and if enough of us want it, they will seize the opportunity (this is how the Demand model can come to news). They will even anticipate our needs — that’s why the airline gives me the weather in Florida on my boarding pass when I fly there.

Note in that example that media doesn’t come just from media anymore. Retailers, airlines, government, doctors, teachers, communities — any and all of us — will all be media, understanding the needs of a public and using all these tools to answer them without having to go through the old media brands to create content or reach an audience. That’s the lesson of blogs. And that may be the most profound change of all: the complete and utter disaggregation and disintermediation of media, turning everything about it upside-down: content starts with the consumer instead of the creator; authority is established by the public instead of the brand; the audience is the distributor.

So imagine a content ecosystem where users — who already do most of the information sharing themselves — decide where and how value can be added, explicitly or through our usage data. Imagine that these creations come to us through recommendations from peers we trust, prioritized by formulae (human-aided algorithms and algorithmically aided humans), or through search. Imagine that the creation isn’t a static piece of content but instead that nest of relevance with updates powered by collaboration and links. News and media start to look very different.

What does this mean for the economics of media? We don’t know yet; that’s why we must create new models and enterprises to figure it out. I tell my students that the marginal cost of the sharing of information and the creation of content is now zero; the internet makes it possible for that to happen on its own. So there is no value in doing what others have already done (even the value of one more page about fixing a toilet — no matter how clever its SEO — is diminishing); commodification is death. They should take advantage of the great efficiency the internet enables through platforms, specialization, and collaboration. They should then ask where they add unique value as journalists — finding or even anticipating needs and answering them by reporting, correcting, explaining, curating, organizing, training. That will be true for anyone in media.

And how is money made? We don’t know that yet, either, of course. At Friday’s PaidContent event on [cough] paid content, Forrester’s James McQuivey argued that we’ve never paid for content. He said we do pay for access, but I think it’s hard to make money in access long-term because somebody can provide it cheaper, faster, better. Can we still deliver audiences to advertisers? I hope so, but Bob Garfield warns that as merchants and manufacturers build their own direct relationships with customers — as they become media — there’ll be less to spend on media. I think the value is in the relationships, which is the question I asked of the well-media-trained New York Times executives at Friday’s event: In how many ways can you find value in a deep relationship with your public (selling goods and services, acting as a platform, selling education, selling events….); the implication of my question is that putting up a toll booth turns away those relationships and can reduce that value. But then, that’s just my theory. Everything is.

The one thing I know with some confidence is that we have to build to a new reality and this is a simple way to begin to express some of that change.

Helping news be news

Google News has just open-sourced its code to create what it calls Living Stories. What this really is, I think, is Google’s attempt to take editors to school on content presentation in our new world.

The article, I’ve argued, is outmoded as the building block of news. The new atomic unit(s) of journalism needs to reflect the transition of news from a product to a process. It needs to gather updates and corrections on a story. It needs to put that story in context and history. It needs to link to other versions of the story from other sources. Going past what Google’s Living Stories format does, it needs to open the door to collaboration. It can do so much more: showing the provenance of the news and linking to original sources, gathering comment and perspective, soliciting questions….

Daylife (where, disclosure, I’m a partner) its own vision of the future of the story, called Smart Stories, that will do more neat things; I’ll let them tell you about it. Daylife also sees that news needn’t exist in isolated, short-lived, repetitive units of presentation invented for the age of print. News should reside in a nest of relevance, which not only improves the presentation, it gives you more options on how you want to delve into the story and follow it and eventually contribute to it. It makes news more personal.

Both companies are doing something important for the benefit of journalists: making them look at what they create in a new way. This is just one possibility, just one step. We also need to think about making news embeddable and distributed. We need to insinuate news into your stream (“if the news is that important, it will find me“) and make it collaborative and enable you to triangulate from different viewpoints and footnote our work and….

The way for Google to serve the interests of news is not to make deals to mollify the mewling Associated Press or cater to pipe dreams of charging. The way that Google and other technology visionaries can help is by reshaping the form of news to show the people who do it how they can do it now. The open-sourcing of Living Stories is a welcome start.

Next to the gallows: Newspaper coupons

The best reason that some newspapers have to stay in print — at least a few days a week — is to distribute coupons and circulars (free-standing inserts, or FSIs, in the jargon). But as newspaper circulation declines below critical mass and as digital means of delivery of coupons and bargains catch on, the FSI line of business is the next to fall over the cliff for papers.

Rick Edmonds at Poynter writes about an NAA study that says the coupon business for newspapers is under siege. Meanwhile, Coupons.com brags that the growth of digital coupons is surging; printouts of deals at Coupons.com alone equaled $858 million last year. This comes as coupon use in America is growing overall for the first time in 17 years; we redeemed 3.3 billion last year, a 27% jump over 2008. Sunday coupons still account for the lion’s share of the business, but online is growing fast.

Newspapers defined themselves and their barrier to entry by their production — we already know what is happening to paper — and distribution — now we see what is to become of that.

It’s not just coupons that are affected. When I visited the very smart people at Best Buy a few months ago, I came to see that their circular is media as well; it provides value to manufacturers and consumers. Large retailers, like manufacturers, need effective distribution and as newspapers shrink, they will need to look at alternatives.

Is that the Postal Service? Well, they, too, are losing a fortune (more on that soon). Most of what the Post Office delivers today is advertising and I certainly don’t want to subsidize that with my stamps or taxes, so I’d expect advertising postal rates to rise, which will also put pressure on coupon and circular advertisers, motivating them even more to find ways to make digital work.

The problem with digital coupons and circulars has been portability: the extra and inconvenient step of printing out supresses use. But now enter the smart phone and the long-fabled day of the smart, mobile coupon may actually arrive. If I can check into a flight with a scan of my iPhone shouldn’t I be able to buy toilet paper with it? The value of that redemption is greater for the advertiser because (a) it may cost them nothing — no need to use media as a middleman if I receive deals directly and (b) the advertiser will know a lot more about me; that data itself is terribly valuable and (c) this allows the advertiser to target with far greater relevance, which (d) is better for us customers.

I think there’s a short-term opportunity here for someone to craigslist (as a verb) the newspaper distribution business, creating the means to deliver in key markets with greater reach and better Zip code targeting, drastically undercutting both newspapers and the Postal Service. As coupons do move to mobile and digital, this business will go away, too, but it won’t have much in the way of shut-down cost so there’s a way to disrupt the last dying ember of an industry and get some nice cash flow. If I were a coupon company — and News Corp. is — I’d do it myself.

The point: expect the coupon and FSI business to head over a cliff and with it, another important revenue stream for print papers, giving them more reason to abandon print.

ONE MORE THING: I’ve told this first part of this story before: When I was Sunday editor of the NY Daily News and we came back from a strike, we didn’t have coupons because Murdoch was feuding with our new owner, Robert Maxwell. When they did return, our circ went up 100k. Those people were buying coupons more than the paper.

Now the second part: I later proposed to a publisher starting a coupon magazine that would be sold at supermarket checkout. Yes, I said sold. I wasn’t going to charge readers for content. I was going to charge them for advertising. Didn’t happen, sadly. Still think it was a good idea.