Google: Drop the AP first

Forbes quotes AP head Tom Curley sabre-rattling in negotiations with Google: “Curley warned that if Google doesn’t strike the right deal with the AP soon, ‘They will not get our copy going forward.'” This is more than mere negotiation. The AP has been making noise about trying to force Google to favor it and its members in the search engine’s algorithms.

Forbes explains:

The AP, a 163-year-old cooperative owned by news organizations, won’t discuss its talks with Google, but plans to create landing pages and Web-based “news maps” directing users to original AP stories (and away from secondary sources who post material “borrowed” from the AP). To do this, the AP needs Google’s help. Most likely that means Google creating search protocols similar to those created from the licensing deal the AP inked with Google in 2006.

Since that deal was struck, Google has paid the AP undisclosed fees to carry AP content on the Google News section of the site. Search rankings on Google News give priority to recognizable news brands like the AP. But Google applies no such algorithmic discretion to general searches. The broader search rankings spread AP content out across the Web, says Curley, encouraging misappropriation by other sites. Curley wants Google to “protect content from unauthorized use and pay us for the longtail.” By “longtail,” Curley refers to the thousands of small sites that collectively drive vast herds of traffic using AP content.

THe AP is trying to play victim here, saying that Google is pointing to sites that steal its content. Name two. When I search for news, I can’t remember being taken to a thief. I’m often taken to the AP, which rewrites news and cuts the links to original journalism and thus cuts off the value of links. But not reputed thieves.

Now, apparently, the AP wants to start to rectify its role in the link economy by creating these news maps. OK, I’ll agree that there must be more linking directly to journalism at its source. But I don’t know why Google needs the AP to do that. It could improve its algorithms not to favor certain brands but to favor original reporting wherever it occurs, at the AP, at newspapers, or at blogs.

So it’s in the sense that I’ll suggest Google should cancel the AP contract first – not as retribution but as a service to journalism. Now GoogleNews runs full AP stories it licenses from the wire service, taking traffic away from AP members’ sites and pointing to rewrites of reporting rather than original reporting. If what we want is an ethic of linking to original journalism, then Google should consider no longer presenting full AP stories and, for that matter, linking to AP rewrites. That would serve original reporting. But we have to wonder whether serving journalism or the AP is the AP’s real strategy in these negotiations.

Danny Sullivan links us to an explanation of the AP’s tactics at AllThingsD earlier this month:

This has been construed in some quarters as a plan to create a search engine or news portal. But it’s really just an attempt to upgrade the AP’s search engine optimization strategy — that is, trying to get its stuff to show up higher on Google’s (GOOG) search results. It will do that via “search pages,” or “topic pages,” which are par for the course in the Web world….

If the search page plan works, the pages will be generating plenty of page views when people land on them, and it’s possible that the AP will sell ads on that inventory, Kennedy says. But their real function is to shuttle searchers to the original source material from the AP’s members.

So Google could cut out the middleman – the AP – and just link to the original journalism itself. But being bullied into linking to the AP and its members is not the way to go.

Sullivan explains:

Google’s web search quality team — which has nothing to do with Google’s business folks — generally does not take well to people suggesting they’re somehow going to own the search results. AP content probably will start ranking well for some things, but if it started showing up Wikipedia-style for everything, people outside the AP would start complaining about favoritism.

That’s what makes the Forbes piece so puzzling. AP chief executive Tom Curley (who the AP told me was “unavailable” to talk; nor after nearly two hours, does anyone else seem available) sounds naive enough to believe he can force Google into a deal that would give AP preferential treatment in regular search results….

Google News doesn’t give “recognizable news brands” a boost. I’ve never seen them say this, nor have I seen it actually happen in real life. Google News includes large and small news sites and lists a diverse collection of stories. I know lesser-known news sites do well because I run one of those. At times, I can have a headline story that beats the AP or other mainstream outlets in Google News….

Certainly if Google starts ranking brands better than other content, they’ll have issues. Brands do not equal trust. Enron had a brand; AIG has a brand — being a brand doesn’t mean that you are more trustworthy or deserve an automatic ranking boost. From my perspective, Google’s algorithm has continued to change over the past few years to reward trusted sites. Many brands have sites that Google has decided are trustworthy, but some don’t.

Curley is foolish if he thinks he’ll browbeat Google into somehow changing its algorithm in web search to reward AP as part of this deal. Google’s search quality engineers wouldn’t stand for that, any more than a journalist would stand for a newspaper CEO marching into a newsroom and demanding that certain advertisers get favorable stories written about them.

There’s the irony: Journalists would never stand for what the AP is allegedly trying to do on behalf of journalism. If an editor walked into a newsroom and told reporters: ‘I want you all to quote only big-company and government officials from this approved list and stop quoting little people,’ there’d be a proper revolt. Google’s engineers will protect the authority of their algorithm just as self-respecting journalists would protect their own independence and reputation.

So, Google: Resist the bullying and blackmail. Drop the AP. Perfect ways to link to and thus support journalism at its source. That is the better service to the public and news.

(Full disclosure: I’m a partner at another aggregator, Daylife. As I’ve blogged before, I’ve discussed both there and at GoogleNews the need to link to and thus support journalism at its source, wherever it occurs.)

: LATER: In the comments, Paul Colford of the AP corrects me:

AP sells only a selection of its staff-generated international and national news stories to Google and other commercial customers. A very small slice of this — less than 2 percent of the mix — comes from member newspapers, typically scoops that are credited to the papers.

Stories from member newspapers make up a much larger piece of AP’s state wires — but the state wires are not available to Google and others outside the AP membership.

I stand corrected. But then I would also say that the AP now has an unfair advantage over its members by selling its content to Google to distribute in full. Google does this only for wire services, not for anyone else. And I don’t want it to do this for others, because someone will get left out of the mix. So I still think Google should link instead, and link directly to original journalism.

  • Do you know of any attempts to write a markup for the journalistic content of an article (just like HTML is a display markup for content)? I’m thinking that it would be really sweet to have a standard for distinguishing between rewritten press releases and original reporting.

  • RE: “Now GoogleNews runs full AP stories it licenses from the wire service, taking traffic away from AP members’ sites and pointing to rewrites of reporting rather than original reporting.”

    This assertion is wildly inaccurate, as a check of any number of stories about the AP would have revealed.

    AP sells only a selection of its staff-generated international and national news stories to Google and other commercial customers. A very small slice of this — less than 2 percent of the mix — comes from member newspapers, typically scoops that are credited to the papers.

    Stories from member newspapers make up a much larger piece of AP’s state wires — but the state wires are not available to Google and others outside the AP membership.

    Paul Colford
    AP Director of Media Relations

  • Tom

    You and your readers should know that AP often trots out this bogus factoid that only 2 percent of the AP report comes from newspapers. It simply isn’t true. They don’t sell the state wires to Google, but they do pull the best stories from the state wires for use on the services they sell to sites like Google. The minute the AP rewrites a story reported by a newspaper or broadcaster, they consider it staff-generated. Here are the AP odd news headlines on right now – where the bulk of the stories are from newspapers or broadcasters:

    Outhouses cushion small plane crash in Wash state
    (from the Tacoma News-Tribune)
    2 win Alaska betting game, guess river ice breakup
    Police: driver caused $26K damages, arrested
    (from the Fremont Tribune)
    Couple arrested for sex on lawn at Windsor Castle
    (from The Sun)
    Cowboy ticketed for ‘riding under the influence’
    (from KUSA-TV)
    U of Oregon to Frisbee team: No pants, no season

  • I watched Curley talk about these landing pages on Charlie Rose and I was struggling to get his real meaning. It’s not that I don’t “get” what he’s talking about or have a lack of understanding about a landing page, but there was something about his demeanor and attitude that was very victim-like on one hand but Google-supportive on the other. Arianna Huffington was on that show as well and she kept talking about the importance of the Link Economy and moving forward. It was a strange mix, and Curley seemed so out of it. I would love to see what their high-level meetings look like about this whole Google issue. Google that interview and watch if you can. You’ll see exactly what I mean.

  • Pingback: StevieB’s Shared Items - May 5, 2009 at Lost in Cyberspace()

  • Here’s what happened in our market and what I blogged about it last week:

    A tour bus flips over on a California highway. People are ejected out the window and off an overpass. 5 people dead, dozens seriously injured. When this news event happened, local media sprang into action providing a full-on onslaught of coverage.

    In the immediate moments after the crash, the local stations efforts became the top items on major search engines. But an interesting thing happened as the day unfolded. AP picked up the story. So did CNN and all the news networks. Then the major newspapers picked up the AP story. Suddenly, Google and the other search engines started moving the AP stories up to the top. So, within an hour of the first report, the local media was pushed farther and farther down the queue. Because Google and the others use a proprietary algorithm that gives more weight to what they call “more credible” sources, anytime the big guys come in on something, they big foot the little guys out of the way. So the more traffic a site gets, the higher they show up.

    That may work for finding static information, but it shouldn’t work that way for news. Almost always, the most accurate coverage – and newest information – comes from the local source, whether it’s traditional media or the neighborhood blogger. Within 5 minutes of the AP story being posted, the local guys were all but gone.

    Why is that a problem? Well, at one point, the first 40 stories were all the SAME EXACT Associated Press wire copy, showing up on different media websites. AP didn’t update the story for hours. Meanwhile, the local media was updating the web story constantly. Dozens of new angles and side bar stories. Literally hundreds of updates to add new information, maps, graphics, slide shows, live streaming. Raw video, news conferences, aerial views. And none of it showed up on Google. OK, it actually did show up. But if you have to go 5 or 6 pages deep on a search to find it, does it really matter?

    Under Google’s current algorithm, they were rewarding traditional media over currency and along the way suppressing enterprise report and accuracy. The first reports from the scene were that 10 people had died. That’s what AP reported, which is what the New York Times and the big boys reported. But shortly thereafter, the local media found out this wasn’t true. The number was reduced to 4 immediate fatalities and another death a little later. All the local media revised their stories again, but it was 4 hours before it hit AP and, in turn, the big guys.

  • Bret McCormick

    Excellent overview: I’ve said it before and I’ll say it again…News organizations will flourish on the web when they stop relying on the AP.

    Local digital directors have long espoused the lunacy of sending our local content to AP so they can rewrite and drive traffic to the AP site when it should be coming to the local provider. When will local news orgs wake up and realize they are actually paying AP to have their news swiped from them on the web?