Live coverage

The Huffington Post, the New York Times, the Wall Street Journal, ABC, CNN, Mashable, and many others, including even Mother Jones had live web video. But you can get live video on television, so perhaps the digitally native form of the live blog is more interesting. This can include commentary from multiple reporters, reactions from social media, link round-ups, etc. The New York Times, the Boston Globe, The Wall Street Journal, CNN, MSNBC, and many others had a live blog. The Huffington Post’s effort was particularly comprehensive, continuing well into Wednesday afternoon.

Multi-format, socially-aware live coverage is now standard, and by my reckoning makes television look meagre. But the experience is not really available on tablet and mobile yet. For example, almost all of the live video feeds were in Flash and therefore unavailable on Apple devices, as CNET reports.

As far as tools, there was some use of Coveritlive, but most live blogs seemed to be using nondescript custom software.

Visualizations

Lots of visualization love this year. But visualizations take time to create, so most of them were rooted in previously available SOTU information. The Wall Street Journal did an interactive topic and keyword breakdown of Obama’s addresses to congress since 2009, which moved about an hour after Tuesday’s speech concluded.

The New York Times had a snazzy graphic comparing the topics of 75 years of SOTU addresses,  by looking at the rates of certain carefully chosen words. Rollovers for individual counts, but mostly a flat thing.

The Guardian Data Blog took a similar historical approach, with Wordles for SOTU speeches from Obama and seven other presidents back to Washington. Being the Data Blog, they also put the word frequencies for these speeches into a downloadable spreadsheet. It’s a huge image, definitely intended for big print pages.

A shout-out to my AP colleagues for all their hard work on our SOTU interactive, which included the video, a fact-checked transcript, and an animated visualization of Twitter responses before, during, and after the State of the Union.

But it’s not clear what, if anything, we can actually learn from such visualizations. In terms of solid journalism content, possibly the best visualization came not from a news organization but from Nick Diakopoulos and co. at Rutgers University. Their Vox Civitas tool does filtering, search, and visualization of over  100,000 tweets captured during the address.

I find this interface a little too complex for general audience consumption — definitely a power user’s tool. But the algorithms are second to none. For example, Vox Civitas compares tweets to the text of the speech within the previous two minutes to detect “relevance,” and the automated keyword extraction — you can see the keywords at the bottom of the interface above — is based on tf-idf and seems to choose really interesting and relevant words. The interactive graph of keyword frequency over time clearly shows the sort of information that I had hoped to reveal with the AP’s visualization.

Fact Checking

A number of organizations did real-time or near real-time fact checking, as Yahoo reports. The Sunlight Foundation used itsSunlight Live system fo real-time fact checks and commentary. This platform, incorporating live video, social media monitoring, and other components is expected to be available as an open-source web app, for the use of other news organizations, by mid-2011.

The Associated Press published a long fact check piece (also integrated into the AP interactive), ABC had their own story, and CNN took a stab at it.

But the heaviest hitter was Politifact, who had a number of fact check rulings within hours and several more by Wednesday evening. These are together in a nice summary article, but as is their custom the individual fact checks are extensively documented and linked to primary sources.

Audience engagement

Pretty much every news organization had some SUTO action on social media, though with varying degrees of aggressiveness and creativity. Some of the more interesting efforts involved solicitation of audience responses of a specific kind. NPR asked people to describe their reaction to the state of the union in three words. This was promoted aggressively on Twitter and Facebook. They also asked for political affiliation, and split out the 4000 responses into Democratic and Republican word clouds:

Apparently, Obama’s salmon joke went down well. The Wall Street Journal went live Tuesday morning with “The State of the Union is…” asking viewers to leave a one word answer. This was also promoted on Twitter. Their results were presented in the same interactive, as a popularity-sorted list.

Aside from this type of interactive, we saw lots of agressive social media engagement in general. The more social-media savvy organizations were all over this, promoting their upcoming coverage and responding to their audiences. As usual, the Huffington Post was pretty seriously tweeting the event, posting about updates to their live blog, etc. and going well into Wednesday morning. Perhaps inspired by NPR, they encouraged people to tweet their #3wordreaction to the speech. They also collected and highlighted reaction from teachers, Sarah Palin, etc.

But as an AP colleague of mine asked, engagement to what end? Getting people’s attention is great, but then how do we, as journalists, focus that attention in a way that makes people think or act?

The White House

No online media roundup of the SOTU would be complete without a discussion of the White House’s own efforts, including web and mobile app presences. Fortunately, Nieman Journalism Lab has done this for us. Here I’ll just add that the White House livestreamed a Q&A session in front of  an audience immediately after the speech, in which White House Office of Public Engagement’s Kal Penn (aka Kumar) read questions from social media. Then Obama himself did an intervew Thursday afternoon in which he answered questions submitted as videos on YouTube.

Over the last several days there has been considerable hubbub around the notion that pioneering media theorist Jürgen Habermas might have signed up for Twitter as @JHabermas. This would be “important if true”, as Jay Rosen put it. Intrigued, I tracked him down through the University of Frankfurt. I succeeded in getting him on the phone at his home in Sternburg, and asked him if he was on Twitter. He said,

No, no, no. This is somebody else. This is a mis-use of my name.

He added that “my email address is not publicly available,” which suggests that perhaps he didn’t quite understand what I was getting at. In fact, the father of the public sphere doesn’t seem to understand the internet very well at all, judging by his few previous references to the topic.

I know many people will be disappointed, especially @bitchphd who tweeted “JURGEN HABERMAS is on twitter. definitive response to all future articles about how stupid twitter is.” Personally I believe that Twitter is significant even without Habermas, but it’s clear that this is an issue for the next generation of theorists to decide.

UPDATE: here is an audio recording of my question and his answer.

aricaaa #10yearsago boys still had cooties. ah i miss those days!

davidwees Happy New Year! #10yearsago today I was in a dead-end job working in a warehouse. Now I love what I do and have a great family.

scottharrison: #10yearsago I was a sycophant and a drunk selling vodka to bankers in clubs. Grateful for God’s grace and sense of humor.

Sirenism #10yearsago I was eleven and one of my brothers friends tried to kiss me at midnight. I punched him in the nuts.

cosmicjester Holy Shit #10yearsago I met a girl at a friends birthday party, we both liked Red Dwarf and the Beatles. Then she became the girl.

shaunraney #10yearsago was the the saddest day of my life.

As striking as this is, I notice that almost all of the traffic is in English. The only other language reasonably well represented is Indonesian. Curious, though it is the 4th largest country by population, and social media are hugely popular here.

I’ve also really enjoyed watching the clock strike midnight in different time zones. Here in Jakarta, the NYE conversations of my friends in California — 13 hours behind — seem so last night. I’m nursing a hangover, they’re working on one.

It’s so easy to forget the world outside what you know. I hope that global media like Twitter will help us to remember everyone else. The technological means have arrived with a roar, but we’re still not really talking to one another. What is the next step?

I had intended to do this myself. But I’ve discovered that I’m back in graduate school full time, so I’m looking for a collaborating programmer who wants to do the majority of the coding. If you have some programming skill and you want to get into web apps, drop me a line!

But mostly, you’ll do this because you think that the world needs better multi-lingual communication. In particular, you want people to be able to keep track of news from places with oppressive internet censorship regimes (Iran, China, some Middle East), and you want the people who live there to be able to have public, real-time conversations with the rest of the world.

(Getting an uncensored internet connection in these places, one that can actually reach Twitter, is a different problem. But believe me, that problem has an active community around it.)

Spaz is written in Adobe Air and will need to call the Google Translate APIs.

Advertisers have been smoking the Google and Facebook crack. And they no longer want that shakeweed that the [TV] networks are offering.

The second half is in many ways even better, when Leo takes questions from the audience and discusses topics such as the future of printing news on dead trees

Maybe there will always be [paper] news, but it will be brought to you by your butler who has ironed it out carefully for you. It will be the realm of the rich person.

and the “holy calling” of being a journalist:

You reporters are really the monks of the information world. You labour in obscurity. You have to be driven by passion because  you’re paid nothing. And you sleep on rocks.

He goes on to discuss the necessity of bidirectional communication, Twitter as the “emerging nervous system” of the net, etc. — all the standard new media stuff, but put very succinctly by someone who has deep experience in both old and new media. Very information-dense and enlightening!

It is absolutely true that journalism is much more than random tweeting or blogging. I have been particularly inspired by the notion that “journalism is a discipline of verification,” and a tweet or a blog post neither requires nor endures the fact-checking and truthfulness standards that we expect of our more traditional news media. I also agree that search engines are simply not a substitute for being there. Someone must be a witness. Someone has to feed their experience into the maw of the internet at some point.

However, when Cohen says “the mainstream media — expelled, imprisoned, vilified — is missed” he is implicitly arguing that only the mainstream media can produce good journalism.  Traditionally, “journalist” was  a distinct, easily defined class: a journalist was someone who worked for a news organization. There weren’t many such organizations, because a distribution monopoly is an expensive thing. All this has changed with the advent of nearly free and truly democratic information distribution, and we are seeing a rapid erosion of the the distinction between professional and amateur or “citizen” journalists. The result is confusion, uncertainty and fear — especially on the part of those who have staked their careers or their fortunes on the clarity of this distinction.

But I see a big difference between journalists and journalism, and this is where Cohen and I part ways.

In my view the failure of journalism in Iran was not the failure of the mainstream media to hold their ground (or their funding, or their audiences) but rather the failure of the journalism profession to educate the public about what exactly it does, and how to do it. When Cohen asks questions such as

But who is there to investigate these deaths — or allegations of wholesale rape of hundreds of arrested men and women — and so shed light?

my answer is, the Iranians, of course!

Naturally, a young activist-turned-reporter does not have the experience or connections of an old-school foreign correspondent. But such a person is there, and they care enormously. What they lack is guidance. What is and is not journalism, exactly? What are the expected standards and daily, on-the-ground procedures of verification? Where can someone turn to for advice on covering the struggles they are immersed in? And what, actually, differentiates the New York Times from a blogger? We need clear answers, because the newspapers are no longer the only ones declaiming the news.

Perhaps the mainstream media couldn’t be in Iran, but they could have been mentoring and collaborating from afar, and yes, publishing the journalism of non-career journalists. And such a project needs to begin long before times of crisis, in every region, so that those who are there are ready.

If “citizen journalism” has so far been somewhat underwhelming, it is because we have not taught our citizens to be journalists.

The background: Attorney Rodrigo Rosenberg was shot while riding his bicycle on May 10th, just a few days after recording a video message which begins,

If you are watching this message, it is because I was assassinated by President Álvaro Colom.

The video implicates not only the president but the major state-owned bank, and indeed much of the current government, and there were mass protests in the capital city. Xeni has been covering the story from Guatemala since the 20th, and I can only commend her for actually being there. However, her coverage has focussed on the role of the internet in these protests.

Google is not reality and Twitter is not reality in exactly the same way that television is not reality. Part of the reason that Middle-Eastern peasants have such a warped view of America is that they too watch Desperate Housewives (via satellite or bootleg VCD), but never get the chance to actually meet some Americans. To them, all American women are blonde and slutty. There’s no reason to believe that we’re not getting a similarly warped view of other cultures when we watch their internet.

For it is something else entirely to be walking the streets of a foreign country. It’s a different world; the language is different and the food is different and the way things get done are different. We can fire up our web browsers and speculate about Facebook-organized protests, but it means nothing without the context. Maybe people in the Guatemalan cafes are angry, maybe they are apathetic; or maybe talking about politics over coffee is a luxury that the desperately poor rural population cannot afford, along with internet access. The only way to know is to go there.

Therefore, Kudos to Xeni for understanding the value of on-the-ground journalism, for being there, and for putting in so much time trying to learn something about people in another country. Consequently I am a little surprised that she would write,

Rosenberg’s video was handed out on DVDs at his funeral. The footage spread within days to YouTube and other video networks. Soon, it was the focal point of chatter among mostly young Guatemalans (who are more well-off than Guatemala’s extremely poor majority) on social sites like Twitter, Facebook, and Hi5. Remixes of the video soon appeared online, along with subtitled versions and amateur op-ed responses to the claims therein.

Those same social networks also played a role in organizing massive demonstrations in the country’s capital, Guatemala City. Crowds one weekend were estimated to be between 30,000 and 50,000. Newspapers in Guatemala credited social networks such as Facebook and Hi5 with “summoning” the petition signers.

The implication of this — and of the headline “The Twitter Revolution” — is that online tools played a crucial role in the spread of information and the organization of protests. But I don’t think we actually know this; I don’t think we actually can know it just from watching Twitter and Facebook and counting the number of webcasts. It’s exciting to talk about the role of technology in social justice, but these are just the most externally visible pieces of a huge and complex phenomenon.

So what role did “new media” actually play in spreading and coordinating organized dissent? Did anyone survey the protesters and ask them how they heard about the protest?

I can just as easily imagine that Twitter and Facebook and all the rest played only a relatively minor role in the massive response to Rosenberg’s death. Communication networks existed long before technology, in the form of dense and fast-responding social networks. When my friend had a motorcycle to sell in a small town in India, he walked into a dealership. The dealer didn’t buy his bike and my friend walked away without giving any contact information, but four hours later a pair of Tamil men knocked on his hotel room door with an offer of 15,000 rupees cash. In India, communication moves with astonishing speed along the networks of big extended families, business partnerships, chatter at the chai stand, and other channels I was never privy to.

And so we come to someone handing out DVDs of Rosenberg’s last statement at his funeral. The DVDs were played on existing, ubiquitous, cheap technology (DVD players now cost under $20 worldwide). They were doubtless copied and probably re-copied onto VCDs which can be duplicated on any dirt-cheap relic of a computer, and endlessly passed hand to hand. Meanwhile, unlike computers and internet access, mobile phones really are a ubiquitous technology, and surely good old-fashioned telephone gossip played a huge role.

It would have been weird if the video hadn’t eventually been posted online and the topic had never made it to Twitter. But just because something was online doesn’t mean that it had any effect. “Online” is just the part of a culture’s psyche that is easiest to measure,  and it’s also exciting to report on if you’re an idealistic technologist (like me.) And it’s the preferred method of young, well-off Guatemalans who are politically motivated and rich enough to spend endless hours online in a country where bandwidth is very expensive, in relative terms. These are precisely the people who a tech-savvy foreigner like Xeni would be spending the most time with.

This problem of understanding is not unique to Guatemala, of course. One of my favorite pieces of research is the study of Iranian bloggers that came out of the Berkman Center for Internet and Society which I have previously commented on here. Not only did this work dispel some dearly-held new media myths (e.g. “the majority of Iranian bloggers are politically liberal,” which is just not true) but it raised some really tricky questions about the relationship between a society and its online footprint. Who, exactly, are these people writing blogs?

So, Xeni, I have some questions about Guatemala’s ”Twitter revolution.” You were there, so perhaps you can shed some light on them:

• What fraction of the Guatemalan population has internet access?
• How many Guatemalan Twitter users are there?
• What is the demographic of each of these groups? What is known about the political leanings of these demographics?
• How many users joined Facebook groups concerning the protests? How many protestors were there? How does this ratio compare with protests organized online in developed countries?
• Was/is the Rosenberg video widely copied and circulated on DVD/VCD? Can you buy it at street level from the usual sources for pirated videos?
• What is know about SMS usage in these protests, a technology which is far more widely deployed than Twitter?
• Finally, did you get the chance to ask random protestors how they heard about the protest?

If we truly believe in the potential for new media in social change — and I certainly do — then we have to be ruthlessly honest about the cause and effect relationships involved. Yes, mass protests really are organized online in our rich and digital corner of the world, but that doesn’t mean that anyone else does it the same way. If Guatemalans might mistakenly think that all Americans act just like they do on TV, we’re in danger of believing that all Guatemalans act just like they do on the internet.

UPDATE: And it turns out that a key piece of context was missed by the twitter stream and related commentary: the counter-protests for Colom that took place. These were reportedly of the same magnitude as the anti-Colom demomstrations, but they involved slum-dwellers and the rural poor, who don’t tweet.