Bring on the #moron filter

tweet

The post I made a couple of days ago about Twitter’s coverage of the sustained terror assault on the city of Mumbai was by far the most viewed post we’ve made here. It obviously struck a chord. Bits of it ended up on CNN Asia.

In that post, I was responding to the social melee forming around the end of a dirty big fire-hose of re-tweeting, rumour and shocked reaction. The thing I felt most strongly about when the terror was actually unfolding second-by-bloody-second was the triumphal glee that some contributors were expressing that Twitter was ahead of the mainstream media in reporting ‘the event’. In some peoples’ minds the main event was the defeat of CNN by Twitter and the ‘victory’ of social media in general. It was pretty ridiculous even at that stage as a very large proportion of the total tweetage was actually reporting what was happening on television – and then the re-tweets with added conjecture that followed.

A very few people indulged in really ugly displays of aggression and hate and this has, sadly, continued.

Ugly

Sounds bad...

Yes, it does sound bad.

Some people say that this is just the way a real conversation works, you just put up with the noise and disparate views, but that’s nonsense. In meatspace you either walk away from the twats or you ask them to keep their voices down. In fact, the only conversations in any way ‘like’ the busiest period of the other night’s hashtag Mumbai event are shouty drunken lock-ins, the 11.45 booze-train burger queue at London Bridge Rail Station on a Thursday night, or a football riot. In any case, at that stage we weren’t looking for ‘conversation’ – it was precisely because Twitter was ahead of the curve and there was little ‘official’ information that we wanted to know so badly what was really going on. At that really critical early stage, working out what was happening was made much more difficult by these morons. It may sound elitist but, clearly, all views are not equal.

And this problem didn’t just affect rubber-necking news-junkies like me, it also made it more difficult to for those people who actually really needed to find emergency numbers, or ask for ask for blood donations. It must have been truly horrible if you were there trying to find out if a loved one was okay. The sheer volume of rubbish tweeting made it more difficult to find useful links. There were plenty of them, but maybe 6 out 10 tweets were just noise.

Sadly, it’s unlikely to be the last time Twitter is used in this way, and so I’ve been wondering if there are ways to introduce a filtered version of the next event-stream on a #Mumbai scale. I’m not suggesting replacing the #[insert event name] search stream – but offering an additional, optional stream that has been ‘filtered’ by a team of trusted curators. In a blog post he made yesterday JP Rangaswami (Confused of Calcutta) put it like this:

Sometimes I think about all this as a giant virtual switchboard manned by volunteers, willing and able to help. We should be thinking about how we can improve all this. How we can set up this virtual switchboard effectively. How we can help quash rumours. How we can take the load off the security and emergency services people.

What we need is a team of international storytellers who we can trust to draw it all together, to verify, tag and reference the best quality external sources, to mix these up with edits from the main #twitstream, and to orchestrate an over-arching ‘telling’ of the story within which we can remain as participants in some way, but with filters. To put it bluntly, you’d get better quality info with all the twats filtered out. Some of it could be automatic – anyone using upper case would be automatically removed to start with. :-)

Who could we trust to do this? People on Twitter with a certain level of reputation? People who have passed what would basically be a crowd-sourced audition? And what about brand-endorsed twitterers? Instead of childishly bashing CNN why don’t we all work together to create a global panel of ‘trusted twitterers’ with them – of people who have passed certain filters? Of course, even to think about doing that would require a new attitude to old media. We’ll have to get over the “CNN is so over, dude…” tendency. We must stop thinking that it’s necessary to continually demonstrate and celebrate the power of social media. And we need to be honest about how it needs to evolve and get better. I don’t feel as optimistic as JP does about the self-corrective power of the crowd. I’m not sure it’s good enough to say that because real-life crowds always result in Chinese whispers we should accept it as an inevitable fact of life on Twitter in all circumstances. Of course, it is inevitable – in the sense that we won’t change human nature – but we can use Twitter in many different ways, and one way to improve it for some specific circumstances would be to engineer a social editorial filter. Don’t we want Twitter to evolve, to mature, to become even better? What we use today is a very immature version of what all media might become – ever-present, real-time/near-real-time, personal, participatory. It can continue to be all of these things *and* we can make it better too.

The solution I’ve been pondering is deliberately technology-lite, and that’s because we need to come up with something now. I reckon you could probably do this using a Tumble-log – most of the effort would be involved in creating a network of trusted curators and agreeing some basic groundrules. Nevertheless, it would also be healthy to consider technological solutions. I found one service on the night that claims to have created an algorithm based on filtering contributions at the beginning of an ‘event’ (see below). I can’t work out how and I can’t see much evidence of it. Apologies if I’m missing something – can anyone tell me how it works? (It’s called Tweetip and you can find it here).

Tweetpic

And then there’s the The Dashboard of Doom: a horizontally scrolling mash-up of the leading Mumbai related #hashtags, Flickr-streams and Dipity timelines.

Dashboard of Doom

Please drop me a line to let me know what you think about ‘the next time’, and how we might clean the signal up a bit.

I’ll leave you with a selection of some of the more striking screen-grabs I’ve taken from the #Mumbai stream over the last few days. And cheers to my brother Ben, who helped out with this and the last post.

tweet

tweet

tweet

tweet

tweet

tweet

tweet

About the author

Tim has been creating innovative online community stuff since 2000 and was recently named as one of Revolution Magazine's 'Future 50' - one of the the "marketers, authors, entrepreneurs, and thinkers who will shape the digital industry of tomorrow". It also called him "disruptive and challenging". Tim is a founding partner of Made by Many, Agilist, strategist, Dad and designer of social software.

  • Comments (8)

    1. Very thought-provoking piece. On the night itself I badly wanted better filters, at first because I was trying to locate a friend in Mumbai; then later, once I knew he was safe, I just wanted to lose the mob. Eventually I switched off…it was overwhelming and only got worse.

      Yet the fact remains that Twitter is set up as a conversation, for anyone to join. The egalitarian in me does not want to see that change. Whilst a group of professional overseers may be the way to go, we risk losing what makes Twitter unique.

      Perhaps instead we need a simple, primary or secondary filter which is always used to denote ‘utility’ about any given subject? If it’s personal opinion or commentary, send your tweet elsewhere.

      I have (perhaps too much) faith in the ability of the crowd to moderate itself – we just need some rules to follow. As I scanned through 25-50+ Mumbai tweets a minute, it was hard to find and then keep up with the genuinely useful. As you say, the signal needed cleaning up. What if we had had a simple hashtag which separated out genuine information associated with the attack (covering how to obtain information about family & friends in the city to on-the-ground reports & calls for help, for example) from the chatter (sympathetic, bigoted or otherwise)? I would hope it would have been respected. A start, at least.

      If not, god help us… time to bring on the wikipedia-style moderators.

      Overall, it strikes me the topic raised here goes beyond Twitter and its relationship with the terrible events in Mumbai. It’s both the oldest and the newest of questions – can you, should you, try to control the crowd?

    2. Hi Tim,

      Our tumblr is a log of our work, mixed with markers, timelines, odd bits. It’s not a news source.

      Did you see the mumbai timeline we posted? It’s a snapshot of the very beginning of the event. We can’t show everything, but within that screen grab we feel the “trajectory” of the event can be forecast. But it’s not for folks who want all the details. That’s not what we’re aiming at.

      Our aim is within the screen grab we posted today – the Wordle Cloud on tweets we posted PRIOR to the 1st tweet within the mumbai event. We’re filtering & tagging the twitter firehose for pre-conscious connections which when combined provide a possible forecast of a major event. Not always bad, but that’s where our world is right now.

      Re your idea of worldwide storytellers – love it – so much so we began to code a desktop app called ‘TwitterProbe’ which would allow one to create their own filtering around events and then reblog/retweet as needed. This project is on hold for several reasons: 1) we need the twitter firehose which is not yet available publicly 2) we no longer have funding to support the program. Something may change in the future, but we’ve moved our focus to the forecasting.

      hth,

      Michael

    3. Completely agree 100%. There’s no doubt that Twitter could be used as an invaluable media tool, but there needs to be some major filtering and fact-finding to really make it stand out.

      Do we have a dedicated and recognized group of journalists or news centers delivering the Tweets? Is citizen reporting the answer?

      It’s hard to say what the answer is, and sadly until then it looks like we’re stuck with the chaff along with the wheat…

    4. Twitter is young, and the way it’s being used is constantly evolving. The #mumbai feed this week was a new stage in its evolution.

      As has been with Twitter’s use to date, I believe that users will determine how it’s used in the future. A peer reviewer system, when you have over 100 tweets a minute, will never work, and it also defeats the purpose and appeal of Twitter.

      For users, in Twitter’s present form, I believe the solution to avoiding all the comment noise is using more detailed searches, such as #mumbai and emergency, or #mumbia and emergency and phone.

      Unfortunately, I think you will see an increase in twitter feed spam and trolling. Dropping links into your web site within the busy #mumbai feed is a sure way to increase traffic to your web-site, and oddly, I only observed a little of it this week.

      Better feed search tools is the answer in my opinion. Twitter could promote subsections of #mumbai for example. Further empower the users, instead of installing regulators.

    5. Hi, Social Media has its boons and banes. Also, SM is not always Citizen Journalism so we shouldn’t expected the contributors to follow the norms and protocols of Journalism. Its just common people who have found a new tool to express their anger, frustration and joy. Yes, we do have trolls and stalkers here, but they are found in real life too and it would be too harsh to label them as #moron :)

    6. Hi Tim,

      Nice post and for one I am happy to see at least some people thinking on how to improve the system(Twitter here) rather than basking in the glory of self-proclaimed victory of Social Media over Conventional Media.

      I too had a tough time keeping track of relevant tweets on #mumbai and was quick to change to #taj for the want of selected(and less) tweets.

      About your proposal of having a selected group of people having more authority than other, I am not too sure if it will be possible/achievable. However an easier solution could be if some people start tagging new and useful information with a different tag #mumbainews or something.

    7. Interesting points on Bring on the #moron filter, On a related topic if i need to get data I use python for simple html extracting data, but for larger projects like documents, the web, or files i tried extracting data which worked great, they build quick custom web scrapers, extracting data, and data parsing programs

    8. This is a great post, Tim. Thank you.

      But I think you might be the filter already. You’ve presented a considered position focussing on a certain aspect of #mumbai in your post here. You filtered.

      Like other commenters has said, the idea of filtering Twitter seems dangerous. You can’t filter without censoring. And the most powerful aspects of Twitter are it’s speed and it’s openness. Any filtering would reduce this.

      I think there are two sides to this: media production and consumption.

      What needs to develop around it is a media ecosystem that fills the gap between Twitter and CNN (or the Guardian or the BBC).

      In Twitter we have the base level of unfiltered, unfounded conversation that is fast yet unreliable. I reckon that as blogging becomes faster and more common, we might end up with a middle-layer of media outlet that can filter Tweets, images and videos to create more considered thought-pieces fast. That could solve the production lag between Twitter and CNN, perhaps.

      And then to your point, which is more about consumption. We need tools that allow is to filter information better. The same way we choose our newspaper according to our bias. I think this will be a longtime coming but one can imagine a cross between Google Reader and a Twitter client that calculates your interests, biases and provides live filtering of all your streams. Cory Doctorow alludes to such things in Makers.

      Good post. I’ll follow it up at some point with a more considered POV.

  • Responses (4)

    1. Veckan som gick - vecka 48 at Same Same But Different

      [...] gjorde. Och Tim Moldon fortsätter att titta på baksidorna med Twitterrapporteringen och föreslår ett #moron-filter. Och kritiken som kommit handlar också om att Twitter inte är att lita på – en kritik som [...]

    2. links for 2008-12-01

      [...] Bring on the #moron filter on the need of establishing some human & automated filters; a kind of authority in the real-time diffusion of information. (tags: filter information twitter flux) [...]

    3. Crisis,Twitter and Noise

      [...] others have been pondering on various aspects of Citizen Journalism using Social Media tools and how could the noise be reduced from this [...]

    4. Twitter zur Krisenkommunikation? « Net Thoughts

      [...] eine größere Verlässlichkeit der Bürgerberichte in Ausnahmesituationen erreichen könnte. So überlegt etwa Tim Malbon, eine Twitter-Community in Zusammenarbeit mit CNN zu [...]

Leave a comment

Our latest tweets

Categories

Recent comments

  • James Higgs: At some level Kujau wanted the attention, and the same seems to be true of Manning if he is indeed t...
  • William Owen: Sara, you've asked lots of pertinent questions here but I think you’re really asking quite a lot of ...
  • Sara Williams: James, as much as I want to agree with you -- you are right a very good percentage of the time -- th...
  • James Higgs: There is a certain logic to this: people are unlikely to go through a great deal of effo...
  • Tim Malbon: I think we should remember that we are in Afghanistan because its leaders allowed it to be used as a...