#hhldn: Miso project & Renew interactive rubbish bins


#hhldn: Miso project & Renew bins

A brief roundup of tweets from May’s Hacks and Hackers London meetup, which featured talks on the Miso project and Renew interactive rubbish bins. First up: Alastair Dant and Alex Graul presenting the Miso project, a set of code libraries to help people build their own data visualisations.

Storified by Mary Hamilton · Wed, May 30 2012 05:09:55

at #HHLdn, @ajdant & @AlexGraul presenting @TheMisoProject http://misoproject.comLaurian Gridinoc
#hhldn @ajdant & @alexgraul talking about @themisoproject & journalism in the age of data.Mary Hamilton
#hhldn @ajdant: ManyEyes was an early visualisation tool but has petered out somewhat – partly coz it’s Java, partly IBM not developing itMary Hamilton
#hhldn @ajdant: Google Charts was useful, but Google pulled the plug. Swivel was visualisation startup but shut down coz couldn’t make moneyMary Hamilton
Two years ago, newsrooms relied on flash (not html5) says presenter at #hhldn.Elana Zak
#hhldn @ajdant: Flash vs HTML5: Flash no longer seen as futureproof so databiz has moved to web standards. Takes longer, much more testing.Mary Hamilton
#hhldn @ajdant: strong dataviz contenders: Google public data explorer, powered by Fusion tables; Tableau (needs sophisticated authoring)Mary Hamilton
.@ajdant and @AlexGraul taking us through the past and future of digital data visualisation at #hhldn http://instagr.am/p/K-pnR7wF31/Peter MacRobert
#hhldn @ajdant: now, open source software has exploded & experiments are everywhere. People are committing to sharing their work.Mary Hamilton
#hhldn @ajdant: there is no magic dataviz bullet. Don’t want to do churnalistic thing of pulling out the same interactives over & over.Mary Hamilton
#hhldn @ajdant: customisation is awesome. So is combination. Lots of dataviz platforms fall down through lack of interoperation.Mary Hamilton
#hhldn @ajdant: we took the idea of 2012 as #codeyear & started to build JavaScript libraries for dataviz. Led to @themisoprojectMary Hamilton
#hhldn @ajdant: We put emphasis on libraries rather than a magic "visualise this!" button.Mary Hamilton
#hhldn @alexgraul: Miso is aimed at making it easier to make stuff, not a magic button. Also not just a way to make Guardian stuff.Mary Hamilton
#hhldn @alexgraul: aim is to make interactive & data-driven storytelling faster, richer & better.Mary Hamilton
#hhldn @alexgraul: To make combined timeline/map with key (eg mapping IED attacks) work you need data management & component management.Mary Hamilton
#hhldn @alexgraul: You need flow in order to express a narrative, & you need state management.Mary Hamilton
#hhldn @alexgraul: 3 layers, all operating sensibly together. Like a prefab structure. Lets you focus on what you’re doing rather than how.Mary Hamilton
#hhldn @alexgraul: Making reusable structures for code means barrier to entry much lower; as people learn they can customise.Mary Hamilton
#hhldn @ajdant on mobile: no good just reflowing interactives onto small screens. @alexgraul: sometimes on mobile you need different contentMary Hamilton
More on Miso: http://www.journalism.co.uk/a548892 Ignore the fact it says ‘guardian-style’. Corrected by @alexgraul at #hhldnSarahMarshall3
#hhldn http://instagr.am/p/K-r9X4qKjY/kevt
The second speakers were from Renew, which created a new display system for the sides of rubbish bins in London, and then started inviting publishers to futz around with it and make things.
More details here about the Renew Media Pods (bins) http://renewsolution.com/ #hhldnKathryn Corrick
#hhldn Renew: won 21-year contract to supply London with the world’s most expensive bins.Mary Hamilton
#hhldn Renew: wanted to put web pages on the street. People have been using public space to communicate for years, but only one way in past.Mary Hamilton
#hhldn Renew: we have a lot of reach. Brands want us to put ads there: we want to try putting content there.Mary Hamilton
#hhldn Renew: 8 days after we launched our CMS supplier went bankrupt. We had to either buy it ourselves or kill it.Mary Hamilton
#hhldn Renew: took 96 hours for geek squad to kill everything we’d spent 18 months making & put it in browser. Realised we’d built a channelMary Hamilton
.@Economist and @TimeOutLondon working with renew to bring news to screens on bins in London c/o City of London #HHLdnHannah RW
#hhldn Renew: "Content is digital bait." Got writers. Writing stories in 1/3 length of tweets wi big pics: new format. 2-4 second news.Mary Hamilton
#hhldn Renew: publishers started to show interest. We realised we could remove ourselves as bottleneck & see what else can be done.Mary Hamilton
#hhldn Renew: it’s not TV, no direction. Not digital as you’d have at home. Consumed while walking past.Mary Hamilton
#hhldn Renew: challenges: fight screen blindness & default assumption it’s an ad; use pods to inform/entertain/interact.Mary Hamilton
#hhldn Renew: started opening up platform for devs. Made SDK. Held hackathon. Had parallel hackathon next door trying to make SDK work.Mary Hamilton
#hhldn Renew: example apps: Boris bike availability app; weather; markets; made tiny crossword (1 up, 1 down) with News Int.Mary Hamilton
#hhldn Renew: held local data hackathon. "Are You Hungry?" with Yelp gives directions to nearby restaurants. 4sq made "be the first at" app.Mary Hamilton
#hhldn Renew: Closed Captioned team: mining for local tweets, made hashtag survey app.Mary Hamilton
#hhldn Renew: "Dodge them or join them" tells you where people are & lets you dodge crowds. http://pic.twitter.com/qbKjDl3fMary Hamilton
Like the idea of screen on a bin saying ‘most people are over there’ –> based on @foursquare checkins locations. @renewtweets at #HHLdnHannah RW
#hhldn Aha! Renew are @renewtweet.Mary Hamilton
Ah so that’s what that LCD bin by St. Pauls is. #HHLdn #mysterysolvedsamthetechie
#hhldn @RenewTweet: this is a model that works for breaking news. Gives example of Greek bailout.Mary Hamilton
#hhldn @RenewTweet: focussing on financial centres. 1 in Manhattan outside NYSE: police got worried coz their robot couldn’t look inside.Mary Hamilton
Q&A of @renewtweet people right now at #hhldn. Really interesting stuff. http://twitpic.com/9og8mxPablo M. Fernández
#hhldn @RenewTweet: there’s potential for brand tie-in but we want to avoid "buy this thing now" because it turns people off.Mary Hamilton
#hhldn @RenewTweet: v difficult to make audience do anything they wouldn’t already do. Hence have to build content that’s passive & fast.Mary Hamilton
#hhldn More info about the binpodscreenthings at http://bit.ly/KbaDsQMary Hamilton

Rewiring the state

Last year I reported on Young Rewired State, when a group of committed and amazingly talented youngsters descended on Neontribe‘s offices for three days of making stuff. (The report’s not online because at the time the EDP’s CMS automatically took everything offline after two months; no, I still don’t know why they thought that was a good idea.) I remember being stunned by the results and by the people involved – the energy, the excitement, and the apps they made.

On Saturday, I went up to Neontribe’s new offices in Norwich along with 14 others to be part of the first regional Rewired State hack day – but as a developer, not a hack. (For the record: I’m no dev, I just mash things together and swear at them till they more-or-less work in a cargo-cult sort of way.) I got to work with three brilliant young people – Callum, Isabell (@issyIO) and Ben. They were all way ahead of me – I can’t wait to see what they make in the future.

The aim of the day was to use local government data to make apps. We started out with a computer each, a list of data sources, a whiteboard full of ideas and a lot of very tasty food (seriously, the catering was amazing). Oh, and 8 hours to go before we presented our work to a room full of local dignitaries. So no pressure.

The team I was working with decided to create Kebab Hunter, an app that mashed together reviews of local takeaway joints with hygiene data from Norwich City Council, then plotted them on an augmented reality Layar that could be viewed on your smartphone. The result was an app you could use to quickly find a nearby takeout that not only serves tasty food but also won’t make you ill. The bits I did were mostly to do with finding, cleaning and mashing data together (I’m indebted to @psychemedia for this timely post). Most of the time (well, when not eating the delicious cake, anyway) I had my head down, so it wasn’t really until the very end that I got to see what other people had been working on.

For me, with my very limited hodge-podge set of skills, the day was exhilarating. The time limit gave it a focus and a sense of urgency, and working alongside such a talented group of people was a pleasure and a privilege – and a very fast and efficient way of learning. I felt like my brain had gone through a wringer at the end of it, but in a very good way. And we had some awesome things to show for the effort.

Here’s what we made (I’ll add links to this list if I can find them, and if there are any mistakes let me know – I didn’t catch everyone’s name):

  • Where does Norfolk’s money go? A map of Norfolk council spending – Sym Roe
  • Bin Posse. Reminders of what goes out when by SMS – Rupert Redington
  • AV findings. Where voted “Yes”, and what were they like? (Apparently Yes to AV is strongly correlated with museum visits) – Chris Heath and Katja Mordaunt
  • Bridge Headroom. How much space is there under Potter Heigham bridge? – Michael Holness
  • Words about Norfolk. What words does Wikipedia link to Norfolk? – Rob Young
  • Festival timeline. The Norfolk and Norwich Festival lineup, displayed to investigate – Harry Harrold
  • Hey Chief! A humourous look at the value for money of Norfolk Fire Service. (Norwich has a lot of cat-related incidents, we learned) – Peter Chamberlin, Heydon Pickering, Michael Holness
  • Kebab Hunter. Augments a phone camera’s eye view of Norwich, with takeaway food safety info and reviews – Callum Weaver, Mary Hamilton, Ben Holloway and Isabell Long.

At the end of the day we presented our creations to local politicians, council staff and each other in the Octagon Chapel, a beautiful and oddly stately venue for such a high-tech day. I hope the folks who saw what we made see what’s possible when you get interested, creative people with l33t skills in a room with their data.

Afterwards, people were talking about the power of open data – its scariness, the fact that transparency can’t be done half-heartedly, the fact it can’t be controlled, but also the freedom to experiment and the excitement of possibility. And the need for devs, designers, interpreters and even journalists to bridge the gap between spreadsheets and stories, between data and people. Those were good conversations, and I hope a lot more comes out of this event.

Very, very good day.

Edited to add: @harryharrold has collected the whole day as it happened. Includes geese.

JEEcamp thoughts on data journalism

Information VisualizationI spent some time talking to Martin Belam (@currybet) about data journalism and the importance (or otherwise) of journalists learning to code.

He said, as he’s said before, that it’s more important for journalists to know whether something is or isn’t possible than for us to necessarily be able to do it ourselves.

And for working journalists whose day to day job doesn’t carry a coding requirement already – and particularly those of us who are lucky enough to be in a workplace where there are developers or programmers who can take our ideas and make them flesh (ie. not me), he’s almost certainly right.

Those skills are becoming more and more important. With the birth of data.gov.uk and the increasingly open approach to information that the new coalition government is likely to take, sifting and analysing data to find the stories is going to be a vital skill for a lot of journalists.

We need to know our way around a spreadsheet. We need to be able to spot patterns in data and understand not only what they mean but also how we can use them to reveal stories that are not only relevant but useful.

We need to know where our skills can get us. We need to know our capabilities and our limits – and, crucially, we must be aware of what we don’t know. That’s not just knowing that there are holes in our knowledge, but knowing the shape of those holes so that we can try to get our problems a little closer to a solution.

Journalism is about asking the right questions. We research stories before we interview subjects so that we can ask pertinent questions whose answers will illuminate the subject. We need to be able to do the same thing with our data – we need to know what questions to ask and how, so that even if we can’t make the tools ourselves we can hand over the task to someone else without asking the impossible or wasting their time.

But most of the time, certainly for journalists on regional papers and I would wager for many in other areas, those people who know how to make the tools just don’t exist. I have friends who code, but I can’t ask them for a favour every time I want to create a news app, or diff two versions of a stack of documents, or visualise a complex dataset, or tell the story of 100 people’s losses from an investment fund going bust in a way that conveys both the scale and the humanity of the problem.

Regional journalists work on hundreds of stories that could be made vastly easier or more beautiful or more accessible through a touch of computer work (spreadsheets, maps, things that aren’t quite coding but sort of almost are and look like it to the untrained eye). A few of us can create those additions; the rest just write the story, and our papers and websites are poorer for it.

We work on a few stories – and the number is increasing – that are perfect for news apps, web coding, multimedia packages or other more complex solutions that very, very few of us can create. But no one else will do it for us.

On top of that many of us struggle with inflexible content management systems that penalise or make it literally impossible to display data-driven work online. Faced with that problem, some budding computer-assisted-reporters give up before they’ve even started.

So I’m not going to stop learning Python. It’s not a complete solution to the problem – for that we need real, systemic change so that the businesses we work for all value data work, understand its increasing relevance, reflect on current practice and support training journalists to do an evolving job.

But for me, it means that in the future I might be able to create better stories, automate processes within series or campaigns or multiple follow-up stories, make my job easier and make a better experience for the reader all at the same time.

At least, until we all have newsroom developers.