Last modified: 21 January 2016
"Know your enemy" they say. And so there I was, speaking at the BBC, in London: the belly of the beast.
Except the BBC aren't my enemy. I like them and I pay my license fee without too much fuss. The BBC is like the NHS: massively over-worshipped as a Great British institution and in continual need of challenge and reform. But ultimately it is a force for good that we should keep.
What the BBC aren't yet good at is open data.
Kenn Cukier of The Economist told us about his audience, how they discover and share content, how long they read what type of article, and which formats and apps drive what type of engagement. If I'd have asked him where his readers lived or how old they were I'm sure he'd have told me. In his single talk he shared more understanding of his audience than I heard from the sum of all the speakers from the BBC.
I want that knowledge from the BBC. My talk posed the same challenges directly to the Beeb that you'll have heard me bang on about on twitter.
I know the BBC has the data because I saw it. I heard no good reason why most of it couldn't be published as open data right now. The event made clear to me that getting open data right would strengthen not weaken the BBC's case for continued existence. So what's stopping progress?
The problem certainly isn't a lack of talent or understanding. The BBC has that. Chris Cook at Newsnight is one of the UK's top data journalists and I'm sure he's nearly as frustrated as me that the BBC is not setting a better example to the government departments he hounds for data almost every day.
I suspect that the problem is the same question that I've confronted in local governments across the country. "What do you want to do with it?" My honest answer is that I don't know but I'm almost certain that what people will do with your data is more positive than you fear. It will definitely be less negative than the worst of what people are imagining now in the absence of that data.
But I know that saying "I don't know" isn't enough and I know that examples help. So here are three really bad examples. Give thousands of clever people access to the data and you'll soon get hundreds of better ones.
As I said, these are bad examples. But if they're what I can come up with on the 8pm train to Wolverhampton after an early start just think what's possible!
Overall I had a great day. Broadcasting House is much smaller and much less intimidating once you're there. The realisation that W1A is closer to a documentary than a comedy makes the place feel much more welcoming. And some of the products that BBC R&D have developed are brilliant. Atomised news and the Home Front story explorer are especially beautiful implementations of great ideas.