The BBC, being an historic company, have a lot of legacy data. They wanted to house this data together, and have sufficient metadata for searching, linking and enriching their existing data sets.

The project brief: Investigate the use of a data warehouse and metric store for enriching existing data sets. Complete a proof-of-concept implementation of this metric store, and investigate how to integrate with a specific piece of legacy BBC software.

The implementation: LinkedIn’s Datahub as a metric store, linked to multiple BBC data streams, as well as a paper describing how to integrate with BBC’s existing legacy software via kafka and API endpoints.

The outcome: A metric store that proved so successful it went from proof-of-concept to production system in record time, as well as a paper discovering not one but three methods of integrating with BBC’s existing legacy software.