top of page
Search

Building an enterprise data warehouse at the IOPC: our journey

  • Writer: Rhys Hanscombe
    Rhys Hanscombe
  • Sep 5, 2023
  • 2 min read

At the 2023 Data Vault Conference, Alessia Pulieri (Business Intelligence Manager) shared the Independent Office for Police Conduct’s (IOPC) inspiring journey to modernize their data platform. If you missed it, here’s your friendly recap—and a reminder to join our forum to keep the conversation going!


Why Modernize? The Case for Data Vault

The IOPC faced the classic challenges of an outdated, outsourced data warehouse: overnight data load failures, slow release cycles, and difficulty accommodating legislative changes. The team explored solutions and found that Data Vault was the right fit—offering flexibility, reliability, and a path to a modern Enterprise Data Warehouse (EDW).


The A-Team Approach: Building for Success

  • One Team, One Culture: The IOPC built a collaborative team culture, emphasizing on-the-job training and shared goals.

  • Agile Ways of Working: Sprints, iterations, and a focus on communication, quality, and capacity kept the project moving forward.

  • Modern Tools: DevOps, a team wiki, and WhereScape enabled efficient development and knowledge sharing. [Alessia Pu...ur journey | PDF]


From Legacy to Enterprise: The Transformation

Before (Legacy Data Warehouse):

  • Overnight data load failures could take a day or more to resolve

  • New features took 4+ months to release

  • Legislative changes required 3 months to implement


Now (Enterprise Data Warehouse):

  • Overnight data load failures resolved in 2–3 hours

  • New features released in just 1 week

  • Legislative changes accommodated in 12 weeks


The team also tackled refactoring business rules, building new information marts, integrating additional data sources, and migrating data from legacy systems—all while supporting a new case management system and police data integration.


Key Takeaways

  • Start small, iterate, and communicate: One step at a time, with ongoing conversations and negotiations, leads to sustainable progress.

  • Empower your team: Invest in training and foster a culture of collaboration.

  • Leverage automation and agile tools: Modern platforms and DevOps practices accelerate delivery and improve quality.

  • Data Vault works: For organizations facing legacy constraints, Data Vault offers a proven path to a flexible, scalable EDW.


Join the Data Community!

  • Sign up to our forum: Share your experiences, ask questions, and connect with fellow data enthusiasts.

  • Stay up to date: We host regular webinars, workshops, and meetups—don’t miss out!

  • Shape the future: Your feedback and participation help us build better tools and resources for everyone.


Final Thoughts

The IOPC’s journey shows that with the right team, tools, and approach, you can transform even the most challenging legacy data environments. Ready to start your own data journey? Join the conversation, sign up for our next webinar, and let’s build the future of data together!

bottom of page