Enterprise Data Lake for a State Transportation Department

A state department of transportation set out to become a more data-driven organization and modernize how its data is stored and accessed. Doing that required both a strategic foundation and sustained execution across years of investment.

Triverus partnered with the department to move from a data strategy roadmap to a live Enterprise Data Lake — a governed source of truth for the divisions and partner agencies whose decisions affect transportation safety, infrastructure investment, and how residents move across the state.

Challenges

The department's divisions, partner agencies, and external vendors each held critical data in separate systems. The volume and diversity of that data made it difficult to access and inconsistent to work with:

• Large-scale, high-diversity data siloed across more than 17 source systems

• Inconsistent approaches to how data was stored, secured, and accessed

• No shared analytics foundation across divisions and partner agencies

• A need for cloud architecture that met statewide security and infrastructure standards

How We Helped

Triverus provided the strategy, architecture, and engineering to stand up the Enterprise Data Lake and keep extending it:

• Architecture and design. Guidance for the lake across Snowflake, AWS, Informatica, Azure, SQL Server, and Azure Data Factory.

• Data pipelines. Designed, implemented, and tested ETL pipelines in Azure Data Factory, built to the data lake architecture and approved design patterns.

• Cloud services and standards. Configured the underlying cloud services with the state's central cloud architecture team, applying Infrastructure as Code and DevOps to statewide standards.

• Ingest and transform. Ingested, cleaned, and transformed data from 17+ source systems into governed, reusable datasets analysts could access quickly.

• Multi-agency analytics. Expanded analytics and dashboards to serve divisions and partner agencies.

Results

• An Enterprise Data Lake of 170+ tables and 3,879+ governed columns from 17+ integrated data sources

• 60+ dashboard sets served from the Enterprise Data Lake

• The primary data source behind the IT operations dashboard — workload, staffing, and time-to-close

• Powered a major tunnel-closure dashboard used by 70+ people across the department and partner agencies

• Statewide vehicle census analytics used across agencies

Capabilities and Technology

• Capabilities. Enterprise data strategy and roadmap, data architecture and engineering, data lake design and implementation, data governance and CDO enablement, business intelligence and analytics

• Technology. Snowflake, AWS, Microsoft Azure (including Azure Data Factory), Informatica, SQL Server, Power BI

‍