Maine Health Data Warehouse
Maine
Opportunity
Working with the Maine Health Data Organization (MHDO) and our partner NORC at the University of Chicago, we helped design and build a state-of-the-art data submission system and data warehouse for Maine’s all-payer claims and hospital encounter data. We’ve also been assisting MHDO to produce timely data releases and ad hoc analysis to support state and legislative initiatives.
Approach
Secure and highly configurable data intake and warehouse solutions
Since 2003, the MHDO has been collecting health care claims data by mandate of the state legislature. In 2012, MHDO sought to rebuild its warehousing functions to take better advantage of newer technologies and improve customer service, and contracted with HSRI and NORC to make it happen. Together, and with input from a variety of constituents, we redesigned the state’s system to collect and house health care claims data, hospital encounter data, and hospital quality data.
HSRI led the project, performing project management and quality assurance functions in addition to developing web platforms and user interfaces for the system. NORC oversees the core engineering and maintenance of the warehouse infrastructure and hosts the system on its secure Data Enclave.
Achieving efficiencies
The system we developed provides an ETL platform that helps reduce the burden on data submitters by providing timely data quality feedback and by automating the secure file transfer process. This system is easily configurable via a convenient web portal, reducing the need for costly system updates to accommodate future changes (e.g., state legislative rule changes). Reporting capabilities are made accessible to data submitters, MHDO staff, and other authorized users via a secure web portal. The system makes use of cloud technologies to provide a robust, scalable, and highly secure data platform capable of handling high volumes of data and achieving high levels of availability.
Collaborating to produce a sustainable system
To develop a system that could sustain itself, we needed to make sure it would provide vital healthcare data to a diverse range of interested audiences—not only policymakers but also health care industry players, independent researchers, consumer advocacy groups and others. To do this, we convened several stakeholder groups to identify important system elements and outputs.
- Payers and hospitals participated in the APCD and hospital encounter database development process
- Key stakeholders weighed in on data submission and validation quality rules
We also sought to make all processes, rules, and methods transparent and explicitly define these on the MHDO website.
Supporting data release and reporting
Recently, data from the APCD and hospital encounter data systems have been used in several initiatives to improve the health and health systems for Maine residents, providing:
- Information on opioid treatment in the state for Maine’s Opioid Task Force
- Data to support the annual Maine KIDS COUNT Data Book, Maine’s comprehensive report of the physical, social, economic and educational well-being of Maine children
- Details on the costs of surgical procedures across hospitals in Maine for the legislature
Impact
Health data warehouses can be valuable tools, but developing and implementing them so they are useful for population health research presents a host of technical challenges. As health researchers, we work to build technical solutions that overcome these challenges, producing rich, timely data on meaningful measures.
Working with our project partners and seeking input from data submitters and end users, we redesigned the Maine APCD, submission portals, and data warehouse for hospital data to produce more timely and higher-quality data.