Use case / Data Engineering
Multi-Portal Data Integration
Combine recurring downloads from several web portals into one governed reporting dataset.
Workflow
Typical process.
- 01Collect portal data
- 02Standardize fields
- 03Validate records
- 04Publish a unified dataset
Technology
Typical building blocks.
Bruin or Airflow
dbt
Reporting layer
Next step
Start a project