Healthcare Data Engineering Pipeline
Local open lakehouse pipeline processing synthetic Synthea patient records via two ingestion paths — structured CSV and FHIR R4. Airflow orchestrates staging to MinIO, ingestion into Apache Iceberg via Trino and Apache Polaris (REST catalog), and dbt transformations producing a clinical mart. A Streamlit dashboard serves KPIs directly over Trino.