Pinned Loading

1. DBT-Medallion-Pipeline DBT-Medallion-Pipeline Public

   Medallion (Bronze/Silver/Gold) data pipeline MongoDB → PostgreSQL, transformed with dbt, extracted via PySpark, orchestrated with Airflow.

   Python 1 1

2. Banking-Iceberg-Lakehouse Banking-Iceberg-Lakehouse Public

   End-to-end banking data pipeline: **MongoDB → Iceberg Bronze/Silver/Gold → PostgreSQL → Streamlit**, built with PySpark, Scala, Docker, dbt, and Airflow, with data quality checks and monitoring.

   Python

3. Bike-Store-Relational-Database Bike-Store-Relational-Database Public

   PySpark incremental ETL pipeline from MongoDB to PostgreSQL, with automated data quality validation, schema evolution, upserts, analytics, and production-style monitoring.

   Python

4. Logistics-Medallion-Pipeline Logistics-Medallion-Pipeline Public

   Portfolio-grade end-to-end logistics ETL pipeline using MongoDB, PostgreSQL, and Databricks with a Bronze–Silver–Gold architecture, orchestrated by Airflow and containerized with Docker.

   Python

5. pathway pathway Public

   Forked from pathwaycom/pathway

   Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

   Python

6. Data-Modelling Data-Modelling Public

   Kimball-style PostgreSQL warehouse with MongoDB source, 5 dimensions, 5 fact tables, and catalog-driven PL/pgSQL data quality checks.

   Python