homeCrunching Data,Meshing Intelligence
Pipelines, platforms, & petabytes — engineered with care.
Recent updates
Waste Reduction Hub
Shipped a Streamlit app that turns messy retail operations data into clear waste signals — hotspots by stream, weekly trends, and downloadable summaries for the ops team.
Fuse and Forge
A Streamlit utility that fuses scattered CSV/Parquet drops into a single, typed dataset — schema inference, dedupe, and one-click export. Plus a playground for forging quick data prototypes: load a source, sketch transforms, preview lineage.
What I build
Pipelines & Orchestration
Airflow and Kedro pipelines, containerised with Docker for reproducible runs.
Lakehouse & Modeling
Databricks, Delta Lake, Unity Catalog governance, and dimensional data modeling.
Spark & Declarative ETL
Apache Spark transforms and declarative pipeline patterns for batch workloads.
MLOps
End-to-end MLflow tracking, model registry, and deployment workflows.
Streamlit Apps
Internal tools, dashboards, and data products shipped as Streamlit apps.
Data Platforms
Building meshpatato — a sandbox for modern data engineering patterns.
Python
PySpark
Databricks
Airflow
MLflow
Streamlit
Docker
Flask