End-to-end SaaS subscription data platform using AWS, Databricks (Delta Lake), and Snowflake featuring streaming ingestion, CDC/SCD modeling, medallion architecture, and Iceberg-based analytics.

Real-time IoT Machine Health Analytics pipeline built with Databricks Medallion Architecture (Bronze, Silver, Gold). Includes data ingestion, cleaning, data quality checks, time-series anomaly detection, and dashboarding using PySpark, Delta Lake, and Databricks Workflows.

Loading files into delta table warehouse

A LINQ query layer for ParquetSharp that can read entire Parquet datasets — not just single files. Supports Delta Lake tables, Hive partitions, predicate pushdown, and efficient column projection for high-performance .NET data processing.

Indian Data Club : Databricks 14-Days Challenge-2 is designed to help beginners build a strong foundation in Databricks through daily learning, hands-on practice, and problem solving.

A concise handbook covering Databricks architecture, Delta Lake, Unity Catalog, and data engineering best practices for building scalable and production-ready data pipelines.

Source code for the python package: delta-hybrid-scd