Project in the context of Data Engineering self-learning
Discover an Azure Function App powered by C# and .NET, seamlessly processing Azure Service Bus messages, storing data in Azure Data Lake, with Dead Letter Queue support
Microsoft Fabric based Bing News live Data Stream Ingestion and Sentiment Analysis
Comprehensive data engineering solution using Azure platform tools such as Data Factory and Databricks, completed with analysis and dashboard in Power BI.
Data ingestion and transformation pipeline for AirBnB using Azure Data Factory, Synapse, CosmosDB, and ADLS for automated CDC and analytical reporting.
An automated Bronze → Silver → Gold ETL pipeline for ATP tennis data. Built with Databricks, PySpark, and Delta Lake. Features data quality checks, partitioning, and analytics-ready Fact/Dimension tables.
Data Migration with Azure Synapse, PySpark, and Delta Tables
Azure-first medallion lakehouse for NYC 311 service request analytics using ADF, ADLS Gen2, Databricks, PySpark, Delta Lake, data quality checks, dimensional modeling, and reporting marts.
Add a description, image, and links to the azure-data-lake-storage topic page so that developers can more easily learn about it.
To associate your repository with the azure-data-lake-storage topic, visit your repo's landing page and select "manage topics."