Real-World Data Engineering Workflow with Shruti Bharat

Tutorials teach tools. This session shows how they fit together.

I walk you through an end-to-end Databricks pipeline that I built as a hackathon project using production patterns. It brings together three data sources, cleans and joins them, and ends in a dashboard.

What we cover

1. How raw data is ingested and kept as it arrived (Bronze)
2. How it’s cleaned, deduplicated and validated (Silver)
3. How it’s combined into business-ready tables (Gold)
4. How the pipeline is orchestrated, and where pipelines usually break
5. Time for your questions

Good for: beginners and learners who know some SQL or Python and want to see how the pieces connect.

Please note: This is a project walkthrough, not a company system. No confidential or employer data is shown.