Akash Ganguly
Senior Data Engineer
Berlin
Summary
Senior Data Engineer with 9+ years building end-to-end data products on AWS, Databricks, Snowflake, and BigQuery. Expert in Spark, dbt, Airflow, and Kafka with deep experience in digital analytics (GA4, Snowplow) and warehouse modeling (Kimball, Data Vault). Delivers operational data assets under SLAs via data contracts, driving P1 reliability, stakeholder alignment, and squad delivery through OKRs and mentoring. Side interest in Node.js and AdonisJS web apps expands technical breadth.
Overview
9
9
years of professional experience
Work History
Senior Data Engineer
HelloFresh
01.2024 - Current
- Owned critical operational data assets ensuring SLAs and schema stability for P1 datasets consumed by BI and analytics.
- Standardized ELT with dbt on Databricks/EMR, reducing breakage and accelerating developer throughput.
- Applied Kimball & Data Vault methodologies, implementing CDC patterns aligned with product SLAs.
- Leveraged AI tools and MCPs to draft specs, generate tests, validate data contracts, reducing documentation drift.
- Built Grafana observability dashboards, enabling proactive incident mitigation and cost dashboards to control expenses.
- Managed containerized workloads (Docker, Kubernetes), optimizing cost and runtime efficiencies.
- Led squad OKRs, sprint ceremonies, mentoring, and stakeholder forums for P1 assets.
Senior Data Engineer
ConcertAI
08.2021 - 01.2022
- Delivered AWS Glue PySpark pipelines with Glue Catalog integration, automating schema discovery and table refreshes.
Consultant
Capgemini
11.2018 - 08.2021
- Built Spark pipelines analyzing weather & power grid data for US regions, aiding proactive grid stability.
- Developed microservices APIs for weather-driven data, supporting operational planning & risk management.
- Implemented CI/CD with Jenkins, containerized deployments; built stakeholder dashboards; supported PostgreSQL and Cassandra modeling.
System Engineer
Tata Consultancy Services
11.2016 - 11.2018
- Developed Java Spark applications to process MongoDB-stored sales invoices with ETL workflows for GST compliance.
- Built AngularJS frontends for GST return filing and compliance dashboards.
- Managed Kafka flows and data storage on MongoDB/PostgreSQL for backend robustness.
Education
B.Tech - Electronics & Communication Engineering
RCC Institute of Information Technology
01.2016
Skills
Apache Spark (PySpark/SQL), dbt, Airflow
Certification
Apache Spark
Interests
Sports (badminton, table tennis, cricket, gym), photography (multiple awards), reading, cooking
Publications
How dbt Helped Us Solve Governance Around BigQuery Scheduled Query at HelloFresh — Medium, 2025
Tools & Technologies
Spark, PySpark, dbt, Airflow, AWS Glue, EMR, S3, Snowflake, Databricks, BigQuery, Hive/Impala, Kafka, Docker, Kubernetes, Flask, Spring Boot, PostgreSQL, MySQL, MongoDB, Cassandra, Node.js, AdonisJS
Accomplishments
Awarded at HelloFresh for best technical writing and planning in 2023
Awarded best overall achiever at HelloFresh in 2024
Timeline
Senior Data Engineer
HelloFresh
01.2024 - Current
Senior Data Engineer
ConcertAI
08.2021 - 01.2022
Consultant
Capgemini
11.2018 - 08.2021
System Engineer
Tata Consultancy Services
11.2016 - 11.2018
B.Tech - Electronics & Communication Engineering
RCC Institute of Information Technology