Hi, I’m
Kishan Pandya
Berlin
Summary
Senior Data Engineer with 11 years of experience building scalable data platforms, backend services, and cloud-native infrastructure. Skilled in Go, Python, SQL, Kubernetes, and AWS/Snowflake/Redshift with expertise in ETL pipelines, APIs, and large-scale data workflows. Recently built an A&R analytics dashboard that improved talent discovery efficiency using BigQuery, Airflow, and predictive modeling. Strong focus on data modeling, performance tuning, and end-to-end ownership from design to production.
Overview
11
years of professional experience
Work History
SoundCloud
Data Engineer
02.2025 - Current
Job overview
- Built data pipelines and dashboards to support music talent discovery, using BigQuery, Python, and Airflow.
- Collaborated with data scientists on predictive modeling and leveraged Kubernetes and Docker to manage large-scale workflows.
ZendeskBangalore, Karnataka
Senior Data Engineer
04.2022 - 01.2025
Job overview
- Designed and developed scalable backend services for datastore management using Go, Kubernetes APIs, and ReactJS, improving datastore operations efficiency by 40%.
- Architected and operated Snowflake and MySQL data stores, supporting thousands of internal users with secure and reliable data access.
- Built automated data migration pipelines in Python that enabled 200+ enterprise customers to migrate support data with zero downtime.
- Owned services end-to-end, from schema design to production monitoring.
- Collaborated with cross-functional teams to deliver developer tools for datastore operations.
Amazon Development Centre
Data Engineer
04.2020 - 04.2022
Job overview
- Engineered ETL pipelines and large-scale workflows using Spark SQL, Scala, and AWS EMR, processing petabyte-scale datasets across 10+ countries.
- Optimized Amazon Redshift clusters, reducing average query runtime by 45% and lowering compute costs by 20%.
- Automated supply chain ML infrastructure using AWS Lambda, Step Functions, and SageMaker, cutting model deployment time from days to hours.
- Managed PB-scale structured and semi-structured data in S3, DynamoDB, and Glue, enabling global reporting and analytics.
- Developed a visualization tool (React + Lambda) to represent SQL query execution and joins graphically, adopted by 100+ analysts and engineers, improving query debugging efficiency.
Legato Healthcare Technology
Senior Software Engineer
08.2019 - 03.2020
Job overview
- Developed PL/SQL scripts and contributed to documentation for Anthem health care systems.
- Developed databases, programs and processes for integration and implementation across enterprise.
Appirio, A Wipro Company
Data Consultant
06.2018 - 08.2019
Job overview
- Executed MS SQL script-writing for data migration from various databases to Salesforce.
- Gained expertise in Data Migration, ETL Techniques, and Salesforce data modeling.
- Gained complete knowledge of salesforce admin and salesforce data model.
Tata Consultancy Services
System Engineer
11.2014 - 06.2018
Job overview
- Crafted PL/SQL procedures for various client reports and direct client demand data warehousing.
- Specialized in data warehouse concepts and logical/physical data modeling techniques.
Education
Rajasthan Technical University - Geetanjali Institute of Technical StudiesUdaipur, India
B.Tech.
05.2014
Skills
- SQL Snowflake Big Query Kubernetes Python Go Lang
- AWS Ecosystem: S3 EC2 Redshift Lambda EMR Glue DynamoDB
- Big Data Tools: Apache Spark Hadoop Kafka Hudi
- Database Management: SQL PL/SQL MS SQL Redshift Administration No SQL
- Languages: Scala Reactjs JavaScript
LANGUAGES
English, Hindi, Gujarati
Awards
Received the 'Pat on the Back' monthly recognition award at Wipro., Nominated for 'Debutant of the Year' for outstanding performance.
Timeline
Data Engineer
SoundCloud
02.2025 - Current
Senior Data Engineer
Zendesk
04.2022 - 01.2025
Data Engineer
Amazon Development Centre
04.2020 - 04.2022
Senior Software Engineer
Legato Healthcare Technology
08.2019 - 03.2020
Data Consultant
Appirio, A Wipro Company
06.2018 - 08.2019
System Engineer
Tata Consultancy Services
11.2014 - 06.2018
Rajasthan Technical University - Geetanjali Institute of Technical Studies
B.Tech.
Similar Profiles
Jenna GrahamJenna Graham
Executive Assistant to CEO and President at SoundCloudExecutive Assistant to CEO and President at SoundCloud
Nashelle DacostaNashelle Dacosta
Songwriter at SoundCloudSongwriter at SoundCloud
Tommy WakefieldTommy Wakefield
Electronic Music Producer at SoundCloudElectronic Music Producer at SoundCloud
Marian CalixMarian Calix
Delegate Relations Manager at Smart Bridges GmbhDelegate Relations Manager at Smart Bridges Gmbh
Christian RamsbeckChristian Ramsbeck
Commercial Bid Manager Rail Infrastructure at Siemens Mobility GmbHCommercial Bid Manager Rail Infrastructure at Siemens Mobility GmbH