Asim Ahmad

Project : Lufthansa Airline

Visa Type : ICT

Experience Summary:

• Implemented Azure Data Lake Gen2 as storage layer for Azure Delta Lake, leveraging its ACID transactions and data versioning capabilities.
• Developed end-to-end data integration pipelines using Azure Data Factory, orchestrating extraction, transformation, and loading (ETL) of data from diverse sources into target destinations.
• Implemented data quality and validation checks within Azure Data Factory pipelines to ensure accuracy, completeness, and consistency of data processed through ETL workflows.
• Developed end-to-end data processing pipelines using Azure Databricks, leveraging PySpark for distributed data processing and analysis.
• Utilized PySpark dataframe to perform data manipulation, transformation, and aggregation tasks on large-scale datasets stored in Azure Data Lake Storage.
• Implemented data wrangling techniques using Pandas dataframe and Series objects to handle missing values, outliers, and inconsistencies in data, ensuring data quality and integrity
• Experienced in ingesting google bigquery data into ADLS gen2.
• Developed Databricks notebook to load data from Sharepoint to Azure Data Lake and derive KPIs for Tableau.
• Designed and implemented end-to-end data processing pipelines using Azure Synapse Analytics, incorporating data ingestion, transformation, and serving layers.
• Leveraged serverless SQL pools for ad-hoc querying and dedicated SQL pools to support mission-critical workloads, to define data modeling standards and best practices, ensuring high performance and scalability for complex analytical queries.
• Developed Stream Analytics queries using SQL-like syntax to filter, aggregate by windowing functions, and enrich streaming data, ensuring accurate and timely analysis.
• Leveraged Azure Stream Analytics output adapters to deliver processed data to downstream systems, such as Azure SQL Database, and Power BI.
• Developed data pipeline with both sensitive and non sensitive data and stored them into appropriate containers.
• Experienced in Python and its coding standard with PEP 8 and also used pandas library for data processing.
• Integrated Azure Purview with various data sources including Azure SQL Database, Azure Data Lake Storage, and on-premises data repositories to ingest metadata and lineage information.
• Implemented data retention policies and archival strategies to manage data lifecycle effectively.
• Worked on Hadoop to Azure migration project.

Project: Belgium Banking Project

Experience Summary:

• Writing spark jobs for data consumption from HDFS and transform it as per requirement and then ingesting into different tenant of HDFS.
• Worked with structured data of 10 GB daily with replication factor 3.
• Implemented Sqoop jobs for large sets of structured data migration between HDFS and other data storage like Hive or RDBMS.
• Created multiple Hive tables, implemented partitioning and buckets in Hive for efficient data access.
• Worked on Scala library to build Spark applications, Spark SQL, RDDs, dataframe, transformation and action and pushed results to HDFS.

Project: Fluke Corp.

Experience Summary:

• Plan and coordinate agile based development's project.
• Understand Power BI reporting requirement based on business subject areas.
• Derived MTD , QTD ,YTD logic by using DAX query based fiscal calendar.
• Updated the fact data with actual, forecast(linear & seasonal) and plan value.
• Define data model in SSAS based on fact tables and dimensions.
• Worked closely with data team to analyze data models for procurement of business requirements.

Projects: Petrofac project, Indus Tower project.

Experience Summary:

• Prepared BRD based on requirements gathering session and included functional, non functional, logical data model later included physical data model.
• Design best practices to support continuous process automation for data ingestion and data pipeline workflows.
• Provided support in development of OBIEE, ODI, Microsoft Power BI solutions.
• Provided continued maintenance and development of bug fixes for existing and new PowerBI reports.
• Design and develop data modeling concepts using various data modeling tools like star schema and snowflake.
• Developing ODI ETL packages, creation of interface using knowledge modules, handle operational issues.