7+ years of experience in software development, primarily of JVM-based software
Experience in design, implementation and support of Spark-based batch and streaming applications running on YARN/Hadoop clusters
Experience in architecture, design and implementation of large, distributed and highly available software systems on all layers, including UI, backend, middleware and databases
Experience in performance analysis and optimization
Experience in administration of Linux-based systems
Experience in developing server and client sides of web applications
Experience with Agile and Waterfall methodologies
Good understanding of modern development approaches and technologies
Strong communication and collaboration skills
Experience in team leading and mentoring
Responsibilities and Achievements:
- Architected and participated in setup of the DWH and ETL processes
- Participated in setup of the infrastructure for DE
- Setup the incident management system with DE team
- Regular collaboration with analytics and DevOps teams
- Guiding junior data engineers
- Setup practices of sprint planning and grooming
- Setup PR process for DE
Responsibilities & Achievements:
- Architected and implemented distributed extraction algorithm for company purposes
- Architected and developed several ETLs with Big Data stack
- Increased company's saving for data processing with AWS resources and regular cost analysis
- Collaborate with ML team
Responsibilities & Achievements:
Working as a Big Data engineer with Hadoop cluster and Big Data stack:
Technologies: Spark, PySpark, HDFS, NiFi, Azkaban, Hive, Sqoop, Pig, Kafka, Flume, AWS, GCP, Flask;
Responsibilities & Achievements:
Backend development for blockchain startup company:
Technologies: Python, Django framework, Redis, PostgreSQL, WebSocket;
Responsibilities:
Achievements:
Technologies: Java 8, Scala, JS, Akka, Play framework, Spring: MVC, Security, Boot, Data;
VueJS, Electron, Backbone, ExtJs, React, LESS; MongoDB, Firebird;