Data Engineers propel your project forward by implementing methods to improve data reliability and quality. Data Engineers put together raw information from different sources to create consistent and machine-readable formats.
Senior Data Engineer candidate should have at least 5 years of proven experience working in a data engineering department as a Data Engineer. A strong candidate has extensive experience working with varied forms of data infrastructure. This position calls for such skills:
Middle Data Engineer candidates should possess at least 3 years of proven experience as a database engineering support personnel or a database engineering administrator. A strong candidate must possess the following skills:
If you want to hire a Junior Data Engineer, you should be evaluating someone with 1 to 3 years of proven experience as a Data Engineer. A strong candidate should have the following skills:
Data Engineers are responsible for developing and maintaining analytics infrastructure that enables practically every other feature in the data world. They are responsible for architecture development, design, maintenance, and testing, such as databases and large scale processing systems.
Projects That Require A Data Engineer
The world’s most ambitious tech companies and startups choose Make it in Ukraine Java freelancers to scale their teams, execute high-velocity projects and ship groundbreaking products
Certified Information Technology professional with focusing on Business Intelligence and Data Processing. Work with MS SQL Server from version 2000 to 2016 including: SQL Server Analysis Services (SSAS) SQL Server Integration Services (SSIS) SQL Server Reporting Services (SSRS) Experience in work with relational, multidimensional and tabular models. Experience in built different Data Warehouses and Data Lakes both from scratch and improvement existing systems.
Specialties: Languages: Spark, Scala, T-SQL Relational databases: MS SQL Server 2000 - 2016 No-SQL databases: Cassandra Source control: GIT, TFS IDE: IntelliJ IDEA, Visual Studio Technologies: DWH, OLAP, ETL
Dates of Employment: October 2019 - Present (8 months)
Position: Senior Data Engineer
Dates of Employment: March 2016 - June 2019 (3 years 4 months)
Position: Senior BI Developer / Data Engineer
Dates of Employment: March 2012 - February 2016 (4 years)
Position: Senior BI Developer
Dates of Employment: June 2010 - March 2012 (1 year 10 months)
Position: Analyst-programmer, Business Intelligence Developer
Dates of Employment: March 2008 - June 2010 (2 years 4 months)
Position: Business Intelligence Developer
Dates of Employment: February 2006 - February 2008 (2 years 1 month)
Position: OLAP & Database Developer
Ukrainian Institute for Scientific, Technical and Economic Information Computer and automation systems programming, 2003 - 2004
National Technical University of Ukraine 'Kyiv Polytechnic Institute' Specialist, Chemical engineering, 1993 - 1999
Database structure design and performance tuning. Developing ETL processes. Developing data visualization dashboards and reports.
Databases: MS SQL, MySQL, Hive, Redshift, Athena. BI technologies: Tableau, FastReport, Superset.
ETL tools: Talend Studio.
Cloud technologies: Amazon Web Services, Google Cloud.
Bigdata: Hadoop, Spark, YARN. Python, Airflow, Jira, GitLab.
Dates of Employment: June 2019 - Present (1 year)
Position: Senior Data Engineer
Creating ETL data pipelines with Talend Studio
Dates of Employment: October 2018 - June 2019 (9 months)
Position: Middle SQL Engineer
Creating different types of new charts and dashboards. Creating pipelines for identifying data inconsistencies between different services. Analyzing and resolving data inconsistencies.
Dates of Employment: August 2017 - October 2018 (1 year 3 months)
Position: Middle Data Quality Engineer
Creating new charts and reports. Creating pipelines for finding and alerting data discrepancies. Identifying and resolving data discrepancies. Extracting, transforming and loading data from source (MS SQL, MySQL, CSV, JSON) to target (Hive, Parquet, ORC).
Dates of Employment: December 2015 - August 2017 (1 year 9 months)
Position: Junior MS SQL Developer
Checking and optimizing DB performance (Profiler, Extended Objects). Designing DB structure (tables, indexes, views, stored procedures). Analyzing and optimizing performance of existing stored procedures, functions, indexes. Designing new charts and reports.
Dates of Employment: August 2012 - October 2015 (3 years 3 months)
Position: Software Implementation Specialist
Configuring software based on customer requirements. Software functional testing. Developing financial reports for customers. Administering and maintaining customer databases. Identifying and fixing data issues.
State University 'Lviv Polytechnics' Master’s Degree, Software of systems, 2007 - 2012
Interested in distributed data processing, functional programming. Love Spark, have good knowledge of MapReduce paradigm and Hadoop ecosystem. Have experience in ad tech (RTB), FinTech, IoT domains.
Dates of Employment: November 2019 - Present (7 months)
Position: Senior Data Engineer
Project in AdTech domain Technical stack: Scala, Spark, Hive, Presto, ClickHouse, GCP (Storage, Dataproc), Jenkins
Dates of Employment: February 2019 - November 2019 (10 months)
Position: Senior Data Engineer
The client is one of the world largest marketplace, dealing with billion events per day. Working on data pipeline that generates accounting data.
Technical stack: Scala, Spark, Presto, Superset, Hive, Airflow, Hadoop (YARN, HDFS), AWS (S3, EMR)
Responsibilities:
Dates of Employment: October 2018 - February 2019 (5 months)
Position: Data Engineer
Dates of Employment: October 2017 - October 2018 (1 year 1 month)
Position: Java/Big Data Software Engineer
Technical stack: Spark, Hadoop (HDFS, MapReduce), Druid, Scala, Java 8, Vert.x, Spring Framework (IoC, MVC, Data), Hibernate, MySQL, Maven.
Responsibilities:
Dates of Employment: July 2016 - September 2017 (1 year 3 months)
Position: Java/Big Data Developer
Responsibilities:
Technical stack: Spark (Core, Streaming, SQL), Kafka, Cassandra, Redis, Java 8, Spring Framework (IoC, MVC, Security), Hibernate, Postgres, JUnit, Mockito, Maven,
Jenkins
Dates of Employment: January 2016 - June 2016 (6 months)
Position: Git Java Developer
Has was working on a short project (6 months) as Backend developer.
My responsibilities included:
Technical stack: Java 8, Spring Framework (IoC, MVC, Data, Security), Hibernate, MySQL, Liquibase, JUnit, Maven, jQuery, Semantic UI, JIRA, Jenkins, Git
Dates of Employment: October 2015 - February 2016 (5 months)
Position: Junior Java Developer
Responsibilities:
Technical stack: Java 8, Google guice, JUnit, Mockito, log4j2
National Technical University of Ukraine 'Kyiv Polytechnic Institute' Master's degree, Computer Science, 2018 - 2019
National Technical University of Ukraine 'Kyiv Polytechnic Institute' Bachelor's degree, System engineering, 2014 - 2018
BIONIC University Java EE Pre-Production, 2015 - 2016