305 King St W
Suite 1100
Kitchener, ON N2G 1B9
Canada
Senior Data Engineer Czech Republic or Remote
Senior Data Engineer Description
DESCRIPTION
We are looking for a Senior Data Engineer to make a team even stronger.
Responsibilities
- Develop, monitor, and operate the most used and most critical curated data pipeline - Sales Order Data (incl. Post-order information, e.g. shipment, return, payment). This pipeline is processing hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases
- Consulting with analysts, data scientists, and product managers to build and continuously improve "Single Source of Truth" KPI for business steering such as the central Profit Contribution measurement (PC II)
- Leverage and improve a cloud-based tech stack that includes AWS(Azure), Databricks, Kubernetes, Spark, Airflow, Python, and Scala
Requirements
- Expertise in Apache Spark along with Spark streaming & Spark SQL
- Good hands on experience with Databricks and delta-lake
- Fluency in Scala programming language
- Good understanding & hands-on experience with CI/CD
- Rich working experience with Github
- Fluency working with any cloud (AWS, Azure, GCP) landscape
- Ability to build Apache Airflow pipelines
We Offer
- Opportunity to work in a fast-paced, agile, software engineering culture
- English-speaking environment
- Unlimited access to LinkedIn learning solutions
- Comfortable modern offices in Prague 4 or remote work from any location in Czech Republic
- Benefit program (5 weeks of vacation, paid sick days, paid days off for special occasions, meal vouchers, flexi pass, Prague city public transport annual coupon, multisport cards, contribution to pension fund, health insurance for family member)
- English language courses
- Czech language courses upon request
- Relocation assistance
- Rotation program - possibility to relocate for short and long-term projects within 30 countries
- Referral bonuses for recommended candidates
- Mobile Phone Tariff’s program for managerial level candidates
- EPAM Employee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements)
- Some of these benefits may be available only after you have passed your probationary period