Lead Data Software Engineer Lviv, Ukraine or Remote

Responsibilities

• Understand data features and mappings to implement required Airflow DAGs in Python
• Develop, maintain, and optimize data pipelines for the data platform
• Transform, translate, and move data to different states for training or inference
• Collaborate with cross-functional teams to ensure data pipeline efficiency
• Contribute to the design and implementation of the data platform
• Troubleshoot and resolve data pipeline issues in a timely manner
• Ensure data integrity, quality, and security throughout the pipeline process
• Document and communicate data pipeline processes and best practices
• Provide technical guidance and mentorship to junior team members
• Stay updated with industry trends and best practices in data engineering

Requirements

• Minimum of 5 years of experience in Data Software Engineering
• 1+ years of relevant leadership experience
• Hands-on experience with Amazon EMR, AWS, Apache Airflow, and PostgreSQL
• Proficiency in PySpark and Python
• Strong understanding of data pipelines and data transformation processes
• Experience with data storage and retrieval systems
• Proficiency in data manipulation and transformation
• Capability to work with large-scale data processing frameworks
• Excellent problem-solving and analytical skills
• Ability to work effectively in a collaborative team environment

Nice to have

• Experience with OpenSearch
• Certification in relevant data engineering technologies
• Familiarity with data visualization tools and techniques
• Knowledge of containerization and orchestration technologies

We offer

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Consider relocation options in over 30 countries worldwide
• Participate in volunteer, charity programs and communities (both technical and interest-based)
• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children