305 King St W
Suite 1100
Kitchener, ON N2G 1B9
Canada
Senior Python ETL Engineer Lithuania
Senior Python ETL Engineer Description
EPAM is on the lookout for a talented Python ETL Engineer to join the team. In this role, you'll be the wizard behind the curtain, designing and implementing ETL processes that weave data magic. Extracting, transforming and loading data from various sources into our data warehouse will be your domain. Your expertise will be pivotal in understanding business requirements, crafting data models, and ensuring the accuracy and quality of our data.
Got a passion for Python? Love the thrill of creating ETL pipelines that run like clockwork? Perfect! Your solid Python development background, advanced programming knowledge and expertise with Airflow or Luigi will drive our data-driven success. And let's not forget your experience in data modeling, database design, and SQL – a true game-changer.
So, if you're passionate about ETL development and crave the excitement of cutting-edge technologies, we can't wait to welcome you aboard!
#LI-DNI#top-vacancies-10-LT-dec
Responsibilities
- Design and implement ETL processes
- Understand business requirements and translate them into technical specifications
- Develop custom ETL scripts using Python
- Maintain ETL pipelines using frameworks such as Airflow or Luigi
- Ensure data accuracy and quality by implementing ETL best practices such as data cleansing, data validation, and error handling
- Work with data warehouses such as Redshift, Snowflake, or BigQuery to store and manage large data sets
- Run SQL and relational databases such as PostgreSQL, SQL Server, and Oracle to design and optimize database schemas and queries
- Operate cloud technologies such as AWS, Azure, or Google Cloud Platform, including cloud-based ETL services such as AWS Glue or Azure Data Factory
- Collaborate with cross-functional teams to ensure the successful delivery of projects
- Stay up-to-date with industry trends and best practices in ETL development
Requirements
- Bachelor's degree in Computer Science, Information Technology or a related field
- 3+ years of experience in Python development
- Advanced Python programming language knowledge with an understanding of internal mechanics (interpreter, memory management, concurrency, etc.)
- Ability to develop scalable, maintainable and reliable ETL code
- Proficiency with ETL frameworks such as Airflow or Luigi
- Familiarity with data extraction from diverse sources such as databases, APIs, and flat files and transforming them to meet business requirements
- Strong understanding of data modeling and database design, including experience with dimensional modeling and star schemas
- Knowledge of SQL and relational databases such as PostgreSQL, SQL Server, and Oracle, including experience with database optimization techniques
- Showcase of working with cloud technologies such as AWS, Azure or Google Cloud Platform
- English – B1+, both verbal and written
Nice to have
- Competency in maintaining CI/CD pipelines for ETL applications
- Expertise in web applications for data ingestion using Flask or FastAPI
- Knowledge of Agile development methodologies (SCRUM/Kanban)
- Availability of Cloud certification (AWS, GCP, Azure)
- Familiarity with Docker and Docker Compose
- Flexibility to use big data technologies such as Hadoop, Spark
We offer
- Engineering Heritage: Best-in-class experts sharing a culture of engineering excellence and tackling complex engineering challenges for over 30 years
- Advanced Tech Stack: Innovative projects where you can apply or enhance your expertise in Cloud, Data, AI, and other emerging technologies
- World-Class Clients: Work closely with 295+ of the Forbes Global 2000 on creating disruptive solutions that make a global impact
- Professional Growth: Exceptional support for career development with comprehensive resources for upskilling or reskilling in pioneering practices
- GenAI Community: Strong AI competencies with 600+ experts across 55+ locations driving GenAI-enabled transformation journeys
- Entrepreneurial Culture: If you're passionate and dedicated to improving business transformation, we provide the support you need to bring your ideas to life
- Hybrid Setup: The flexibility to work from any location in Lithuania, whether it's your home or our dynamic offices in Vilnius and Kaunas
- Other Benefits: Additional vacation and trust days, private health insurance, Employee Stock Purchase Plan and more
Salary range €3.6K-€5.5K gross, based on your experience and interview results.
About EPAM
EPAM is a leading global provider of digital platform engineering and development services. For over 30 years, our team has helped leading brands navigate the waves of digital transformation, building solutions that help them stay competitive through constant market disruption.
With offices in 55+ countries, EPAM has grown in Lithuania to over 1,200+ talented innovators in just 4 years. We foster creativity and unconventional ways of doing things, welcoming like-minded professionals to join us
