305 King St W
Suite 1100
Kitchener, ON N2G 1B9
Canada
Senior/Lead Data Integration Engineer Remote
Senior/Lead Data Integration Engineer Description
We are seeking a talented Senior/Lead Data Integration Engineer to join our client's team in building a revolutionary data platform tailored for tax solutions.
This role focuses on leading the migration and integration of complex datasets, predominantly from the O-Series product covering sales tax calculation rules, into a new data platform. The initial data sources will consist of SQL Server, Oracle, CSV files, and unstructured data in HTML and PDF formats.
#LI-DNI
Responsibilities
- Lead the migration of databases from Oracle to AuroraDB (PostgreSQL)
- Work collaboratively with data analysts to define and refine database models
- Implement transformation logic to optimize data integration
- Ensure the integrity and security of data throughout the migration process
- Develop strategies for handling unstructured data sources including HTML and PDF files
- Optimize existing data integration processes and methodologies for improved performance
- Design and execute test scenarios to validate data migrations and transformations
- Document data integration procedures and outcomes for future reference
- Provide technical guidance and mentorship to junior data engineers in the team
- Stay updated with industry trends and advancements in data integration technologies
Requirements
- Proficiency in SQL, Oracle, and PostgreSQL
- Expertise in DB modeling and transformations
- Background in using Liquibase or similar tools for managing and deploying DB schema changes
- Skills in handling both structured and unstructured data sources
- Fluency in spoken English
- Capability to collaborate effectively with cross-functional teams
Nice to have
- Experience with AWS DMS and ETL processes
- Knowledge of AWS S3 and dbt
- Understanding of AWS Lambda, SNS, SQS
- Familiarity with implementing data cataloging and other data governance capabilities
- Background in MLOps principles or real project experience with AI algorithms using database inputs
We offer
- Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
- Receive the necessary equipment to perform your work tasks
- Change projects and technology stacks within EPAM
- Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
- Consider relocation options in over 30 countries worldwide
- Participate in volunteer, charity programs and communities (both technical and interest-based)
- You can plan your individual career path together with your manager
- Receive regular feedback from colleagues
- Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
- Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
- Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
- Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
- Study at EPAM Solution Architecture School with the instructors who are practicing architects
- Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
- Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
- Vacation and sick leave (including a sick leave without a medical certificate)
- A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
- Medical insurance for family members at corporate rates
- Company support during significant life events (childbirth or adoption, marriage, etc.)
- Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
- E-kids program - a free programming language training program for EPAMers' children
EPAM strives to provide its global team of over 52,800+ professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.