Senior Data Integration Engineer Australia or Remote

Responsibilities

• Design and implement data integration pipelines to connect operational systems with analytics environments
• Develop and optimize ETL/ELT workflows using modern cloud platforms, ensuring efficient data transformation and movement
• Leverage Azure tools to manage data pipelines, processing, and storage effectively
• Manage and optimize data storage solutions using best practices in structured and unstructured data handling
• Apply data modeling techniques to design robust and scalable data architectures
• Write and optimize complex SQL queries for data transformations and reporting
• Develop data workflows and processes using Python and distributed frameworks to handle large-scale data
• Monitor and maintain data workflows to ensure reliability, performance, and operational efficiency
• Collaborate with stakeholders to understand business and technical requirements and deliver aligned solutions

Requirements

• Expertise in Azure cloud services, including data pipelines, processing, and storage (e.g., Azure Synapse, Data Factory, Data Lake)
• Strong proficiency in SQL for querying, data transformation, and optimization
• Experience with Python for automation, scripting, and developing data workflows and transformations
• Familiarity with distributed data processing frameworks like Apache Spark
• In-depth understanding of data modeling principles (e.g., dimensional modeling, star schema)
• Hands-on experience with CI/CD pipelines and version control tools like Git
• Proven ability to troubleshoot and optimize complex data workflows

Nice to have

• Knowledge of advanced Azure capabilities such as Fabric component
• Experience in building reports and datasets with business intelligence tools like Power BI
• Familiarity with real-time data synchronization and integration methods
• Strong communication skills to effectively collaborate with technical and non-technical stakeholders

We offer

• By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us