Lead Data DevOps Engineer Remote

Responsibilities

• Lead the design, implementation, and maintenance of Data DevOps solutions
• Design, deploy, and manage data infrastructure in the cloud, primarily using almost one of the clouds (AWS, Azure, GCP)
• Collaborate with cross-functional teams to define and implement engineering best practices
• Develop and maintain CI/CD pipelines for data infrastructure and applications
• Automate and streamline data-related processes, ensuring scalability and reliability
• Provide technical leadership and mentorship to engineering teams
• Ensure the security, availability, and performance of data platforms
• Install, configure, and maintain data tools such as Apache Spark, Apache Kafka, ELK Stack, Apache NiFi, Apache Airflow, or similar tools in both on-premises and cloud environments
• Monitor and troubleshoot data systems, proactively identifying and resolving performance, scalability, and reliability issues
• Collaborate with stakeholders to understand and address their data infrastructure needs
• Drive continuous improvement and innovation in data engineering practices

Requirements

• Minimum of 5 years of relevant professional experience
• Proven expertise in leading and managing complex engineering projects (1+ year)
• Demonstrated experience in designing and implementing Data DevOps solutions
• Proficiency in cloud platforms, such as Azure, GCP, or AWS
• Strong understanding of CI/CD pipelines, automation, and infrastructure as code
• Experience with containerization and orchestration technologies, such as Docker and Kubernetes
• Knowledge of scripting languages and automation tools like Python, PowerShell, or Bash
• Familiarity with database technologies and data management best practices
• Solid understanding of network protocols and mechanisms, such as TCP, UDP, ICMP, DHCP, DNS, and NAT
• Infrastructure as Code experience: Ansible, Terraform, Cloudformation, and so on
• Experience installing and configuring data tools such as Apache Spark, Apache Kafka, ELK Stack, Apache NiFi, Apache Airflow, or similar tools
• Experience with SQL
• Professional mastery of the Linux operating system
• Ability to collaborate effectively with cross-functional teams and stakeholders
• B2+ English level proficiency

We offer

• Learning Culture - We want you to be the best version of yourself, that is why we offer unlimited access to learning platforms, a wide range of internal courses, and all the knowledge you need to grow professionally
• Health Coverage - Health and wellness are important, that is why we have you and up to four family members in a premiere health plan. We have a couple of options, so you can choose what is best for you and your family
• Visual Benefit - Seeing your work for us would be a sight for sore eyes. We want your vision to always be at 100% which is why we offer up to $200.000 COP for any visual health expenses
• Life Insurance Plan - We have partnered with MetLife to offer a full-coverage Ife insurance plan. So, your family is covered, even if you are gone
• Medical Leave Coverage - We are one of the few companies that cover 100% of your medical leave, for up to 90 days. Your health is the most important thing to us
• Professional Growth Opportunities - We have designed a highly competitive and complete development process, where you will have all the tools to get where you have always wanted to be, personally and professionally
• Stock Option Purchase Plan - As an EPAMer you can be more than just an employee, you will also have the opportunity to purchase stock at a reduced price and become a part owner of our organization
• Additional Income - Besides your regular salary, you will also have the chance to earn extra income by referring talent, being a technical interviewer, and many more ways
• Community Benefit - You will be part of a worldwide community of over 50,000 employees, where you can learn, challenge yourself, stand out, and share your knowledge and experience with multicultural teams!