Senior Data Engineer Remote

Responsibilities

• Design, build, and optimize large-scale data processing pipelines using PySpark or Apache Spark
• Develop and maintain data processing applications and data integration solutions
• Collaborate with data scientists and analysts to understand data requirements and deliver effective data solutions
• Work with cross-functional teams to ensure the scalability, reliability, and efficiency of data processing pipelines
• Implement and maintain CI/CD pipelines for data engineering projects
• Contribute to the design and development of data storage and retrieval solutions using MongoDB and AWS services
• Optimize data processing workflows for performance and scalability
• Troubleshoot and debug data processing issues, ensuring the integrity and quality of processed data
• Stay updated with the latest trends and advancements in data engineering and contribute to the continuous improvement of data processing practices

Requirements

• Minimum 3 years of professional experience as a Data Engineer, with a strong focus on building and optimizing large-scale data processing pipelines
• Hands-on experience in PySpark or Apache Spark, and proficient in Python for data manipulation and analysis
• Expertise in Amazon Web Services (AWS) for data storage, processing, and analysis
• Proficiency in working with MongoDB for data storage and retrieval
• Strong understanding of distributed data systems and the ability to work with complex datasets
• Passionate about solving data challenges in a scalable and efficient way
• Excellent communication skills and the ability to collaborate with cross-functional teams
• B2+ English level proficiency

Nice to have

• Knowledge of CI/CD, Cucumber

We offer

• Career plan and real growth opportunities
• Unlimited access to LinkedIn learning solutions
• International Mobility Plan within 25 countries
• Constant training, mentoring, online corporate courses, eLearning and more
• English classes with a certified teacher
• Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
• Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
• Flexible work schedule and dress code
• Collaborate in a multicultural environment and share best practices from around the globe
• Hired directly by EPAM & 100% under payroll
• Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
• Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
• 13 % employee savings fund, capped to the law limit
• Grocery coupons
• 30 days December bonus
• Employee Stock Purchase Plan
• 12 vacations days plus 4 floating days
• Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
• Monthly non-taxable amount for the electricity and internet bills