Lead Software Engineer (Big Data) Malaysia or Remote

Responsibilities

• Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies
• Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks
• Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions
• Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals
• Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions
• Participate actively in code reviews and ensure adherence to best practices and coding standards
• Foster a high-performance engineering culture, mentor team members and provide motivation and guidance
• Maintain comprehensive project documentation to support development and operations

Requirements

• 8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions
• Proficiency in Python, Java, Scala, or Kotlin
• Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals
• Expert skills in SQL and relational algebra
• Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies
• Hands-on experience with modern Big Data components and data modeling
• Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems
• Deep understanding and practical application of CI/CD principles and best practices
• Expertise in Docker and Kubernetes for containerization and resource management
• Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture
• Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations
• Significant experience with high-load and IoT data platform architectures
• Solid infrastructure troubleshooting skills
• Practical experience in performance tuning, optimization and problem analysis
• Advanced understanding of distributed computing principles
• Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus
• Excellent interpersonal, leadership and communication skills
• Experience in direct customer communications and stakeholder management
• Experience in technical leadership and mentoring within data-oriented projects
• Ability to handle multiple projects in a fast-paced, startup-like agile development environment
• Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA

We offer

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us