305 King St W
Suite 1100
Kitchener, ON N2G 1B9
Canada
Lead Software Engineer (Big Data) Malaysia or Remote
Lead Software Engineer (Big Data) Description
Are you a highly skilled and motivated Data Software Engineer with a passion for Big Data, Machine Learning Operations and scalable enterprise software development? Join our dynamic team and take the lead in designing and implementing cutting-edge data solutions in a cloud-native environment. If you thrive in a fast-paced, agile setting and have a strong technical background, this is the opportunity for you!
#LI-DNI#REF_MY_PrR
Responsibilities
- Lead, design and implement innovative analytical solutions using Cloud-Native, Big Data, and NoSQL technologies
- Architect and develop Cloud, On-Premise and Hybrid data solutions using industry-leading frameworks
- Collaborate with product and engineering teams to evaluate new features, architectures and technical decisions
- Establish strong partnerships with architects and key stakeholders to ensure solutions align with business goals
- Conduct in-depth analysis of business challenges and technical environments to develop high-quality solutions
- Participate actively in code reviews and ensure adherence to best practices and coding standards
- Foster a high-performance engineering culture, mentor team members and provide motivation and guidance
- Maintain comprehensive project documentation to support development and operations
Requirements
- 8+ years of experience, specializing in Data Software Engineering, Machine Learning Operations (MLOps), and Big Data solutions
- Proficiency in Python, Java, Scala, or Kotlin
- Advanced knowledge of Linux OS, including service configuration, shell scripting and network fundamentals
- Expert skills in SQL and relational algebra
- Extensive experience in administration, configuration, monitoring, debugging and performance tuning of data technologies
- Hands-on experience with modern Big Data components and data modeling
- Proven ability to design, automate, provision and manage scalable, available and fault-tolerant cloud systems
- Deep understanding and practical application of CI/CD principles and best practices
- Expertise in Docker and Kubernetes for containerization and resource management
- Strong background in data ingestion pipelines (ETL workloads), Data Warehousing and Database architecture
- Expertise in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Security and Operations
- Significant experience with high-load and IoT data platform architectures
- Solid infrastructure troubleshooting skills
- Practical experience in performance tuning, optimization and problem analysis
- Advanced understanding of distributed computing principles
- Analytical problem-solving mindset with the ability to work at an abstract level and gain consensus
- Excellent interpersonal, leadership and communication skills
- Experience in direct customer communications and stakeholder management
- Experience in technical leadership and mentoring within data-oriented projects
- Ability to handle multiple projects in a fast-paced, startup-like agile development environment
- Data-oriented mindset with awareness of compliance standards such as PI, GDPR, HIPAA
We offer
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
Life at EPAM
- EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
- We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients