Lead Data Software Engineer Remote

Responsibilities

• Execution of innovative analytical solutions using Spark/PySpark, NoSQL, and other Big Data technologies
• Close collaboration with product and engineering teams to understand requirements and drive decisions
• Persistent interaction with architects, technical leads, and key individuals within other functional groups
• Analysis of business problems and technical environments for the implementation of quality technical solutions
• Participation in code review and testing solutions to ensure they meet best practice specifications
• Documentation of project details

Requirements

• Minimum of 5 years of engineering experience in Data Management, Data Storage, Data Visualization, Operation, and Security
• Mastery in at least one programming language: Python, Java, Scala, or Kotlin
• Concrete experience with SQL and strong familiarity with Big Data tools, mainly Spark/PySpark, and optionally Hadoop, Hive, and Flink
• Comprehensive understanding of Cloud Solutions for Data environments such as AWS (Glue, RedShift), Azure (Databricks, Data Factory, Cosmos), and GCP (BigQuery, DataProc, DataFlow)
• Good grasp of CI/CD and software development using Big Data technologies
• Prior exposure to software development with Big Data technologies including administration, configuration management, monitoring, debugging, and performance tuning
• Familiarity with data ingestion pipelines, Data Warehousing, and Data Lakes
• Prior experience with data modeling and development of scalable, available, and fault-tolerant systems
• Analytical approach towards problems accompanied by excellent interpersonal and communication skills
• Motivation, independence, efficiency, and ability to work under pressure with a solid sense for setting priorities
• Knowledge of Containers and Resource Management systems like Docker, Kubernetes, and Yarn
• Experience in direct customer communications

Nice to have

• Prior experience with Event Streaming tools like Kafka, Pub/Sub, Kinesis, Events Hub
• Familiarity with Orchestrator tools such as Airflow and Databricks
• Knowledge of Snowflake is advantageous

We offer

• Learning Culture - We want you to be the best version of yourself, that is why we offer unlimited access to learning platforms, a wide range of internal courses, and all the knowledge you need to grow professionally
• Health Coverage - Health and wellness are important, that is why we have you and up to four family members in a premiere health plan. We have a couple of options, so you can choose what is best for you and your family
• Visual Benefit - Seeing your work for us would be a sight for sore eyes. We want your vision to always be at 100% which is why we offer up to $200.000 COP for any visual health expenses
• Life Insurance Plan - We have partnered with MetLife to offer a full-coverage Ife insurance plan. So, your family is covered, even if you are gone
• Medical Leave Coverage - We are one of the few companies that cover 100% of your medical leave, for up to 90 days. Your health is the most important thing to us
• Professional Growth Opportunities - We have designed a highly competitive and complete development process, where you will have all the tools to get where you have always wanted to be, personally and professionally
• Stock Option Purchase Plan - As an EPAMer you can be more than just an employee, you will also have the opportunity to purchase stock at a reduced price and become a part owner of our organization
• Additional Income - Besides your regular salary, you will also have the chance to earn extra income by referring talent, being a technical interviewer, and many more ways
• Community Benefit - You will be part of a worldwide community of over 50,000 employees, where you can learn, challenge yourself, stand out, and share your knowledge and experience with multicultural teams!