Lead Data Engineer
About this position
Responsibilities
What You'll Do:
• Provide technical hand-on mentorship in data engineering practices (e.g. data architecture, data ops, data quality management, or orchestration tools).
• Design and implement data ops and data pipeline on data lake/data lakehouse concept.
• Monitor data platform cluster (Kubernetes).
• Coaching other team members.
• Develop data engineering best practices across product squads.
Requirements
About You:
• At least 4+ years of experience in designing and implementing data pipelines on data lake/data lakehouse concept.
• Experience with Apache Spark and Apache Airflow.
• Experience with NoSQL and GraphDB.
• Ability to manage multiple projects.
• Understanding of data ops and data quality/data validation concepts.
• Strong programming skills (SQL, Python, Scala).
• Strong in using Docker and Kubernetes.
• Experience in coding standard and testing practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• A growth mindset with a passion for learning and knowledge sharing.
It’s Great if you have:
• Experience in data ingestion and dataops tools (e.g. Airbyte, SQLMesh) is a plus.
• Understanding of data lineage, data observability, data mesh, or data governance concept is a plus.
• Data analytics engineer or data scientist experience is a plus.