Lead Data Engineer
Detail posisi
Kewajiban
• Work closely with other engineers, data scientists, product and project managers, management and customers
• Translate business requirements to technical requirements and provide analytics solutions to customers and internal stakeholders
• Plan projects, tasks and priorities, contribute to the tech roadmap and ensure execution
• Design data architecture and build reliable, scalable and automated real-time data systems with monitoring and alerting
• Operate, optimize and migrate existing data pipelines and storage
• Manage costs
• Manage a team of data engineers and provide guidance to data users
• Be a strong advocate for development best practices, data quality and business alignment
Kualifikasi
• At least a bachelor's degree in computer sciences, Software Engineering or equivalent experience
• Familiarity with common data engineering concepts such as SQL, key-value stores, data modeling, distributed computing, job orchestration
• Experience in building and managing big data pipelines with Spark, Kafka or other big data tools and frameworks
• Experience in cost monitoring and optimizing data processing and storage systems for cost efficiency
• Good understanding of on-premises data processing and modern data stack on Google Cloud, AWS, Azure or other cloud
• Strong programming skills such as Scala, Java, Python with good knowledge of common data structures and algorithms
• Strong analytical problem-solving skills
• Effective communication skills with ability to understand business context and convey complex ideas to various stakeholders
• Can-do attitude with self-learning skills, service oriented and customer centric, excellent team player
• Experience in building and managing teams, providing feedback and setting KPIs
• Bonus skills: Familiarity with telecom industry, Databricks, Kubernetes, CI/CD, consent management and PDPA