Senior Data Engineer (Insurance), Bangkok, Thailand
เกี่ยวกับตำแหน่งนี้
The Senior Data Engineer will be instrumental in shaping the organization’s data strategy by designing and implementing data pipelines and frameworks. This role involves developing and delivering comprehensive data and analytics solutions, enhancing data architecture, and ensuring the integrity and accessibility of data across the enterprise. The ideal candidate will have a strong background in ETL development, big data technologies, and data warehousing.
หน้าที่รับผิดชอบ
- Develop and sustain the existing integration framework to manage routine data pipelines within the Data Platform.
- Design and implement data pipelines for both real-time and batch processing across various layers of the Data Platform.
- Maintain a strong understanding of logical and physical data models, as well as the business glossary.
- Engage in performance tuning to enhance the quality of the data platform continuously.
- Collaborate closely with the data governance team to ensure data integrity and availability across different data domains
คุณสมบัติ
- Over a decade of experience in building and managing data pipelines for real-time and batch processing of large-scale data within distributed data platforms (Data Warehouse or Data Lake).
- Strong programming skills in Python, PySpark, and SQL, with knowledge of SDLC and Agile methodologies.
- Proven expertise in Big Data technologies and Cloud platforms such as Azure, AWS, or GCP; hands-on experience is a plus.
- Hands-on experience with Databricks, Kubernetes, Kafka, and Jenkins is preferred.
- Excellent analytical thinking, problem-solving abilities, and interpersonal skills.
- Proficient communication skills in both Thai and English.