Senior/Lead Data Engineer
About this position
Responsibilities
• Design and develop large and high performance data processing systems to drive LINE MAN Wongnai business growth and improve the product experience.
• Lead and oversee data engineering projects to ensure pipelines are reliable, efficient, testable, & maintainable.
• Improve data quality to management and governance.
• Evangelize high quality software engineering practices towards building data pipelines and platforms at scale.
• Contribute to shared engineering tooling & standards to improve the productivity and quality of output for engineers across the company.
Requirements
• At least 3-7 years of practical or hands-on experience in Data Engineering or relevant industry.
• Excellent problem-solving skills and attention to detail.
• Effective communication and collaboration skills.
• Knowledge and experience with data quality frameworks (e.g., Great Expectations).
• Working knowledge with both relational and non-relational databases (e.g., MongoDB, MySQL, PostgreSQL).
• Strong proficiency in SQL, Python, and other programming languages commonly used in data engineering.
• Extensive hands-on experience with Apache Spark Batch/Real Time and performance tuning.
• Proven hands-on experience with Hadoop and familiarity with open table formats.
• Experience with Polars and DuckDB (Preferable).
• Proficient in English language skills (Thai a plus).