Data Engineer
About this position
We are seeking a Data Engineer to join our growing team. The ideal candidate will be a highly motivated and experienced data professional with a strong technical background in data engineering, data architecture and cloud.
Responsibilities
In this role, you will get to:
• Collaborate with cross-functional teams to understand business requirements and design data solutions to meet those needs
• Design and build scalable data pipelines to ingest, process, and store large volumes of data
• Manipulate complex data from a variety of sources (e.g. API, SFTP, Databases, SAP, Google Analytics, etc.)
• Ensure data quality, accuracy, and completeness through data validation and error handling processes
• Maintain and monitor existing ETL pipelines and advising on necessary infrastructure changes
• Design and implement security and access control measures to protect sensitive data or comply with regulation such as PDPA
• Participate in recruitment in order to evaluate and interview candidates, as well as improving our recruitment processes
• Gather customer requirements during pre-sales interactions, determining project scope, creating technical diagrams, and making estimations for man-days and cloud costs
• Develop and maintain technical documentation
Requirements
You'll be successful if you have:
• 4+ years of experience in Data engineering in designing, building, maintaining data infrastructure in cloud environments such as AWS, GCP or Azure
• Strong programming skills in languages such as Python, Java, or Scala (Python preferred)
• Strong Experience with cloud based data lake solutions, such as S3, GCS or Data Lake Storage, and how to design and implement data lake architectures
• Strong Experience with data warehousing tools, such as Redshift, Synapse or BigQuery, and how to optimize data warehousing performance for large-scale data sets
• In-depth knowledge and hands-on experience