Data Engineer
Detail posisi
As the Data Engineer, the key responsibility is to help team to drive building state-of-the-art data infrastructure to unlock full potential of VGI Digital Lab's data analytics capabilities. This includes, but not limited to, data integration (from both internal and external sources), large-scale data pipelines, data workflow management, and in the future, ML/AI real-time inference service.
Kewajiban
Key Responsibility:
Data analyst: Be one of point of contacts regarding any VGI One data-related matter. Help create and maintain optimal data pipeline architecture on data platforms either data warehouse and data lake.
• Collaborates with analytics, Group data and business teams to improve data models that feed VGI One platform, increasing data accessibility and fostering data-driven decision making across the organization.
• Develops and maintains scalable data pipelines and help design/builds out API integrations to support continuing increases in data volume and complexity.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Works closely with a team of frontend and backend engineers, product managers, and analysts to designs and evaluates open source and vendor tools for data lineage.
• Utilize data platforms & tap into a vast amount of data generated by the BSSH group to provide the insights into business metrics: customer acquisition, operational efficiency, operational risk, regulation, etc.
Team Management: Supports Head of the team and performs management duties when Head is absent or out of office.
• Assisting head and the team in organizing, planning and implementing strategy
• Answers team member questions, helps with team member problems, and oversees team member work for quality and guideline compliance
• Provide mentoring to other team members from time to time, developing their coaching skills and effectiveness
System/Data Architect: Identify, design and propose required resources to meet with company's goals and manage end-to-end product delivery (I.e. off-the-shelf software, IT outsourcing etc.).
• Help building product roadmap including In-sourcing requirement (VGI DL Tech team), outsourcing to external software houses to expedite time-to-market, integrating off-the-shelf solutions to expedite time-to-market.
• Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
• Reformulating existing frameworks to optimize their functioning.
• Testing such structures to ensure that they are fit for use.
• Preparing raw data for manipulation by BI & Data Scientists.
Kualifikasi
Qualification:
• BS/MS degree in Computer Engineering, Computer Science, or a related field
• 1-4 years of full-time experience in tech or related industry
• Proficiency in advanced data analytics techniques, including data mining, machine learning, data visualization, Natural Language Processing with specialization in some areas
• Deep knowledge of advanced analytics tools