Data / ML Engineer
About this position
Responsibilities
• Data Pipeline Development: Design, implement, and optimize scalable ETL/ELT pipelines to ingest, transform, and store structured and unstructured data in a cloud environment (AWS is a core but not limit).
• Machine Learning Pipeline Development: Work collaboratively with data scientists to productionize and maintain scalable machine learning services. The solutions encompass a variety of approaches, including traditional and near real-time machine learning, deployed across multi-state service architectures.
• Data Platform: Collaborate closely with DevOps and infrastructure teams to design, implement, and manage scalable data storage and processing platforms. Leverage AWS services such as S3, Redshift, Glue, Lambda, Athena, and EMR to ensure performance, reliability, and cost-efficiency.
• Data Modeling and Schema Management: Develop and maintain robust data models and schemas to support analytics, reporting, and operational requirements. Adhere to the design principle of establishing a "single version of truth" to ensure consistency, accuracy, and reliability across all data-driven processes.
• Data/AI Quality-as-a-Service Development: Design, develop, and maintain scalable "Data/AI Quality-as-a-Service" solutions, adhering to zero-ops design principles. The scope of quality includes monitoring data drift, analyzing performance metrics, and detecting model drift to ensure consistent, reliable, and high-performing AI systems.
• Cross-Functional Collaboration: Collaborate closely with data scientists, analysts, and application developers to ensure the seamless integration of data solutions into workflows, enhancing functionality and enabling data-driven decision-making.
• Automation & Monitoring: Design and implement robust monitoring and automation frameworks to ensure the high availability, performance, and cost-efficiency of data workflows, guided by the principle of “Zero Ops by Design.”
• Compliance & Security: Uphold data security, privacy, and compliance with banking regulations and industry standards, ensuring all solutions meet rigorous governance requirements.
• Continuous Improvement: Stay informed about emerging technologies and trends in cloud data engineering, advocating for their adoption to enhance system capabilities and maintain a competitive edge.
Requirements
• Bachelor's degree in Computer Science, Computer Engineering, Data Engineering, or a related field.
• 3+ years of experience in cloud data engineering or