Data Engineer ( Backend Java / Python) - True Money Wallet
About this position
Responsibilities
• Develop big data solutions for batch processing and near real-time streaming
• Retrieve, prepare, and process a rich data variety of data sources
• Work with business domain experts, data scientists and application developers to identify data that is relevant for analysis
• Keep abreast of new developments in the big data ecosystem and learn new technologies
• Triage code problems and data-related issues
Requirements
• 3+ years of experience with relational or non-relational database systems
• 3+ years of programming experience in Java, Python, Scala or similar
• 3+ years of experience data management, data warehousing or unstructured data environments is a plus
• Experience with cloud-based platforms such as AWS, Google Cloud platform or similar
• Experience building complex pipelines using automated workflow is a plus, e.g. Luigi, Airflow or similar
• Experience with parallel data processing is a plus, e.g. MapReduce, Hadoop, Spark or similar
• Experience with streaming technologies is a plus, e.g. Kafka, RabbitMQ, Google Pub/Sub or similar
• Experience with Business Intelligence tools and platforms is a plus, e.g. Tableau, PowerBI, Google Looker Studio or similar
• Experience with Machine Learning.AI is a plus, e.g. TensorFlow, NumPy, Scikit-Learn, VertexAI or similar
• Good communication in English