• Provide product recommendation based on business and technical assessment, demonstrate solid knowledge in data and analytics space
• Build distributed and highly parallelized Data Acquisition and event processing pipeline which is able to process massive amounts of data (both structured and unstructured data) in near real-time
• Evaluate and deploy data quality framework to measure and improve data quality in the organisation over time
• Engage with data cabin crew, producers and consumers to design appropriate data pipelines
• Automate processes where possible and are repeatable and reliable
• Work closely with Product Managers and Business team to deliver software in a continuous delivery environment.
Requirements:
We expect the ideal candidate to have past experience (10+ years) in data engineering and be a complex problem solver. You should be able to write production code in Scala or Python and have strong interests in the latest Data Technology.
• Data driven thinking
• Full stack developer / Data Scientist
• Knowledge in Apache Kafka, experience in Spark/Fink for event streaming
• Experience in container technologies (Open Shift, Docker or k8s)
• Knowledge in automation tools (Terraform and Ansible)
• Delivery focus with strong product mind-set
• Knowledge in design and implementation of data infrastructure on AWS or GCP
• Strong communication skills and experience working in cross-functional teams
• Experience in implementing data security capabilities such as encryption and anonymization is a plus
• Solid grounding in the Financial Services industry is a plus
• Solid knowledge in SQL
• Understanding in statistical models, machine learning, graph analysis is a plus
• Have an excellent command of both written and spoken English and Cantonese