Data Engineer

Intro

Our data and risk team is the core pillar of our business that harnesses alternative data sources to guide the decisions we make at Rely. The team designs, architects, as well as develop and maintain a scalable data platform the powers our machine learning models. Be part of a team that will help millions of consumers across Asia, to be effortlessly in control of their spending and make better decisions.

What will you doThe data engineer is focused on making data correct and accessible, and building scalable systems to access/process it. Another major responsibility is helping AI/ML Engineers write better code.• Optimize and automate ingestion processes for a variety of data sources such as: click stream, transactional and many other sources.

Create and maintain optimal data pipeline architecture and ETL processes

Assemble large, complex data sets that meet functional / non-functional business requirements.

Develop data pipeline and infrastructure to support real-time decisions

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data' technologies.

Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.

What will you need• 2+ hands-on experience building and implementation of large scale production pipeline and Data Warehouse• Experience dealing with large scale

Proficiency in writing and debugging complex SQLs

Experience working with AWS big data tools• Ability to lead the project and implement best data practises and technology

Data Pipelining

Strong command in building & optimizing data pipelines, architectures and data sets

Strong command on relational SQL & noSQL databases including Postgres

Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

Big Data: Strong experience in big data tools & applications

Tools: Hadoop, Spark, HDFS etc

AWS cloud services: EC2, EMR, RDS, Redshift

Stream-processing systems: Storm, Spark-Streaming, Flink etc.

Message queuing: RabbitMQ, Spark etc

Software Development & Debugging

Strong experience in object-oriented programming/object function scripting languages: Python, Java, C++, Scala, etc

Strong hold on data structures & algorithms

What would be a bonus

Prior experience working in a fast-growth Startup

Prior experience in the payments, fraud, lending, advertising companies dealing with large scale data