Data Engineer Permanent

1. To develop, expand and optimize the data pipeline architecture under DBS data and analytics platform.
2. Design, create and maintain optimal data pipelines.
3. Discover the data acquisition opportunities, analyze and optimize data sourcing with analytics team to ensure the quality data.
4. Prepare metadata and ingest data from source to data warehouse following DBS ingestion framework.
5. Work with business analysts on data transformation and compute to prepare for advanced analytics and dashboarding.
6. Work with stakeholders including the senior management, platform team, technology team and design teams to assist with data-related technical issues and support their data infrastructure needs.
7. Develop analytics dashboards.
8. Work with data and analytics experts to strive for greater functionality in our data systems.
9. Support ad-hoc business analytics request and process automation tasks.

Education and Relevant Experience (What minimum qualification does the job require?)

1. Degree (and above) in Information Technology, Computer Science, Statistics, Applied Mathematics, Business Analytics, or equivalent quantitative fields preferred.
2. 5+ years’ experience in building and optimizing ‘big data’ data pipelines, architectures and datasets.
3. A passion for learning and using new technologies in the open-source communities.
4. A passion for coding.

Functional / Technical Competencies (What competencies do the job require?)

1. Experience in using ADA platform is big plus.
2. Proficient programming skills in Python, R, Scala, SQL etc.
3. Experience with relational SQL and NonSQL DB.
4. Experience in ETL and/or data wrangling tools for big data environment.
5. Good working experience in big data technologies such as Apache Spark, Hive and Hadoop.
6. Knowledgeable on structured and unstructured data design/ modelling, data access and data storage techniques.
7. Experience in data sourcing from open source through API.
8. Knowledge in data visualization tools like Tableau.
9. Self-motivated and a desire to learn and develop professionally.
10. Good communication skills (both oral and written).