Data Engineer Permanent NEW

The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don’t limit ourselves on what we can or can’t do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee’s hyper-growing business scale has transformed most “innocent” problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.

Job Description:

Design and grow Shopee’s data warehouse, build reliable and smart ways to ingest data to the warehouse, and help engineer efficient data pipelines. Some examples include self-service data ingestion systems, Airflow-enabled workflows with code-as-configuration, and data validation tools
Build critical data marts and applications to support products and solve specific business needs, design data models for optimal storage and retrieval, and optimize data architectures to meet critical product and business requirements. Some examples include a real-time Campaign Mart (used to serve the business with live intelligence) and Order Mart (to supply low latency seller performance system)

Requirements:

B. Sci. / Ms / PhD in Computer Science or a related technical field
Less than 1 year of experience welcomed
Working experience in software development in at least one of these languages: Java, Scala, Python, C/C++, under Linux / Unix. Scala is a plus
Familiar with SQL; strong scripting ability in Bash is a plus
Familiar with Hadoop, Spark, Kafka, Presto, and other big data experience is a plus
Familiar designing and operating of a robust distributed system is a plus
Love to use and develop open-source technologies
Excited to work intimately with data
Passionate, self-motivated, and takes ownership