Senior Big Data Engineer (AWS, Spark, SQL)

  • Data Engineering & Data Science Team
  • Singapore, Singapore

Senior Big Data Engineer (AWS, Spark, SQL)

Job description

Conceptualise, Implement and Maintain Big Data Pipelines  (Batch and Real-Time Processing) in AWS Environments
Make excellent use of Technologies like  Spark, Lambda, SQL, Python, S3 and Redshift or other Technologies to deploy stable and scalable Data Pipelines
Deploy Machine Learning Models in collaboration with in–house Data Scientists using AWS Technologies and Open Source Software.
Find novel solutions to complex data pipeline challenges together with our team of Product Managers and Software Engineers.
Building a great company and products together which disrupt the way how retailers and brands work together on Big Data.

Requirements

7 +years of hand-on experience in Data Engineering, Big Data Pipelines, AWS Cloud Technologies, Redshift and Spark.
Excellent knowledge in SQL, ETL procedure, relational data models.
Willing to work in a dynamic and fast-paced start up environment with talentend data-passionate people.
Eager to work both conceptually on architecure and hands-on in implementation of new solutions together with the data engineering team
Basic conceptual understanding on Machine Learning Models and their deployment.
Experience in SQL Server and SSIS a plus.
Work experience in SaaS Startup Environment and or Retail Data is a plus.
Responsible and accurate work ethics
Fluent in english