Cloudera & Big Data Engineer

Location Singapore
Discipline Information & Communications Technology
Job Reference BBBH148230_1740557537
Salary S$7000 - S$10000 per month
Consultant Name Cristina Malabuyoc Malijan
Consultant Email [email protected]
Consultant Contact No. 62328835
EA License No. 02C3423
Consultant Registration No. R1111547


Job scopes

  • Design, build, deployment, of ETL/ELT data pipelines within big data ecosystems ( Impala, Hue, Spark, Talend and Cloudera)
  • Develop technical design, and ETL specification documents
  • Manage, monitor and fine tune Hadoop cluster architecture (HDFS) jobs for performance, security and resource management.
  • Create detailed designs and POCs to enable new workloads and technical capabilities on the Platform.
  • Work with the platform and infrastructure engineers to implement these capabilities in production



Job requirement

  • Bachelor's degree in computer science or any equivalent
  • Around 5-8 years of experience with development to centered around big data applications, and adhoc transformation of unstructured raw data
  • Experience with Talend and Cloudera Manager, Navigator, and Data Science Workbench.
  • At least 5 years Relational DBA experience, preferably with experience in SQLServer and/or MySQL.
  • Design, build, and maintain Big Data workflows/pipelines to process continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.
  • Demonstrated work experience in the following with Big Data and distributed programming models and technologies
  • Knowledge of database structures, theories, principles and practices (both SQL and NoSQL).
  • Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines
  • Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive, Hadoop
  • Understanding of Map Reduce and other Data Query and Processing and aggregation models
  • Understanding of challenges of transforming data across distributed clustered environment
  • Experience with techniques for consuming, holding and aging out continuous data streams

Cristina Malabuyoc Malijan EA License No. 02C3423 Personnel Registration No. R1111547

Please note that your response to this advertisement and communications with us pursuant to this advertisement will constitute informed consent to the collection, use and/or disclosure of personal data by ManpowerGroup Singapore for the purpose of carrying out its business, in compliance with the relevant provisions of the Personal Data Protection Act 2012. To learn more about ManpowerGroup's Global Privacy Policy, please visit https://www.manpower.com.sg/privacy-policy