Cloud SRE Engineer
Deezer
Paris, Île-de-France, France
il y a 13h
Job Description

 Responsibilities:

  • Participate in the cloud migration of our data warehouse.
    • Migrate Hadoop jobs on Google Cloud Platform (dataproc, bigquery etc.).
    • Resource monitoring and optimization.
    • Cost estimation and optimization.
    • Articulate between on-premise infrastructure and cloud (security, network issues).
  • Manage large scale Hadoop cluster environments including capacity planning, cluster setup, performance tuning, monitoring, and Alerting. 
  • Monitor Hadoop jobs and recommend optimization 
  • Work with Core Infrastructure team to automate the deployment and operation of the infrastructure. Manage, deploy, and configure infrastructure with Ansible or other automation toolsets.
  • Debug Infrastructure issues (Like - Underlying network issue or Issues with the nodes)
  • Test/Support for infrastructure component change.
  • Participate proof of concepts on scaling, reliability, performance, and manageability and help other data teams with PoC/Adhoc execution for debugging/cost analysis
  • Develop and apply patches for the data production system. 

Qualifications

  • 4+ years of experience of Spark/MapReduce(Pig, Hive etc.) in a production environment
  • A deep understanding of Hadoop design principals, cluster connectivity, security, and the factors that affect distributed system performance.
  • Experience in Cloudera/Hortonworks and Google Cloud Platform.
  • Knowledge of best practices related to security, performance, and disaster recovery.
  • Good collaboration & communication skills, the ability to participate in an interdisciplinary team.


Additional Information

 

  • Development experience in Java/Scala/Python.
Signaler cette offre d'emploi
checkmark

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.

Postuler
Mon email
En cliquant sur « Continuer », je consens au traitement de mes données et à recevoir des alertes email, tel que détaillé dans la Politique de confidentialité de neuvoo. Je peux retirer mon consentement ou me désinscrire à tout moment.
Continuer
Formulaire de candidature