Google DataProc Sr Developer
Maarut Inc
Toronto, ON, ca
2d ago

Job Description

  • Design, build and configure applications to meet business process and application requirements.
  • Master's degree in Computer Science, or related field with 10 years of experience in related filed
  • Understanding of Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiplescripting and languages (YAML, Python).
  • Understanding of Google Cloud Platform (GCP) technologies in the big data and data warehousing space (BigQuery, Cloud Data Fusion, Dataproc, Dataflow, Data Catalog) and working knowledge with GCP services pub sub, data proc, Data flow.
  • Demonstrable track record of dealing well with ambiguity, prioritizing needs, and delivering results in a dynamic environment.
  • Excellent verbal and written communication skills with the ability to effectively advocate technical solutions to research scientists, engineering teams and business audiences.
  • Create, customize, monitor, and scale Dataproc clusters
  • Create, customize, Run data processing jobs on Dataproc using Python / Scala / Java
  • Reading / Writing data to / from Cloud Dataproc to Google BigQuery, Cloud Storage and other GCP components
  • Working knowledge on relationship between Dataproc, key components of the Hadoop ecosystem, and related GCP services b :
  • Apply access control to Dataproc and Deep understanding and working knowledge of Apache Spark using Java / python / Scala, Spark performance tunning etc
  • Working knowledge of spark streaming, spark ML
  • Requirements

    Understanding of Google Cloud Platform (GCP) technologies in the big data and data warehousing space (BigQuery, Cloud Data Fusion, Dataproc, Dataflow, Data Catalog) and working knowledge with GCP services pub sub, data proc, Data flow.

    Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form