Big Data Compute Platform Development Engineer
Huawei Technologies Co., Ltd
Markham, Ontario, CA
12m ago

As a member of the Big Data Compute Platform Development team, you will help create state of the art technologies surrounding big data ecosystem.


  • Lead in analyzing the software requirements and software elements for system design.
  • Determine the software implementation architecture.
  • Plan and lead the software development at the product or platform level.
  • Take charge of the design and code writing for a specific cross-sub-system or codes of key algorithms.
  • Work closely with the other teams to ensure architectural integrity.
  • Participate in different open source and standard meetings to present solutions
  • Work with distributed resource management system, workload scheduling, and application lifecycle.
  • Qualifications

  • Bachelor / Master degree in Computer Science, Electrical Engineering.
  • 3+ years of work experience in related field
  • Proficient in Java and scripting languages such as Python, Perl, etc., and deep understanding of object-oriented design principles.
  • Proficient in related software development tools, such as IDE, code / version controls.
  • Familiar with various design patterns, good component and modeling ability.
  • Familiar with the design principles and application methods of distributed system, such as Hadoop, YARN, Spark, Hive, HDFS, and NoSQL databases.
  • Familiar with mainstream big data related technologies and distributed frameworks
  • Experience developing and using virtualization, container-based and cloud platforms such as Kubernetes, Openstack, Swarm, Docker, etc.
  • Must demonstrate strong people leadership skills, project management and communication skills.
  • Strong collaboration skills to partner effectively with teams throughout the organization.
  • Exposure to any of the following traits would be a bonus : Experience in developing Micro Services, Serviceless architecture, Service Oriented Architecture, Web Services, or Data Processing Pipeline.
  • Experience developing in Scala and golang. Experience implementing and using streaming platforms such as SparkSQL, Flink, Kafka, Storm, etc.

    Experience with handling large datasets in data mining and machine learning tools.

    Add to favourites
    Remove from favourites
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form