Principal Software Engineer
HAYS Specialist Recruitment (Canada) Inc.
Vancouver, BC, CA
4d ago
source :

Our client is seeking a Principal Software Engineer in Vancouver

Job Description : Arm Treasure Data began by offering data warehousing and processing services; since then we've moved further up the value chain with our Customer Data Platform application (CDP), which is seeing a lot of traction with customers new and old.

CDP is built atop our existing data infrastructure called Query Engines, which currently includes Hive / Hadoop and Presto, that sees more than two million events every second and services nearly seven million data queries monthly.

We are seeking an engineer that eagerly wants to take on the challenge of multi-tenant large scale data processing, including job and resource scheduling, optimization of query execution, and resilience engineering.

Together with the team you'll be working towards the continuous advancement of the state of the art of data processing at Arm Treasure Data.

The primary responsibilities of this job are : building new features, maintenance and refactoring of existing code, carrying out code and design reviews, testing and automation, and operations of the system.

Furthermore, our approach is not static and as part of the team we want you to help evolve how we do things. Along with your team, you will work with other Engineering Teams, Product Managers, QA Engineers, and Customer Support Staff to understand what to build next and how to do it.

You will collectively build, maintain, and operate the Presto Query Engine, while continuously monitoring, evaluating, and course correcting based on key metrics.

The ideal candidate will be able to help our team improve product related outcomes, such as ensuring that the Presto Query Engine continues to scale with customer growth, and handles new types of workloads as we expand the CDP feature set.

Things you will do :

  • Build and contribute to the Java Presto engine, extend the engine to adapt to the Treasure Data Platform needs, and maintain various versions running as a multitenant service.
  • Build, expand & improve, and maintain the Presto production ecosystem of microservices written in Java or Scala.
  • Write high quality, maintainable code always seeking high levels of test coverage.
  • Consistently reduce complexity across the organization by collaborating with teams and engineers to come up with an elegant solution for a problem.
  • Join the team in an on-call rotation to be able to react and respond to production incidents.
  • Build and maintain the infrastructure code supporting the Presto ecosystem in collaboration with the Infrastructure team.
  • Leverage data and analytics to surface key performance metrics, improve observability, and reduce mean-time-to-recovery (MTTR) for incidents.

  • As part of our system resilience efforts you'll participate in our incident response practices, which involve on call, postmortems, defining takeaways, and scheduling fixes.
  • Collaborate with other teams in charge of the underlying data platform and storage system in defining requirements and initiatives to support the advancement of the Presto Query Engine.
  • Your experience and skills will include :

  • 10+ years of full stack software engineering experience with a proven track record of timely delivery.
  • 5+ years of experience running and maintaining cloud systems, AWS in specific.
  • 1+ year experience programming in Java and other typed programming languages.
  • 1+ year experience in testing, diagnosing and fixing performance scale issues in production
  • 1+ year experience with analytical query engine and streaming services including Spark, Kafka.
  • Experience mentoring other engineers.
  • University degree in Computer Science or related
  • Additional requested knowledge : Business Equipment and Computer Applications : One are more of (Xcode, Microsoft Visual Studio, Sublime Text, Eclipse);
  • Computer and Technology Knowledge : Business Intelligence, Cloud, Word Processing Software, Presentation Software, Project Management Software, Programming Software, Web Service Design, Database Software, Programming languages, Software Development, Data analysis software, SQL.

    Operating Systems : Environment - Client / Server, Environment - Distributed, Linux; Operating Systems and Software : Bourne-again Shell.

    Programming Languages : Shell Script, Java, Object Oriented Programming languages, Git, Scala, Python. Area of specialization : System Integration.

    You can expect a work environment where the team is collaborative and open to your ideas, while we keep our collective eye on supporting our customers' needs.

    Our team is committed to technical innovation in our product and in the world through customer collaboration, open-source projects, and by continuing to make our product an integral part of our customers' growth and success.

    Fast paced environment. Tight deadlines. We are an equal opportunity employer dedicated to building an inclusive and diverse workforce.

    We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

    About Us Arm Treasure Data provides an end-to-end, fully managed cloud service (data acquisition, storage and analysis capability) for Big Data that is trusted and simple.

    As the original developers of Fluentd, an advanced open-source log collector specifically designed to solve the big data log collection problem, Arm Treasure Data solves the problems for companies wanting the ability to manage their big data needs.

    Agencies and recruiters, we cannot consider your candidate(s) without a contract in place. Any resumes received without having an active agreement will be considered gratis referrals to us.

    Thank you for your understanding and cooperation!

    What you need to do now

    If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.

    If this job isn't quite right for you but you are looking for a new position, please contact us for a confidential discussion on your career.

    Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form