Senior Data Engineer
GuruLink
Toronto, Ontario, Canada
9d ago

Job Description

We believe that understanding data is a fundamental skill and when leveraged well, it can be used to elevate even the best designed products.

This is why we’re thrilled to be adding two Data Engineers to our engineering team. We are looking for people to work alongside our engineers and project managers to improve and maintain the integrity of our data systems which are responsible for transforming the millions of raw logs we capture each day into actionable insights used by everybody in the company.

These actionable insights are foundational to improving the user experience in our products in a meaningful way. This role is intended for a highly experienced and technically proficient candidate.

You will work on :

  • Acquiring a complete understanding of how data moves and is transformed across our systems from raw event logs to critical reports consumed by internal teams
  • Creating and maintaining optimal data pipelines within our architecture
  • Building jobs and tools on top of the data pipeline to provide actionable insights into key metrics
  • Debugging discrepancy issues that come up in the ETL (e.g. misaligned metrics with 3rd parties, duplicates, failures in the ETL, performance bottlenecks)
  • Building tools to automate data verification and ensure integrity of our reported metrics
  • Integrating data from multiple sources across internal and external partners
  • Working alongside Architects and Project Managers to strive for greater functionality in our data systems
  • Must Have Skills :

  • Strong SQL skills
  • Experience with tools used for large scale data processing : Spark, Hadoop, Kafka
  • Experience with AWS cloud services : EC2, EMR, RDS, Redshift, Kinesis, Api Gateway. Lambda
  • Experience with object-oriented, functional and scripting languages : Scala, Python, Java
  • Experience with relational SQL and NoSQL databases, including Redshift, Postgres, Redis and MySQL
  • Knowledge of message queuing, stream processing, and highly scalable big data’ technologies
  • Nice to Have Skills :

  • Knowledge of Machine Learning and experience implementing ML applications
  • Worked with real time and streaming analytics
  • Experience building tech that operates at scale
  • Contributed to an Open Source Project
  • Details :

    Starting : ASAP Travel : 0% Dress Code : Casual

    Apply
    Add to favourites
    Remove from favorites
    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form