Data Engineer
Planet4iT
Toronto, ON, CA
1d ago

Great career opportunity in downtown Toronto for a Data Engineer to work with

billions of events, petabytes of data and optimizing for last millisecond. If

this excites you because you've seen enough messy data sets, we're looking for

you.

You will be working on writing frameworks building for real time and batch

pipelines to ingest and transform events (108 scale) from 100 s of applications

every day. You will also help optimize the feature pipelines for fast execution

and work with software engineers to build event driven microservices.

You will get to put cutting edge tech in production and freedom to experiment

with new frameworks, try new ways to optimize and resources to build next big

thing in fintech using data!

The successful applicant will have :

Previous experience building serious data pipelines ingesting and

transforming >

10 6 events per minute and terabytes of data per day

Passion for producing clean, maintainable and testable code part of

real-time data pipeline

Understanding of how microservices work and are familiar with concepts of

data modeling

Experience with Spark and Kafka before and have experimented or heard about

Flink / Druid / Ignite / Presto / Athena and understand when to use one over the other

Proficient in Java / Scala / Python / Spark

Report this job
checkmark

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.

Apply
My Email
By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
Continue
Application form