About the role
Data is the most important asset in today’s competitive world. We are the Data and Analytics department of the largest P&C insurer in Canada.
Our mission is : Accelerate our data advantage by bringing to user analytical data ready to be consumed, at a proper level of trust and security .
Our team is using modern concepts, tools and technologies for data ingestion, acquisition and data consumption and work with Agile framework.
We are structured into small, highly productive squads and working very close with the Data Lab team composed of Actuaries and Data Scientists.
You dream of exciting challenges? Join our team as a Data Engineering Developer and contribute to the planning and execution of data pipelines for various machine learning projects.
You will :
Design, implement, and maintain large-scale batch and real-time scalable data pipelines with complex data transformations;
Perform data wrangling to transform and map data from raw data forms into formats more appropriate and valuable for analytics;
Write and optimize complex queries on large data sets;
Assemble large, complex data sets that meet functional / non-functional business requirements;
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs;
Experience working with business teams to translate functional requirements into technical requirements;
Conduct business and functional requirements gathering and provide projects estimates;
Experience supporting and working with cross-functional teams in a dynamic environment;
Develops workflows and tools that automate data loading processes and help ensure data quality and integrity.
You are :
Motivated and autonomous, you love learning and applying new technologies to solve complex problems;
Eager to understand how the business works and how your work impacts the business;
Comfortable working in complex environments and multidisciplinary teams;
Fast learner, versatile and a good team player;
Excellent communicator with good analytical skills.
You have :
A bachelor’s degree in computer science, Software Engineering or equivalent;
Minimum of 5 years of experience in a Data Engineering role (ingestion and consumption);
Hands-on experience with leading commercial Cloud platforms, including AWS and Azure;
Excellent Python and PySpark skills;
Strong experience with Apache Spark ( Databricks or similar), Kafka and NiFi;
Hands-on experience with Snowflake or Redshift, or similar cloud storage technologies;
Hands on experience with Hadoop distributions (Cloudera, Hortonworks) and Hive;
Strong experience with relational SQL and NoSQL databases like PostgreSQL, Oracle, Cassandra, Mongo DB;
Experience with ElasticSearch and Kibana is a big plus;
Experience with Alation and / or other data catalog tools (Azure, Informatica) is a big plus;
Experience with Kubernetes, Docker is a big plus;
Experience with Agile development methodologies;
Strong presentation, facilitation, verbal and written communication skills, including interpersonal skills.
Here are a few reasons why others have joined our team :
An award-winning, inspiring workplace that supports its people and recognizes great work
Stimulating, challenging projects and development opportunities to help you grow your skills and career
Flexibility in how and where you work
A comprehensive financial rewards program that recognizes your success
An extensive, flexible benefits package
An industry leading Employee Share Purchase Plan where we match 50% of net shares purchased
A casual dress for your day’ culture that encourages you to be yourself
A $350 annual wellness account that promotes an active lifestyle