Senior Data Engineer
iQmetrix
Winnipeg, Manitoba, CAN
6d ago

Description

You will have a clear focus on distributed, self-service data platform capabilities, BI products and the ways in which our customers need to consume data.

Your immediate goal is to build a resilient, scalable, and maintainable high-throughput platform for all iQmetrix customer needs.

Once the new data platform is created you will be able to realize the rewards of this brand-new system by helping with pipelines for machine learning.

A typical day might include attending daily stand-ups, meeting with clients along with product, pressure testing new systems, and collaborating on new systems with an architect.

Accountabilities :

  • Fully understanding client challenges and business needs so that these can be considered during the development of this new platform.
  • Develop, construct, test and maintain architecture.
  • Align the architecture to business and client requirements.
  • Develop data set pipelines and processes including data integrity and quality testing.
  • Identify ways to improve data reliability, system efficiency and quality.
  • Facilitate deeper analysis for reporting.
  • Working with the iQmetrix data science team.
  • Collaborating with architecture to develop pipelines for predictive and prescriptive modelling.
  • Basic Qualifications :

  • Experience in Data Modeling, ETL Development, and Data Warehousing.
  • Experience dealing with Highly Scalable Data systems like Apache Hadoop, Azure Data Lake, Apache Spark or others. As well as relational or NoSQL languages.
  • Experience using business intelligence reporting tools (Power BI, Tableau, SI Sense, Looker, etc.).
  • Experience using big data technologies (Hadoop, Spark, Hive, Hbase, etc.).
  • Experience with CDC logging, databricks, and Kafka.
  • 2+ years Public Cloud Development Experience.
  • Knowledge of Data Management fundamentals and Data Storage principles.
  • Experience coding and automating processes using Python or R.
  • Strong customer focus, ownership, urgency, and drive.
  • Excellent communication skills and the ability to work well in a team.
  • Effective analytical, troubleshooting, and problem-solving skills.
  • Experience building end-to-end data pipelines capable of handling high throughput from scratch.
  • Preferred Qualifications :

  • 3+ years of experience using big data technologies including Hadoop and Spark.
  • Experience working with Microsoft big data technologies (Synapse, Data Factory, data lake).
  • Experience with clustered column store data warehouses such as Synapse and Redshift.
  • Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy.
  • Experience providing technical leadership and educating other engineers for best practices on data engineering.
  • Background in Big Data, non-relational databases, Machine Learning and Data Mining is a plus.
  • Masters in computer science, mathematics, statistics, economics, or other quantitative fields.
  • Experience with managing a team.
  • What Does it Take to Be a Part of Our Team?

  • Communication skills and emotional intelligence are key. iQmetrix is looking for someone who can listen to others and take multiple perspectives into consideration when making decisions decision.
  • People who love what they do; they’re passionate about their work.
  • With interpersonal skills, a team member can build strong relationships from scratch. We love that.
  • Be humble. We’re on the hunt for, someone who is not afraid to admit their mistakes and work towards preventing them in the future.
  • Thinks about the health of the company before personal agendas. Profit and loss are major influencers on organizational decisions and our team must have the big picture in mind always.
  • Being a self-starter is a huge asset. This means being able to dive into the work without fear of making a mistake.
  • Flexibility, and the ability to adapt to an evolving environment, will go a long way at iQmetrix. Keep in mind : the iQmetrix team works in open, collaborative office environments.
  • Successful people can thrive in this style of workspace.

  • People who can stick by their decisions, since they did what they thought was best, will fit well into the iQmetrix team.
  • These people are also not afraid to admit to and learn from their mistakes.

    Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form