We believe that understanding data is a fundamental skill and when leveraged well, it can be used to elevate even the best designed products.
This is why we’re thrilled to be adding two Data Engineers to our engineering team. We are looking for people to work alongside our engineers and project managers to improve and maintain the integrity of our data systems which are responsible for transforming the millions of raw logs we capture each day into actionable insights used by everybody in the company.
These actionable insights are foundational to improving the user experience in our products in a meaningful way. This role is intended for a highly experienced and technically proficient candidate.
You will work on :
Acquiring a complete understanding of how data moves and is transformed across our systems from raw event logs to critical reports consumed by internal teams
Creating and maintaining optimal data pipelines within our architecture
Building jobs and tools on top of the data pipeline to provide actionable insights into key metrics
Debugging discrepancy issues that come up in the ETL (e.g. misaligned metrics with 3rd parties, duplicates, failures in the ETL, performance bottlenecks)
Building tools to automate data verification and ensure integrity of our reported metrics
Integrating data from multiple sources across internal and external partners
Working alongside Architects and Project Managers to strive for greater functionality in our data systems
Must Have Skills :
Strong SQL skills
Experience with tools used for large scale data processing : Spark, Hadoop, Kafka
Experience with AWS cloud services : EC2, EMR, RDS, Redshift, Kinesis, Api Gateway. Lambda
Experience with object-oriented, functional and scripting languages : Scala, Python, Java
Experience with relational SQL and NoSQL databases, including Redshift, Postgres, Redis and MySQL
Knowledge of message queuing, stream processing, and highly scalable big data’ technologies
Nice to Have Skills :
Knowledge of Machine Learning and experience implementing ML applications
Worked with real time and streaming analytics
Experience building tech that operates at scale
Contributed to an Open Source Project
Starting : ASAP Travel : 0% Dress Code : Casual