Loading... Title : Data Engineer Job ID : KH2778361925
Location : CalgaryOur client is seeking a Data Engineer who will be play a vital role in expanding and optimizing their data and data pipeline architecture, as well as optimizing data flow and collection related to their integrated operating center, situational awareness, mining, processing and engineering systems.
The successful candidate will support the team in designing, building and optimizing their company’s data architecture. Responsibilities :
Be a courageous safety leader, adhere to and sponsor safety and environmental rules and procedures
Create and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements
Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-
designing infrastructure for greater scalability, etc
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Google Cloud Platform and Microsoft Azure big data’ technologies
Other duties as assigned
Certificates / Training : Bachelor’s degree in Computer Science, Statistics, Information Systems or another quantitative fieldGoogle Cloud Platform or Microsoft Azure professional certification, desired.
Experience : 5+ years of experience in a Data Engineer roleGoogle Cloud Platform and / or Microsoft Azure cloud servicesAdvanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databasesBuilding and optimizing big data’ data pipelines, architectures and data setsStream-
processing systems : Storm, Spark-Streaming, etc.Object-oriented / object function scripting languages : Python, Java, C++, Scala, etc.
Working with cross-functional and international teams in a dynamic environment
Knowledge and SkillsStrong analytic skills related to working with unstructured datasetsBuild processes supporting data transformation, data structures, metadata, dependency and workload managementA successful history of manipulating, processing and extracting value from large disconnected datasetsWorking knowledge of message queuing, stream processing and highly scalable big data’ data storesStrong project management and organizational skillsExcellent written and verbal communication skillsExcellent knowledge of Spanish will be an asset