Titre du poste ou emplacement
RECHERCHES RÉCENTES

Senior Lead Data Engineer - Cloud and Integration (AWS)

VDart Inc - 23 emplois
Toronto, ON
Temps plein
Exécutif

Job Title: Senior Lead Data Engineer - Cloud and Integration (AWS)

Location: Toronto, ON

Duration: Fulltime

Responsibilities:

  • Understanding of design concepts and experience in implementing data solutions covering Data Lakes, Data Warehouses and Analytic solutions.
  • Strong data engineering experience in the cloud, ingesting and processing data both in batch and streaming mode, following best practices covering error handling, re-processing, performance optimization, etc
  • Experience in managing data pipelines and providing production and operations support
  • Experience engaging with users to understand requirements
  • Experience in data modeling using methodologies such as Data Vault 2.0, Dimensional modelling and 3NF modeling
  • Strong experience in AWS data ecosystem having worked on AWS native components and services such as S3, Glue, RedShift, Athena, CloudFormation, etc
  • Good experience in Apache Spark with Scala and Python
  • Experience in Big Data stack (Hadoop ecosystem)
  • Experience implementing cloud data solutions leveraging Snowflake data cloud
  • Experience in data integration platforms like Matillion and Data Warehouse Automation tools (Wherescape Red or similar)
  • Strong SQL programming skills and experience in code versioning (GIT/SVN)

Key Skills:

AWS Data Engineer, Cloud Data Integration, Data Lakes, Data Pipelines, Data Modeling, AWS Data Ecosystem, Apache Spark, Scala, Python, Snowflake, SQL Programming