Title: Software Developer - ETL

Location: Toronto, ON

Mode: Contract

Must Haves -

• 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
• Proficiency in Azure Data Factory, Azure Synapse workspaces, PolyBase, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
• Strong SQL skills and experience working with Azure SQL Databases and Dataverse; good understanding of Azure storage concepts and technologies.
• Proficiency in scripting languages like Python, experience with Azure-specific scripting using PowerShell or Azure CLI.
• Expert proficiency with data manipulation languages (T-SQL, PL/SQL), data definition languages, physical database design, data modeling, query performance analysis & tuning
• Knowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
• Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.
• Familiarity with data warehousing concepts and experience working with Azure Synapse Analytics or similar platforms for building and managing large-scale data warehousing/lakehouse solutions.
• Experience with SSIS, SSRS, PowerBI.

Nice To have:

• Azure cloud certifications (e.g. Azure fundamentals, Azure Data Engineer associate, Azure Database Administrator associate)
• Experience with PowerApps platform, Power Automate, Dynamics CE and F&O

Desired Skills and Experience:

• 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
• Experience in integrating various data sources and systems, both on-premises and in the cloud, using Azure ETL services or other ETL tools
• Knowledge of integration technologies commonly used with Dynamics, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
• Expertise in data transformation techniques, such as data cleansing, aggregation, enrichment, and normalization using Azure cloud technologies
• Understanding of data quality management practices, including data profiling, data validation, and error handling within ETL processes.
• Understanding of data governance principles, data privacy regulations and experience working with high-sensitivity data, and knowledge of best practices for data security and compliance in Azure.
• Ability to monitor and troubleshoot ETL processes, optimize query performance, and implement efficient data processing techniques in Azure.
• Proficiency in Azure Data Factory, Azure Synapse workspaces, PolyBase, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
• Strong SQL skills and experience working with Azure SQL Databases and Dataverse; good understanding of Azure storage concepts and technologies.
• Proficiency in scripting languages like Python, and experience with Azure-specific scripting using PowerShell or Azure CLI.
• Expert in data manipulation languages (T-SQL, PL/SQL), data definition languages, physical database design, data modelling, query performance analysis & tuning
• Familiarity with version control systems (e.g., Azure Repos) and collaboration tools (e.g., Azure DevOps) for managing code, tracking changes, and collaborating with team members.
• Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.
• Experience with SQL Server Management Studio, Azure data management tools, XRM toolbox, data modeling tools (preferably, ERWIN).
• Familiarity with data warehousing concepts and experience working with Azure Synapse Analytics or similar platforms for building and managing large-scale data warehousing/lakehouse solutions.
• Experience with SSIS, SSRS, PowerBI