Role: Software Developer// Senior Database migration consultant
Location: Toronto, Canada
Duration: Long term
Rate: Market
Assignment Deliverables:
As a member of the development team, you will be responsible to migrate high-sensitive and large volume data from the existing Oracle database to the new Azure SQL Server, DataOps / Pipeline and on-going Database Administration.
A high-level list of deliverables follows:
o Data Analysis: analyze the existing data in the applications, understand its structure, quality, and relationships and help in designing an appropriate migration strategy;
o Data Mapping and Transformation: map the data elements from the application to the corresponding entities and fields in Azure SQL Database. Handle necessary data transformations, ensuring compatibility and consistency between the legacy data and the target system;
o Data Extraction: help extract the required data from the application, develop and implement extraction processes to retrieve data from various sources, such as databases, files, APIs, or other relevant systems;
o Data Cleansing and Validation: cleanse and validate the extracted data to ensure its accuracy, completeness, and consistency. Help with identifying and resolving data quality issues, performing deduplication, and applying business rules to ensure the integrity of the migrated data;
o Data Migration Strategy and Execution: review the present migration strategy that outlines the overall approach, sequence, and timeline for migrating the data from Oracle database to Azure SQL Database using a delta-load approach; execute the migration plan efficiently, managing data transfers and ensuring minimal disruption to ongoing operations;
o Data Testing and Quality Assurance: conduct thorough testing to verify the accuracy and integrity of the migrated data; define test cases, perform data reconciliation, and address any issues or discrepancies that arise during the testing phase; develop KPIs to report on the progress, completeness and quality of the data migration effort;
o Documentation: document the entire data migration process, including data mapping rules, transformation logic, migration scripts, and any specific configurations;
o Ongoing Support: provide post-migration support, analyze and address data-related issues or questions; help optimize data management processes in the new environment, on-going Database Administration
o Implement on-going Database Administration procedures, process and guidebook
o Implement relevant DataOps / pipeline
o Other duties as assigned;
Mandatory Requirements:
- 5+ year experience working with RDBMS, Azure SQL Server, Database Administration, security management for high-sensitive database, database performance management, query performance analysis & tuning, database quality practice, good understanding of Azure storage concepts and technologies.
- 5+ years of working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
- Proficiency in Azure Data Factory, SSMA, Database Migration Services, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
- Proficiency in scripting languages, relational data models, data manipulation languages (T-SQL, PL/SQL), data definition languages, physical database design, and experience with Azure-specific scripting using PowerShell or Azure CLI.
- Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.