Role: Data Engineer Developer-Bilingual Mid level

Location: Remote/Canada

Duration: 6-12+ Months

Job Description:

• Data Integration: Lead the integration of data from core banking systems into our Hadoop-based data infrastructure. Develop and maintain efficient data ingestion processes.

• Hadoop Ecosystem: Design, build, and optimize data pipelines within the Hadoop ecosystem, including HDFS, Sqoop, Unix shell scripting, Python coding and Spark.

• Data Modelling: Create and maintain data models, schemas

• ETL Processes: Develop Extract, Transform, Load (ETL) processes to cleanse, enrich, and transform data for downstream consumption.

• Data Quality: Implement data quality checks and monitoring processes to ensure the accuracy, completeness, and consistency of data.

• Performance Optimization: Optimize data processing and query performance within the Hadoop ecosystem.

• Data Security: Ensure data security and compliance with data privacy regulations during data handling and processing.

• Documentation: Maintain thorough documentation of data pipelines, transformations, and data flow processes.

• Collaboration: Collaborate with cross-functional teams, including banking consulting, data scientists, analysts, and business stakeholders, to understand data requirements and deliver actionable insights.

• Mastery of the core banking backend tables and data model is essential.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.

• 3 to 6 Years of proven experience in designing and implementing data solutions within the Hadoop ecosystem.

• Strong expertise in Hadoop components such as HDFS, Sqoop, Unix shell scripting, Python coding and Spark

• Experience with core banking integration and data extraction.

• Proficiency in SQL and database systems.

• Knowledge of data modeling and ETL processes.

• Strong problem-solving and analytical skills.

• Excellent communication and teamwork abilities.

• Banking or financial industry experience is a plus.

• Certifications in Hadoop or related technologies are beneficial.