Position: Data Engineer (Montreal or Toronto)
Location requirements: Hybrid / 2 days at the office
Salary/hour: 85$ CAD

Key Responsibilities:

• Design, implement, and maintain data pipelines with complex data transformations.
• Assemble large, complex data sets that meet functional and non-functional business requirements.
• Collaborate with stakeholders to address data-related technical issues and support their data infrastructure needs.
• Translate functional requirements into technical specifications in partnership with business teams.
• Conduct business and functional requirements gathering and provide project estimates.
• Communicate effectively, explaining work in a manner that is understandable to all team members and framing problems to ensure the right questions are asked.
• Support and work with cross-functional teams in a dynamic environment.
• Maintain a strong software engineering background.

Required Technologies:

• Extensive experience with PySpark and Spark.
• Proficiency with Databricks.
• Strong expertise in the AWS ecosystem.
• Significant experience with Snowflake.
• Minimum of 8 years of industry experience working with data, coding, and scripting in Python, Java, Scala, SQL, JavaScript, Bash, design, and testing.
• Solid experience with major Big Data technologies and frameworks, including but not limited to Hadoop, HIVE, MapReduce, Spark, Cassandra, Kafka, and Elasticsearch.
• Experience with relational SQL and NoSQL databases, including Oracle, Postgres, and Cassandra.

Additional Requirements:

• Knowledge of data visualization best practices and cloud warehouses (e.g., Snowflake, Redshift) is an asset.