Senior Data Engineer

Job Description

Exciting Opportunity: Senior Data Engineer
Location: Hybrid, Toronto, Ontario, Canada
Security Clearance: Required
Type: Long-term Contract

Are you ready to shape the future of data architecture, warehousing, and analytics for a leading-edge organization? We are seeking a Senior Data Engineer who thrives in dynamic environments and is passionate about designing and optimizing cutting-edge data systems. If you have deep expertise in building efficient ETL pipelines, working with cloud technologies, and driving impactful data transformation initiatives, we want to hear from you!
Key Responsibilities:
As a Senior Data Engineer, you will:
Design, develop, maintain, and optimize ETL processes in Databricks for data warehousing, lakes, and analytics.
Work closely with data architects and business teams to ensure seamless data transformation and movement, meeting business needs with a focus on Change Data Capture (CDC) and streaming data.
Led the creation of high-performance data pipelines to process large-scale datasets using Databricks, Delta Lake, Delta Live Tables, and Apache Spark.
Collaborate in the design and maintenance of complex data warehouses and databases.
Engage in data modeling and utilize tools like SAP Power Designer or Visio to create high-quality models and solutions.
Design and optimize database systems for maximum performance and reliability.
Ensure high data integrity through detailed unit testing and documentation.
Work in an Agile environment to deliver scalable data engineering solutions.
Key Skills and Experience:

To succeed in this role, you will bring:
7+ years of experience with SQL Server, T-SQL, Oracle, PL/SQL, or similar relational databases.
2+ years of hands-on experience with Azure Data Factory, Databricks, and Python.
Proven experience building data ingestion pipelines and Change Data Capture solutions using Oracle Golden Gate.
In-depth experience with ETL pipelines, leveraging Databricks and other tools to efficiently process structured and unstructured data.
Strong knowledge of data modeling and tools (e.g., SAP Power Designer, Visio).
Experience with SQL Server SSIS or other ETL tools and proficiency in SQL scripting for complex queries.
Solid understanding of Data Warehouse architecture, including Delta Lake and Delta Live Tables.
Proven ability to design, develop, and troubleshoot high-performance ETL pipelines based on detailed specifications.