QA Automation Engineer – Data Migration & Databricks Validation

Job Description

  • Contractor
  • Anywhere

Are you ready to lead data quality assurance for large-scale pipelines and Python-based processes? Apply Now!

Working with one of our top financial clients, this role calls for a QA Automation Engineer –  Data Migration & Databricks Validation who can validate complex data transformations, ensure reliable ETL outcomes, and strengthen automated testing practices in a Databricks environment.

Pay rate range (CAD): $50.00/hr – $55.00/hr

Responsibilities

Design, build, and maintain automated data validation scripts for ETL and data pipelines
Validate large-scale data volumes across transformations and pipeline outputs
Perform SQL-based testing and verification using SSMS and database queries
Test and assess Python-based processes to confirm data correctness and reliability
Verify data quality for ingested files, structured outputs, and downstream datasets
Ensure testing coverage for backend/data workflows in environments with no UI testing
Support quality practices within Databricks-based development workflows
Desired Skill-Set

Strong QA automation experience in data-centric environments
Experience validating large volumes of data and ETL pipelines
Advanced SQL skills with hands-on SSMS experience
Ability to write and maintain automated data validation scripts
Experience testing Python scripts
Experience validating data files, transformations, and data quality
Exposure to Databricks and Unity Catalog
Ability to work effectively in back-end/data testing only (no UI testing)
Nice to Have

Basic understanding of Mutual Funds and GICs
Experience working on data migration or cloud modernization projects