Lead Data Engineer

Job Description

  • Contractor
  • Anywhere

Quarry Consulting is looking for a Lead Data Engineer – Remote in Ontario
This is a 1 year contract.

Must Have skill and experience:
· Hands-on experience in Databricks architecture, administration, and performance optimization
· 7+ years of experience in data engineering, with a strong background in cloud-native data architecture.
· Strong knowledge of Spark performance tuning and job optimization.
· Expertise in Databricks SQL, PySpark, Delta Lake, and large-scale data pipelines.
·  A background in building reusable Python libraries with Pandas, Openpyxl, XLSXWriter, and PySpark.
· Experience working with Unity Catalog for security and governance.
·  SQL expertise and hands-on experience with PostgreSQL, SQL Server, or similar.
· DevOps expertise with tools like Azure DevOps, Git, and pipeline automation.

Should you have the above experience feel free to send a WORD version of your resume to: bmckenna@quarryconsulting.ca

Quarry Consulting would like to thank all candidates but only those with above experience in the resume will be contacted.