Job Description
Quarry Consulting is looking for a Lead Data Engineer – Remote in Ontario
This is a 1 year contract.
Must Have skill and experience:
· Hands-on experience in Databricks architecture, administration, and performance optimization
· 7+ years of experience in data engineering, with a strong background in cloud-native data architecture.
· Strong knowledge of Spark performance tuning and job optimization.
· Expertise in Databricks SQL, PySpark, Delta Lake, and large-scale data pipelines.
· A background in building reusable Python libraries with Pandas, Openpyxl, XLSXWriter, and PySpark.
· Experience working with Unity Catalog for security and governance.
· SQL expertise and hands-on experience with PostgreSQL, SQL Server, or similar.
· DevOps expertise with tools like Azure DevOps, Git, and pipeline automation.
Should you have the above experience feel free to send a WORD version of your resume to: bmckenna@quarryconsulting.ca
Quarry Consulting would like to thank all candidates but only those with above experience in the resume will be contacted.