Senior Software Engineer ETL

About the job
Type: Contract

Role: Senior Software Engineer ETL

Term: 1 Year + extension option

Pay Rate: $90.00

Start date: 3-4 weeks

Location: Toronto / Hybrid

Requirements: What you’ll need

Skills, Knowledge, Experience, and Qualifications:

Sr. Software Engineer – ETL, Databricks, RAG data for AI

Role Overview:

We are seeking a skilled Software Engineer with expertise in ETL workflows, Python, Databricks, Azure Data Lake, and Key Vault, along with a strong understanding of Retrieval-Augmented Generation (RAG) techniques. This role requires a mix of technical skills and ownership to develop, deploy, and manage data solutions that meet client needs. The ideal candidate will be responsible for the end-to-end hands-on development of scalable ETL pipelines.

Key Responsibilities:

Design, develop, and optimize ETL workflows using Python, Databricks, and Azure Data Lake.Implement secure and scalable data solutions, leveraging Azure Key Vault for secrets management.Work closely with data scientists and machine learning engineers to integrate Retrieval-Augmented Generation (RAG) techniques into data workflows.Develop proof-of-concept (PoC) solutions to evaluate new technologies and approaches in data engineering.Own and manage the data pipeline roadmap, ensuring continuous improvement and optimization.Monitor, debug, and optimize ETL processes for performance and reliability.Maintain documentation, best practices, and knowledge sharing across teams.

Skills & Qualifications:

Strong problem-solving skills and ability to work independently on complex technical challenges.5+ years of experience in ETL development, data engineering, software integration, or a related role.Strong proficiency in Python and SQL, with experience in PySpark and distributed computing.Strong ability to write and refactor Python code, create classes and functions.Ability to follow architectural guidance and adhere to patterns, conventions.Expertise in Databricks and Azure Data Lake for building and optimizing large-scale data pipelines.Solid understanding of Retrieval-Augmented Generation (RAG) and its applications in AI-driven workflows.Familiarity with Azure services.Experience in developing proof-of-concept (PoC) solutions to validate technical approaches.Experience with Azure KeyVault for secrets and credential management.Ability working in Agile, fast-paced, data-driven environment.

PREFERRED SKILLS

Formal education in a relevant field is a plus.Previous experience with other programming languages is a plus.Experience working with large-scale distributed systems.General understanding of LLMs (Large Language Models) LangChain and LangGraph and their integration with data pipelines.Familiarity with CI/CD practices in data engineering, including Azure DevOps and Git.

HOW TO APPLY

Matt Dawsonis hiring for this position.

Apply to this position through LinkedIn Easy Apply or Email us at: talent@wirehead.com

Interested in working with us in the future?

Privately share your profile with us: talent@wirehead.com

Follow Wirehead on LinkedIn

We thank all candidates for their interest but advise that only candidates selected for interviews will be contacted directly. Rest assured that your resume will be kept on our database and will be considered for all future opportunities.

Applicants must be authorized to work in Canada.

Wirehead is proud to be an Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, status as a crime victim, disability, protected veteran status, or any other characteristic protected by law. Wirehead is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. If you need special assistance or an accommodation while seeking employment, please contact a member of our Human Resources team to make arrangements. Email: accessibility@wirehead.com

Your Right to Work – All persons hired will be required to verify identity and eligibility to work in the Canada and to complete the required employment eligibility verification document form upon hire.