Data Architect / Data Solutions Architect (Databricks)

NEW ROLE: Data Architect / Data Solutions Architect (Databricks)
📍Location: Toronto Canada (Hybrid)
Duration: Fulltime
Job description:
Summary:
1. The Data Architect / Data Solutions Architect (Databricks) will lead the design, governance, and strategy of the company’s data systems, encompassing the data warehouse, data lake, and integrations between systems.
2. This role ensures the scalability, security, and performance of the data ecosystem, aligning it with business objectives.
3. The ideal candidate combines technical expertise with strategic vision, leveraging tools like Databricks and GCP/Azure to build a robust and future-proof architecture.

Responsibilities:
1. Key responsibilities include, but are not limited to:
Architecture Design & Strategy
2. Design and oversee the architecture of the company’s data warehouse and lakehouse using Databricks and Azure/GCP services.
3. Develop and maintain best practices for data modeling, storage, and system integration.
4. Define the roadmap for enhancing the data ecosystem, focusing on scalability, innovation, and business alignment.
Strategic Oversight
5. Act as a key advisor to business and IT leaders, ensuring data systems support organizational goals.
6. Lead initiatives to integrate emerging technologies (e.g., MLflow, Unity Catalog) into the company’s data strategy.
7. Ensure compliance with data governance, security, and privacy regulations.
8. Data Integration Leadership
9. Provide guidance on the design and optimization of ETL/ELT pipelines using Databricks, Delta Live Tables, and Azure Data Factory/Dataflow/Dataproc.
10. Collaborate with SMEs and analytics teams to streamline data ingestion and enhance reliability.
11. Supervise the integration of data from structured, semi-structured, and unstructured sources.
12. Performance & Cost Optimization
Oversee resource utilization and performance tuning of Databricks clusters and Spark jobs.
13. Implement strategies to reduce cloud costs while maintaining high performance and scalability.
14. Mentorship & Team Collaboration
Mentor and guide data engineers, analysts, and developers to implement architectural standards.
15. Foster collaboration between cross-functional teams to align data solutions with business needs.
16. Drive organization-wide adoption of data management best practices.
Security, Compliance, & Governance
17. Establish and enforce data security frameworks, including RBAC, encryption, and secure key management.
18. Collaborate with IT and compliance teams to maintain audit readiness and adhere to industry standards.

Qualifications & Requirements:
1. Advanced experience with Databricks features, such as Unity Catalog, MLflow, and Delta files.
2. Familiarity with Apache Spark internals and advanced libraries.
3. Knowledge of BI tools and platforms (e.g., Sage, Solver, Trux, DayForce, Dossier).