Job Description

  • Contractor
  • Anywhere

Are you an experienced Data Analyst ready to lead transformative projects? Apply Now!

Working with one of our top financial clients, this role calls for a Data Analyst. This position involves leveraging advanced data engineering skills within a dynamic, transformation-focused environment to support global asset management initiatives. The successful candidate will work closely with senior data engineers and business analysts to develop, optimize, and deploy data solutions using cutting-edge Azure and Databricks technologies.

Responsibilities

Develop and maintain data pipelines using Azure Data Factory, Databricks, and Azure Functions (C#)
Design, implement, and optimize Delta Lake tables with proper schema, design, properties, and security access
Migrate and manage Databricks workspace configurations, including transitioning from Hive metastore to Unity Catalog, ensuring appropriate permissions setup
Create notebooks and scripts in Python / Spark for data transformation and validation
Configure and manage Unity Catalog and data governance policies
Develop DevOps pipelines for deployment and CI/CD workflows using Azure DevOps and GitHub Enterprise
Manage Azure Entra ID for Single Sign-On, RBAC, and security controls
Work with diverse data sources to load datasets into Databricks, implementing Medallion architecture
Collaborate with stakeholders and team members to troubleshoot, resolve technical issues, and optimize workflows
Lead small teams and technical problem-solving sessions, demonstrating independence and leadership in a regulated environment
Desired Skill-Set

7+ years experience with Azure Data Factory, Databricks, and Azure Functions (C#)
Proficient in Python / notebooks on Databricks / Spark / Pandas
Expert knowledge of Unity Catalog and data governance setup and configuration
Experience in migrating Databricks workspace from Hive Metastore to Unity Catalog
Strong skills in creating Delta tables with security and proper schema design
Hands-on experience with Delta Live Tables (nice to have)
Proficiency in Azure DevOps / GitHub for DevOps and deployment pipelines
Deep understanding of Azure PaaS resources such as Azure SQL PaaS, ADLS, Synapse, and Azure Entra ID
Familiarity with working in a highly regulated, security-conscious Windows environment
Proven ability to work independently and lead technical teams
Financial services industry experience (asset)
Nice to Have

Previous experience with financial institution
Knowledge of advanced Databricks functionality and transformations
Experience working on projects involving complex data governance and security policies