Sr. Databricks Spark Developer (Banking)

Are you experienced in building scalable data solutions with Databricks? Apply Now!

Working with one of our top financial clients, this role calls for a Sr. Databricks Spark Developer (Banking). This position involves designing, developing, and optimizing large-scale data pipelines using Databricks and Apache Spark, with a focus on delivering robust solutions within the banking or financial services domain. The successful candidate will communicate effectively with both technical teams and business stakeholders, contributing to high-performance data environments in a fast-paced setting.

Responsibilities

Design, develop, and optimize data pipelines utilizing Databricks and Apache Spark
Manage and process large-scale datasets in a distributed computing environment
Collaborate with cross-functional teams including business and technical stakeholders
Participate in solution design discussions and provide insightful technical recommendations
Ensure data quality, performance optimization, and solution scalability
Troubleshoot and resolve data pipeline issues efficiently
Contribute to documentation and best practices for data engineering processes
Desired Skill-Set

Proven hands-on experience with Databricks and Apache Spark development
Familiarity with enterprise environments, preferably in banking or financial services
Strong understanding of distributed computing and data architecture
Excellent verbal and written communication skills
Ability to work independently in a dynamic, fast-paced environment
Experience working on large-scale data projects with multiple stakeholders
Nice to Have

Experience with Kafka or other messaging systems
Knowledge of Python programming
Previous experience in data solution architecture or leadership roles
Familiarity with cloud platforms and related data tools