About the role
Senior Databricks Engineer
This position offers you the opportunity to join a fast-growing technology organization that is redefining productivity paradigms in the software engineering industry. Thanks to our flexible, distributed model of global operation and the high caliber of our experts, we have enjoyed triple digit growth over the past five years, creating amazing career opportunities for our people. If you want to accelerate your career working with like-minded subject matter experts, solving interesting problems and building the products of tomorrow, this opportunity is for you.
Position Overview
We are seeking an experienced Sr Databricks Engineer to join our growing data engineering team. This role will be instrumental in designing, developing, and maintaining our enterprise-level data platform using Databricks to support critical banking operations and analytics initiatives.
Key Responsibilities
- Design, develop, and optimize data pipelines using Databricks and Apache Spark
- Build scalable ETL/ELT processes to ingest, transform, and deliver data from various banking systems
- Implement data lakehouse architecture using Delta Lake for reliable data storage and processing
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements
- Optimize Databricks cluster configurations and query performance for cost efficiency
- Develop and maintain data quality frameworks and monitoring solutions
- Implement security best practices and ensure compliance with banking regulations (PCI-DSS, SOX, GDPR)
- Create and maintain technical documentation for data workflows and processes
- Mentor junior engineers and promote best practices in data engineering
- Participate in code reviews and contribute to continuous improvement initiatives
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, or related field
- 5+ years of experience in data engineering or related roles
- 3+ years of hands-on experience with Databricks platform
Strong proficiency in Apache Spark (PySpark/Scala)
- Expert-level SQL skills and experience with large-scale data processing
- Experience with Delta Lake and data lakehouse architectures
- Solid understanding of cloud platforms (AWS, Azure, or GCP)
- Experience with banking or financial services data and regulatory requirements
- Knowledge of data modeling, data warehousing concepts, and dimensional modeling
- Strong problem-solving skills and attention to detail
Preferred Qualifications
Databricks certification (Data Engineer Associate or Professional)
Experience with real-time streaming data processing (Kafka, Event Hubs)
Knowledge of MLOps and ML model deployment on Databricks
Experience with Infrastructure as Code (Terraform, CloudFormation)
- Familiarity with CI/CD pipelines and DevOps practices
- Experience with data governance tools and frameworks
- Knowledge of Python libraries for data processing (Pandas, NumPy)
- Understanding of banking products, risk management, or fraud detection systems
Technical Skills
Databricks Platform & Unity Catalog
Apache Spark (PySpark, Spark SQL, Scala)
Delta Lake & Data Lakehouse Architecture
SQL & NoSQL Databases
Cloud Platforms (AWS/Azure/GCP)
Python & Scala Programming
Git & Version Control
Data Orchestration Tools (Airflow, Azure Data Factory)
Data Visualization Tools (Power BI, Tableau)
What We Offer
- Competitive salary and performance-based bonuses
- Comprehensive health, dental, and vision insurance
401(k) with company match
Professional development and certification opportunities
Flexible work arrangements
Collaborative and innovative work environment
Opportunity to work on cutting-edge data technologies in the banking sector
About Parser
Parser is a forward-thinking banking company committed to leveraging data and technology to deliver exceptional financial services. We foster a culture of innovation, collaboration, and continuous learning, empowering our teams to drive meaningful impact in the financial industry.
Parser is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.