Hiring.Camp

Senior Databricks Engineer, Apache Spark and AWS - Vice President

Citi Bank

·

Aug 25, 2026

Location
Pune, MH,IN, IN
Type
Full-time
Department
Engineering
Seniority
VP
Source
Eightfold

Description

We are looking for a highly skilled Senior Databricks Engineer to contribute to the engineering, modernization, and continuous evolution of data processing platform on Databricks on AWS. While supporting the transition from the legacy Cloudera Hadoop platform to Databricks on AWS, this role will continue to play a key part in enhancing performance, simplifying pipelines, and delivering new capabilities on the Databricks platform over the long term.

The ideal candidate is a strong hands‑on Spark engineer with solid design experience, capable of contributing to architectural decisions while leading complex implementation and optimization efforts.

Responsibilities:

1\. Platform Engineering & Modernization

  • Refactor and modernize existing Spark pipelines to Databricks native architectures
  • Eliminate legacy Hadoop dependencies and adopt cloud native AWS patterns
  • Enhance and extend existing processing logic using optimized Spark (JavaSpark / PySpark) on Databricks

2\. Databricks Native Development

  • Build and optimize solutions using Databricks features, including Delta Lake, Databricks Workflows for orchestration and Auto scaling and job clusters

3\. Design & Solution Engineering

  • Contribute to low and mid level architecture and design
  • Translate high level architecture into detailed technical designs
  • Define data models, pipeline patterns, and reusable components
  • Ensure solutions are scalable, maintainable, and production ready

4\. Performance Optimization & Simplification

  • Analyze, improve Spark job performance and simplify complex or over engineered pipelines into standardized, efficient patterns

5\. Engineering Standards & Best Practices

  • Follow and contribute to Databricks and Spark engineering standards
  • Write clean, modular, and testable code
  • Contribute to shared frameworks, reusable libraries, and quality standards

6\. Collaboration & Stakeholder Engagement

  • Work closely with senior architects, platform teams, and DevOps engineers
  • Provide technical inputs, troubleshooting support, and implementation guidance
  • Participate in design discussions and technical decision making

7\. Testing & Quality Assurance

  • Develop unit, integration, and data validation tests
  • Support production releases and post deployment validation

Qualifications:

Core Technical Skills

  • 10+ years in data engineering or distributed systems
  • Strong expertise in Apache Spark (JavaSpark / PySpark), Databricks on AWS, and Delta Lake
  • Experience on SQL
  • Experience with AWS services and large‑scale distributed data processing

Modernization & Optimization Experience

  • Experience modernizing or refactoring legacy data platforms into cloud‑based architectures
  • Strong background in Spark performance tuning and large‑scale batch optimization

Design Capability

  • Ability to translate architecture into implementable designs
  • Understanding of data modeling and pipeline orchestration patterns

Behavioral Competencies

  • Strong problem‑solving mindset for complex distributed systems
  • Comfortable working in time‑bound, high‑impact environments
  • Proactive, accountable, and collaborative
  • Clear communication skills across global teams

Education:

  • Bachelor’s degree/University degree or equivalent experience

\------------------------------------------------------

## Job Family Group:

Technology

\------------------------------------------------------

## Job Family:

Applications Development

\------------------------------------------------------

## Time Type:

Full time

\------------------------------------------------------

## Most Relevant Skills

Please see the requirements listed above.

\------------------------------------------------------

## Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

\------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills

AWSSQLSparkHadoopDatabricksData EngineeringDevOps

Similar Jobs

30

Senior Databricks Engineer

Koniag Government Services·Washington, District of Columbia·Remote

1w ago

Senior Databricks Engineer

Epic Software·Hyderabad, Telangana

2w ago

Senior Databricks Engineer

Pwc·Lviv, Ukraine

2w ago

Sr. Databricks Engineer

EXL Talent Acquisition Team·Bengaluru, Karnataka·Hybrid

1mo ago

Sr. Databricks Engineer

EXL·Bengaluru, Karnataka·Hybrid

1mo ago

Sr. Databricks Engineer

EXL Talent Acquisition Team·Pune, Maharashtra·Hybrid

1mo ago

Sr. Databricks Engineer

EXL·Pune, Maharashtra·Hybrid

1mo ago

Senior Databricks Engineer

EXL Talent Acquisition Team·Pune, Maharashtra·Hybrid

2mo ago

Senior Databricks Engineer

EXL·Pune, Maharashtra·Hybrid

2mo ago

Senior Databricks Engineer

Bounteous·New York City, New York·Remote

5mo ago

Senior Azure Databricks Engineer (ESS-424)

Environmentalandsafetysolutionsllc·Glendale, Arizona

2d ago

Senior Data Engineer – Azure & Databricks

Inetum·Brussels, Brussels Capital·Hybrid

2d ago

Data Engineer Databricks senior H/F

Inetum·France

2d ago

Sr Data Engineer (Databricks) - (Freelance)

Ensitech

#11 Data Engineer Senior - Databricks

Muttdata·Buenos Aires, Buenos Aires F.D.·Remote

3d ago

#11 Data Engineer Senior - Databricks - Latam

Muttdata·Remote·Remote

3d ago

#11 Data Engineer Senior - Databricks - Mexico

Muttdata·Mexico City, Mexico·Remote

3d ago

Senior Data Engineer – Databricks, dbt & GenAI

Kyndryl·Mumbai, Maharashtra

3d ago

Senior Cloud Platform & DataOps Engineer (Azure / Databricks / Terraform)

Professional Kyndryl·INDLFCHE CHENNAI - DLF IT PARK, India·Remote

3d ago

Data Engineer Databricks Senior - H/F - CDI

Talan·Paris, Île-de-France·Onsite

4d ago

Senior Data Engineer Databricks H/F

Devoteam·Lyon, Rhône-Alpes·Hybrid

4d ago

Senior Data Engineer (Databricks)

Gulf Coast Automation Group·Chicago, Illinois·Hybrid

5d ago

Senior Data Engineer (Databricks/AWS)

Citi Bank·5900 HURONTARIO STREET MISSISSAUGA, Canada·Hybrid

5d ago

Senior Data Engineer – Azure Databricks & DevOps 60–100%

Eraneos·Bern, Switzerland +2

5d ago

Senior Data Engineer (Databricks/AWS)

Citi Bank·Mississauga, Ontario

5d ago

Senior Databricks Engineer/Architect

Virtasant·Austin, Texas·Remote

1w ago

Senior Databricks Data Engineer

Beinit·Hybrid

Databricks Data Engineer, Senior

Booz Allen Hamilton·Bethesda, Maryland +1

1w ago

P1 - GP - Senior QA Engineer – Data (Databricks)

Atlas Systems·Bengaluru, Karnataka

1w ago

Senior Engineer – Data Engineering (Databricks) - Contractor - India

Object Edge·Remote