Hiring.Camp

Senior Developer - Python and Spark

citibank

·

2 weeks ago

Location
Pune, MH,IN, IN
Type
Full-time
Department
IT
Seniority
Senior
Source
Eightfold

Description

Citi is looking for a Senior Data Engineer to design and build the next-generation data processing and analytics platform that sits at the core of our AI-driven business innovation. In this role, you will architect scalable ETL/ELT pipelines using Python and PySpark, while also integrating Generative AI and Machine Learning models to push the boundaries of what our data systems can do. Working within a high-performing engineering team, you will shape how data flows, performs, and delivers value across the organisation at scale.

## Responsibilities

  • Design and build highly scalable ETL/ELT pipelines in Python and PySpark to power reliable data ingestion, transformation, and integration at scale.
  • Develop production-grade code and elevate team capability through structured code reviews and hands-on peer mentorship.
  • Integrate Generative AI and Machine Learning models into data workflows, using AI development tools to deliver innovative solutions and resolve complex technical challenges.
  • Establish and enforce data quality standards across all pipelines, ensuring accuracy, consistency, and reliability of data throughout its lifecycle.
  • Implement an AI-first engineering approach by exploring and embedding Agentic AI workflows to increase development velocity and platform intelligence.
  • Automate CI/CD pipelines for builds and deployments, advancing DevOps maturity across the data platform.
  • Apply performance tuning and optimisation techniques to process large volumes of structured and semi-structured data efficiently and at speed.
  • Collaborate directly with engineers and product owners to align technical direction with delivery goals and accelerate outcomes.

## Required Qualifications & Skills

  • Deep hands-on expertise in Python and Apache Spark, including Spark Core, Spark SQL, and DataFrames/Datasets, applied to production data systems.
  • Advanced SQL capability across complex query writing, data transformation logic, and query performance optimisation.
  • Demonstrated experience designing, building, and maintaining ETL/ELT pipelines for large-scale data ingestion and transformation.
  • Proficiency with Python data processing libraries including Pandas, NumPy, and SciPy for data wrangling and preprocessing tasks.
  • Practical experience with DevOps tools and CI/CD pipeline automation, with version control managed through GitHub.
  • Solid working knowledge of Linux environments, with familiarity across Windows systems.
  • Ability to collaborate across multidisciplinary teams to diagnose complex technical problems and deliver effective, lasting solutions.

## Beneficial Skills & Qualifications

  • Working knowledge of Machine Learning and Generative AI, with direct exposure to AI development tooling in an engineering context.
  • Familiarity with Agentic AI workflows and their application to enhancing platform capabilities or development productivity.
  • Experience using Jupyter Notebook for rapid prototyping and iterative development of data solutions.

## What We Offer

At Citi, you will work on technically challenging problems that matter, contributing to a platform that shapes how a global financial institution processes and derives intelligence from data. This is a role where technical depth, curiosity, and engineering rigour are genuinely valued.

  • Hybrid working model with 3 days in the office and 2 days working remotely, giving you flexibility and in-person collaboration.
  • Access to complex, large-scale engineering challenges at the intersection of data and AI, keeping your technical skills at the forefront of the industry.
  • Opportunities to grow into AI and platform architecture disciplines, supported by a team culture that invests in continuous technical development.
  • Exposure to a globally connected engineering network, collaborating with specialists across technology, data, and product functions.
  • A performance-driven environment where your contributions to platform innovation directly influence business outcomes at scale.
  • Wellbeing and work-life balance support, alongside a competitive benefits package designed to recognise the value you bring.

Build data systems that power real decisions — apply now to join Citi's next-generation AI and data platform engineering team.

\------------------------------------------------------

## Job Family Group:

Technology

\------------------------------------------------------

## Job Family:

Applications Development

\------------------------------------------------------

## Time Type:

Full time

\------------------------------------------------------

## Most Relevant Skills

Please see the requirements listed above.

\------------------------------------------------------

## Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

\------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills

PythonCI/CDLinuxSQLMachine LearningPandasNumPySparkETLGitHubDevOpsPrototyping

Similar Jobs

30

Senior Developer

Computershare · Melbourne, Australia

Today

Senior Developer

Nab · BNZ Place Wellington, 1 Whitmore Street, New Zealand · Hybrid

Today

Senior Developer

Arcticwolf · Office - IND - Karnataka, Bengaluru, India

Yesterday

Senior Developer

Glint Tech Solutions Llc · New York

2 days ago

Senior Developer

Reddyice · OCS Finance & IT, United States of America

2 days ago

Senior Developer

Barclays · Pune, Gera Commerzone SEZ, India

2 days ago

Senior Developer

Theapexgroup · Makati City, Ayala Avenue, Philippines

2 days ago

Senior Developer

Thoughtworksreferral · Pune, India +1

5 days ago

Senior Developer

Ice · Atlanta, GA, US

5 days ago

Senior Developer

Alsglobal · GBR - Coventry, United Kingdom · Hybrid

5 days ago

Senior Developer

Rbc · RBC CENTRE, 155 WELLINGTON ST W:TORONTO, Canada

6 days ago

Senior Developer

Poet · Sioux Falls, SD, United States of America · Onsite

1 week ago

Senior Developer

Peelregion · ON, CA · Remote

1 week ago

Senior Developer

Servicestream · VIC - Melbourne - 655 Collins St, Australia

1 week ago

Senior Developer

NI · Kenya

1 week ago

SENIOR DEVELOPER

NYC Department of City Planning · New York City, NY, United States

1 week ago

Senior Developer

Cobdenandcarter · Quezon City

1 week ago

Senior Developer

Fairsteadescllc · Denver, Colorado, United States +1

1 week ago

Senior Developer

Ntara

1 week ago

Senior Developer

Canopius · Manchester, United Kingdom, GB · Hybrid

1 week ago

Senior Developer

Fairsteadescllc · Bethesda, Maryland, United States

1 week ago

Senior Developer

Telesure · Steyn City Capital Park, South Africa

2 weeks ago

Senior Developer

Myob 2 · Auckland, New Zealand · Hybrid

2 weeks ago

Senior Developer

Fiserv is the global leader · Dublin, Ireland · Onsite

2 weeks ago

Senior Developer

Trinity College London · London, Greater London, United Kingdom

2 weeks ago

Senior Developer

Saxobank · Gurugram, India

2 weeks ago

Senior Developer

Barclays · Pune, Gera Commerzone SEZ, India

2 weeks ago

Senior Developer

Commercial · Cheltenham, United Kingdom

2 weeks ago

Senior Developer

Quad Lock · Melbourne · Hybrid

3 weeks ago

Senior Developer

Gevernova · Madrid, Spain

3 weeks ago
Senior Developer - Python and Spark at citibank | Hiring.Camp