Hiring.Camp

Big Data and Apache Spark Developer - Assistant Vice President

Citi Bank

·

Today

Location
Pune, MH,IN, IN
Type
Full-time
Department
IT
Seniority
VP
Source
Eightfold

Description

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Key Responsibilities:

  • Design, develop, test, and maintain data processing applications using Apache Spark.
  • Build scalable ETL and data transformation pipelines for large datasets.
  • Develop and support applications using Java or Python in a distributed data environment.
  • Analyze requirements and collaborate with business analysts, QA teams, and stakeholders to deliver solutions.
  • Troubleshoot production issues and optimize application performance.
  • Participate in code reviews and follow engineering best practices.
  • Contribute to application modernization, migration, and automation initiatives.
  • Leverage AI-assisted development tools to improve productivity and quality.

Required Skills:

  • 8-10 years of software development experience.
  • Strong hands-on experience with Apache Spark.
  • Proficiency in either Java or Python.
  • Candidates with primary expertise in Python should have a good understanding of Java fundamentals (OOP concepts, collections, exception handling, multithreading basics).
  • Experience working with SQL and relational databases.
  • Understanding of distributed computing concepts and big data processing.
  • Strong analytical, problem-solving, and debugging skills.

Preferred Skills:

  • Experience with Databricks (highly desirable).
  • Exposure to cloud platforms and modern data engineering practices.
  • Experience with CI/CD pipelines, Git, and Agile development methodologies.
  • Knowledge of regulatory reporting or financial services domain is a plus.

### AI Mindset & Engineering Excellence

  • Demonstrated ability and willingness to adopt AI-assisted development tools (e.g., GitHub Copilot, Devin, Databricks Assistant, or similar) to improve productivity, code quality, and delivery efficiency.
  • Ability to effectively leverage AI-generated recommendations for coding, testing, debugging, documentation, and analysis while maintaining accountability for final deliverables.
  • Strong engineering judgment to critically review, validate, and optimize AI-generated code and solutions rather than relying solely on tool outputs.
  • Capable of identifying potential functional, performance, security, and maintainability issues in AI-assisted implementations and making appropriate corrections.
  • Passion for continuous learning and staying current with emerging AI technologies and software engineering best practices.

Nice to Have:

  • Experience with Spark performance tuning.
  • Familiarity with data lake architectures.
  • Experience leveraging AI tools such as Copilot or similar developer productivity solutions.

This role offers an opportunity to work on large-scale data platforms, modernization initiatives, and business-critical applications while collaborating with global team

We are seeking an Intermediate Big Data Spark Developer to design, develop, enhance, and support large-scale data processing solutions.

The ideal candidate is a strong Spark developer with proficiency in Java or Python, a solid understanding of distributed data processing, and a growth mindset toward adopting modern AI-powered development practices. They should be able to combine the productivity gains offered by AI tools with sound technical judgment, ensuring solutions are accurate, scalable, maintainable, and production-ready.

Key Responsibilities:

  • Design, develop, test, and maintain data processing applications using Apache Spark.
  • Build scalable ETL and data transformation pipelines for large datasets.
  • Develop and support applications using Java or Python in a distributed data environment.
  • Analyze requirements and collaborate with business analysts, QA teams, and stakeholders to deliver solutions.
  • Troubleshoot production issues and optimize application performance.
  • Participate in code reviews and follow engineering best practices.
  • Contribute to application modernization, migration, and automation initiatives.
  • Leverage AI-assisted development tools to improve productivity and quality.

Required Skills:

  • 8-10 years of software development experience.
  • Strong hands-on experience with Apache Spark.
  • Proficiency in either Java or Python.
  • Candidates with primary expertise in Python should have a good understanding of Java fundamentals (OOP concepts, collections, exception handling, multithreading basics).
  • Experience working with SQL and relational databases.
  • Understanding of distributed computing concepts and big data processing.
  • Strong analytical, problem-solving, and debugging skills.

Preferred Skills:

  • Experience with Databricks (highly desirable).
  • Exposure to cloud platforms and modern data engineering practices.
  • Experience with CI/CD pipelines, Git, and Agile development methodologies.
  • Knowledge of regulatory reporting or financial services domain is a plus.

### AI Mindset & Engineering Excellence

  • Demonstrated ability and willingness to adopt AI-assisted development tools (e.g., GitHub Copilot, Devin, Databricks Assistant, or similar) to improve productivity, code quality, and delivery efficiency.
  • Ability to effectively leverage AI-generated recommendations for coding, testing, debugging, documentation, and analysis while maintaining accountability for final deliverables.
  • Strong engineering judgment to critically review, validate, and optimize AI-generated code and solutions rather than relying solely on tool outputs.
  • Capable of identifying potential functional, performance, security, and maintainability issues in AI-assisted implementations and making appropriate corrections.
  • Passion for continuous learning and staying current with emerging AI technologies and software engineering best practices.

Nice to Have:

  • Experience with Spark performance tuning.
  • Familiarity with data lake architectures.
  • Experience leveraging AI tools such as Copilot or similar developer productivity solutions.

This role offers an opportunity to work on large-scale data platforms, modernization initiatives, and business-critical applications while collaborating with global team

\------------------------------------------------------

## Job Family Group:

Technology

\------------------------------------------------------

## Job Family:

Applications Development

\------------------------------------------------------

## Time Type:

Full time

\------------------------------------------------------

## Most Relevant Skills

Please see the requirements listed above.

\------------------------------------------------------

## Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

\------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills

PythonJavaCI/CDSQLSparkDatabricksData EngineeringETLGitGitHubAgile

Similar Jobs

19

Senior Internal Audit Manager - Big Data and AI Strategy for Internal Audit

Ebury·Madrid, Spain·Hybrid

2d ago

Senior DevOps Engineer (Big Data and AI Platforms)

Exacaster·Remote, Hybrid

Software Engineer (Java and Big Data)

Equifax·US·Remote, Onsite

4w ago

Analyst, Database and Big Data Administration

Melcoresorts·Macau SAR, Macao

1mo ago

Senior Software Developer (C++) in Bioinformatics and Big Data

National Center for Biotechnology Information (NCBI)·Bethesda, Maryland·Remote, Onsite

1y+ ago

Software Development Manager - Instant Video - Playback Insights and Big Data

Comtech LLC·Seattle, Washington

1y+ ago

Experienced Big Data and Hadoop Trainer

SRP Systems Inc·Princeton, New Jersey

1y+ ago

Marketing / Branding Expert needed for a Big Data and Machine Learning Company

SRP Systems Inc·Princeton, New Jersey

1y+ ago

Big Data Developer and spark

Citi Bank·India·Hybrid

1d ago

Big Data Developer and spark

Citi Bank·Tennessee, US

1d ago

Big Data Architect and Trainer

SRP Systems Inc·Princeton, New Jersey

1y+ ago

Python and Apache Spark Big Data Engineer - Assistant Vice President

Citi Bank·India·Hybrid

2w ago

Python and Apache Spark Big Data Engineer - Assistant Vice President

Citi Bank·Pune, Maharashtra

2w ago

Big Data Platforms / AI Hardening Portfolio and Intake Project Manager

Koniag Government Services·Arlington, Virginia

1w ago

Big Data Keynote/Guest Speaker | Technology And Innovation [ESC1X201]

ProSidian Consulting·Texas City, Texas

1y+ ago

Big Data/ Hadoop with AWS Cloud and Spark Experience

TestingXperts·Madison, Wisconsin·Onsite

1y+ ago

An external freelance lecturer for “Big Data & Analytics” (m, f, d) (Digital Business and Data Science, B.Sc.) in Hamburg, Germany

University of Europe for Applied Sciences·Hamburg, Germany·Remote, Hybrid, Onsite

8mo ago

Exciting FinTech Startup - ETL Developer or Big Data analyst - Data Warehouse, AWS Redshift, Stitch and Segment

Oiga·Medellín, Antioquia

1y+ ago

An external freelance lecturer for “Big Data & Analytics” (m, f, d) (Digital Business and Data Science, B.Sc.) in Hamburg, Germany

Global University Systems GmbH

8mo ago