Hiring.Camp

Senior Data Platform Engineer

Citi Bank

·

3 days ago

Location
Chennai, TN,IN, IN · Pune, MH,IN, IN
Type
Full-time
Department
Engineering
Seniority
Senior
Source
Eightfold

Description

We are seeking a highly skilled, hands-on Senior Data Platform Engineer to design, build and manage complex, high-performance enterprise data services supporting data integration, reconciliation, data controls, data quality and operational intelligence.

The role combines strong software engineering expertise with distributed data processing, cloud-native architecture and modern lakehouse technologies. The successful candidate will develop reusable, scalable and resilient data services supporting high-volume batch and real-time processing across enterprise applications.

Key Responsibilities:-

  • Enterprise Data Services Engineering: Architect, develop and maintain complex, reusable data services for data ingestion, transformation, standardisation, validation, reconciliation and data processing using Scala, Spark, Python and Java.
  • Data Integration & Processing: Build scalable integration frameworks supporting files, databases, APIs, Kafka, CDC and enterprise messaging, including batch, near-real-time and streaming ingestion.
  • Reconciliation & Matching Engines: Develop high-performance reconciliation services supporting complex matching rules, multi-pass matching, tolerance handling, one-to-one and many-to-many matching, balance proofing and exception generation.
  • Data Controls & Integrity: Engineer reusable control frameworks for completeness, accuracy, timeliness, record counts, control totals, source-to-target validation, auditability, data lineage, replay and recovery.
  • Data Quality Engineering: Develop configurable data quality services supporting schema validation, business rules, profiling, anomaly detection, data quality scoring, exception handling and automated remediation.
  • Databricks & Lakehouse Engineering: Build and optimise distributed processing workloads using Databricks, Apache Spark, S3, Apache Iceberg, Delta Lake, Unity Catalog and Lakeflow orchestration.
  • Streaming & Event-Driven Services: Develop Kafka/MSK-based event-processing services, CDC integration, stateful streaming, checkpointing, deduplication and reliable event delivery.
  • Software & API Development: Design and develop REST APIs, microservices, metadata-driven processing frameworks, configuration services and reusable libraries using Scala, Java/Spring Boot and Python.
  • AI & Intelligent Data Services: Integrate AI/ML capabilities for intelligent matching, anomaly detection, data quality remediation, metadata discovery and AI-assisted data processing.
  • Cloud Engineering, DevOps & Reliability: Implement AWS infrastructure, Terraform, CI/CD, automated testing, observability, performance optimisation, FinOps, production support and disaster recovery.

Essential Technical Skills:-

  • Software Engineering: Strong hands-on Scala, Java or Python development, object-oriented design, concurrency, distributed systems and software design patterns.
  • Distributed Processing: Apache Spark, Scala Spark, PySpark, Spark SQL, Structured Streaming and performance tuning.
  • Cloud & Lakehouse: AWS, Databricks, S3, Apache Iceberg, Delta Lake and Unity Catalog.
  • Data Integration: Kafka/MSK, CDC, REST APIs, JDBC, file processing and enterprise messaging.
  • Data Services: Data transformation, reconciliation, rule engines, data validation, data controls, data quality and exception processing.
  • Application Development: Microservices, REST APIs, Spring Boot/FastAPI, metadata-driven frameworks and service integration.
  • Data Engineering: SQL, data modelling, schema evolution, partitioning, incremental processing and data optimisation.
  • DevOps & SRE: Terraform, Docker, Git, CI/CD, automated testing, CloudWatch, OpenTelemetry and production troubleshooting.

Desirable Skills:-

  • Experience developing enterprise reconciliation or financial data processing platforms.
  • Real-time matching, balance proofing and stateful stream processing.
  • AI/ML, MLflow, vector search, RAG and agentic AI integration.
  • MongoDB Atlas, PostgreSQL/Aurora and enterprise workflow integration.
  • Financial services data governance, regulatory controls and operational resilience.

Experience

  • 8+ years of hands-on software development and data platform engineering.
  • Proven experience building complex, high-throughput distributed data services.
  • Strong development experience with Scala/Spark and cloud-native architectures.
  • Experience designing reusable frameworks rather than only implementing ETL pipelines.
  • Demonstrated ownership of production systems, performance, reliability and scalability.
  • Experience delivering enterprise-scale platforms within regulated environments preferred.

Expected Outcomes:-

  • Scalable, reusable enterprise data services.
  • High-performance batch and streaming reconciliation processing.
  • Automated, auditable data quality and control frameworks.
  • Reliable and cost-efficient Databricks/AWS workloads.
  • Production-ready services with strong observability, resilience and automated recovery.
  • Accelerated onboarding of new data sources and business use cases through configurable, self-service capabilities.

Education:

  • Bachelor’s degree/University degree or equivalent experience
  • Master’s degree preferred

\------------------------------------------------------

## Job Family Group:

Technology

\------------------------------------------------------

## Job Family:

Applications Development

\------------------------------------------------------

## Time Type:

Full time

\------------------------------------------------------

## Most Relevant Skills

Please see the requirements listed above.

\------------------------------------------------------

## Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

\------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

Skills

PythonJavaScalaFastAPISpring BootAWSDockerTerraformCI/CDSQLPostgreSQLMongoDBSparkDatabricksData EngineeringETLGitRESTDevOpsSRE

Similar Jobs

30

Senior Product Manager, Data Platform

Kinetic·Remote·Remote

Today

Senior Snowflake Platform & Data Engineer

Encora·Bogotá, Bogota D.C.·Hybrid

Today

Senior Data Platform Engineer (Infra)

Riskified·Lisbon, Portugal·Hybrid

Sr Lead Software Engineer - Data Engineering & Data Platform

JP Morgan Chase·Bengaluru, Karnataka

1d ago

Sr Lead Software Engineer - Data Engineering & Data Platform

JP Morgan Chase·Bengaluru, Karnataka

1d ago

Senior Platform Data Engineer

Raising The Village Career Page·Hybrid

Senior Data Platform Engineer - Zonda - Irvine, CA

Costar·Irvine, California

1d ago

ID 4535 – Senior Data Platform Engineer

Conexion Hr·Buenos Aires, Buenos Aires F.D.

1d ago

Data Platform Product Delivery Associate Senior

JP Morgan Chase·Columbus, Ohio·Onsite

2d ago

Data Platform Product Delivery Associate Senior

JP Morgan Chase·Columbus, Ohio·Onsite

2d ago

Product Manager-Aviation and Data Platform (Senior, or Principal)

Boeing·CAN - Richmond, Canada +1·Hybrid

2d ago

Product Manager-Aviation and Data Platform (Senior, or Principal)

Boeing·CAN - Richmond, Canada +1·Hybrid

2d ago

Senior Data/Product Analyst DIA Analytics Platform (all genders)

Zalando·Berlin, State of Berlin·Hybrid

2d ago

Senior Software Engineer - Data Platform

Trendmicro·Austin, Texas·Hybrid

2d ago

Sr. Director, Data Platform Engineering

Thomson Reuters·Eagan, Minnesota +1·Hybrid

2d ago

Senior Director, Software Engineering – Data Platform

Tempus·Calgary, Alberta +1

2d ago

Senior Engineer, AI & Data Platform

Vantageanalytics·Toronto, Ontario·Remote

2d ago

Senior Snowflake Data Platform & Artificial Intelligence (AI) Architect

Fiserv is the global leader·Jacksonville, Florida·Remote

2d ago

Senior ML Data Platform Engineer | $165K-$175K + Hybrid + Equity | AI Powered Outage Intelligence SaaS Startup

PhillyTech·King of Prussia, Pennsylvania·Hybrid

2d ago

Senior Snowflake Data Engineer (German B2+) | Energy Data Platform

Polcode LLC·Remote

Senior Software Engineer, Data Platform

Sofi·Seattle, Washington

Senior Site Reliability Engineer (Data Platform)

Nebius·Amsterdam, North Holland +4·Remote

Sr. Data Governance Platform Engineer

Usbank·Cupertino, California·Hybrid

3d ago

Senior Data Engineer - Data Platform

Trendmicro·Austin, Texas

3d ago

Product Manager-Aviation and Data Platform (Senior, or Principal)

Boeing·US·Onsite

3d ago

Product Manager-Aviation and Data Platform (Senior, or Principal)

Boeing·US·Onsite

3d ago

Senior Data Platform Engineer

Calix·Mumbai, Maharashtra

3d ago

(Senior) Data Engineer (m/f/d) Energy Trading Platform

Tmh·Munich, Bavaria

3d ago

Senior Data Platform Engineer

Citi Bank·India·Hybrid

3d ago

Senior Data Engineer, Data Platform

Rakuten·Crimson House Singapore

3d ago