Hiring.Camp

Sr. Data Engineer - Databricks

Anblicks

·

Sep 15, 2026

Location
Hyderabad, India
Workplace
Remote, Hybrid
Department
Engineering
Experience
6+ years
Source
Keka

Description

Job Role: Senior Data Engineer – Databricks
Location: Hyderabad, India (Hybrid)
Experience: 6+ Years
Number of Positions: 6

Role Overview
Anblicks is looking for experienced Senior Data Engineers to design, build, and optimize scalable data platforms and high-performance ETL/ELT pipelines using Databricks, Apache Spark, Python, Java, and SQL.
The ideal candidate will have strong hands-on experience in building enterprise-grade data solutions, processing large-scale datasets, optimizing distributed data workloads, and implementing reliable data ingestion and transformation frameworks. The role will involve working closely with data, cloud, analytics, and engineering teams to deliver scalable and high-quality data solutions.

Key Responsibilities
  • Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks and Apache Spark.
  • Build robust data ingestion, transformation, processing, and validation frameworks for large-scale datasets.
  • Develop and optimize data processing workloads using Python, Java, Spark, and SQL.
  • Work extensively with Databricks to develop scalable data engineering solutions and production-grade pipelines.
  • Implement efficient data transformation and storage solutions using modern data engineering practices.
  • Write complex and optimized SQL queries for large-volume data processing and analytics.
  • Perform performance tuning and optimization of Spark jobs, SQL queries, pipelines, and data processing workloads.
  • Implement data quality checks, validation frameworks, monitoring, logging, and error-handling mechanisms.
  • Work with stakeholders, data analysts, architects, and engineering teams to understand requirements and deliver effective data solutions.
  • Contribute to the design and implementation of cloud-based data platforms and modern data architectures.
  • Troubleshoot production issues and ensure the reliability, scalability, and performance of data pipelines.
  • Follow data engineering best practices related to security, governance, data quality, and operational excellence.
  • Mentor junior engineers and contribute to technical standards, reusable frameworks, and engineering best practices.
Required Qualifications
  • 6 - 10 years of professional experience in software development and/or data engineering, with proven experience delivering production-grade data solutions.
  • Strong hands-on experience in Data Engineering and ETL/ELT development.
  • Strong experience with Databricks and Apache Spark.
  • Strong programming skills in Python and Java.
  • Advanced proficiency in SQL, including query optimization and working with large datasets.
  • Experience designing and developing scalable data pipelines and distributed data processing solutions.
  • Strong understanding of data warehousing, data modeling, and large-scale data processing.
  • Hands-on experience with data ingestion, transformation, data quality, and pipeline optimization.
  • Strong troubleshooting, debugging, and performance tuning capabilities.
  • Experience working in Agile development environments and collaborating with cross-functional teams.
Preferred Qualifications
  • Experience working with AWS cloud services and cloud-based data platforms.
  • Experience with Delta Lake and modern Databricks data engineering capabilities.
  • Knowledge of Databricks Workflows, Jobs, notebooks, clusters, and deployment practices.
  • Experience with CI/CD, Git, and DevOps practices for data engineering.
  • Exposure to AdTech, MarTech, Customer Data Platforms (CDP), or customer analytics environments.
  • Experience working with high-volume, complex, and diverse datasets.
Education
Bachelor’s degree in Computer Science, Computer Engineering, Software Engineering, or a related technical field, or equivalent professional experience.

Skills

PythonJavaAWSCI/CDSQLSparkDatabricksData EngineeringETLGitAgileDevOps

Similar Jobs

30

Sr Data Engineer

MidAmerican Energy·Des Moines, Iowa·Onsite

Today

Senior Data Engineer

Vericast·San Antonio, Texas·Remote

Today

Senior Data Engineer

Encora·Campinas, São Paulo·Remote

Today

Senior Data Engineer

Encora·Bogotá, Bogota D.C.·Remote

Today

Senior Data Engineer

Encora·Bogotá, Bogota D.C.·Remote

Today

Senior Data Engineer

Encora·Peru, Indiana·Remote

Today

Senior Data Engineer

Encora·Costa Rica, Mato Grosso do Sul·Remote

Today

Senior Data Engineer

CloudKaptan·Kolkata, West Bengal

Today

Sr. Data Engineer

Arlo·California, US

1d ago

Senior Data Engineer

Appliedis·India Corporate Headquarters - Hyderabad·Hybrid

1d ago

Senior Data Engineer

Alliedsolutions·US

1d ago

Senior Data Engineer

Ensemblehp·Hyderabad, Telangana·Hybrid

1d ago

Senior, Data Engineer

Gsk·UK·Remote

1d ago

Sr Data Engineer

PayPal·Bengaluru, Karnataka +1

1d ago

Sr Data Engineer

PayPal·Chennai, Tamil Nadu +1

1d ago

Senior Data Engineer

AIR Communities·Denver, Colorado·Onsite

1d ago

Senior Data Engineer

Chorus Innovations·Long Beach, California·Hybrid

1d ago

Senior Data Engineer

TTEC Digital·At Home - Colombia·Hybrid

1d ago

Sr. Data Engineer

NBCUniversal·New York City, New York·Hybrid

1d ago

Senior Data Engineer

NielsenIQ·Israel·Hybrid

1d ago

Senior Data Engineer

User Experience Researchers Pteltd·Singapore

1d ago

Senior Data Engineer

endeavour group careers·Sydney, New South Wales·Hybrid

2d ago

Senior Data Engineer

Centene and its subsidiary companies·Missouri, US·Remote

2d ago

Sr Data Engineer

PayPal·Austin, Texas +1

2d ago

Sr Data Engineer

PayPal·Austin, Texas +1

2d ago

Senior Data Engineer

MediaRadar·Madrid, Spain·Hybrid

2d ago

Senior Data Engineer

Gdit·US·Remote

2d ago

Sr. Data Engineer

Plante Moran·Southfield, Michigan

2d ago

Senior Data Engineer

Professional Kyndryl·India +1·Remote

2d ago

Sr Data Engineer

healthcatalyst·Singapore·Remote

2d ago