- Location
- Gurugram, Haryana, India · published
- Type
- Full-time
- Department
- IT
- Seniority
- Mid
- Source
- Workable
Description
We are looking for a Data Engineer with 2–5 years of experience to design, build, and maintain reliable data pipelines and analytics-ready datasets. The ideal candidate will have strong SQL and Python or PySpark skills, hands-on experience with cloud data platforms, and the ability to troubleshoot data-quality, performance, and production issues independently.
Key Responsibilities
· Design, develop, and maintain scalable ETL and ELT pipelines for batch and scheduled data processing.
· Build and optimize data transformations using SQL, Python, and PySpark.
· Ingest and integrate data from databases, APIs, files, SharePoint, and cloud storage.
· Create and maintain curated, analytics-ready datasets for Power BI, Superset, and other reporting platforms.
· Implement data-quality checks, reconciliation controls, monitoring, logging, and failure alerts.
· Troubleshoot pipeline failures, schema mismatches, performance bottlenecks, and data discrepancies.
· Optimize large-scale data processing for runtime, memory, storage, and cost efficiency.
· Automate recurring workflows and schedule production jobs using orchestration tools such as Apache Airflow.
· Maintain technical documentation, data mappings, business rules, and operational runbooks.
· Collaborate with BI analysts, application teams, and business stakeholders to deliver dependable data solutions.