Lead Data Engineer
Techblocks
·Today
- Salary
- ₹2500k – ₹3400k
- Location
- Gurugram, India · Hyderabad, India
- Department
- IT
- Seniority
- Lead
- Experience
- 7+ years
- Source
- Keka
Description
- 7+ years of experience in Data Engineering, Data Platform Development or related technical roles.
- Strong hands-on experience with Databricks.
- Strong programming experience in Python and PySpark.
- Advanced SQL skills, including complex queries, joins, aggregations and data transformations.
- Strong experience with Apache Spark and distributed data processing.
- Hands-on experience designing and developing ETL/ELT pipelines.
- Experience with REST APIs and API-based data integrations.
- Working knowledge of Databricks Unity Catalog, including data governance, access management and metadata.
- Understanding of Delta Lake and lakehouse architecture.
- Hands on experience in Databricks AI Genie / or any Agentic AI framework.
- Working knowledge of CI/CD practices and Git-based development workflows.
- Experience designing governed data pipelines and maintaining enterprise data quality.
- Hands-on experience integrating enterprise data with Planisware.
- Experience with Databricks Genie and Databricks-based AI/BI capabilities.
- Experience with LangGraph, LangChain, Semantic Kernel, CrewAI or similar agentic frameworks.
- Experience building knowledge graphs using Neo4j or other graph technologies.
- Experience with RAG, vector search and enterprise data retrieval patterns.
- Experience implementing automated data quality and pipeline monitoring.
- Exposure to enterprise project portfolio management (PPM), resource management or financial planning datasets.