Senior Data Engineer - Azure Databricks

Job Title: Senior Data Engineer - Azure Databricks
Key Skills: Azure Databricks, DBT, Snowflake, Python, SQL, Terraform
Experience: 5+ YOE.
Location: Costa Rica, Peru, Colombia, and Bolivia.
Mode: Remote.

We at Coforge are hiring Senior Data Engineer - Azure Databricks (#22146) with the following skill set.

Key Responsibilities
· Own the end-to-end delivery of data pipelines and data products from design through deployment and production support.
· Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python.
· Support and execute large-scale data migrations from Snowflake (AWS) to Azure Databricks.
· Build and manage infrastructure-as-code solutions using Terraform.
· Ensure seamless integration across enterprise data platforms and environments.
· Implement data quality frameworks, testing, and validation processes.
· Enable observability through monitoring, logging, and alerting solutions.
· Contribute to the design of scalable data architectures aligned with Lakehouse principles.
· Monitor and support production environments, ensuring performance and reliability.
· Collaborate with cross-functional teams and mentor junior engineers through best practices and code reviews.

Required Skills & Qualifications
· 5 to 8+ years of experience in Data Engineering within enterprise-scale environments.
· Strong hands-on expertise with Azure Databricks, DBT, and Snowflake.
· Strong proficiency in Python and SQL.
· Proven experience building and managing large-scale data pipelines and transformations.
· Experience working with high-volume datasets and complex data models.
· Solid understanding of data modeling, ETL/ELT frameworks, distributed systems, and Lakehouse architectures.
· Experience with Terraform and Infrastructure as Code (IaC) principles.
· Strong experience with CI/CD pipelines and Git-based version control.
· Experience supporting production systems, including monitoring, alerting, and incident resolution.
· Knowledge of data quality, testing, and observability frameworks.
· Excellent analytical, problem-solving, and communication skills.

Preferred Skills
· Experience in insurance or financial services environments.
· Experience with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables.
· Knowledge of security, compliance, and data protection standards in regulated industries.
· Experience with cloud cost optimization and performance tuning.
· Exposure to multi-cloud or hybrid architectures.

Posted On: 14-08-2026

At Coforge, we hire professionals based solely on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.