Hiring.Camp

Data Engineer | DISA-DIA-OMDE-JHB-0091

Decision Inc 3

·

Today

Location
Johannesburg, South Africa
Department
Engineering
Closing date
Today
Source
CareersPage

Description


1. Azure Databricks Hands-On Experience

  • Status: Exceeded
  • Notes: She brings 3 dedicated years of hands-on Databricks experience, specifically architecting and implementing ETL/ELT pipelines using Azure Databricks, Spark clusters, high concurrency performance tuning, and Databricks Asset Bundles (DABs) in her current role at Investec and previous work with Standard Bank.

2. Apache Spark, PySpark, and SQL

  • Status: Met
  • Notes: Highly proficient across Python, PySpark, SparkSQL, and T-SQL. Her experience includes developing complex transformations and automated notebooks for enterprise-scale data workloads.

3. Delta Lake & Medallion Architecture (Bronze, Silver, Gold)

  • Status: Met
  • Notes: Extensively experienced in implementing Lakehouse architecture using Delta Lake, delta tables, parquet files, and executing full on-prem to cloud data migrations utilizing the Medallion Architecture across multiple financial sector roles.

4. Data Pipelines & Data Integration Solutions

  • Status: Met
  • Notes: Extensive enterprise background building batch processing data pipelines, integrating disparate sources (REST APIs, Cosmos NoSQL, Azure SQL, on-prem databases) using Azure Data Factory (ADF), SSIS, and custom orchestration tools like Control-M.

5. Azure DevOps and CI/CD Pipelines

  • Status: Met
  • Notes: Strong 5-year track record managing CI/CD pipeline workflows for schema migrations, infrastructure deployments (using Terraform and Bicep/ARM templates), and code promotion via Azure DevOps and Git/GitHub.

6. Data Quality, Performance Tuning, and Cost Optimization

  • Status: Met
  • Notes: Leverages data governance frameworks like Unity Catalog and data quality best practices. She also brings strong relational database and cloud performance tuning experience (indexing, partitioning, cluster optimization) gained across 11+ years of database development..

7. Advantageous Skills (Generative AI / LLMs & SharePoint Integration)

  • Status: Partial / Present
  • Notes: Her CV notes exposure to Azure ML and AI services (retraining/deploying models), although explicit Generative AI/LLM project deployment and specific SharePoint integrations are not highlighted and should be verified in conversation if needed.

Skills

PythonAzureTerraformCI/CDSQLSparkDatabricksETLGitGitHubRESTDevOpsLLM

Similar Jobs

30

Data Engineer

Bridgeway Benefit Technologies·Remote·Remote

Data Engineer

User Experience Researchers Pteltd·Singapore

Today

Engineer, Data

Holley Performance·Bowling Green, Kentucky +1

Today

Data Engineer

Goodwill Central Texas·Austin, Texas

Today

Data Engineer

Public Storage·Burbank, California

Today

Data Engineer

mindboxgroup·Hybrid

Data Engineer

Google

Data Engineer

Kohr Consulting·Tukwila, Washington·Hybrid

Today

Data Engineer

Ambition Institute·Birmingham, England·Hybrid

Today

Data Engineer

Ambition Institute·London, England·Hybrid

Today

Data Engineer

Ambition Institute·Birmingham, England·Hybrid

Today

Data Engineer

Entain·London, England·Hybrid

1d ago

Data Engineer

BVN Architecture·Hybrid

Data Engineer

Entain·Lisbon, Portugal·Hybrid

1d ago

Data Engineer

Entain·Sofia, Sofia-Capital·Hybrid

1d ago

Data Engineer

Entain·Gibraltar·Hybrid

1d ago

Data Engineer

Integrators services a.s.·Hybrid, Prague 8·Hybrid

1d ago

Data Engineer

Toast·Boston, Massachusetts +1·Remote

Data Engineer

Healthfirst is New York·Florida, US +1·Remote

1d ago

Data Engineer

CVS Health·US·Remote

1d ago

Data Engineer

Analytica·Bethesda, Maryland·Remote

1d ago

Data Engineer

Cai·US·Remote

1d ago

Data engineer

IRIUM - Spain·Madrid, Spain

1d ago

Data Engineer

Accenture·India

1d ago

Data Engineer

Pavago·New York City, New York·Remote

1d ago

Data Engineer

Patrianna·Atlanta, Georgia +3·Hybrid

1d ago

Data Engineer

Booz Allen Hamilton·Fort Shafter, Hawaii

1d ago

Data Engineer

Barclays·Pune, Maharashtra

1d ago

Data Engineer

HP·Bengaluru, Karnataka

1d ago

Data Engineer

HP·Bengaluru, Karnataka

1d ago