Hiring.Camp

Data Engineer | DISA-DIA-OMDE-JHB-0091

Decision Inc 3

·

3 days ago

Location
Johannesburg, South Africa
Department
Engineering
Closing date
Today
Source
CareersPage

Description


1. Azure Databricks Hands-On Experience

  • Status: Exceeded
  • Notes: She brings 3 dedicated years of hands-on Databricks experience, specifically architecting and implementing ETL/ELT pipelines using Azure Databricks, Spark clusters, high concurrency performance tuning, and Databricks Asset Bundles (DABs) in her current role at Investec and previous work with Standard Bank.

2. Apache Spark, PySpark, and SQL

  • Status: Met
  • Notes: Highly proficient across Python, PySpark, SparkSQL, and T-SQL. Her experience includes developing complex transformations and automated notebooks for enterprise-scale data workloads.

3. Delta Lake & Medallion Architecture (Bronze, Silver, Gold)

  • Status: Met
  • Notes: Extensively experienced in implementing Lakehouse architecture using Delta Lake, delta tables, parquet files, and executing full on-prem to cloud data migrations utilizing the Medallion Architecture across multiple financial sector roles.

4. Data Pipelines & Data Integration Solutions

  • Status: Met
  • Notes: Extensive enterprise background building batch processing data pipelines, integrating disparate sources (REST APIs, Cosmos NoSQL, Azure SQL, on-prem databases) using Azure Data Factory (ADF), SSIS, and custom orchestration tools like Control-M.

5. Azure DevOps and CI/CD Pipelines

  • Status: Met
  • Notes: Strong 5-year track record managing CI/CD pipeline workflows for schema migrations, infrastructure deployments (using Terraform and Bicep/ARM templates), and code promotion via Azure DevOps and Git/GitHub.

6. Data Quality, Performance Tuning, and Cost Optimization

  • Status: Met
  • Notes: Leverages data governance frameworks like Unity Catalog and data quality best practices. She also brings strong relational database and cloud performance tuning experience (indexing, partitioning, cluster optimization) gained across 11+ years of database development..

7. Advantageous Skills (Generative AI / LLMs & SharePoint Integration)

  • Status: Partial / Present
  • Notes: Her CV notes exposure to Azure ML and AI services (retraining/deploying models), although explicit Generative AI/LLM project deployment and specific SharePoint integrations are not highlighted and should be verified in conversation if needed.

Skills

PythonAzureTerraformCI/CDSQLSparkDatabricksETLGitGitHubRESTDevOpsLLM

Similar Jobs

30

Data Engineer

Oddball·Remote·Remote

Today

Data Engineer

MidAmerican Energy·Des Moines, Iowa·Onsite

1d ago

Data Engineer

Learning Care Group·US

1d ago

Data Engineer

Cognite - AI for Industry·Norway

1d ago

Data Engineer

NYC Department of City Planning·New York, US·Onsite

1d ago

Data Engineer

Vattenfall·Amsterdam, North Holland

2d ago

Data Engineer

Asia Select Inc.·Philippines·Hybrid

2d ago

Data Engineer

Leaders Credit Union·Jackson, Tennessee·Onsite

2d ago

Data Engineer

Seattlechildrens·US·Hybrid

2d ago

Data Engineer

Bits In Glass

2d ago

Data Engineer

Pavago·Buenos Aires, Buenos Aires F.D. +2·Remote

2d ago

Data engineer

Two95 International Inc.·California City, California·Onsite

2d ago

Data Engineer

Two95 International Inc.·Glendale, California·Onsite

2d ago

Data Engineer

General Motors·Austin, Texas·Hybrid

2d ago

Data Engineer

Costar·US-VA Richmond - CoStar Tower, US·Onsite

2d ago

Data Engineer

Cross Country Mortgage, LLC·US·Onsite

2d ago

Data Engineer

Dreamix Ltd.·Sofia, Sofia-Capital·Remote

2d ago

Data Engineer

Accenture·Chennai, Tamil Nadu

2d ago

Data Engineer

Accenture·India

2d ago

Data Engineer

Accenture·Bengaluru, Karnataka

2d ago

Data Engineer

Accenture·Bengaluru, Karnataka

2d ago

Data Engineer

Accenture·Bengaluru, Karnataka

2d ago

Data Engineer

Accenture·Hyderabad, Telangana

2d ago

Data Engineer

Accenture·Chennai, Tamil Nadu

2d ago

Data Engineer

Accenture·Bengaluru, Karnataka

2d ago

Data Engineer

Accenture·Bengaluru, Karnataka

2d ago

Data Engineer

Accenture·Pune, Maharashtra

2d ago

Data Engineer

Accenture·Chennai, Tamil Nadu

2d ago

Data Engineer

Accenture·Mumbai, Maharashtra·Remote

2d ago

Data Engineer

Accenture·Bengaluru, Karnataka

2d ago