Hiring.Camp

Senior Data Engineer Python & AI Migration (Freelance possible)

Engiflex

·

5 days ago

Location
Brussels
Type
Contract
Department
Engineering
Seniority
Senior
Experience
5+ years
Closing date
Today
Source
CareersPage

Description

📋 Tasks and responsibilities

To support the migration of legacy SAS-based ETL workloads to a modern Python data platform using technologies such as Parquet and Spark, this role contributes to the build-out of an AI-assisted, agent-driven migration factory. The objective is to support analysis, transformation, validation and the generation of Python artefacts throughout the migration lifecycle.

As a Senior Python Data Engineer, you will help deliver migration solutions and further improve the agentic workflows, orchestration mechanisms and validation processes that support this migration approach.

You will work closely with data engineers, architects and SAS specialists to strengthen the quality, scalability and efficiency of the migration process.

Core Domains of Expertise

1. Python Data Engineering

  • Design, build and validate Python-based data transformation solutions.
  • Review and optimise AI-generated Python code.
  • Safeguard code quality, maintainability, performance and operational robustness.
  • Handle complex migration scenarios where automated generation needs refinement.
  • Contribute to data quality controls, schema management and Parquet optimisation.
  • Support PySpark implementations where relevant.
  • Apply Python performance tuning in data engineering contexts.
  • Work on ETL and ELT processes for data acquisition and transformation.

2. AI-Assisted Development & Agent Harness Engineering

  • Act as a key user and contributor within the AI-assisted migration pipeline.
  • Help evolve the agent harness used to orchestrate specialised agents.
  • Improve collaboration between agents responsible for SAS analysis, functional analysis generation, technical analysis generation, Python code generation, validation and testing.
  • Increase workflow reliability, traceability and throughput.
  • Strengthen human-in-the-loop validation mechanisms and feedback loops.
  • Identify opportunities to further automate the process while preserving quality and control.

📝 Your profile

You are a senior Python Data Engineer with strong software and data engineering skills, combined with hands-on experience in AI-assisted development, agentic workflows and agent harness engineering. You are comfortable contributing both to delivery and to the further industrialisation of an AI-driven migration factory.

  • You have at least 5 years of hands-on experience in Python development.
  • You have solid experience in data engineering, including ETL / ELT processes, data quality controls and schema management.
  • You have strong knowledge of Pandas, Polars, PyArrow, Parquet and testing frameworks.
  • You have experience with Python programming and performance tuning.
  • You are familiar with Python from a data engineering perspective, including Pandas and Apache Spark.
  • Experience with PySpark is a strong asset.
  • You have experience with AI-assisted software development tools such as GitHub Copilot or similar solutions.
  • You are familiar with agentic workflows, multi-agent systems, agent harness engineering, workflow orchestration and human-in-the-loop validation.
  • Experience with SAS BASE is a strong asset, as is the ability to understand legacy SAS programs.
  • You understand concepts such as DATA steps, PROC SQL, SAS macros and ETL processing patterns.
  • You collaborate effectively with SAS analysts and subject-matter experts during migration and validation activities.
  • Experience as a confirmed Data Architect is an asset.

Languages

  • Dutch
  • English
  • French

💼 Offer

You will be part of a growing Belgian SME where initiative and personal development are encouraged. We will provide you with an enjoyable work environment with fun colleagues. We will work out a career plan with you, with attention and a budget for extra education/certification. You can count on an attractive salary, supplemented with extra-legal benefits, including a company car.
(Freelance is also possible)

Skills

PythonSQLPandasSparkData EngineeringETLGitHub

Similar Jobs

30

Senior Data Engineer

Mwdn · Remote

2 days ago

Senior Data Engineer

Blend · Guadalajara, Jal., Mexico · Remote

2 days ago

Senior Data Engineer

ICON · Austin, Texas, United States

2 days ago

Data Engineer, Senior

Blue Shield of California · Oakland, CA, United States, US

2 days ago

Senior Data Engineer

Default (MSD) · All, MD

2 days ago

Senior Data Engineer

Encora · Bolivia; Colombia; Costa Rica; Peru

2 days ago

Senior Data Engineer

Capco · India - Mumbai

2 days ago

Senior Data Engineer

Experian · Sofia, Bulgaria · Hybrid

2 days ago

Senior Data Engineer

Scale3C · Vilnius, Vilniaus, Lithuania · Hybrid

2 days ago

Senior Data Engineer

Sand Tech Holdings Limited · South Africa · Remote

2 days ago

Senior Data Engineer

Apadmi · Salford Quays +1

2 days ago

Senior Data Engineer

Coatesgroup · Sydney · Hybrid

2 days ago

Senior Data Engineer

Fractal · California, United States of America

3 days ago

Senior Engineer - Data

M&G · Mumbai Central Avenue, India

3 days ago

Senior Data Engineer

Adobe · San Jose, United States of America

3 days ago

Senior Data Engineer

Quantiphi · IN KA Bengaluru, India +4

3 days ago

Senior, Data Engineer

Carrington Mortgage Services · United States, US · Remote

3 days ago

Senior Data Engineer

Accenturefederalservices · Arlington, VA +1 · Onsite

3 days ago

Senior Data Engineer

Mattel · Hyderabad, India

3 days ago

Senior Data Engineer

Fastmarkets · Sofia, Sofia City Province, Bulgaria · Hybrid

3 days ago

Senior Data Engineer

Hiflylabs · Budapest, Hungary · Hybrid

3 days ago

Senior Data Engineer

Wmeimg · CA-Beverly Hills - 9601 Wilshire, United States of America

4 days ago

Senior Engineer - Data

M&G · Pune, India

4 days ago

Senior Data Engineer

Danaher · IND - Bangalore North - Beckman Coulter India Private Limited · Onsite

4 days ago

Senior Data Engineer

Lbg · Hyderabad Knowledge Park Tower 2, India · Hybrid

4 days ago

Senior Data Engineer

Lendi Group · Sydney, NSW, Australia · Hybrid

4 days ago

Senior Data Engineer

Blend · Buenos Aires, Buenos Aires, Argentina · Remote

4 days ago

Senior Data Engineer

Blend · Bogotá, Bogota, Colombia · Remote

4 days ago

Senior Data Engineer

LineVision, Inc. · Boston, MA · Hybrid

4 days ago

Senior Data Engineer

KMS Technology · Guadalajara, Jal., Mexico · Hybrid

4 days ago