Hiring.Camp

Data Platform Engineer - ANJU

Valsoft Corp

·

Today

Location
Beirut, Beirut Governorate, Lebanon
Workplace
Hybrid
Type
Full-time
Department
Aspire Software Lebanon
Source
Workable

Description

Aspire Software is looking for a Data Platform Engineer to join our team in Lebanon.

Here is a little window into our company: Aspire Software operates and manages wholly owned software companies, providing mission-critical solutions across multiple verticals. By implementing industry best practices, Aspire delivers a time sensitive integration process, and the operation of a decentralized model has allowed it to become a hub for creating rapid growth by reinvesting in its portfolio.

About the job:

Data Platform Engineer will own the databases and data pipelines behind a data product with regular releases. The role combines database administration, scripting, integration and AI, in an agile Kanban team. You will fix data accuracy within life sciences and clinical trials raised by support and help deliver new product releases. Above all, you will improve the processes to deliver faster data updates through AI and Automation.

Core Responsibilities

Process Improvement

  • Find bottlenecks, manual steps and recurring errors in the release process.
  • Propose improvements, deliver them and measure the result.
  • Automate repetitive steps with scripts (Python, SQL, Bash).
  • Automate data health checks and functional tests.
  • Run improvement projects and keep runbooks up to date.

Database Administration

  • Administer, tune and monitor relational databases (MariaDB / MySQL, PostgreSQL, SQL Server or Oracle).
  • Manage schemas, indexes, backups to S3, replication and user access.
  • Run upgrades and migrations with minimal downtime.

Weekly Data Release

  • Parse, map and load collected data from trial registries, publications, conferences and hospital directories.
  • Run Java batch jobs, delta updates and production installs.
  • Run queries, match and de-duplicate person and organisation records.
  • Run mappers, publication pipelines and customer exports (API, S3, Azure).
  • Hand each validated release to IT for provisioning, and support data checks after go-live.

Support and Product Releases

  • Investigate and fix data issues raised by customers and support.
  • Find the root cause so issues do not come back.
  • Help plan and deliver new product releases and features.
  • Prepare and validate the data changes for each new version.

Platform Operations

  • Monitor data jobs and troubleshoot failures from logs and dashboards.
  • Check job pods and logs on Kubernetes.

AI and Automation

  • Use AI tools for data matching, classification, quality checks and coding.
  • Use AI responsibly with personal and clinical data.

Agile Delivery (Kanban)

  • Work from a Kanban board within WIP limits.
  • Join stand-ups and retrospectives, and suggest ways to improve flow.

Skills

PythonJavaAWSAzureKubernetesJenkinsCI/CDSQLPostgreSQLMySQLOracleSQL ServerMachine LearningDatabricksData ScienceGitLabJiraPower BIAgileScrum

Similar Jobs

30

Data Platform Engineer

Clickhouse·Berlin, State of Berlin +2·Remote

1d ago

Data Platform Engineer

Accenture·Hyderabad, Telangana +1

2d ago

Data Platform Engineer

Accenture·Hyderabad, Telangana

3d ago

Data Platform Engineer

Accenture·Bengaluru, Karnataka

3d ago

Data Platform Engineer

Accenture·Bengaluru, Karnataka

3d ago

Data Platform Engineer

Rain·New York City, New York +2·Onsite

3d ago

Data Platform Engineer

Accenture·Pune, Maharashtra

3d ago

Data Platform Engineer

Accenture·Bengaluru, Karnataka +1

5d ago

Data Platform Engineer

Bpost·BRUXELLES DE BROUCKERE - BRUSSEL DE BROUCKERE - Boulevard Anspach

Data Platform Engineer

Nexus Cognitive Technologies·Pune, Maharashtra·Onsite

1w ago

Data Platform Engineer

Finnair is·Finland

1w ago

Data Platform Engineer

Domino’s Pizza·Ann Arbor, Michigan

2w ago

Data Platform Engineer

Airtasker·Sydney, New South Wales·Hybrid

2w ago

Data Platform Engineer

Orange Company·Cairo, Egypt·Hybrid

2w ago

Data Platform Engineer

Electrolux·India

2w ago

Data Platform Engineer

VusionGroup SA·Paris, Île-de-France·Hybrid

2w ago

Data Platform Engineer

Team Cymru·Lake Mary, Florida·Remote

2w ago

Data Platform Engineer

10 Percent Recruiting·Edmonton, Alberta·Hybrid

3w ago

Data Platform Engineer

Branch International·Remote

3w ago

Data Platform Engineer

nou Systems·Colorado Springs, Colorado +1

3w ago

Data Platform Engineer

Mgmchina·MGM Macau, Macao

3w ago

Data Platform Engineer

Spirax Group·Cotopaxi - UK - Skelmersdale

Data Platform Engineer

INEOS is·Denver, Colorado

3w ago

Data Platform Engineer

Southeastern University·FL - Main Campus - Lakeland, FL 33801

Data Platform Engineer

Typesafe Ai·San Francisco, California·Onsite

1mo ago

Data Platform Engineer

Shift4payments·Toronto, Ontario

1mo ago

Data Platform Engineer

Accenture·Pune, Maharashtra

1mo ago

Data Platform Engineer

Accenture·Bengaluru, Karnataka

1mo ago

Data Platform Engineer

Employerdirecthealthcare·Dallas, Texas·Hybrid, Onsite

1mo ago

Data Platform Engineer

Universe·Remote·Remote

1mo ago