Data Platform Engineer - ANJU
Valsoft Corp
·Today
- Location
- Beirut, Beirut Governorate, Lebanon
- Workplace
- Hybrid
- Type
- Full-time
- Department
- Aspire Software Lebanon
- Source
- Workable
Description
Aspire Software is looking for a Data Platform Engineer to join our team in Lebanon.
Here is a little window into our company: Aspire Software operates and manages wholly owned software companies, providing mission-critical solutions across multiple verticals. By implementing industry best practices, Aspire delivers a time sensitive integration process, and the operation of a decentralized model has allowed it to become a hub for creating rapid growth by reinvesting in its portfolio.
About the job:
Data Platform Engineer will own the databases and data pipelines behind a data product with regular releases. The role combines database administration, scripting, integration and AI, in an agile Kanban team. You will fix data accuracy within life sciences and clinical trials raised by support and help deliver new product releases. Above all, you will improve the processes to deliver faster data updates through AI and Automation.
Core Responsibilities
Process Improvement
- Find bottlenecks, manual steps and recurring errors in the release process.
- Propose improvements, deliver them and measure the result.
- Automate repetitive steps with scripts (Python, SQL, Bash).
- Automate data health checks and functional tests.
- Run improvement projects and keep runbooks up to date.
Database Administration
- Administer, tune and monitor relational databases (MariaDB / MySQL, PostgreSQL, SQL Server or Oracle).
- Manage schemas, indexes, backups to S3, replication and user access.
- Run upgrades and migrations with minimal downtime.
Weekly Data Release
- Parse, map and load collected data from trial registries, publications, conferences and hospital directories.
- Run Java batch jobs, delta updates and production installs.
- Run queries, match and de-duplicate person and organisation records.
- Run mappers, publication pipelines and customer exports (API, S3, Azure).
- Hand each validated release to IT for provisioning, and support data checks after go-live.
Support and Product Releases
- Investigate and fix data issues raised by customers and support.
- Find the root cause so issues do not come back.
- Help plan and deliver new product releases and features.
- Prepare and validate the data changes for each new version.
Platform Operations
- Monitor data jobs and troubleshoot failures from logs and dashboards.
- Check job pods and logs on Kubernetes.
AI and Automation
- Use AI tools for data matching, classification, quality checks and coding.
- Use AI responsibly with personal and clinical data.
Agile Delivery (Kanban)
- Work from a Kanban board within WIP limits.
- Join stand-ups and retrospectives, and suggest ways to improve flow.