Data Engineer
User Experience Researchers Pteltd
·Today
- Location
- Singapore
- Type
- Full-time
- Department
- Engineering
- Seniority
- Mid
- Closing date
- Today
- Source
- CareersPage
Description
Key Responsibilities:
- Design, develop and maintain data pipelines for data ingestion, integration, transformation, storage and processing across cloud and enterprise data platforms.
- Integrate data from multiple sources, including databases, APIs, files, streaming sources, IoT and OT systems.
- Develop and maintain data processing workflows to support enterprise data requirements and downstream analytics use cases.
- Implement data validation, quality checks, monitoring and error-handling mechanisms to ensure data accuracy and reliability.
- Work with SQL, Python or equivalent programming languages, ETL frameworks and data orchestration tools to develop and maintain data engineering solutions.
- Support the development and maintenance of data lakes, data warehouses and data models.
- Apply version control and relevant data engineering practices to ensure maintainable and reliable data solutions.
- Support data governance activities, including metadata management, data lineage, access control and data lifecycle management.
- Collaborate with senior data engineers, software engineers, cloud engineers and other technical stakeholders to support data platform implementation and maintenance.
Requirements:
- At least TWO (2) years of experience as a Data Engineer or in a similar data engineering role, including the design, development and implementation of data pipelines, data ingestion and integration workflows, data transformation, data storage and data processing solutions on cloud and/or enterprise data platforms.
- Experience in integrating data from multiple sources, including structured and unstructured data, APIs, databases, files, streaming sources and/or IoT or OT systems, and implementing appropriate data quality, validation, monitoring and error-handling mechanisms.
- Experience with relevant data engineering technologies and practices, including SQL, Python or equivalent programming languages, ETL frameworks, data lakes and/or data warehouses, data modelling, orchestration and version control.
- Experience in implementing data governance, metadata management, data lineage, access control and/or data lifecycle management requirements within enterprise data environments.