- Location
- Singapore
- Type
- Full-time
- Department
- Engineering
- Closing date
- Today
- Source
- CareersPage
Description
Key Responsibilities:
- Work with policy and communications officers, product owners, engineers, domain experts and subject-matter specialists to understand user needs and translate them into clear analytical and machine-learning problems.
- Develop and maintain robust evaluation frameworks and datasets for natural language, generative AI and other machine-learning use cases.
- Design and conduct experiments to assess and improve model quality, accuracy, consistency, reliability, latency and cost.
- Explore and evaluate appropriate models, techniques and emerging technologies, recommending solutions based on evidence, user needs and operational considerations.
- Perform systematic error analysis, identify performance gaps across use cases and user segments, and priorities improvements with the team.
- Establish suitable automated and human-evaluation approaches, recognizing the limitations and risks of individual metrics and AI-assisted evaluation.
- Partner with engineers to integrate validated improvements, define quality checks and monitor performance in production.
- Ensure that data, experiments and model decisions are reproducible, well documented and aligned with responsible AI, privacy and security requirements.
- Communicate findings, trade-offs and recommendations clearly to technical and non-technical stakeholders across the organization.
What we are looking for:
- A degree in Computer Science, Data Science, Statistics, Artificial Intelligence, Computational Linguistics or a related quantitative discipline, or equivalent practical experience.
- Demonstrated experience using data science or machine learning to solve real-world problems, preferably involving natural language processing, generative AI, search or information retrieval.
- Strong programming skills in Python and working knowledge of SQL, data processing, version control and software-development practices.
- Sound understanding of statistics, experimental design, evaluation methodology, sampling, error analysis and model validation.
- Experience working with unstructured text or other complex data types, and evaluating machine-learning or generative AI systems beyond a single aggregate metric.
- Familiarity with modern NLP and AI concepts such as embeddings, language models, prompt design and model evaluation.
- Ability to write maintainable code and work with engineers to bring data-science solutions into production.
- Strong analytical, problem-solving and communication skills, with the ability to explain technical findings and trade-offs clearly to diverse audiences.
- A proactive and collaborative mindset, willingness to learn, and motivation to improve public services and communications through technology.
The following would be advantageous:
- Experience with multilingual NLP, translation quality evaluation, or working with linguists and language reviewers.
- Knowledge of Chinese, Malay or Tamil, or familiarity with Singapore's multilingual communications landscape.
- Experience with cloud-based AI services, vector search, MLOps, production monitoring or responsible AI practices.
- Experience developing AI-enabled products in government, communications, regulated or other high-assurance environments.
- An understanding of Singapore's public communications landscape and the needs of public-sector stakeholders.