Hiring.Camp

Expert Rater

Welocalize is

·

Today

Location
Asia (Remote), India
Workplace
Remote
Type
Full-time
Experience
2+ years
Closing date
Today
Source
Workday

Description

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login

When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

Thank you!

NOTICE:  For Privacy Policy please review here

Job Responsibilities:

Welo Data is an award-winning localization and AI data company. We run some of the world’s largest AI model relevance rating programs. This will play a crucial role in analyzing and improving AI-driven online advertising platforms.

This role will help establish benchmarks and guidelines for data used to train AI models, particularly in areas lacking defined standards. That means you will be shaping the future of web-based advertising and AI models.

MAIN DUTIES

The following is a non-exhaustive list of responsibilities and areas of ownership of an Expert Rater

  • Rate Client-provided ads following pre-defined guidelines
  • Evaluate advertisements based on specific quality, relevance, and compliance criteria provided by the client.
  • Ensure ratings are objective, consistent, and aligned with the predefined rating standards.
  • Identify any guideline ambiguities and apply critical thinking when assessing borderline cases.
  • Maintain a high level of accuracy and efficiency, meeting daily/weekly rating quotas.
  • Review and refine rating guidelines, identifying areas for improvement and recommending updates to enhance accuracy, consistency, and overall rating quality.
  • Curate high-quality datasets ("golden sets") by selecting and validating top-tier rated ads, which can serve as benchmarks for AI model training and human rater calibration.
  • Collaborate with cross-functional teams (e.g., quality assurance, data analysts, and AI training teams) to ensure rating processes align with evolving industry and client needs.
  • Analyse trends and patterns in ad ratings, providing insights that contribute to guideline optimizations and overall rating effectiveness.
  • Assist in training and mentoring new raters, ensuring they understand guidelines and best practices for accurate evaluations.

REQUIREMENTS

Experience

  • Have experience in AI model relevance, such as data labeling, linguistic annotation, relevance rating, etc.
  • Are analytical and data-driven with a proven track-record of data-based decision making  
  • Have a strong interest and understanding of digital marketing and advertising, especially as it relates to artificial intelligence  
  • Can effectively summarize complex information, questions, and solutions for various audiences Have experience researching and gathering insights, and understanding complex problems across a variety of topics  
  • Can defining, explain, and defend their points of view in group discussions 
  • Are comfortable reviewing and discussing a variety of topics – you do not need to have expertise on the topics, but willingness to research and understand to support consensus decisions is vital 
  • Are comfortable with ambiguity in guidelines, workflows, and processes, and are motivated to help establish those systems 

Requirements

  • Native level fluency in the target language
  • Excellent understanding of both written & spoken English
  • A 4 year university degree and/or or at least 2 years work experience in one or more of the following: AI-based relevance rating, marketing/advertising, linguistics, content creation, writing, tech-related quality assurance, data labeling, or linguistic annotation.

Additional Job Details:

Skills

WorkdayCompliance

Similar Jobs

30

Expert Coding Rater

Topcoder taas·New York City, New York

Expert Coding Raters

Topcoder taas·New York City, New York

Waste Water Expert

AECOM·Bengaluru, Karnataka·Hybrid

4mo ago

Team Leader (Transboundary Water Expert) (International)

Afghanbureau·Kabul Afghanistan

1y+ ago

Front Desk Water Care Expert

HotSpring Spas & Pool Tables·West Fargo, North Dakota

Front Desk Water Care Expert

HotSpring Spas & Pool Tables·Bismarck, North Dakota

Subject Matter Expert in Water, Waste and Waste Water (F/M/N)

Yokogawa·France

5mo ago

Hydrology & Water Resources Expert (National)

Afghanbureau·Kabul Afghanistan

1y+ ago

Water & Sanitation Expert - M/F

Hris Suez·Casablanca, Casablanca-Settat

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Sacramento, California·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·San Diego, California·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·San Francisco, California·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Pasadena, Texas·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Portland, Oregon·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Federal Way, Washington·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Denver, Colorado·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Virginia, US·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Seattle, Washington·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Tampa, Florida·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Fort Worth, Texas·Hybrid

1d ago

National Water Treatment Technical Expert

Kennedy/Jenks Consulting·Austin, Texas·Hybrid

1d ago

Water Treatment Technical Expert

Olsson·Remote·Remote

2mo ago

Water Treatment Technical Expert

Olsson·Baton Rouge, Louisiana

2mo ago

Regional Drinking Water Subject Matter Expert

Default·Denver, Colorado +1

4mo ago

Water Supply / Hydraulics Expert

AECOM·Mandi, Himachal Pradesh

5mo ago

Expert Technical Services Life Science Water Treatment - Americas

Omya·Charlotte, North Carolina +3·Remote

2w ago

Water & Wastewater (W-WW) Technical Expert

Maxwon Llc

Advanced Battery Cell Material Expert

Vinfast·Haiphong, Hai Phong

2w ago

Senior Expert, Material Science Project Leader

Novartis·Hyderabad, Telangana

3w ago

Sr. / Principal Material Expert – MSAT (m/f/d)

Lilly·Germany

1mo ago