- Location
- Remote job
- Workplace
- Remote
- Type
- Full-time
- Department
- DataForce
- Seniority
- Mid
- Source
- Recruitee
Description
Role Summary
You'll design and run AI data projects and build the automation behind them, combining deterministic tooling with LLM agents to deliver solutions in quality management, project management, and data analytics.
Key Responsibilities
Build hybrid automation: Pair deterministic components (scripts, validation rules, trackers, scheduled jobs) with stochastic ones (LLM agents that score, classify, check, report, etc.). Decide which steps must be rules and which can be models, and design the hand-offs between them.
Set up and run agents in Claude and in our native enterprise agentic environment: task specs, connections to data and tools, schedules, monitoring and failure handling.
Quality management: Design QA workflows, guidelines, rubrics and scorecards; calibrate automated checks against human reviewers; turn review findings into error categories you can measure and fix.
Project management: Run data collection and annotation projects end to end (scoping, vendors, workflows, tracking, delivery) and build the tooling that lets coordinators run the day.
Data analytics: Collect, clean, and analyse production and quality data (throughput, rework, error rates, contributor performance) and turn it into reporting that teams and clients act on.
Verify everything: Test automation before release and build continuous auditing parallel workflows to ensure quality.
Document so others can run it: short specs, tickets and runbooks that let coordinators and engineers operate and extend what you build.