- Salary
- C$60 – C$75/hr
- Location
- Toronto, Ontario, CA
- Workplace
- Hybrid
- Type
- Contract
- Department
- Engineering
- Seniority
- Senior
- Source
- BetterTeam
Description
Work Model: Hybrid / Flexible Location
Project: Enterprise Regulatory Compliance AI Platform
- Design and develop AI agents and multi-agent workflows for regulatory compliance use cases.
- Build AI solutions using Python and AWS Bedrock.
- Design the underlying architecture for agent orchestration, reasoning, and workflow execution.
- Develop robust AI evaluation frameworks to measure accuracy, reliability, consistency, and quality of agent outputs.
- Implement mechanisms to identify and monitor compliance drift over time.
- Collaborate with regulatory and business SMEs who will validate agent outputs and business rules.
- Develop production-quality components that can integrate into the broader DLO platform.
- Support testing, iteration and continuous improvement of AI agent performance.
- Document architecture, evaluation methodology and technical design decisions.
- Strong hands-on experience developing Generative AI / LLM applications.
- Advanced Python development skills.
- Practical experience with AWS Bedrock and AWS-based AI architectures.
- Experience designing and implementing AI agents, agentic workflows or multi-agent systems.
- Experience building LLM evaluation frameworks, including approaches for measuring output quality, hallucination, accuracy and reliability.
- Strong understanding of prompt engineering, model selection, orchestration and production AI deployment.
- Experience taking AI solutions from prototype through production implementation.
- Ability to work directly with business and domain SMEs to translate requirements into AI workflows.
- Experience with enterprise compliance, governance, risk, or regulatory applications.
- Experience with AI guardrails, responsible AI, and model governance.
- Familiarity with RAG, knowledge bases, embeddings, and enterprise data integration.
- Experience monitoring AI systems for performance degradation or drift.
- Previous consulting, enterprise or professional-services experience.