Hiring.Camp

AI Platform and Harness Engineer

Lts

·

Jul 29, 2026

Location
United States - Remote
Workplace
Remote
Type
Full-time
Department
Program and Project Management
Experience
5+ years
Education
Bachelor
Source
Greenhouse

Description

LTS is seeking an AI Platform and Harness Engineer to develop and maintain the infrastructure, tooling, and evaluation frameworks that power enterprise AI solutions. This role is responsible for building the AI platform and reusable "AI harnesses" that enable Large Language Models (LLMs), AI agents, Retrieval-Augmented Generation (RAG), and Generative AI applications to be securely developed, tested, evaluated, monitored, and deployed at scale.

The ideal candidate has experience with AI platforms, LLMOps, software engineering, cloud-native technologies, and backend systems, along with a passion for building reliable, observable, and production-ready AI solutions. You will work closely with AI architects, software engineers, data scientists, and product teams to ensure AI solutions are scalable, secure, cost-effective, and continuously improving.

What You'll Do:

  • Design, build, and maintain enterprise AI platform capabilities supporting Large Language Models (LLMs), AI agents, RAG, and Generative AI applications.
  • Develop reusable AI harnesses to automate testing, prompt evaluation, model benchmarking, regression testing, and quality assurance.
  • Build AI evaluation frameworks to measure model accuracy, retrieval quality, hallucination detection, latency, throughput, cost, and overall application performance.
  • Implement observability and monitoring solutions for AI applications, including telemetry, tracing, logging, dashboards, and operational metrics.
  • Build and maintain LLMOps pipelines supporting model deployment, versioning, evaluation, experimentation, rollback, and continuous improvement.
  • Design automated workflows for prompt testing, retrieval evaluation, AI system validation, and performance benchmarking.
  • Develop internal tools for prompt management, model experimentation, AI performance optimization, and developer productivity.
  • Build scalable backend services and APIs supporting AI platforms and enterprise AI integrations.
  • Collaborate with AI architects and engineering teams to integrate LLMs, RAG pipelines, vector databases, and agentic AI solutions into enterprise applications.
  • Support deployment of AI services across AWS, Azure, or Google Cloud using containerized and cloud-native architectures.
  • Implement CI/CD pipelines and infrastructure automation supporting enterprise AI development and deployment.
  • Apply security, governance, and Responsible AI controls throughout the AI development lifecycle.
  • Evaluate emerging AI frameworks, LLMOps technologies, evaluation methodologies, and automation tools to improve engineering productivity.
  • Troubleshoot production AI issues and continuously improve platform reliability, scalability, security, and user experience.
  • Document engineering standards, AI platform architecture, evaluation methodologies, and operational best practices.

What We're Looking For:

  • Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Data Science, or a related technical field.
  • 5+ years of experience in software engineering, platform engineering, backend engineering, DevOps, cloud engineering, or infrastructure engineering.
  • 2+ years building or supporting Generative AI, Large Language Model (LLM), or machine learning applications.
  • Strong programming experience in Python.
  • Experience developing APIs, backend services, and distributed systems.
  • Experience with cloud platforms including AWS, Azure, or Google Cloud Platform.
  • Experience deploying applications using Docker and Kubernetes.
  • Experience working with Git, CI/CD pipelines, Infrastructure as Code (IaC), and infrastructure automation.
  • Strong understanding of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Prompt engineering, Embeddings, Vector databases, AI agents and agentic workflows
  • Familiarity with AI evaluation techniques, automated testing, benchmarking, regression testing, and model validation.
  • Experience building scalable, production-grade software platforms.
  • Strong problem-solving, debugging, and performance optimization skills.

Nice to Have:

  • Experience with AI orchestration frameworks such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, or AutoGen.
  • Experience implementing LLMOps or MLOps platforms and deployment pipelines.
  • Experience with AI observability tools such as LangSmith, OpenTelemetry, Prometheus, Grafana, Evidently AI, or Arize AI.
  • Experience with vector databases including Pinecone, Qdrant, Weaviate, Azure AI Search, or pgvector.
  • Experience with OpenAI, Azure OpenAI, AWS Bedrock, Anthropic Claude, Google Vertex AI, or similar enterprise AI platforms.
  • Experience implementing Responsible AI, AI governance, model security, and AI safety best practices.
  • Experience supporting Federal Government or other regulated environments.
  • Experience evaluating AI systems for quality, reliability, accuracy, explainability, latency, and cost optimization.
  • Familiarity with healthcare, enterprise modernization, or mission-critical systems.

 

What’s In It for You?

  • The Opportunity to support high-visibility federal missions
  • A culture that values innovation, growth, and collaboration
  • Access to cutting-edge tools and technologies
  • Comprehensive benefits for you and your family
  • A career path that rewards ambition and performance

 

If you’re ready to push boundaries, sharpen your skills, and join a team that is passionate about building what’s next, we’d love to meet you. Apply today and let’s build a future together!

 

 

LTS shares salary ranges to promote transparency. Compensation ranges are provided for informational purposes, and final compensation may vary based on experience, skills, location, and role requirements.

LTS is committed to offering eligible employees comprehensive benefits that will provide them with options intended to meet their needs and the needs of their family.

Skills

PythonAWSAzureDockerKubernetesCI/CDMachine LearningData ScienceGitDevOps

Similar Jobs

30

Principal Software Engineer – Search and AI Platform Innovation

Relx·Philadelphia, Pennsylvania

1d ago

Principal Software Engineer – Search and AI Platform Innovation

Relx·Philadelphia, Pennsylvania

1d ago

ServiceNow Solution Architect – HRSD, CSM, IRM, AI and Platform

Talents LGS·Canada·Remote

3d ago

Senior Product Lead, Agent Fleet and AI Platform

Burq·Lahore, Punjab·Onsite

3d ago

Director, Developer Platform and AI Transformation

Verily·Boston, Massachusetts +4·Hybrid

1w ago

Head of Platform and AI Engineering

Computershare·London, England·Hybrid

1w ago

Principal AI Platform and Model Operations Engineer - TS/SCI with Polygraph

Gdit·USA VA Chantilly - 14700 Lee Rd, US·Onsite

2w ago

Principal AI Platform and Model Operations Engineer - TS/SCI with Polygraph

Gdit·USA VA Chantilly - 14700 Lee Rd, US·Onsite

2w ago

Senior AI Platform and Solutions Innovator

Fulcrumdigital·Pune, Maharashtra·Hybrid

1mo ago

Software Engineer, Data and AI Platform

Doordash USA·San Francisco, California

1mo ago

Executive Manager - AI Platform and Observability

Pepsi Co·Hyderabad, Telangana

1mo ago

SaaS Platform and AI Partner Marketing Lead

Stripe·New York City, New York +1·Remote

Solution Architect (Data and AI Platform)

Relx·London, England

1mo ago

Solution Architect (Data and AI Platform)

Relx·London, England

1mo ago

Marketing Technology and Platform AI Specialist (Associate)

Centrax·South Africa·Remote

1mo ago

Platform and AI Enablement Engineer Supervisor

RSM·SLV-San Salvador-Calle Cortez Blanco #8 Urb. Madreselva, El Salvador

2mo ago

Staff Engineer - AI Platform and Enablement

Netgear·Cork, Munster·Hybrid

2mo ago

Director, AI Platform and Portfolio Delivery

Betmgminc·Connecticut, US +2·Remote

3mo ago

Senior Software Development Engineer, Data Integration AI and Platform Excellence (APEX)

Amazon Company

Engineering Manager, Platform and AI Infrastructure

Anrok·New York City, New York +2·Remote

5mo ago

Senior Manager, ITP Program Management, AI and Agentic Platform

Micron·Bengaluru, Karnataka +1

3d ago

Senior Manager, ITP Program Management, AI and Agentic Platform

Micron Technology·Bengaluru, Karnataka +1

3d ago

Senior Director, ITP AI Data Platform and Infrastructure

Micron Technology·San Jose, California

1w ago

Software Engineer- AI, Autonomy and Platform Development

Leidos·Huntsville, Alabama +2·Onsite

1w ago

Senior Director, ITP AI Data Platform and Infrastructure

Micron·San Jose, California

1w ago

AI and Data Platform Engineer (m/f/d)

Patrizia·Augsburg, Bavaria +3·Remote, Hybrid

1w ago

Engineering Manager - Compute and Data Platform (AI Platform)

Wayve·London, England·Hybrid

2w ago

Sr Security Platform Engineer, AI and Automation

Vanguard·Houston, Texas +2·Hybrid

3w ago

Sr Security Platform Engineer, AI and Automation

Vanguard·Houston, Texas +2·Hybrid

3w ago

Software Architect, AI Systems and Platform

Okta·San Francisco, California