Principal Search AI Engineer
CVS Health
·Today
- Location
- Work At Home-California, United States of America · Work At Home-Idaho · Work At Home-Arizona · Work At Home-Florida · Work At Home-Alaska · Work At Home-Virginia
- Workplace
- Remote
- Type
- Full-time
- Department
- Engineering
- Seniority
- Lead
- Experience
- 10+ years
- Closing date
- Today
- Source
- Workday
Description
We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time.
Position Summary
The Principal Search AI Engineer is a senior individual contributor responsible for defining the technical vision, architecture, and engineering direction for large-scale Search and AI platforms. The role combines deep expertise in information retrieval, distributed systems, machine learning, Generative AI, and agentic architectures to build intelligent search capabilities that are scalable, reliable, observable, and production-ready.
This individual serves as a technical authority across engineering teams, establishing reference architectures, reusable patterns, and paved-road capabilities while remaining hands-on with architecture, prototyping, design reviews, and complex engineering challenges. The role drives outcomes through technical leadership and influence rather than direct people management.
Primary Responsibilities
- Define the technical vision and reference architecture for Search AI, including search, retrieval, ranking, relevance, AI-assisted retrieval, and intelligent query processing.
- Architect highly scalable distributed search and retrieval systems capable of supporting high-volume, low-latency, mission-critical applications.
- Establish architecture and engineering patterns for Generative AI and agentic systems, including LLM orchestration, Retrieval-Augmented Generation (RAG), tool integration, memory/context management, workflow orchestration, and multi-agent systems. These capabilities align with the broader architectural patterns being used for production agentic systems.
- Design and evolve search relevance and ranking architectures, including lexical retrieval, semantic/vector retrieval, hybrid search, query understanding, intent detection, learning-to-rank, reranking, personalization, and related ML techniques.
- Establish patterns for AI-enabled retrieval and reasoning, balancing deterministic search techniques with probabilistic AI/ML approaches based on quality, latency, cost, explainability, operational complexity, and measurable outcomes.
- Lead architectural decisions for agentic search, including how agents discover and use tools, access data, retrieve knowledge, maintain context, orchestrate workflows, and interact with external services.
- Define the evaluation strategy for Search AI, including offline evaluation, relevance metrics, online experimentation, production telemetry, AI quality evaluation, regression testing, and continuous improvement.
- Establish operational standards for Search AI covering availability, resiliency, latency, scalability, observability, incident response, capacity, and cost efficiency. Your architecture discussions have similarly emphasized performance, resiliency, technical debt, cross-team dependencies, and engineering consistency
- Partner with platform and infrastructure teams to ensure AI capabilities can move successfully from experimentation and prototypes into secure, scalable production systems. Enterprise guidance also specifically calls out reference architectures and standardized frameworks to accelerate this transition.
- Provide technical direction for data ingestion, indexing, enrichment, embeddings, retrieval, and serving architectures, clearly separating platform responsibilities where doing so improves scale and ownership.
- Lead architectural reviews and provide design authority on significant Search AI initiatives, identifying architectural risks, unnecessary complexity, scalability concerns, and long-term technical debt.
- Remain hands-on with critical technology decisions, prototypes, reference implementations, performance investigations, and complex production issues rather than operating solely as an architecture governance role.
- Evaluate emerging technologies and frameworks through engineering evidence rather than technology hype, using prototypes, benchmarks, quality metrics, operational characteristics, security, cost, and maintainability to guide adoption.
- Influence technology strategy across multiple teams and establish consistent engineering patterns without requiring direct organizational authority.
- Balance near-term delivery with long-term architectural sustainability, ensuring platforms can evolve as search algorithms, AI models, agent technologies, and product requirements change.
**Ideal candidate can be located anywhere in the US , work remote and EST coast time**
Required Qualifications
- 10+ years of software engineering experience building large-scale production systems, with significant depth in search, information retrieval, AI/ML, data-intensive systems, or distributed systems.
- Deep understanding of modern search and information retrieval concepts, including indexing, retrieval, ranking, relevance, query processing, semantic search, vector retrieval, and hybrid search.
- Strong hands-on software engineering skills in one or more modern programming languages such as Java, Python, or equivalent languages.
- Demonstrated experience designing large-scale distributed systems, including APIs, microservices, asynchronous/event-driven architectures, caching, databases, messaging, and high-throughput data-processing systems.
- Strong understanding of machine learning applied to search, such as classification, ranking, embeddings, semantic retrieval, reranking, recommendations, or personalization.
- Experience with modern Generative AI architectures, including LLMs, RAG, embeddings, vector retrieval, prompt/context engineering, model evaluation, and AI application patterns.
- Understanding of agentic AI architecture, including agents, tools, orchestration, planning, memory/context, routing, evaluation, guardrails, and human-in-the-loop patterns.
- Experience architecting production capabilities on at least one major cloud platform such as AWS, Microsoft Azure, or Google Cloud Platform, with the ability to reason across cloud technologies rather than being tied to one vendor. Internal AI architecture guidance similarly spans AWS, Azure, and GCP rather than prescribing a single stack.
- Strong understanding of production engineering practices including automated testing, CI/CD, DevSecOps, observability, performance engineering, resiliency, security, and operational readiness.
Preferred Qualifications
- Demonstrated ability to influence architecture and engineering direction across multiple teams without direct reporting authority.
- Proven ability to communicate complex technical decisions, tradeoffs, and architecture to both highly technical audiences and senior business/product stakeholders.
- Experience building or modernizing enterprise-scale search platforms or other high-volume information-retrieval systems.
- Experience with learning-to-rank, neural retrieval, embeddings, semantic search, hybrid retrieval, reranking, personalization, or recommendation systems.
- Experience designing multi-agent or agentic applications that integrate models, enterprise data, APIs, tools, workflows, and external systems.
- Experience defining Search/AI quality metrics, experimentation frameworks, evaluation pipelines, production monitoring, and feedback loops.
Education
- Bachelor’s degree, or equivalent experience (HS diploma + 4 years relevant experience)
Pay Range
The typical pay range for this role is:
$144,200.00 - $288,400.00
This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above. This position also includes an award target in the company’s equity award program.
Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.
Great benefits for great people
We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.
Additional details about available benefits are provided during the application process and on Benefits Moments.
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.