Generative AI & LLM Architecture Manager
Accenture
·Today
- Location
- Belen, La Ribera, Costa Rica
- Workplace
- Hybrid
- Type
- Full-time
- Department
- Engineering
- Seniority
- Manager
- Experience
- 10+ years
- Source
- Workday
Description
Accenture helps the world’s leading enterprises reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries. Our strategy is to be the reinvention partner of choice for our clients and lead in the safe, widespread adoption of AI, and to be the most client-focused, AI-enabled, great place to work in the world. We bring together the talent of our approximately 799,000 people with proprietary assets and platforms, deep process and industry expertise, and leading ecosystem relationships to deliver end-to-end solutions and measurable outcomes at scale. Through our Reinvention Services, we offer broad expertise across Cybersecurity, Digital Core, Finance, Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,000 clients and generated approximately $70 billion in FY25 revenue. Visit us at accenture.com.
About the role
We are looking for an experienced Generative AI & LLM Architecture Manager to define and lead the implementation of scalable Artificial Intelligence solutions.
In this role, you will shape enterprise AI architecture with a strong focus on Generative AI, Large Language Models and multimodal solutions. You will lead multidisciplinary teams and guide initiatives from early-stage prototypes to secure, reliable and production-ready platforms.
This opportunity is ideal for a senior technology leader who combines hands-on architectural expertise with strong stakeholder management, delivery leadership and the ability to translate complex technical decisions into clear business outcomes.
Key responsibilities
- Define and evolve enterprise AI architecture blueprints covering LLMs, multimodal models, data platforms, security, governance and operations.
- Evaluate technology options and make architectural recommendations across model development, serving, orchestration, observability and AI governance.
- Develop implementation roadmaps to move AI initiatives from their current state toward scalable and reusable enterprise capabilities.
- Lead the design and operationalization of data ingestion, vector search, Retrieval-Augmented Generation pipelines, model-serving gateways, prompt management, evaluation tools and LLMOps capabilities.
- Design reusable architectural components such as model-routing services, safety controls, retrieval and reranking services, caching layers and policy-enforcement mechanisms.
- Guide Proofs of Concept through production, establishing technical standards, reusable patterns and engineering best practices.
- Optimize AI solutions for performance, availability, scalability and cost efficiency.
- Establish security, Responsible AI and governance controls, including data privacy, identity and access management, content safety, model-risk assessment, auditability and continuous monitoring.
- Define observability practices covering metrics, logs, tracing, model quality, safety, infrastructure utilization and cost monitoring.
- Lead multiple technical workstreams and coordinate with engineering, data, security, platform and product teams.
- Present architectural recommendations and trade-offs to both technical and executive audiences.
- Mentor engineers, technical leads and architects while supporting the continued development of AI capabilities across the organization.
What we are looking for
- 10+ years of experience in software engineering, solution architecture or technology architecture, delivering distributed, web-based and enterprise solutions.
- 3+ years of hands-on experience designing or implementing AI and Generative AI solutions, including LLM applications, Retrieval-Augmented Generation, prompt engineering and model customization techniques.
- Proven experience leading technical teams and complex initiatives across multiple workstreams.
- Strong understanding of enterprise architecture, software development lifecycle practices, platform integration and architectural governance.
- Experience designing and operating services, microservices and APIs in enterprise environments.
- Demonstrated ability to identify scalability and performance bottlenecks and lead optimization and cost-reduction initiatives.
- Experience implementing security-by-design practices, including authentication, authorization, data protection and mitigation of AI-specific risks such as prompt injection and data leakage.
- Experience with DevOps, MLOps, containerized environments and automated integration and deployment processes.
- Ability to manage senior stakeholders, communicate complex architectural decisions and resolve technical or delivery-related escalations.
- Advanced English communication skills, both written and spoken.
Technical skills
We are looking for experience across several of the following areas:
- Enterprise AI architecture for LLMs and multimodal models.
- Retrieval-Augmented Generation, including embeddings, chunking, reranking, grounding and guardrails.
- LLMOps practices such as prompt versioning, evaluation suites, A/B testing, canary releases and production monitoring.
- Model serving, gateways and routing across multiple models or providers.
- Python and API development using frameworks such as FastAPI or Flask.
- Server-side development with technologies such as Java, .NET, Python or Node.js.
- REST APIs, microservices and enterprise integration patterns.
- Relational, non-relational and vector databases, including PostgreSQL with pgvector, Pinecone or Weaviate.
- Streaming and data-ingestion technologies such as Apache Kafka or Azure Event Hubs.
- Identity and access management, OAuth 2.0, OpenID Connect, JWT, encryption and secrets management.
- Docker, Kubernetes, Terraform, Bicep and Git-based delivery workflows.
- Observability tools and standards such as OpenTelemetry.
- Cloud platforms such as AWS, Microsoft Azure or Google Cloud Platform.
- Architecture documentation using UML, C4 models, sequence diagrams and Architecture Decision Records.
Preferred qualifications
- Degree in Computer Science, Software Engineering, Information Technology, Systems Engineering or a related field.
- Advanced studies in Artificial Intelligence, Machine Learning or distributed systems.
- Cloud, AI, data or enterprise architecture certifications.
- Experience with model-serving technologies such as vLLM, NVIDIA Triton Inference Server, TensorRT-LLM, ONNX Runtime or KServe.
- Familiarity with AI and model platforms such as Amazon SageMaker, Google Vertex AI or Azure Machine Learning.
- Experience with model providers, gateways, vector databases and orchestration frameworks such as LangChain or LlamaIndex.
- Knowledge of LLM evaluation and monitoring tools such as RAGAS, Langfuse, Arize Phoenix or PromptFoo.
- Previous experience working in large-scale or complex enterprise technology environments.
What you will bring
You will combine strategic architectural thinking with practical delivery leadership. You should be comfortable setting technical direction, challenging assumptions, making informed build-versus-buy decisions and guiding teams through the complexity of taking Generative AI solutions into production.
You will also play a key role in creating reusable patterns, developing technical talent and ensuring AI solutions are secure, responsible, scalable and aligned with measurable business outcomes.
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.