Agentic AI Architect
Altera
·Today
- Salary
- $149k – $238k/yr
- Location
- San Jose, California, United States, United States of America
- Type
- Full-time
- Department
- Engineering
- Experience
- 10+ years
- Source
- Workday
Description
Job Details:
Job Description:
We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms.
This role sits at the intersection of:
- Large Language Models (LLMs)
- Agent frameworks & autonomous systems
- Retrieval-Augmented Generation (RAG)
- Hardware-aware AI system design (FPGA / ASIC / EDA)
You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration.
Key Responsibilities
AI Architecture & System Design
- Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
- Architect RAG pipelines for enterprise-scale knowledge integration
- Define end-to-end AI system architecture from data ingestion → reasoning → action
Agentic AI & LLM Development
- Develop advanced workflows using:
- tool-using agents
- planning & reasoning agents
- multi-agent collaboration frameworks
- Evaluate and integrate leading LLMs (open-source and proprietary)
- Optimize prompt engineering, memory, and reasoning capabilities
Hardware-Aware AI Optimization
- Co-design AI systems with:
- FPGA acceleration
- ASIC platforms
- heterogeneous compute (CPU/GPU/FPGA)
- Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
- Collaborate with hardware teams on EDA and system integration
Framework & Platform Development
- Build internal platforms using
- LangChain
- LlamaIndex
- custom agent orchestration framework
- Develop reusable components for:
- memory management
- tool integration
- knowledge retrieval
Technical Leadership
- Lead architecture reviews and guide engineering teams
- Mentor senior engineers and influence cross-functional teams
- Drive innovation in AI + hardware convergence
What Makes This Role Unique
- Opportunity to define agentic AI architecture for hardware-driven systems
- Work at the convergence of:
- AI reasoning systems
- FPGA acceleration
- next-generation computing platforms
- High-impact role influencing future AI + semiconductor integration
Impact
You will help shape how AI agents interact with hardware, enabling:
- intelligent system orchestration
- real-time decision-making pipelines
- scalable AI deployment on FPGA platforms
Summary
This role is ideal for a senior technical leader who can:
- bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture
- and drive innovation in next-generation AI systems.
The pay range below is for Bay Area California only. Actual salary may vary based on a number of factors including job location, job-related knowledge, skills, experiences, trainings, etc. We also offer incentive opportunities that reward employees based on individual and company performance.
$149.1K - $238.2K USD
We use artificial intelligence to screen, assess, or select applicants for the position. Applicants must be eligible for any required U.S. export authorizations.
Qualifications:
- Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:
- AI/ML systems
- Distributed systems
- Hardware–software co-design
- Recognized expertise in AI/ Large Language Models (LLMs)
- Deep understanding of:
- LLM architectures and inference
- RAG systems and vector databases
- Agentic AI / autonomous agents
- Hands-on experience building:
- Production-grade LLM applications
- Multi-step reasoning and orchestration workflows
- Scalable and reliable AI systems in production
- Strong background in:
- FPGA / ASIC / EDA systems
- Heterogeneous computing architectures
- Familiarity with:
- Hardware acceleration for AI workloads
- Performance optimization across system stack
Technical Skills
- Programming:
- Python
- C++ (preferred)
- Experience with:
- Distributed systems design
- APIs and microservices architecture
- Cloud and/or edge AI deployment
- Hands-on experience with:
- LLM fine-tuning, quantization, and model distillation
- On-device / edge AI deployment
- Robotics, autonomous systems, or real-time AI pipelines
- Knowledge of:
- Compiler stacks (e.g., MLIR, TVM)
- AI model optimization for FPGA platforms