Hiring.Camp

AI Runtime Engineer

EnCharge AI

·

Jul 10, 2025

Location
U.S., Canada, Germany, Norway
Workplace
Remote
Department
Software
Experience
3+ years
Source
Greenhouse

Description

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.

About the Role

EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments. 

Responsibilities

  • Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
  • Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
  • Optimize data movement between host and device using PCIe, DMA, shared memory.
  • Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM
  • Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.
  • Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.
  • Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments. 

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
  • 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.
  • Strong proficiency in C/C++ and low-level systems programming.
  • Deep understanding of task scheduling, concurrency, and memory hierarchy.
  • Experience with hardware-aware optimizations and dataflow architectures.
  • Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO).
  • Experience with low-latency, high-throughput workload execution for AI models.
  • Strong debugging and profiling skills for optimizing AI execution performance.
  • Exposure to AI model deployment pipelines (Triton, TensorFlow Serving). 

EnchargeAI is an equal employment opportunity employer in the United States.

 

Skills

Deep LearningTensorFlow

Similar Jobs

24

AI Runtime Engineer

Cat·Shanghai, China +1

2w ago

AI Runtime Engineer

Modular·Edinburgh, Scotland·Hybrid

2mo ago

Senior Staff Software Engineer, AI Runtime

Databricks·Mountain View, California +1

DevOps Engineer - AI Runtime Services

Demandbase·Hyderabad, Telangana·Hybrid

4mo ago

Staff Software Engineer, AI Runtime

Databricks·Mountain View, California

[Agentic AI] Senior Agentic AI Systems Engineer – Runtime Frameworks & Resource Intelligence

Hp·Austin, Texas

5d ago

[Agentic AI] Senior Agentic AI Systems Engineer – Runtime Frameworks & Resource Intelligence

Hp·Austin, Texas

5d ago

[Agentic AI] Senior Agentic AI Systems Engineer – Runtime Frameworks & Resource Intelligence

HP·Austin, Texas +1

5d ago

Senior Applied AI Engineer – Agent Runtime (Alwin by DataSnipper)

DataSnipper·New York City, New York·Hybrid

1mo ago

Senior Applied AI Engineer – Agent Runtime (Alwin by DataSnipper)

DataSnipper·Amsterdam, North Holland·Onsite

2mo ago

Senior Software Engineer (AI Inference & Runtime Platform)

AZX·Seattle, Washington·Remote

2mo ago

Software Engineer, AI accelerator Runtime

Openai·San Francisco, California·Hybrid

2mo ago

Staff Software Engineer, Qualcomm AI Runtime

Qualcomm·Markham, Ontario

10mo ago

Senior Software Engineer - AI Agent Runtime

Cresta·Canada·Remote

1y+ ago

Staff Software Engineer, AI Agent Platform & Runtime

Datasite·New York City, New York +1·Hybrid

3w ago

Senior AI Engineer, Agentic Systems & Runtime Architecture

Godirect·New York, US·Hybrid

6mo ago

Software Engineer - Voice AI (Inference Runtime)

Baseten·New York City, New York +1·Hybrid

7mo ago

[Agentic AI] AI Runtime / ML Model Systems Engineer

HP·Austin, Texas +1·Onsite

1mo ago

[Agentic AI] AI Runtime / ML Model Systems Engineer

Hp·Austin, Texas·Onsite

1mo ago

[Agentic AI] AI Runtime / ML Model Systems Engineer

Hp·Austin, Texas·Onsite

1mo ago

AI/ML Compiler & Runtime Software Engineer

Global Foundries·India

3mo ago

[Agentic AI] AI Systems & Edge Runtime Software Engineering

HP·Taipei, Taiwan

1mo ago

[Agentic AI] AI Systems & Edge Runtime Software Engineering

Hp·TPC01 - NanKang Software Park III, Taipei

1mo ago

[Agentic AI] AI Systems & Edge Runtime Software Engineering

Hp·TPC01 - NanKang Software Park III, Taipei

1mo ago