Senior Inference SW Engineer

What you’d do

Builds and evolves the model runtime for HPE's private cloud AI inference platform, covering engine integration, batching, KV cache management, and distributed execution, plus the Kubernetes orchestration layer. Full time, based in Spring, TX, with other US sites or remote considered. Found on the employer's careers page on Oct 21, 2026. Apply through the link.

You’ll need

• Experience with LLM inference engines such as vLLM, SGLang, TensorRT-LLM, TGI, or NVIDIA NIM
• Ability to modify inference engine internals
• Understanding of continuous batching and paged attention
• KV cache reuse and prefix caching knowledge
• Kubernetes orchestration experience