Software Engineer-AI/ML, Inference Team - AWS Neuron

What you’d do

Build core serving features for open-source inference frameworks like vLLM and SGLang on AWS Neuron, including continuous batching, paged attention, quantization, and distributed inference. Also improve model enablement, testing, benchmarking, and release workflows. Full-time. Found on the employer's careers page on Oct 6, 2026. Apply through the link.

You’ll need

• 3+ years non-internship professional software development experience
• 3+ years design or architecture experience for new and existing systems
• Experience with inference frameworks such as vLLM or SGLang
• Knowledge of continuous batching, paged attention, quantization, or distributed inference