As an ML Runtime Optimization Engineer, you will focus on improving the performance of machine learning models in production-grade embedded systems. Your work will directly impact how efficiently models run on real-world hardware across industries like autonomous vehicles, robotics, and defense technologies.
Key Responsibilities
- Optimize ML inference performance across diverse embedded platforms used in both on-road and off-road autonomous systems
- Design and implement strategies to reduce compute and memory usage while maintaining model accuracy
- Apply model pruning, quantization, and other compression techniques for deployment on resource-limited devices
- Collaborate with ML and software teams to refine model architectures for better runtime efficiency
- Develop and apply profiling methods to detect and resolve performance bottlenecks during system integration
Qualifications
Required:
- Bachelor’s degree in Electrical Engineering, Computer Science, or a related technical field such as Mathematics, Physics, or Computer Science
- Minimum of 3 years working with ML accelerators, GPUs, CPUs, or SoC architectures
- Proven experience in embedded software development with a focus on performance optimization
- Hands-on experience profiling and tuning deep learning models on embedded hardware
- Familiarity with deep learning frameworks including PyTorch, JAX, or ONNX
Preferred:
- Advanced degree (M.Sc or PhD) in a machine learning or related technical field
- Experience building custom ML optimization frameworks
- Track record of deploying ML models on embedded chips for real-time robotics or autonomous systems
Technical Environment
You'll work with tools and technologies including PyTorch, JAX, ONNX, TensorRT, CUDA, XLA, and Triton to deliver efficient, scalable inference solutions.
Work Environment
This is an onsite role with primary locations in Sunnyvale, San Diego, Washington D.C., Ann Arbor, Ft. Walton Beach, London, Stuttgart, Munich, Stockholm, Bangalore, Seoul, and Tokyo. Employees are expected to work from the office five days a week, with limited flexibility for remote work to support personal needs such as early meetings from home or adjusted schedules for family responsibilities.
Benefits & Compensation
Compensation includes a base salary ranging from $159,053 to $199,295 USD annually, equity in the form of stock options or restricted stock units, and additional stipends for learning and wellness. Benefits include comprehensive health, dental, vision, life, and disability insurance, as well as a 401k plan with employer matching.
Company Values
We believe in empowering employees to manage their time responsibly and support inclusive hiring practices. You're encouraged to apply even if you don’t meet every qualification. As an equal opportunity employer, we comply with federal regulations that prohibit discrimination based on race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability. We practice affirmative action to ensure equitable employment and advancement opportunities for all individuals.
