San Francisco Hybrid Employment

Baseten is hiring an Engineering Manager, Runtime Fabric

Responsibilities

  • Build and grow a team of skilled systems engineers with strong backgrounds in containers and Linux internals.
  • Promote a culture emphasizing technical excellence, open-source engagement, and ongoing optimization.
  • Deliver consistent coaching, performance feedback, and career growth guidance to team members.
  • Collaborate with engineering leaders to shape the strategic direction and roadmap for container and storage systems.
  • Lead efforts to enhance containerd, runc, and related OCI components to support GPU-intensive AI inference workloads, focusing on fast startup, device access, and secure multi-tenancy.
  • Oversee the design and development of the Baseten Delivery Network, a caching system that accelerates cold starts and prevents overload during traffic spikes.
  • Guide the evolution of the delivery network to support additional artifacts such as container images, training checkpoints, and deployment assets.
  • Provide technical leadership on secure, GPU-enabled isolation for shared inference environments, including hardened runtimes and future micro-VM integration.
  • Ensure accountability for the full container startup lifecycle, from filesystem initialization to first inference response.
  • Support and promote contributions to the open-source containerd project in coordination with core maintainers.
  • Serve as the main internal advocate for Runtime Fabric, enabling integration with dependent teams across the platform.
  • Work with product and engineering partners to align technical priorities with business goals and system reliability.
  • Clearly communicate team progress, architectural choices, and engineering trade-offs to executive leadership.

Benefits

  • Competitive salary and equity package
  • Full medical, dental, and vision coverage for employee and dependents
  • Flexible paid time off policy with a company-wide winter closure from Christmas Eve through New Year's Day
  • Paid leave for new parents
  • Financial support for fertility and family planning via Carrot
  • Company-sponsored 401(k) plan
  • Opportunities to engage with diverse ML startups, enhancing professional growth and industry connections

Compensation

Competitive salary and equity package

Other

  • The company upholds equal employment opportunity, prohibiting discrimination based on race, color, religion, gender, sexual orientation, gender identity, national origin, age, genetic information, disability, or veteran status.
  • Applicants with criminal histories are considered in compliance with applicable laws, including the San Francisco Fair Chance Ordinance where relevant.
About company
Baseten
Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. We’re trusted by leading AI-driven innovators to deliver industry-leading performance, security, and reliability for their mission-critical workloads.
All jobs at Baseten Visit website
Job Details
Department Runtime Fabric
Category management
Posted 2 months ago