Stanford Root

Schedule

Stanford Root

Schedule

CS 349D

AI Inference Infrastructure

UNITS:3
GRADING:Letter or Credit/No Credit
LEVEL:Graduate
GER:—

The emergence of foundation models has revolutionized AI applications, but the most powerful AI systems today are increasingly compound systems - compositions of multiple models, retrievers, tools, and traditional software components. This research seminar explores the intersection of cloud computing infrastructure and compound AI systems, covering both the infrastructure required to build and deploy these systems at scale and the architectural patterns that make them effective. Students will participate in guest lectures from leading experts across academia and industry, including leaders of companies like Databricks, OpenAI, Foundry, NVIDIA, Microsoft, and more, read and discuss papers, and complete a quarter-long project in groups of 2-3.

Syllabus for selected term:
View Spring 2027 Syllabus

Sections

1 Term
Seminar 1Open
ID: 6420
0 / 36 enrolled
DAYS:Monday, Wednesday
TIME:1:30 PM – 2:50 PM
LOCATION:TBD
INSTRUCTOR:
Xie, Zhiqiang, Gandhi, Swapnil, Kozyrakis, Christos
3units

CS 349D: AI Inference Infrastructure

3 units · Letter or Credit/No Credit

The emergence of foundation models has revolutionized AI applications, but the most powerful AI systems today are increasingly compound systems - compositions of multiple models, retrievers, tools, and traditional software components. This research seminar explores the intersection of cloud computing infrastructure and compound AI systems, covering both the infrastructure required to build and deploy these systems at scale and the architectural patterns that make them effective. Students will participate in guest lectures from leading experts across academia and industry, including leaders of companies like Databricks, OpenAI, Foundry, NVIDIA, Microsoft, and more, read and discuss papers, and complete a quarter-long project in groups of 2-3.

Offered in Spring 2027 at Stanford University.

Spring 2027 sections

  • Seminar — Monday Wednesday 1:30 PM – 2:50 PM — Xie, Zhiqiang, Gandhi, Swapnil, Kozyrakis, Christos (Graduate)

More CS courses

  • CS 347: Human-Computer Interaction: Foundations and Frontiers
  • CS 348B: Computer Graphics: Image Synthesis Techniques
  • CS 348C: Computer Graphics: Animation and Simulation
  • CS 348E: Character Animation: Modeling, Simulation, and Control of Human Motion
  • CS 348K: Visual Computing Systems
  • CS 348N: Neural Models for 3D Geometry
  • CS 349E: Efficient ML Infrastructure at Scale
  • CS 349F: Fabric Architectures For AI Systems
  • CS 349H: Software Techniques for Emerging Hardware Platforms (EE 349)
  • CS 349M: Machine Learning for Software Engineering
  • CS 350S: Privacy-Preserving Systems
  • CS 353: Seminar on Logic & Formal Philosophy (PHIL 391)

All CS courses · All departments