Stanford Root

Schedule

Stanford Root

Schedule

CS 329T

Trustworthy Machine Learning: Building and evaluating agentic systems

UNITS:3
GRADING:Letter or Credit/No Credit
LEVEL:Graduate
GER:—

This project-based course will introduce students to building and evaluating agentic AI applications powered by foundation models. The overriding theme of the course is that building an initial prototype AI system can often be completed easily but refining a prototype into something that is useful and reliable requires iterative improvement based on clear evaluation metrics. We will cover background in foundation models, prompting, and retrieval-augmented generation (RAG) before introducing full agentic AI architectures. For each architecture, the course will study methods for evaluation. Students will complete introductory homework assignments to become familiar with retrieval-augmented generation (RAG) and agentic AI. Students will then work in pairs or small teams to develop applications using agentic or other approaches and evaluate them by adapting evaluation methods presented in the class.Prerequisites: CS 229 or similar introductory Python-based ML class; knowledge of deep learning such as CS 230, CS 231N; familiarity with ML frameworks in Python (scikit-learn, Keras) assumed.

Syllabus for selected term:
View Spring 2027 Syllabus

Sections

1 Term
Lecture 1Open
ID: 26103
0 / 999 enrolled
DAYS:TBD
TIME:TBD
LOCATION:TBD
3units

CS 329T: Trustworthy Machine Learning: Building and evaluating agentic systems

3 units · Letter or Credit/No Credit

This project-based course will introduce students to building and evaluating agentic AI applications powered by foundation models. The overriding theme of the course is that building an initial prototype AI system can often be completed easily but refining a prototype into something that is useful and reliable requires iterative improvement based on clear evaluation metrics. We will cover background in foundation models, prompting, and retrieval-augmented generation (RAG) before introducing full agentic AI architectures. For each architecture, the course will study methods for evaluation. Students will complete introductory homework assignments to become familiar with retrieval-augmented generation (RAG) and agentic AI. Students will then work in pairs or small teams to develop applications using agentic or other approaches and evaluate them by adapting evaluation methods presented in the class.Prerequisites: CS229 or similar introductory Python-based ML class; knowledge of deep learning such as CS230, CS231N; familiarity with ML frameworks in Python (scikit-learn, Keras) assumed.

Offered in Spring 2027 at Stanford University.

Spring 2027 sections

  • Lecture — TBA TBA (Graduate)

More CS courses

  • CS 329A: Self Improving AI Agents
  • CS 329D: Machine Learning Under Distributional Shifts
  • CS 329H: Machine Learning from Human Preferences
  • CS 329M: Machine Programming
  • CS 329R: Race and Natural Language Processing (CSRE 329R, LINGUIST 281A, PSYCH 257A)
  • CS 329S: Machine Learning Systems Design
  • CS 329X: Human Centered NLP (CS 129X)
  • CS 329Z: Engineering AI Agents
  • CS 331X: AI for Algorithmic Reasoning and Optimization (MS&E 331)
  • CS 333: Algorithms for Interactive Robotics
  • CS 334: Robots and Arts: Creative Applications and Projects (TAPS 334R)
  • CS 336: Language Modeling from Scratch

All CS courses · All departments