OMSCS Seminar: Introduction to LLM Inference Serving Systems

  • Overview
  • Course Content
  • Requirements & Materials
Overview

OMSCS Seminar: Introduction to LLM Inference Serving Systems

Course Description

The Introduction to LLM Inference Serving Systems course eviews significant topics in large language model (LLM) inference research. The course goes through the typical projects and the most recent works to introduce the current research status of LLM inference systems. By studying them, participants will understand research directions, challenges, and representative works in the LLM inference serving. They also learn the system research methodology.

Course Content
  • Introduction
  • LLM Inference and Systems
  • Typical Systems
  • Research Challenges
Requirements & Materials

Materials

PROVIDED (Student will receive):

  • All content is available in Canvas.

Who Should Attend

This seminar is designed for OMSCS students and alumni who are also researchers and developers interested in learning the systems for LLM inference serving. It is also beneficial for general system learners looking to acquire the system research methodology.

Computer science students coding on computers

What You Will Learn

  • An introduction to LLM inference systems
  • Basic concepts and goals in the research area of LLM inference serving
  • Research directions and challenges of LLM inference systems
  • Representative and most recent works of LLM inference systems
  • Methodology of doing LLM inference system research
Female professional in computer science lab looking at tablet

TRAIN AT YOUR LOCATION

We enable employers to provide specialized, on-location training on their own timetables. Our world-renowned experts can create unique content that meets your employees' specific needs. We also have the ability to deliver courses via web conferencing or on-demand online videos. For 15 or more students, it is more cost-effective for us to come to you.

  • Save Money
  • Flexible Schedule
  • Group Training
  • Customize Content
  • On-Site Training
  • Earn a Certificate
Learn More

Want to learn more about this course?