Unlock the power of large language models (LLMs) on your local machine using Docker Model Runner. In this course, join Docker Captain and DevOps Institute Ambassador Pawel Piwosz as he shows you how to set up and configure Docker Model Runner to run LLMs locally—making them accessible from both containers and the host system. Explore how to pull and manage prebuilt models from Docker Hub, as well as package and distribute your own models. Along the way, learn how to integrate local LLMs into your applications using the familiar OpenAI API interface. Whether you’re building prototypes, safeguarding privacy, or reducing inference costs, this course covers the tools you need to know to run powerful models without relying on the cloud.
Learn More