SC21 Tutorial: Unified Cyber Infrastructure with Kubernetes
Presented by Igor Sfiligoi and Dmitry Mishin
Kubernetes is the leading container orchestration solution, as it can work anywhere from commercial clouds to on-prem clusters and IoT devices. Federating such installations into a larger mesh of clusters makes those clusters a global supercomputer which can span multiple administrative and geographical regions.
One of Kubernetes advantages is its ability to effectively and securely utilize hardware resources for user jobs and system services, co-scheduling those as necessary on the same hardware. Service applications run with high privileges, with functionality and performance typical for bare metal deployments, while user applications are given only basic privileges.
In this tutorial, attendees will learn how to run their favorite software and run alongside other scientists on a nationwide Kubernetes cluster that is already serving hundreds of scientific groups through NFS-funded projects. The program includes a Kubernetes architectural overview and hands-on sessions operating on the PRP production Kubernetes clusters, including a federated ARM64 cluster.
https://sc21.supercomputing.org/presentation/?id=tut106&sess=sess183
Entire Session Tutorial Videos Playlist
(individual module instructions / PowerPoint Decks and Youtube links below)
- 1 – Kubernetes Intro – Slides
- 1 – Kubernetes Intro – Youtube
- 2 – Kubernetes Architecture – Instructions
- 2 – Kubernetes Architecture – Slides
- 2 – Kubernetes Architecture – Youtube
- 3 – Kubernetes Scheduling – Instructions
- 3 – Kubernetes Scheduling – Slides
- 3 – Kubernetes Scheduling – Youtube
- 4 – Persistent Storage – Instructions
- 4 – Persistent Storage – Slides
- 4 – Persistent Storage – Youtube
- 5 – Building you own applications – Slides
- 5a – Building you own applications – Youtube
- 5b – Building you own applications – Youtube
- 6 – Monitoring – Instructions
- 6 – Monitoring – Slides
- 6 – Monitoring – Youtube
- 7 – Federation – Instructions
- 7 – Federation – Slides
- 7 – Federation – Youtube