EKS on AWS re:Invent 2023
Here’s a collection of my learnings from AWS re:Invent 2023 Las Vegas — an incredible event for innovators and technologists from all over the world, in a reality bending place which is Las Vegas.
By 2028, more than 95% of global organisations will be running containerised applications in production, which is a significant increase from fewer than 50% in 2023.
My focus was AWS EKS — AWS Elastic Kubernetes Service. I attended a variety of sessions and workshops focused on the latest advancements, emerging tools and solutions for containerised workloads based on Kubernetes:
- Generative AI
- Karpenter
- Security
- Multi-tenancy
I hope it will become helpful to you!
Generative AI on EKS
Workshop from re:Invent 2023 available for free (thx AWS).
GenAI companies like OpenAI use Kubernetes to train their foundational models like GPT-3, GPT-4, and DALL·E by distributing model training across thousands of powerful GPU-enabled VMs. With frameworks like horovod, and k8s operators like MPI, you can perform distributed deep learning on EKS at scale. You will need to…