Setup K8S Cluster For Gpu Usage

Prerequisites:

• CPU, GPU, RAM, Storage, and Instances Quota : enough for the desired Kubernetes Cluster. If you plan to use auto-scale, you must have enough GPU quota for the maximum amount of nodes that you desire.
• 01 Network Subnet : Network for the Kubernetes Nodes, with a static IP Pool.

Steps to setup the cluster:

Step 1 : Login to the FPT Cloud Portal. From the sidebar menu, choose Kubernetes > click Create Step 2 : Enter the specification for the desired Kubernetes Cluster. Besides the normal information for the cluster, select GPU specs in the Worker Group:

• Choose Instance type : GPU
• Choose GPU type : A30, A100, etc…
• Choose GPU Sharing configuration : None, Single, Mixed, etc…
• Choose Specs type : CPU – RAM – GPU

Step 3 : Click Create and verify the initialization information. Step 4 : Wait until the cluster succeeds initialize (status: Running) > Ready to use.