API How-Tos

the api lets you manage cloud gpu vms programmatically using conventional http requests you can use the api to create, delete, and retrieve information about your cloud gpu vms furthermore, you need templates to provision cloud gpu vms, but templates are not compatible with servers that support full flex configuration cloud gpu vm workflow to get started with cloud gpu, follow these steps verify service readiness cloud gpu vm activates automatically so you can begin provisioning immediately we recommend contacting the support https //docs ionos com/cloud/support/general information/contact information to verify that your contract is ready and to ensure your resource limits meet your project requirements discovery and selection cloud gpu vms are available in preconfigured sizes select a template that fits best to your needs and matches your contract's resource limits, which will be adjusted as part of the access enablement process it is not possible to change the size of a cloud gpu vm instance once it has been provisioned resource limits by default, you can deploy only 1 cloud gpu vm using the h200–s template to deploy templates sized m , l , or xl , or to run multiple s instances, you must first request a resource limit increase through the support https //docs ionos com/cloud/support/general information/contact information list all cloud gpu vm templates https //docs ionos com/cloud/compute services/compute engine/cloud gpu vm/api how tos/retrieve template list review cloud gpu vm template specifications to select the appropriate template for your needs use the template uuid to make an api request call for creating a new cloud gpu vm create a cloud gpu vm initiate a cloud gpu vm creation request https //docs ionos com/cloud/compute services/compute engine/cloud gpu vm/api how tos/create cloud gpu vm through api with the following the selected gpu template uuid linux based operating system note the product supports only linux based operating systems during the launch network settings ssh keys https //docs ionos com/cloud/security/ssh key manager , cloud ini https //docs ionos com/cloud/compute services/compute engine/how tos/boot cloud init t script, or other authentication methods result the vm with the attached gpu is provisioned access and setup connect to vm using one of the following options through the ssh docid\ rg4c3yas6dnz5xcqmjbpl through the remote console docid 6bahuicbakuqtyj96mx9k install nvidia drivers for more information, refer to the nvidia documentation https //www nvidia com/en us/drivers/ run the following command in your terminal or command prompt to verify if the cloud gpu vm is accessible nvidia smi result a successful output should display the driver version, the gpu model(s), the gpu temperature, and the current memory usage if the command is not found or returns an error, your drivers may be missing or the gpu is not properly installed install required framework dependencies use a package manager like pip or conda to install your chosen framework, ensuring you select the gpu enabled version install the version that matches your cuda toolkit for example, cuda 12 1 pip install torch torchvision torchaudio index url https //download pytorch org/whl/cu121 install the standard package it automatically detects and uses cuda if installed correctly pip install tensorflow use the server for your use case usage run gpu workloads, such as model training (finetuning), inference, or graphics rendering monitor gpu utilization and performance metrics management start, restart, or delete the cloud gpu vm as needed monitor costs and usage for more information, see cost alert https //docs ionos com/cloud/set up ionos cloud/management/usage/cost alert and cost & usage https //docs ionos com/cloud/set up ionos cloud/management/usage/cost and usage cleanup back up your results and data before your delete your vm for more information, see install acronis backup agent on linux https //docs ionos com/cloud/backup and storage/backup service/how tos/install acronis backup agent delete a cloud gpu vm docid\ ubpcnvnq8rdtm2b6lx hz from the vdc quick links retrieve template list docid\ ixid8hqmd6ak otblnz2h learn how to retrieve a list of available templates retrieve a template docid\ nup7civlkzppp8zowbzjw learn how to retrieve details of a specific template create a cloud gpu vm docid\ gdhuegt2gnsldnt2 4bkh learn how to create a cloud gpu vm delete a cloud gpu vm docid\ enfnhrqqxk3km39zakpkk learn how to delete a cloud gpu vm retrieve list of gpus in a vm docid 7qrfnvqgid paugsyq1i learn how to retrieve a list of gpus in a vm retrieve a specific gpu in a vm docid\ spryamvxry jjpvd21rvs learn how to retrieve a specific gpus in a vm