Startup scripts allow you to configure and setup your instance, meaning automatically running scripts or installing software as soon as the instance has booted for the first time.
We offer both, predefined installer scripts like the NVIDIA® GPU driver in the dashboard or the possibility to run any custom user-defined startup script via the API.
Let's first take one step back. When you create a new instance it contains all the software that comes with the image that you selected. For example, in the case of Ubuntu 20.04 all the software that comes with a vanilla Ubuntu 20.04 installation.
For a lot of applications, especially GPU applications you will need additional software to be installed in order to successfully run those applications.
For example, to install and run TensorFlow on a NVIDIA® GPU, you will also need a NVIDIA® GPU driver, NVIDIA® CUDA and of course installing TensorFlow itself. In order to set up the most common types of software like the GPU driver, we will provide predefined startup scripts to make it easier to be up and running.
With startup scripts, you can inject a script that is automatically executed after the instance becomes active. Under the hood, it uses a mechanism called cloud-init that is also used to deploy your public SSH key on the instance.
Please Note: The startup script is executed after the instance is booted and active, meaning if you log in to your instance the execution might still happen in the background.Please, don't snapshot, shutdown or restart your instance while a startup script is running.
You can check the logs of your startup scripts via
tail -f /var/log/cloud-init-output.logAlso, you can check the status of your startup script with
cloud-init status
Installing a NVIDIA® GPU driver
Please Note: Installing the driver will take about 4-5 minutes after the instance is active. This means in the first 4-5 minutes you will not be able to use the GPU. Please also don't snapshot or restart the instance during this time. This will fail the driver installation.
First you should wait until the installation is done:
cloud-init status --wait
You can verify the NVIDIA driver installation using the NVIDIA System Management Interface utility by running:
nvidia-smiOnce the installation is done you should see a nvidia-smi response like this one.
Via the Compute Dashboard
Currently, we support NVIDIA® GPU driver version 470, 525 & 535. You can install any NVIDIA® GPU driver version of your choice on the instance, just select the version you would like to install, on the Instance creation flow.
Via the public Compute API
To install the NVIDIA® GPU driver version 535 on your instance via the public Compute API you can pass the following shell script as startup_script in your create instance request metadata parameter. To install the driver version 535, we use the following script, which we then convert to a JSON string with
cat your-startup-script.sh | jq -Rs
and then pass the JSON string to the metadata.startup_script parameter.
If the you use httpie or a similar program that supports httpie nested JSON syntax you can simplify this even further:
metadata[startup_script]="$(cat your-startup-script.sh)"
Startup script in clean bash
#!/bin/bash
set -eo pipefail
NVIDIA_MAJOR_VERSION=535
export DEBIAN_FRONTEND=noninteractive
# remove nouveau module if present
if lsmod | grep -q nouveau; then
rmmod -v nouveau
fi
apt-get update
apt-get install --no-install-recommends -y nvidia-driver-$NVIDIA_MAJOR_VERSION-server
nvidia-smi # loads the driver modules
sed -i 's/--no-persistence-mode/--persistence-mode/g' /lib/systemd/system/nvidia-persistenced.service
systemctl daemon-reload
systemctl restart nvidia-persistenced.serviceStartup script as JSON string passed to the public API as metadata parameter
"metadata": {"startup_script": "#!/bin/bash\nset -eo pipefail\n\nNVIDIA_MAJOR_VERSION=535\nexport DEBIAN_FRONTEND=noninteractive\n\n# remove nouveau module if present\nif lsmod | grep -q nouveau; then\n rmmod -v nouveau\nfi\n\napt-get update\napt-get install --no-install-recommends -y nvidia-driver-$NVIDIA_MAJOR_VERSION-server\n\nnvidia-smi # loads the driver modules\n\nsed -i 's/--no-persistence-mode/--persistence-mode/g' /lib/systemd/system/nvidia-persistenced.service\nsystemctl daemon-reload\n\nsystemctl restart nvidia-persistenced.service\n"}