diff --git a/source/cloud/gcp/vertex-ai.md b/source/cloud/gcp/vertex-ai.md index 32ca7c6b..74ce2ac1 100644 --- a/source/cloud/gcp/vertex-ai.md +++ b/source/cloud/gcp/vertex-ai.md @@ -6,14 +6,13 @@ review_priority: "p0" RAPIDS can be deployed on [Vertex AI Workbench](https://cloud.google.com/vertex-ai-workbench). -## Create a new user-managed Notebook +## Create a new Notebook Instance 1. From the Google Cloud UI, navigate to [**Vertex AI**](https://console.cloud.google.com/vertex-ai/workbench/user-managed) -> Notebook -> **Workbench** -2. Make sure you select **User-Managed Notebooks** (**Managed Notebooks** are currently not supported) and select **+ CREATE NEW**. +2. Select **Instances** and select **+ CREATE NEW**. 3. In the **Details** section give the instance a name. -4. Under the **Environment** section choose "Python 3 with CUDA 11.8". -5. Check the "Attach 1 NVIDIA T4 GPU" option. -6. After customizing any other aspects of the machine you wish, click **CREATE**. +4. Check the "Attach 1 NVIDIA T4 GPU" option. +5. After customizing any other aspects of the machine you wish, click **CREATE**. ```{tip} If you want to select a different GPU or select other hardware options you can select "Advanced Options" at the bottom and then make changes in the "Machine type" section. @@ -23,11 +22,37 @@ If you want to select a different GPU or select other hardware options you can s Once the instance has started select **OPEN JUPYTER LAB** and at the top of a notebook install the RAPIDS libraries you wish to use. +```{warning} +Installing RAPIDS via `pip` in the default environment is [not currently possible](https://github.com/rapidsai/deployment/issues/517), for now you must create a new `conda` environment. + +Vertex AI currently ships with CUDA Toolkit 11 system packages as of the [Jan 2025 Vertex AI release](https://cloud.google.com/vertex-ai/docs/release-notes#January_31_2025). +The default Python environment also contains the `cupy-cuda12x` package. This means it's not possible to install RAPIDS package like `cudf` via `pip` as `cudf-cu12` will conflict with the CUDA Toolkit version but `cudf-cu11` will conflict with the `cupy` version. + +You can find out your current system CUDA Toolkit version by running `ls -ld /usr/local/cuda*`. +``` + +You can create a new RAPIDS conda environment and register it with `ipykernel` for use in Jupyter Lab. Open a new terminal in Jupyter and run the following commands. + ```bash -pip install \ - --extra-index-url={{rapids_pip_index}} \ - "cudf-cu12>={{rapids_pip_version}}" "cuml-cu12>={{rapids_pip_version}}" \ - "dask-cuda>={{rapids_pip_version}}" +# Create a new environment +conda create -y -n rapids \ + {{ rapids_conda_channels }} \ + {{ rapids_conda_packages }} \ + ipykernel + +# Activate the environment +conda activate rapids + +# Register the environment with Jupyter +python -m ipykernel install --prefix "${DL_ANACONDA_HOME}/envs/rapids" --name rapids --display-name rapids +``` + +Then refresh the Jupyter Lab page and open the launcher. You will see a new "rapids" kernel available. + +![Screenshot of the Jupyter Lab launcher showing the RAPIDS kernel](../../images/vertex-ai-launcher.png) + +```{tip} +If you don't see the new kernel wait a minute and refresh the page again, it can take a little while to show up. ``` ## Test RAPIDS diff --git a/source/images/vertex-ai-launcher.png b/source/images/vertex-ai-launcher.png new file mode 100644 index 00000000..692352e1 Binary files /dev/null and b/source/images/vertex-ai-launcher.png differ