Skip to content

Commit

Permalink
Vertex AI update (#518)
Browse files Browse the repository at this point in the history
  • Loading branch information
jacobtomlinson authored Feb 11, 2025
1 parent 20478bf commit e3c471f
Show file tree
Hide file tree
Showing 2 changed files with 34 additions and 9 deletions.
43 changes: 34 additions & 9 deletions source/cloud/gcp/vertex-ai.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,13 @@ review_priority: "p0"

RAPIDS can be deployed on [Vertex AI Workbench](https://cloud.google.com/vertex-ai-workbench).

## Create a new user-managed Notebook
## Create a new Notebook Instance

1. From the Google Cloud UI, navigate to [**Vertex AI**](https://console.cloud.google.com/vertex-ai/workbench/user-managed) -> Notebook -> **Workbench**
2. Make sure you select **User-Managed Notebooks** (**Managed Notebooks** are currently not supported) and select **+ CREATE NEW**.
2. Select **Instances** and select **+ CREATE NEW**.
3. In the **Details** section give the instance a name.
4. Under the **Environment** section choose "Python 3 with CUDA 11.8".
5. Check the "Attach 1 NVIDIA T4 GPU" option.
6. After customizing any other aspects of the machine you wish, click **CREATE**.
4. Check the "Attach 1 NVIDIA T4 GPU" option.
5. After customizing any other aspects of the machine you wish, click **CREATE**.

```{tip}
If you want to select a different GPU or select other hardware options you can select "Advanced Options" at the bottom and then make changes in the "Machine type" section.
Expand All @@ -23,11 +22,37 @@ If you want to select a different GPU or select other hardware options you can s

Once the instance has started select **OPEN JUPYTER LAB** and at the top of a notebook install the RAPIDS libraries you wish to use.

```{warning}
Installing RAPIDS via `pip` in the default environment is [not currently possible](https://github.com/rapidsai/deployment/issues/517), for now you must create a new `conda` environment.
Vertex AI currently ships with CUDA Toolkit 11 system packages as of the [Jan 2025 Vertex AI release](https://cloud.google.com/vertex-ai/docs/release-notes#January_31_2025).
The default Python environment also contains the `cupy-cuda12x` package. This means it's not possible to install RAPIDS package like `cudf` via `pip` as `cudf-cu12` will conflict with the CUDA Toolkit version but `cudf-cu11` will conflict with the `cupy` version.
You can find out your current system CUDA Toolkit version by running `ls -ld /usr/local/cuda*`.
```

You can create a new RAPIDS conda environment and register it with `ipykernel` for use in Jupyter Lab. Open a new terminal in Jupyter and run the following commands.

```bash
pip install \
--extra-index-url={{rapids_pip_index}} \
"cudf-cu12>={{rapids_pip_version}}" "cuml-cu12>={{rapids_pip_version}}" \
"dask-cuda>={{rapids_pip_version}}"
# Create a new environment
conda create -y -n rapids \
{{ rapids_conda_channels }} \
{{ rapids_conda_packages }} \
ipykernel

# Activate the environment
conda activate rapids

# Register the environment with Jupyter
python -m ipykernel install --prefix "${DL_ANACONDA_HOME}/envs/rapids" --name rapids --display-name rapids
```

Then refresh the Jupyter Lab page and open the launcher. You will see a new "rapids" kernel available.

![Screenshot of the Jupyter Lab launcher showing the RAPIDS kernel](../../images/vertex-ai-launcher.png)

```{tip}
If you don't see the new kernel wait a minute and refresh the page again, it can take a little while to show up.
```

## Test RAPIDS
Expand Down
Binary file added source/images/vertex-ai-launcher.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit e3c471f

Please sign in to comment.