Creating a Dedicated AI Cluster in Generative AI for Fine-tuning Custom Models
Fine-tuning dedicated AI cluster are compute resources that you use for fine-tuning custom models. Here are the steps to create a dedicated AI cluster of type, fine-tuning.
- In the navigation bar of the Console, select a region with Generative AI, for example, US Midwest (Chicago). If you don't know which region to select, see Regions with Generative AI.
- Open the navigation menu and click Analytics & AI. Under AI Services, click Generative AI.
- In the left navigation, choose a compartment that you have permission to work in.
- Click Dedicated AI clusters.
- Click Create dedicated AI cluster.
- Select a compartment to create the dedicated AI cluster in. The default compartment is the one you selected in step 3, but you can select any compartment that you have permission to work in.
- (Optional)
Enter a name and description. If you leave the name blank, the system generates a name that you can change later.
The generated name has the format
generativeaidedicatedaicluster<timestamp>.For example:
generativeaidedicatedaicluster20240118204106 - For Cluster type, click Fine-tuning.
-
For Base model, choose the base model for the custom model that you want to fine-tune on this cluster:
- cohere.command - Provisions two Large Cohere units.
- cohere.command-light - Provisions two Small Cohere units.
Important
When you create a dedicated AI cluster for fine-tuning, two units are created for the base model that you choose. Hosting a model requires at least one unit and fine-tuning requires two units, because fine-tuning a model requires more GPUs than hosting a model. The number of units for fine-tuning is hard-coded to two and you can't change it. You can use the same fine-tuning cluster to fine-tune several models. - Read the commitment unit hours for the fine-tuning dedicated AI cluster and click to agree with the commitment.
- (Optional) Click Show advanced options and assign tags to this dedicated AI cluster.
-
Click Create.
Note
Fine-tuning dedicated AI clusters for take some time to create. After a cluster is in an active state, you can use it to fine-tune custom models. To use a dedicated AI cluster for fine-tuning, select that cluster when creating a custom model.