> ## Documentation Index
> Fetch the complete documentation index at: https://docs.wandb.ai/llms.txt
> Use this file to discover all available pages before exploring further.

> Fine-tune Azure OpenAI models with W&B experiment tracking to log metrics, hyperparameters, and training progress.

# Azure OpenAI Fine-Tuning

## Introduction

Fine-tuning GPT-3.5 or GPT-4 models on Microsoft Azure using W\&B tracks, analyzes, and improves model performance by automatically capturing metrics and facilitating systematic evaluation through W\&B's experiment tracking and evaluation tools.

<Frame>
  <img src="https://mintcdn.com/wb-21fd5541/mVjDwbx0mC8gYx-b/images/integrations/aoai_ft_plot.png?fit=max&auto=format&n=mVjDwbx0mC8gYx-b&q=85&s=6b59fe1e990eccf0409f0b8274ce510d" alt="Azure OpenAI fine-tuning metrics" width="1418" height="1198" data-path="images/integrations/aoai_ft_plot.png" />
</Frame>

## Prerequisites

* Set up Azure OpenAI service according to [official Azure documentation](https://wandb.me/aoai-wb-int).
* Configure a W\&B account with an API key.

## Workflow overview

### 1. Fine-tuning setup

* Prepare training data according to Azure OpenAI requirements.
* Configure the fine-tuning job in Azure OpenAI.
* W\&B automatically tracks the fine-tuning process, logging metrics and hyperparameters.

### 2. Experiment tracking

During fine-tuning, W\&B captures:

* Training and validation metrics
* Model hyperparameters
* Resource utilization
* Training artifacts

### 3. Model evaluation

After fine-tuning, use [W\&B Weave](https://weave-docs.wandb.ai) to:

* Evaluate model outputs against reference datasets
* Compare performance across different fine-tuning runs
* Analyze model behavior on specific test cases
* Make data-driven decisions for model selection

## Real-world example

* Explore the [medical note generation demo](https://wandb.me/aoai-ft-colab) to see how this integration facilitates:
  * Systematic tracking of fine-tuning experiments
  * Model evaluation using domain-specific metrics
* Go through an [interactive demo of fine-tuning a notebook](https://colab.research.google.com/github/wandb/examples/blob/master/colabs/azure/azure_gpt_medical_notes.ipynb)

## Additional resources

* [Azure OpenAI W\&B Integration Guide](https://wandb.me/aoai-wb-int)
* [Azure OpenAI Fine-tuning Documentation](https://learn.microsoft.com/azure/ai-services/openai/how-to/fine-tuning?tabs=turbo%2Cpython\&pivots=programming-language-python)