PyTorch
Try our integration out in a colab notebook (with video walkthrough below) or see our example repo for scripts, including one on hyperparameter optimization using Hyperband on Fashion MNIST, plus the W&B Dashboard it generates.
W&B provides first class support for PyTorch. To automatically log gradients and store the network topology, you can call watch and pass in your PyTorch model.
import wandbwandb.init(config=args)# Magicwandb.watch(model, log_freq=100)model.train()for batch_idx, (data, target) in enumerate(train_loader):output = model(data)loss = F.nll_loss(output, target)loss.backward()optimizer.step()if batch_idx % args.log_interval == 0:wandb.log({"loss": loss})
Gradients, metrics and the graph won't be logged until wandb.log is called after a forward and backward pass.
By default the hook only logs gradients.
Arguments | Options |
|
|
| integer (default |
You can pass PyTorch tensors with image data into wandb.Image and torchvision utils will be used to log them automatically.
To log images and view them in the Media panel, you can use the following syntax:
wandb.log({"examples" : [wandb.Image(i) for i in images]})
If you need to track multiple models in the same script, you can call wandb.watch on each model separately.
