Documentation
Search…
spaCy
A Weights & Biases integration for the spaCy library: industrial strength NLP, logged with W&B
​spaCy is a popular "industrial-strength" NLP library: fast, accurate models with a minimum of fuss. As of spaCy v3, Weights and Biases can now be used with
spacy train to track your spaCy model's training metrics as well as to save and version your models and datasets. And all it takes is a few added lines in your configuration!Getting Started: Track and Save your Models
1) Install the wandb library and log in
wandb library and log inNotebook
Command Line
1
!pip install wandb
2
​
3
import wandb
4
wandb.login()
Copied!
1
pip install wandb
2
wandb login
Copied!
2) Add the WandbLogger to your spaCy config file
WandbLogger to your spaCy config filespaCy config files are used to specify all aspects of training, not just logging -- GPU allocation, optimizer choice, dataset paths, and more. Minimally, under
[training.logger] you need to provide the key @loggers with the value "spacy.WandbLogger.v3", plus a project_name. You can also turn on dataset and model versioning by just adding a line to the config file.For more on how spaCy training config files work and on other options you can pass in to customize training, check out spaCy's documentation.
config.cfg
1
[training.logger]
2
@loggers = "spacy.WandbLogger.v3"
3
project_name = "my_spacy_project"
4
remove_config_values = ["paths.train", "paths.dev", "corpora.train.path", "corpora.dev.path"]
5
log_dataset_dir = "./corpus"
6
model_log_interval = 1000
Copied!
Name
Description
project_namestr. The name of the Weights & Biases project. The project will be created automatically if it doesn’t exist yet.remove_config_valuesList[str] . A list of values to exclude from the config before it is uploaded to W&B. [] by default.model_log_intervalOptional int. None by default. If set, model versioning with Artifacts will be enabled. Pass in the number of steps to wait between logging model checkpoints. None by default.log_dataset_dirOptional str. If passed a path, the dataset will be uploaded as an Artifact at the beginning of training. None by default.entityOptional str . If passed, the run will be created in the specified entityrun_nameOptional str . If specified, the run will be created with the specified name.3) Start training
Once you have added the
WandbLogger to your spaCy training config you can run spacy train as usual.Notebook
Command Line
1
!python -m spacy train \
2
config.cfg \
3
--output ./output \
4
--paths.train ./train \
5
--paths.dev ./dev
Copied!
1
python -m spacy train \
2
config.cfg \
3
--output ./output \
4
--paths.train ./train \
5
--paths.dev ./dev
Copied!
Last modified 3mo ago