Set up your W&B account and project
You need these items to access W&B Inference:-
A W&B account
Sign up at W&B -
A W&B API key
To create an API key, select the Personal API key or Service Account API key tab for details.
For secure storage options, see Store API keys securely.
- Personal API key
- Service account API key
To create a personal API key owned by your user ID:- Navigate to User Settings and log in if necessary.
- Click Create new API key.
- Provide a descriptive name for your API key.
- Click Create.
- Copy the displayed API key immediately and store it securely.
-
A W&B project
Create a project in your W&B account to track usage
Set up your environment (Python)
To use the Inference API with Python, you also need to:- Complete the general requirements above
-
Install the required libraries:
NoteThe
weave library is optional but recommended. It lets you trace your LLM applications. Learn more in the Weave Quickstart.See usage examples for code samples using W&B Inference with Weave.Next steps
After completing the prerequisites:- Check the API reference to learn about available endpoints
- Try the usage examples to see the service in action
- Use the UI guide to access models through the web interface