Skip to main content

Launch your jobs

Launch jobs directly from within W&B locally on your machine or to the compute provider of your choice. Reproduce runs or sweeps directly from the W&B User Interface to launch new experiments and compare results.

Recreate a run​

Add your W&B Job to a queue to execute a W&B Run. All jobs pushed to a queue automatically posses the same compute resource type and parameter resource arguments. You can alter the hyperparameters to use when you add a job to a queue.

Interactively recreate a W&B Run with the W&B App or programmatically with the CLI.

The following procedure demonstrates how to add a job to a queue interactively with the W&B App.
info

In this example we demonstrate how add a job to a “Starter queue”. This starter queue is designed to be used for local testing and demonstrative purposes only.

For more information on how to create queues that utilize other cloud compute resources such as Kubernetes, see the Set up a cloud compute resource in the Prerequisites page.

  1. Navigate to your project page on the W&B App.
  2. Select the Jobs tab.

  1. The Jobs Page displays a list of W&B Jobs that were created from previously executed W&B Runs. Find information about the jobs such as the:
  • Job ID: Unique Job ID name. For more information about job naming conventions, see Job naming conventions.
  • Versions: The number of job versions.
  • Runs: The number of W&B Runs created by the associated job.
  • Creation date: The creation date of the job.
  • Last run: The timestamp of the last run created by the job.

  1. Select the Launch button next to the job name. A UI modal will appear.
  2. Within the modal select the:
  • Job version you want to add to your queue from the Job version dropdown. In this example we only have one version, so we select v0.
  • Select the Paste from… button to automatically propagate hyperparameters used from a specific W&B Run. In the following image, we have two runs to choose from.

6. From the Queue dropdown, select Starter queue.
7. Select the Launch now button.

info

The described example use a queue called Starter queue. This is a queue that W&B created for demonstrative purposes only. In addition to adding the job to this queue, W&B will also create this queue for you. The Starter queue uses a Docker image to run the job locally on your machine.

Note that W&B expects that you create a queue before you can add jobs to it. For more information on how to create a queue, see the Prerequisites page.

Create a sweep​

Create W&B Sweeps with Launch. You can create a sweep interactively with the W&B App or programmatically with the W&B CLI.

info

Before you create a sweep with W&B Launch, ensure that you create a job first. Inspect that the run you want to create a job from has a code artifact. See the Create a Job page for more information.

Create a sweep interactively with the W&B App.
  1. Navigate to you W&B project on the W&B App.
  2. Select the sweeps icon on the left panel (broom image).
  3. Next, select the Create Sweep button.
  4. Toggle the Use Launch 🚀 (In Beta) slider.
  5. From the Job dropdown menu, select the name of your job and the job version you want to create a sweep from.
  6. Select the queue to add the job to from the Queue dropdown menu.
  7. Select Initialize Sweep.

View details of launched jobs​

View details of launched jobs with the W&B App. You can view job artifacts that were created and find out runs, version and job specific details.

View job artifacts​

Each W&B Job you create is saved as a W&B Artifact. Select the Artifacts icon within your project’s workspace on the W&B App to view a list of job artifacts created in that project.

Expand the JOB menu on the left panel to view a list of job artifacts. For example, in the following image we have two job artifacts called:

  • job-https___github.com_githubrepo_demo_launch.git_canonical_job_example.py
  • job-source-launch_demo-canonical_job_example.py

View details of each job​

Navigate to your W&B Project to view fine-grained details of each job such as runs created by a job, the full name of your jobs, and version metadata associated with a project.

  1. Navigate to your W&B project.
  2. Select the Jobs icon on the left sidebar.
  3. A Jobs page will appear. In it, you can view all of the jobs created in that project.

For example, in the following image we have two job listed:

  • job-https___github.com_githubrepo_demo_launch.git_canonical_job_example.py
  • job-source-launch_demo-canonical_job_example.py

Select a job from list to learn more about that job. A new page with a list of runs created by the job, along with job and version details will appear. This information is contained in three tabs: Runs, Job details, and Version details.

Select the name of your job from the list. This will redirect you to a new page with details about each run created by the job such as the:

The Runs tab provides information about each run created by the job such as the:

  • Run: The name of the run.
  • State: The state of the run.
  • Job version: The version of the job used.
  • Creator: Who created the run.
  • Creation date: The timestamp of when the run was started.
  • Other: The remaining columns will contain the key-value pairs of the configuration dictionary passed to wandb.init().

For example, in our demo script, we passed the learning rate (learning_rate) and number of epochs (epochs) when we initialized a run with wandb.init().

Was this page helpful?👍👎