Projects are contextual containers for tasks and models (as well as dataviews when Hyper-Datasets are enabled), providing a logical structure similar to file system folders. An often useful method is to categorize components into projects according to models or objectives. Grouping into projects helps in identifying tasks, models, and dataviews when queried.
Projects can be divided into subprojects (and sub-subprojects, etc.) just like files and subdirectories on a computer, making organization easier.
Projects contain a textual description field for noting relevant information. The WebApp supports markdown rendering of the description (see overview).
In addition, the project's default output URI can be specified. When new experiments from the project are executed, the model checkpoints (snapshots) and artifacts are stored in the default output location.
Users can create and modify projects, and see project details in the WebApp (see WebApp Home). The project's description can be edited in the overview page. Each project's experiments, models, and dataviews, can be viewed in the project's experiments table, models table, and dataviews table.
When initializing a task, its project needs to be specified. If the project entered does not exist, it will be created.
Projects can contain subprojects, just like folders can contain sub-folders. Input into the
parameter a target project path. The project path should follow the project tree hierarchy, in which the project and
subprojects are slash (
from clearml import Task
Nesting projects works on multiple levels. For example:
Projects can also be created using the
projects.create REST API call.
View All Projects in System
To view all projects in the system, use the
Task.get_projects class method:
project_list = Task.get_projects()
This returns a list of projects sorted by last update time.
For additional ways to work with projects, use the REST API
projects resource. Some of the available actions include:
projects.delete- create and delete projects
projects.get_hyper_parameters- get a list of all hyperparameter sections and names used in a project
projects.merge_projects- merge projects into a single project
See more in the REST API reference.