First, sign up for free
clearml python package:
pip install clearml
Connect ClearML SDK to the Server
Execute the following command to run the ClearML setup wizard:
If the setup wizard's response indicates that a configuration file already exists, follow the instructions in here. The wizard does not edit or overwrite existing configuration files.
The setup wizard prompts for ClearML credentials.
Please create new clearml credentials through the settings page in your `clearml-server` web app,
or create a free account at https://app.clear.ml/settings/webapp-configuration
In the settings > workspace page, press "Create new credentials", then press "Copy to clipboard".
Paste copied configuration here:
Get ClearML credentials. Open the ClearML Web UI in a browser. On the SETTINGS > WORKSPACE page, click Create new credentials.
The LOCAL PYTHON tab shows the data required by the setup wizard (a copy to clipboard action is available on hover)
At the command prompt
Paste copied configuration here:, copy and paste the ClearML credentials. The setup wizard confirms the credentials.
Detected credentials key="********************" secret="*******"
Enter the ClearML Server web server URL, or press Enter to accept the default which is detected from the credentials.
WEB Host configured to: [https://app.<your-domain>]
Enter the ClearML Server API server URL, or press Enter to accept the default value which is based on the previous response:
API Host configured to: [https://api.<your-domain>]
Enter the ClearML Server file server URL, or press Enter to accept the default value which is based on the previous response:
File Store Host configured to: [files.<your-domain>]
The wizard responds with a configuration and directs to the ClearML Server.
CLEARML Hosts configuration:
Web App: https://app.<your-domain>
File Store: https://files.<your-domain>
Verifying credentials ...
New configuration stored in /home/<username>/clearml.conf
CLEARML setup completed successfully.
Now you can integrate ClearML into your code! Continue here.
To use ClearML with Jupyter Notebook, you need to configure ClearML Server access credentials for your notebook.
- Get ClearML credentials. Open the ClearML Web UI in a browser. On the SETTINGS > WORKSPACE page, click Create new credentials. The JUPYTER NOTEBOOK tab shows the commands required to configure your notebook (a copy to clipboard action is available on hover)
- Add these commands to your notebook
Now you can use ClearML in your notebook!
In ClearML, experiments are organized as Tasks.
ClearML will automatically log your experiment and code, including outputs and parameters from popular ML frameworks, once you integrate the ClearML SDK with your code. To control what ClearML automatically logs, see this FAQ.
At the beginning of your code, import the
from clearml import Task
To ensure full automatic logging, it is recommended to import the
clearml package at the top of your entry script.
Then initialize the Task object in your
main() function, or the beginning of the script.
task = Task.init(project_name='great project', task_name='best experiment')
If the project does not already exist, a new one will be created automatically.
The console should return the following output:
ClearML Task: created new task id=1ca59ef1f86d44bd81cb517d529d9e5a
ClearML results page: https://app.clear.ml/projects/4043a1657f374e9298649c6ba72ad233/experiments/1ca59ef1f86d44bd81cb517d529d9e5a/output/log
That’s it! You are done integrating ClearML with your code :)
Now, command-line arguments, console output as well as Tensorboard and Matplotlib will automatically be logged in the UI under the created Task.
Sit back, relax, and watch your models converge :) or continue to see what else can be done with ClearML here.
Or watch the YouTube Getting Started Playlist on our YouTube Channel!