Version 1.14

Bug Fixes

Fix AWS S3 configuration secure property not forwarded in StorageHelper ClearML GitHub PR #1205
Fix NVIDIA_VISIBLE_DEVICES=all env var value will result in no GPU metrics being reported
Fix setting output_uri when an AWS S3 config section with secure=false exists raises an error
Fix CacheManager attempts to clear cache when file limit has not been reached resulting in slow unnecessary checks

New Features and Improvements

Bug Fixes

Fix clicking on UI Metric Snapshot datapoint does not navigate to experiment ClearML Server GitHub issue #228
Fix some APIs not sanitizing query parameters
Fix downloading UI experiment console log sometimes returns an older file
Fix UI experiment plot comparison displays duplicates of image plots
Fix missing experiment labels in UI experiment plot comparison
Fix starting time not updating for some tasks

New Features and Bug Fixes

Add hash check for pickle files (resolves CVE-2024-24590)
Fix clearml-task relative paths calculation when --cwd, --folder, and --script are provided ClearML GitHub issue #1160
Fix regression causing an error when secure is provided in AWS S3 bucket settings

New Features and Improvements

Report upload/download with tqdm if installed
Add support for a PipelineController.version property
Add support for specifying an AWS profile when providing bucket storage credentials
Add an ignore_remote_overrides argument to Task.connect() and Task.connect_configuration() allowing users to disable overriding values when running remotely
Add support for setting a custom certificate path using the CLEARML_API_HOST_VERIFY_CERT environment variable (instead of just allowing the user to disable verification)
Add dataset reporting example ClearML GitHub PR #1180

Bug Fixes

Fix missing component callbacks on multiple step calls ClearML GitHub PR #1195
Fix unsafe usage of tempfile.mktemp
Fix potential path traversal on file download (CVE-2024-24591)
Fix Python 3.12 support by not using distutils
Fix TaskScheduler does not save local state before running remotely
Fix pipeline should continue instead of aborting when PipelineController.abort_on_failure is set to False and a step has been aborted
Fix HPO crashes when its corresponding task is initialized with continue_last_task=True

Bug Fixes

New Features and Improvements

Add support for decorated pipeline steps ClearML GitHub issue #1154
Improve torch.distributed behavior and auto-detect Huggingface accelerate distributed execution
Improve jsonargparse integration: allow_config_file_override_from_ui argument added for enabling/disabling overriding configuration file entries
Add raise_on_error parameter to Model.update_weights() and Model.update_weights_package()
Add HPO multi-objective optimization support by specifying multiple optimization objectives to the HyperParameterOptimizer class
Improve pipelines from functions: libraries used by pipeline steps no longer have to be imported in the step itself and can be imported globally instead
Support clearing repository details in Task.set_repo()
Auto-detect tensorflow-intel as tensorflow
Add support for auto-detecting torch and transformers accelerate distributed execution
Add tabular data multi-stage pipeline process example

Bug Fixes

Fix langchain integration ClearML GitHub issues #1124 and ClearML GitHub issue #1126
Fix using target_project with TaskScheduler.add_task() corrupts project if used with pipelines ClearML GitHub issue #1137
Fix PipelineController.add_function_step() fails when adding custom decorated step ClearML GitHub issue #1154
Fix jsonargparse binding does not capture parameters before Task.init() is called ClearML GitHub issue #1164
Fix invalid jsonargparse arguments should be deleted
Fix handling of appended parameters to Hydra defaults list
Fix Task.set_repo() and Task.set_packages() do not wait for automatic asynchronous repository detection
Fix active GPU filtering in resource monitor to support GPU ID and not just GPU idx
Fix misleading error raised when using the SDK with no configuration file or an invalid configuration file
Fix process sometimes hangs issue by improving exit and exception handlers, unregistering signal handling in child processes except for the BackgroundMonitor

New Features and Improvements

New UI experiment table comparative view: compare plots and scalars of all selected experiments
Add UI experiment display of original python requirements along with actual packages used ClearML GitHub issue #793
Add UI project metric snapshot support for multiple metrics
Add compressed UI experiment table info panel mode displaying only experiment name and status
Add "x unified" hover mode to UI plots
Add experiment hyperparameter UI section dataset IDs link to datasets page
Make all URLs clickable in UI experiment artifacts
Redesign WebApp tabs: tabs now appear in UI header
Add option to force setting original task as clone's parent when cloning a task

Bug Fixes

Fix CVE-2023-45133 Web App vulnerability
Fix "select all" in UI dataset archive displays count of all archived and unarchived experiments
Fix hyperparameter keys with dots in their names displayed incorrectly in UI experiment table and task info
Fix UI experiment scalar comparison raising error
Fix "Project" column redundantly appears inside a specific project's model table
Fix UI models with many labels slowing down web app
Fix simple UI plots (scatter, bar, etc.) in experiment comparisons not merging by experiment
Fix UI pipeline details panel does not display information
Fix UI plot "Show/hide" legend button sometimes disappears
Fix can't select root project in UI report creation modal when workspace has no projects
Fix "load more" button displayed unnecessarily in UI object tables
Fix archive action in UI dataset table archives unselected datasets