Workflows

info

This page covers clearml-data, ClearML's file-based data management solution. See Hyper-Datasets for ClearML's advanced queryable dataset management solution.

Take a look at the ClearML Data examples which demonstrate common workflows using the clearml-data CLI and the Dataset class:

• Dataset Management with CLI - Tutorial for creating, modifying, and consuming dataset with CLI.
• Folder Sync with CLI - Tutorial for using clearml-data sync CLI option to update a dataset according to a local folder.
• Dataset Management with CLI and SDK - Tutorial for creating a dataset with the CLI then programmatically ingesting the data with the SDK.
• Data Management with Python - Example scripts for creating and consuming a dataset with the SDK.