pipeline package

Subpackages

pipeline.blocks package

Submodules

pipeline.parser module

pipeline.parser.j_print(data, *args, **kwargs)[source]

Print the given data in JSON format if possible, otherwise print it as is. For development purposes only.

Parameters:

data – The data to be printed.
*args – Additional positional arguments to be passed to the print function.
**kwargs – Additional keyword arguments to be passed to the print function.

pipeline.parser.read_config_file(config_file)[source]

Parse the configuration file

Parameters:: config_file (str) – The path to the configuration file
Returns:: The parsed configuration data
Return type:: dict
Raises:: yaml.YAMLError – If there is an error parsing the configuration file

pipeline.parser.parse_config(config)[source]

Parse and validate the configuration

Parameters:: config (dict) – The configuration dictionary to be parsed and validated
Returns:: A dictionary containing the parsed and validated configuration blocks
Return type:: dict[str, BaseModel]

pipeline.parser.get_experiment_configs(config)[source]

Get training configuration defined in other blocks.

Parameters:: config (dict) – The configuration dictionary.
Returns:: The experiment configuration dictionary.
Return type:: dict

pipeline.pipeline module

Module contents