Config Module

This module contains configuration-related functionality.

config

Configuration module for the pipeline.

This module provides configuration classes for controlling pipeline behavior.

CLASS	DESCRIPTION
Configuration	Configuration parameters for pipeline execution.

Configuration dataclass

Configuration(
    thread_count: int = 0, max_step_inputs: int = 50
)

Configuration for the pipeline.

This class encapsulates configuration parameters that control how the pipeline executes, including parallelization and input limitations.

PARAMETER	DESCRIPTION
thread_count	Number of threads to use for parallel processing. If 0, the number of threads is set to the number of available CPUs. TYPE: int DEFAULT: 0
max_step_inputs	Maximum number of inputs to a step. This is used to avoid accidental combinatorial explosions due to the Cartesian product of inputs used when a step has multiple predecessors which are themselves repeated or foreach steps. TYPE: int DEFAULT: 50

Examples:

>>> from nextpipe import Configuration
>>> config = Configuration(thread_count=4, max_step_inputs=100)
>>> config.thread_count
4

max_step_inputs class-attribute instance-attribute

max_step_inputs: int = 50

Maximum number of inputs to a step. This is used to avoid accidental combinatorial explosions due to the Cartesian product of inputs used when a step has multiple predecessors which are themselves repeated or foreach steps.

thread_count class-attribute instance-attribute

thread_count: int = 0

Number of threads to use for parallel processing. If 0, the number of threads is set to the number of available CPUs.