OPT_LOAD_POOL

OPT_LOAD_POOL is a load option that allows assigning a load into a custom load pool in Workflow Orchestration instead of using the default load pool.

See also:

Usage

OPTION

OPT_LOAD_POOL: string

Load pool name in Workflow Orchestration.

Notes

OPT_LOAD_POOL can be used with all loads.

Load pool can also be selected on schedule/DAG level with CONFIG_LOAD_SCHEDULES. OPT_LOAD_POOL overrides a selection done in CONFIG_LOAD_SCHEDULES.

Examples

Assigning a load into a custom load pool

Load A is constantly updating a near real-time entity in DW publish. However, when there are other less frequent workflows starting hourly or daily, load A ends up queuing. This happens because load A is in the same load pool as other loads and pool concurrent slots have been limited to 4.

Another load pool is created and load A is assigned into it:

OPTION

OPT_LOAD_POOL: priority_pool

Load A is now running in a dedicated pool and is no longer affected by other loads in the default pool.

Note: Queuing in the target database
Loads assigned into custom pools may still end up queuing in the target database if there are not enough free nodes to process all concurrent queries.