stream_scheduler

This table contains metadata related to a single scheduler.

This table was renamed from kafka_config.kafka_scheduler.

Column Data Type Description
version VARCHAR The version of the scheduler.
frame_duration INTERVAL The length of time of the frame. The default is 00:00:10.
resource_pool VARCHAR The resource pool associated with this scheduler.
config_refresh INTERVAL

The interval of time that the scheduler runs before applying any changes to its metadata, such as, changes made using the --update option.

For more information, refer to --config-refresh inScheduler Utility Options.

new_source_policy VARCHAR

When during the frame that the source runs. Set this value with the --new-source-policy in Source Utility Options.

Valid Values:

  • FAIR: Takes the average length of time from the previous batches and schedules itself appropriately.
  • START: Runs all new sources at the beginning of the frame. In this case, Vertica gives the minimal amount of time to run.
  • END: Runs all new sources starting at the end of the frame. In this case, Vertica gives the maximum amount of time to run.

Default Value:

FAIR

eof_timeout_ms INT

The maximum amout of time the scheduler waits for data from the source before ending the batch.

Default Value:
1000

pushback_policy VARCHAR

How Vertica handles delays for microbatches that continually fail.

Valid Values:

  • FLAT
  • LINEAR
  • EXPONENTIAL

Default Value:

LINEAR

pushback_max_count INT The maximum number of times a microbatch can fail before Vertica terminates it.
auto_sync BOOLEAN

When TRUE, the scheduler automatically synchronizes source information with host clusters. For more information, refer to Data Streaming Job Scheduler.

Default Value:

TRUE

Examples

This example shows a typical row in the stream_scheduler table.

SELECT * FROM stream_config.stream_scheduler;
-[ RECORD 1 ]------+-------------------
version            | v8.0.0
frame_duration     | 00:00:10
resource_pool      | kafka_default_pool
config_refresh     | 00:05
new_source_policy  | FAIR
eof_timeout_ms     | 10000
pushback_policy    | LINEAR
pushback_max_count | 5
auto_sync          | t