View Tokenizer Parameters
After creating a custom tokenizer, you can view the tokenizer's parameter settings in either of two ways:
- Use the GET_TOKENIZER_PARAMETER — View individual tokenizer parameter settings.
- Use the READ_CONFIG_FILE — View all tokenizer parameter settings.
View Individual Tokenizer Parameter Settings
If you need to see an individual parameter setting for a tokenizer, you can use GET_TOKENIZER_PARAMETER to see specific tokenizer parameter settings:
=> SELECT v_txtindex.GET_TOKENIZER_PARAMETER('majorseparators' USING PARAMETERS proc_oid='45035996274126984'); getTokenizerParameter ----------------------- {}()&[] (1 row)
For more information, see GET_TOKENIZER_PARAMETER.
View All Tokenizer Parameter Settings
If you need to see all of the parameters for a tokenizer, you can use READ_CONFIG_FILE to see all of the parameter settings for your tokenizer:
=> SELECT v_txtindex.READ_CONFIG_FILE( USING PARAMETERS proc_oid='45035996274126984') OVER();
config_key | config_value
--------------------------+---------------
majorseparators | {}()&[]
maxlength | 140
minlength | 1
minorseparators | -,$
stopwordscaseinsensitive | for,the
type | 1
used | true
(7 rows)
If the parameter, used, is set to False
, then you can only view the parameters that have been applied to the tokenizer.
Note: Vertica automatically supplies the value for Type, unless you are using an ngram tokenizer, which allows you to set it.
For more information, see READ_CONFIG_FILE.