Loading Avro Data

You can load Avro data files into flex tables and columnar tables using the parser, favroparser. Before loading, verify that Avro files are encoded in the Avro binary serialization encoding format, described in the Apache Avro standard. The parser also supports Snappy compression. You cannot load Avro data directly from STDIN.

The parser favroparser does not support Avro files with separate schema files. The Avro file must have its related schema in the file you are loading.

You can use the following data types and optional parameters for favroparser.

The favroparser supports two data types:

Rejecting Data on Materialized Column Type Errors

The favroparser has a Boolean parameter, reject_on_materialized_type_error. If you set this parameter to true, Vertica rejects rows when the input data presents both of the following conditions:

  • Includes keys matching an existing materialized column
  • Has a value that cannot be coerced into the materialized column's data type

Suppose the flex table has a materialized column, Temperature, declared as a FLOAT. If you try to load a row with a Temperature key that has a VARCHAR value, favroparser  rejects the data row.

See Also