User-Defined Filter

User-Defined Filter functions allow you to manipulate data obtained from a source in various ways.

For example, a filter could:

  • Process a compressed file in a compression format not natively supported by Vertica.
  • Take UTF-16-encoded data and transcode it to UTF-8 encoding.
  • Perform search-and-replace operations on data before it is loaded into Vertica.

You can also process data through multiple filters before it is loaded into Vertica. For instance, you could unzip a file compressed with GZip, convert the content from UTF-16 to UTF-8, and finally search and replace certain text strings.

If you implement a UDFilter, you must also implement a corresponding FilterFactory.

See UDFilter Class and FilterFactory Class for API details.