Apache Spark Integration
This section contains updates to the Apache Spark integration for Vertica Analytic Database version 8.1.0.
Support for Spark 2.0 and Scala 2.11
The Vertica Connector for Apache Spark now supports Spark 2.0 and Scala 2.11. The connector's JAR file is compatible with a specific version of Spark and Scala. OpenText supplies multiple JAR files for download, each of which is compatible with a specific combination of Spark and Scala versions. See Getting the Spark Connector in Integrating with Apache Spark for more information.
SaveMode.Append Behavior Change
Previously, the connector returned an error when moving data from Spark to Vertica if you specified SaveMode.Append and the target table did not already exist in Vertica. In version 8.1.0, Vertica creates the table if it does not exist and loads data into it.