Introduction to Using Informatica PowerCenter with Vertica
Informatica's PowerCenter family of products lets you collect, transform, and store data. The products support a wide variety of data sources, including databases, message queues, and many different file formats.
The PowerCenter Client consists of four main applications:
- Use Designer to create sources, targets, and mappings.
- Use Workflow Manager to create workflows for those sources, targets and mapping you created in Designer.
- Use Workflow Monitor to monitor running workflows.
- Use Repository Manager to manage repository resources, such as moving folders and objects and managing permissions and users.
The PowerCenter Server enables you to access, read, and write to Vertica.
PowerCenter 9.6.1 HotFix 2 includes the PowerExchange (PWX) Connector for Vertica. Informatica developed this PWX Connector as an alternative to the Vertica plug-in. The PWX connection includes additional capabilities and performance improvements when connected to Vertica.
History of Integration Between Vertica and Informatica
Prior to the PowerExchange (PWX) Connector for Vertica, OpenText developed and supported two connectors for Informatica and Vertica:
- In 2009, OpenText developed the Vertica Plug-in for Informatica. This connector used the native method of loading data from Informatica into Vertica.
-
In 2013, OpenText replaced the earlier Vertica Plug-in for Informatica with a Java plug-in that supports all operating system platforms. This plug-in runs on generic JDBC and ODBC connections and includes new and improved features compared to the native plug-in.
This document describes how to use the Vertica Java plug-in for connecting from Informatica to Vertica.
In 2014, Informatica released the PWX Connector for Vertica. This connector includes enhancements to the partitioning and pushdown capabilities of Informatica.
The following timeline shows the history of plug-ins for connecting from Informatica to Vertica:
OpenText recommends that you use the new PWX Connector for Vertica with Informatica PowerCenter 9.6.1 HotFix 2 or later to connect to your Vertica database.
For detailed information about using the PWX Connector for Vertica, see Vertica Integration with Informatica: Connection Guide.
How the Plug-in Is Configured with Vertica and Informatica PowerCenter
The following illustration provides an overview of the configuration.
This manual provides information for installing plug-in components, using the plug-in to access Vertica as source or target database, and implementing and modifying plug-in features.
Overview
The following table provides recommended steps.
Step | Action | Notes |
---|---|---|
1 |
Follow the procedures in Installing the Vertica Plug-in for PowerCenter to download and install plug-in components.
|
You must install both client and server components. |
2 |
Review the sample for using the plug-in with PowerCenter in Using the Vertica Plug-in with Informatica PowerCenter. |
The sample shows how to import Vertica as source and target. I also provides steps that show you how to specify and connect to your Vertica database and include it in your workflows. |
3 |
Set plug-in features according to your specific needs. Features are listed and described in Accessing and Setting Plug-in Features. |
Be aware of situations where the use of one feature depends on another. For example, to take advantage of the increased performance of EnableStreamingBatchInsert, you must set Copy Local Method to None. |
4 | Check Best Practices for required memory settings and other tips. | Memory requirements are highly dependent upon Informatica and Vertica dedicated resources. |