Prepare Load Scripts
Note: You can postpone this step if your goal is to test a logical schema design for validity.
Prepare SQL scripts to load data directly into physical storage using the COPY...DIRECT statement using vsql, or through ODBC as described in Connecting to Vertica.
You need scripts that load the:
- Large tables
- Small tables
OpenText recommends that you load large tables using multiple files. To test the load process, use files of 10GB to 50GB in size. This size provides several advantages:
- You can use one of the data files as a sample data file for the Database Designer.
- You can load just enough data to Perform a Partial Data Load before you load the remainder.
- If a single load fails and rolls back, you do not lose an excessive amount of time.
- Once the load process is tested, for multi-terabyte tables, break up the full load in file sizes of 250–500GB.
See Bulk-Loading Data and the following additional topics for details:
- Bulk-Loading Data
- Using Load Scripts
- Using Parallel Load Streams
- Enforcing Constraints
- About Load Errors
Tip: You can use the load scripts included in the example databases in Getting Started as templates.