Loading File Using Loaders
When the interface contains a flat file as a source, you may want to use a strategy that leverages the most efficient loading utility available for the staging area technology, rather than the standard LKM File to SQL that uses the ODI built-in driver for files. Most RDBMSs have fast loading utilities to load flat files into tables, such as Oracle's SQL*Loader, Microsoft SQL Server bcp, Teradata FastLoad or MultiLoad.Such LKM will load the source file into the staging area, and all transformations will take place in the staging area afterwards.
A typical LKM using a loading utility will include the following sequence of steps:
-
Drop and create the loading table in the staging area
-
Generate the script required by the loading utility to load the file to the loading table.
-
Execute the appropriate operating system command to start the load and check its return code.
-
Possibly analyze any log files produced by the utility for error handling.
-
Drop the loading table once the integration phase has completed.
No comments:
Post a Comment