NAME
etlp - Perl script to initiate an ETLp job run
USAGE
etlp <config file> <section>
PARAMETERS
config file
The name of the configuration file... The file name must end in .conf, although you are not required to use this suffix when passing the parameter.
section
This is the section with the configuration file that contains the job definition
DIRECTORY STRUCTURE
This script assumes the following directory structure:
/<app_root>
|
+---/bin
| |
| +----etlp (symbolic link to deployed etlp)
|
+---/conf
| |
| +----env.cfg
| |
| +----<source>.cfg
| |
| +----/control
| |
| +----<file>.ctl
|
+---/locks
|
+---/log
+------------+------------------------------------------------+
| Directory | Purpose |
+------------+------------------------------------------------+
| <app_root> | The name of the top-ldev directory |
| bin | Directory for scripts |
| conf | pipeline configuration files |
| control | control files. Define data file formats |
| locks | Prevents other files instances of the job |
| | from running |
| log | Records output of the Pipeline processes |
+------------+------------------------------------------------+
+---------------+----------------------------------------------+
| File | Purpose |
+---------------+----------------------------------------------+
| etlp | This script |
| env.conf | Defines the environment. Make sure this is |
| | only readable by the OS account: |
| | chmod 600 env.cfg |
| <source>.conf | Configuration of the pipeline processing |
| <file>.ctl | Defines the data file fileds and validation |
| | rules |
+---------------+----------------------------------------------+EXAMPLE
etlp sales eastern_regionThis is the same as
etlp sales.conf eastern_regionLICENSE AND COPYRIGHT
Copyright 2010 Redbone Systems Ltd
This program is free software; you can redistribute it and/or modify it under the terms of either: the GNU General Public License as published by the Free Software Foundation; or the Artistic License.
The terms are in the LICENSE file that accompanies this application