Our client had a requirement to extract files on a scheduled basis from an ftp site and load them into their custom SQL database.
We built a Talend Open Studio job to manage this process and iterate upon each file to determine which sub-process to use for the loading the data.
This job contains the following features:
- Ftp connection and extract
- Deleting source file from FTP once extracted
- Determination of file extension
- Iteration on 2 different TRunJob components for each file depending upon file extension