The role of the loader is to take files from a folder and load them into the dashboard.
Configuration
It runs under a service named “BusinessGPTFileLoader” and has the following configurations:
FolderPath - can be local folder or UCN
ApiKey - See here
UploadApiUrl - BusinessGPT upload service API URL- See here
PerformanceFileCount - Help: After how many files to write into the log, the performance of the total number of files and process time. Default 50.
DBPath - local path to SQLite DB file
RunningIntervalMinutes - the service scans the folder every interval for new files that were added to the folder
ReprocessAllFiles - default False. Set to True to reprocess all the files in the folder and upload them again.
Specification
The service includes an SQL Light DB as part of the installation.
The service writes the status of handling Failed/ Finished, ContentID, and time into the DB for files (Table name: FileLoaderStatus.
When the service starts, it writes the total number of files to load into the log.
The processing order will be by date modified of files starting with new files.
It runs in a recursive to expand all sub-folders.
If the service restarts, it will check again how many files need to be uploaded.
The service writes into a log the progress statistics every 50 files (PerformanceFileCount):
Total files loaded
Processing time of last 50 files.
The service updates the ContentSourceName in the content info table to be “FileLoader” and the ContentSourceIP to the host's IP from which the service is running.
Syncing performance to the dashboard
Every time (based on PrefromanceFileCount ), the service will write into the log the performance, and it will sync the data into the preference table. https://agatsoftware.atlassian.net/wiki/spaces/SKYP/pages/3184656385/BusinessGPT-+BG+Tables+SRS#TABLE---BG_PERFORMANCE
ParameterName:
Time to Load X files
Total Files loaded
createdBy: File Loader (IP of the host machine)