Some files in a collection fail
When you load files, the system loads each file using a specific loader to extract the text and then creates slits of the text into chunks. The chunks are at size of 500 tokens which is around one page of text.
We refer to this process as the ingesting of documents.
If some files in a collection fail ingesting, you will receive a message indicating this at the top right corner of the dashboard.
We also mark the status with an exclamation
make like this:
Typical reasons can be password-protected or corrupted files.
To view the files with an issue, select the line and click on the “Show content”
Then, the search for status failed in the advanced search (Version 2.9.0 )
You can click on the retry icon near the failed status if you fixed the issue of the file