Preferential indexing

[kyteinsky]

Describe the feature you'd like to request

The files crawled from all the mounts are stored in a queue in the PHP side. They are downloaded and processed in first-in-first-out FIFO manner so the first ones added to the queue get indexed first. Not e that this does not refer to the oldest files in creation/modified times.

Thanks @miaulalala

Describe the solution you'd like

It might make sense to optimise this to

1. provide priority to the recently created/modified files
2. provide priority to the easy to ingest files like markdown and text files as opposed to pdf files which are heavy on text extraction

Describe alternatives you've considered

/