First, thank you all for your input!
Deep re-index and file filter for external drive solved the speed issue (as of know, crossing fingers).
But the knowledge issue still persists (random sorting of results, not most used or recent).
My settings should be standard, I'll append a screenshot.