Wouldn't this just decrease the signal to noise ratio? Yes, you are finding more results... But this also means that the real answers get obfuscated by probably irrelevant stuff. It's like moving the ranking part to the LLM: the more context it has, the more noise you can feed, the more signal you can extract.

I think this approach is good for knowledge exploration, not for direct and specific questions.