Knowledge Intensive Nlp

Generate Rather Than Retrieve: Large Language Models Are Strong Context Generators

Yu et al. (2022) show that prompting an LLM to generate its own background context before answering a question (GenRead) outperforms retrieval-based approaches on several knowledge-intensive NLP benchmarks. The result challenges the assumption that retrieval is necessary for grounding LLM outputs.