长文档学习稀疏检索适配可复现性的研究

On the Reproducibility of Learned Sparse Retrieval Adaptations for Long Documents

摘要 Abstract

文档检索是信息检索中最具挑战性的任务之一,它需要处理更长的上下文,这通常会导致更高的查询延迟和增加的计算开销。最近,学习型稀疏检索(LSR)作为一种有前景的方法应运而生,旨在解决这些挑战。一些研究者提出通过聚合分段文档并采用不同的后处理方法(如n-gram和邻近分数)、调整表征方式以及学习信号集成等方式,将LSR方法应用于长文档。本研究旨在复现和探讨将LSR方法适配于长文档的机制。我们的复现实验验证了特定片段的重要性,其中首段始终在文档检索性能中占据主导地位。此外,我们重新评估了近期提出的ExactSDM和SoftSDM方法在不同文档长度下的表现,从短文档(最多两段)到较长文档(三段及以上)。我们还设计了多项分析,以探查复现的方法,并揭示全局信息对LSR适配长上下文的影响。本项目的完整代码和实现可在以下地址获取:https://github.com/lionisakis/Reproducibilitiy-lsr-long。

Document retrieval is one of the most challenging tasks in Information Retrieval. It requires handling longer contexts, often resulting in higher query latency and increased computational overhead. Recently, Learned Sparse Retrieval (LSR) has emerged as a promising approach to address these challenges. Some have proposed adapting the LSR approach to longer documents by aggregating segmented document using different post-hoc methods, including n-grams and proximity scores, adjusting representations, and learning to ensemble all signals. In this study, we aim to reproduce and examine the mechanisms of adapting LSR for long documents. Our reproducibility experiments confirmed the importance of specific segments, with the first segment consistently dominating document retrieval performance. Furthermore, We re-evaluate recently proposed methods -- ExactSDM and SoftSDM -- across varying document lengths, from short (up to 2 segments) to longer (3+ segments). We also designed multiple analyses to probe the reproduced methods and shed light on the impact of global information on adapting LSR to longer contexts. The complete code and implementation for this project is available at: https://github.com/lionisakis/Reproducibilitiy-lsr-long.

长文档学习稀疏检索适配可复现性的研究 - arXiv