近年来，大型语言模型（LLMs）的兴起带来了丰富的机遇，同时也伴随着新的挑战，其中污染问题迅速成为关键问题。人工智能（AI）在商业应用和融资方面已达到一定规模，一些问答基准上的百分点提升可能意味着数千万美元的收益，这给模型的完整性带来了巨大压力。与此同时，追踪LLMs所见过的数据变得越来越困难；对于像GPT-4和Claude-3这样闭源的模型，由于不披露任何关于训练集的信息，这几乎是不可能的。因此，污染成为一个主要问题：LLMs的表现可能不再可靠，因为高表现可能部分归因于它们之前对数据的接触。这一局限性危及自然语言处理领域的真实能力提升，然而，目前仍缺乏有效的污染检测方法。本文综述了所有关于LLMs污染检测的最新研究工作，分析其方法论和应用场景，为正确使用污染检测方法提供了指导。我们的工作呼吁自然语言处理研究社区系统地考虑LLMs评估中的污染偏差。

With the rise of Large Language Models (LLMs) in recent years, abundant new opportunities are emerging, but also new challenges, among which contamination is quickly becoming critical. Business applications and fundraising in Artificial Intelligence (AI) have reached a scale at which a few percentage points gained on popular question-answering benchmarks could translate into dozens of millions of dollars, placing high pressure on model integrity. At the same time, it is becoming harder and harder to keep track of the data that LLMs have seen; if not impossible with closed-source models like GPT-4 and Claude-3 not divulging any information on the training set. As a result, contamination becomes a major issue: LLMs' performance may not be reliable anymore, as the high performance may be at least partly due to their previous exposure to the data. This limitation jeopardizes real capability improvement in the field of NLP, yet, there remains a lack of methods on how to efficiently detect contamination. In this paper, we survey all recent work on contamination detection with LLMs, analyzing their methodologies and use cases to shed light on the appropriate usage of contamination detection methods. Our work calls the NLP research community's attention into systematically taking into account contamination bias in LLM evaluation.