大语言模型自动提示优化技术系统性综述

A Systematic Survey of Automatic Prompt Optimization Techniques

摘要 Abstract

自大规模语言模型(LLMs)问世以来,提示工程已成为获取各种自然语言处理(NLP)任务所需响应的关键步骤。然而,由于模型、任务及其最佳实践的快速发展,提示工程对终端用户来说仍是一大障碍。为缓解这一问题,近期出现了自动提示优化(APO)技术,这些技术利用各种自动化方法帮助提高LLMs在各类任务上的性能。本文综述了该领域目前的进展和面临的挑战,给出了APO的正式定义和一个包含五个部分的统一框架,并基于其显著特征严格分类了相关工作。我们希望我们的框架能够引导进一步的研究。

Since the advent of large language models (LLMs), prompt engineering has been a crucial step for eliciting desired responses for various Natural Language Processing (NLP) tasks. However, prompt engineering remains an impediment for end users due to rapid advances in models, tasks, and associated best practices. To mitigate this, Automatic Prompt Optimization (APO) techniques have recently emerged that use various automated techniques to help improve the performance of LLMs on various tasks. In this paper, we present a comprehensive survey summarizing the current progress and remaining challenges in this field. We provide a formal definition of APO, a 5-part unifying framework, and then proceed to rigorously categorize all relevant works based on their salient features therein. We hope to spur further research guided by our framework.

大语言模型自动提示优化技术系统性综述 - arXiv