音频大语言模型（AudioLLMs）在对话、音频理解以及自动语音识别（ASR）等任务上的性能已显著提升并受到广泛关注。然而，在金融场景中评估AudioLLMs仍缺乏相应的基准数据集，而如财报电话会议和CEO演讲等音频数据对金融分析和投资决策至关重要。本文介绍了首个面向金融领域的基准测试数据集——\textsc{FinAudio}。我们首先基于金融领域的独特特性定义了三项任务：1）短音频的ASR；2）长音频的ASR；3）长音频的总结。随后，我们整理了两个短音频数据集和两个长音频数据集，并开发了一个新颖的金融音频总结数据集，构成了\textsc{FinAudio}基准。接着，我们在\textsc{FinAudio}上评估了七种主流的AudioLLMs。我们的评估揭示了现有AudioLLMs在金融领域中的局限性，并为改进这些模型提供了洞见。所有数据集和代码都将公开发布。

Audio Large Language Models (AudioLLMs) have received widespread attention and have significantly improved performance on audio tasks such as conversation, audio understanding, and automatic speech recognition (ASR). Despite these advancements, there is an absence of a benchmark for assessing AudioLLMs in financial scenarios, where audio data, such as earnings conference calls and CEO speeches, are crucial resources for financial analysis and investment decisions. In this paper, we introduce \textsc{FinAudio}, the first benchmark designed to evaluate the capacity of AudioLLMs in the financial domain. We first define three tasks based on the unique characteristics of the financial domain: 1) ASR for short financial audio, 2) ASR for long financial audio, and 3) summarization of long financial audio. Then, we curate two short and two long audio datasets, respectively, and develop a novel dataset for financial audio summarization, comprising the \textsc{FinAudio} benchmark. Then, we evaluate seven prevalent AudioLLMs on \textsc{FinAudio}. Our evaluation reveals the limitations of existing AudioLLMs in the financial domain and offers insights for improving AudioLLMs. All datasets and codes will be released.