Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems

arXiv:2608.195492026-08-21

要测试访谈式对话系统需要大量不同性格的虚拟用户,这项研究用大语言模型自动生成这些虚拟用户人设

询问旅行计划或甜点喜好等信息的访谈类对话系统,用真人测试成本很高。这篇论文只需几个人工写的示例人设,就能让大语言模型自动批量生成风格各异的虚拟用户人设,再用这些人设驱动模拟用户进行对话测试。实验显示,这样生成的模拟对话比只用固定人设时更加多样化。

论文原文摘要（英文）

This paper addresses the issue of the significant labor required to test interview dialogue systems. While interview dialogue systems are expected to be useful in various scenarios, like other dialogue systems, testing them with human users requires significant effort and cost. Therefore, testing with user simulators can be beneficial. Since most conventional user simulators have been primarily designed for training task-oriented dialogue systems, little attention has been paid to the personas of the simulated users. During development, testing interview dialogue systems requires simulating a wide range of user behaviors, but manually creating a large number of personas is labor-intensive. We propose a method that automatically generates personas for user simulators using a large language model. Furthermore, by assigning personality traits related to communication styles when generating personas, we aim to increase the diversity of communication styles in the user simulator. Experimental results show that the proposed method enables the user simulator to generate utterances with greater variation.

作者 · Mikio Nakano, Kazunori Komatani, Hironori Takeuchi

图片来源： Mikio Nakano et al., arXiv:2608.19549, arxiv-nonexclusive