论文标题
提示:自然语言提示的集成开发环境和存储库
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
论文作者
论文摘要
提示Source是一种用于创建,共享和使用自然语言提示的系统。提示是将示例从数据集绘制到自然语言输入和目标输出的示例的功能。使用提示来训练和查询语言模型是NLP中的一个新兴领域,它需要新工具,使用户可以协作开发和完善这些提示。提示源以(1)用于定义数据链接提示的模板语言来解决新环境中的紧急挑战,(2)通过在许多示例上观察其提示的输出,以及(3)为一个社区驱动的指导方针,以促进新的提示,从而使用户可以快速迭代及时开发。提示中已经有超过2,000个提示,大约有170个数据集。提示可从https://github.com/bigscience-workshop/promptsource获得。
PromptSource is a system for creating, sharing, and using natural language prompts. Prompts are functions that map an example from a dataset to a natural language input and target output. Using prompts to train and query language models is an emerging area in NLP that requires new tools that let users develop and refine these prompts collaboratively. PromptSource addresses the emergent challenges in this new setting with (1) a templating language for defining data-linked prompts, (2) an interface that lets users quickly iterate on prompt development by observing outputs of their prompts on many examples, and (3) a community-driven set of guidelines for contributing new prompts to a common pool. Over 2,000 prompts for roughly 170 datasets are already available in PromptSource. PromptSource is available at https://github.com/bigscience-workshop/promptsource.