【第71期】英伟达的audio大模型Fugatto

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。

今天的主题是：

Fugatto 1：Foundational Generative Audio Transformer Opus 1

Summary

The document describes Fugatto, a novel generalist audio synthesis and transformation model capable of following diverse text instructions, optionally incorporating audio inputs. It addresses challenges in audio generation by introducing a specialized dataset creation strategy and ComposableART, an inference-time technique for composing instructions. ComposableART extends classifier-free guidance to enable flexible manipulation of generated audio, including composition, interpolation, and negation of instructions. Extensive experiments demonstrate Fugatto's competitive performance across various audio tasks, showcasing emergent capabilities and the effectiveness of ComposableART. The authors plan to release their dataset and code for reproducibility.

原文链接：https://d1qx31qr3h6wln.cloudfront.net/publications/FUGATTO.pdf