Audio Diffusion: AI Sample Generation + Free Text-to-Audio AI Model
AI Audio Diffusion: Music Sample Generation w/ Text-to-Audio Diffusion models are popular right now. The most noteworthy of these is the recently released Stable Diffusion model, but it appears that this is only the beginning. Indeed, recent work by the Harmonai team has seen diffusion models cross domains, from image generation to audio generation. In this study, we’ll look at some of the technical underpinnings of diffusion models, first focusing on their history, then on their architecture, and finally on audio creation with the Harmonai colab. Let’s just get started, shall we? Table of Contents AI Audio Diffusion: Music Sample Generation w/ Text-to-Audio A Brief History of Diffusion Models General Diffusion Model Architecture Audio Diffusion DIY A look at Harmonai (+ a surprise) Dance, Dance Diffusion Revolution And then… Text-to-image AI for audio? A Brief History of Diffusion Models Diffusion models operate by erasing and then retrieving (or noising and then de-noising) the data ...