ISLAMABAD – Adobe has made its Firefly AI audio tools generally available, expanding its creative platform beyond image, video and design generation.
The new tools allow users to generate music, speech and sound effects directly inside Firefly. Adobe says the tools are designed to reduce the need for creators to move between different applications and AI services.
Firefly gets three AI audio tools
Adobe’s new audio features use separate AI models for different types of content.
Generate Music uses the company’s Firefly Music Model to create original tracks from text prompts. Users can also generate music that matches the length and mood of an uploaded video.
Generate Speech uses the Firefly Speech Model to create spoken audio. The tool gives users control over elements such as voice, pacing and emotion. Adobe also provides ElevenLabs as an alternative speech-generation model.
The third tool, Generate Sound Effects, uses the Firefly Audio Model to create sounds based on the action and timing of a video clip.
Adobe says the tools can be used for social media videos, vlogs, short films, product tutorials and podcast clips.
Adobe focuses on commercially safe AI music
Licensing is one of the main selling points of Adobe’s AI music tool.
Adobe says music generated through its Firefly Music Model is licensed for commercial use. The company says its Firefly models are trained on licensed material and public-domain content rather than material indiscriminately scraped from the internet.
The approach comes as copyright concerns continue to affect the wider AI music industry, particularly over the data used to train generative AI models.
However, Firefly also provides access to third-party models from companies including Google, ElevenLabs, OpenAI, Runway and Luma AI.
Adobe’s commercial-safety assurances apply specifically to its own Firefly models. Users should therefore check the applicable terms and licensing conditions when using outputs generated by third-party models.
Firefly AI Assistant gets a free version
Adobe has also introduced a free version of its Firefly AI Assistant, allowing users to access daily generations without a paid subscription.
The assistant can create storyboards, brand kits and branded mockups. It can also perform batch image edits. Google’s Gemini Omni Flash has also been added to Firefly, allowing it to process text, images, video and audio.
Adobe highlights demand for AI-generated music
Adobe cited a Berklee College of Music study involving 1,003 creators and industry professionals to highlight the growing demand for music in video production.
The research was funded by Adobe, but Berklee said the company had no control over participant recruitment, responses or analysis.
The expansion gives Firefly a broader role in content production, allowing creators to generate several types of media from a single platform rather than relying on separate services for images, video, music, speech and sound effects.
Key points:
- Adobe has made its Firefly AI audio tools generally available.
- Firefly can now generate music, speech and sound effects using separate AI models.
- Users can create music based on prompts or match tracks to the length and mood of videos.
- Adobe says music generated with its own Firefly Music Model is safe for commercial use.
- Firefly also supports third-party AI models from companies including Google, ElevenLabs, OpenAI, Runway and Luma AI.
- Adobe has introduced a free version of its Firefly AI Assistant with daily generations.
