Franklin AI News Brief

ElevenLabs adds music and editable sound effects to uploaded videos

Key Takeaways

  • Instant Soundtracks combines a generated score with timed sound effects, with separate tracks available in the editor and API.
  • A soundtrack from the video itself ElevenLabs has introduced Instant Soundtracks, a feature that creates music and timed sound effects for an uploaded video.
  • The company says the system examines the clip and builds audio around its events, giving creators a starting point for a soundtrack rather than requiring them to select every sound separately.
  • The feature also accepts existing audio as a reference.
  • ElevenLabs describes using qualities such as genre, tempo and instrumentation to guide a new score.

A soundtrack from the video itself

ElevenLabs has introduced Instant Soundtracks, a feature that creates music and timed sound effects for an uploaded video. The company says the system examines the clip and builds audio around its events, giving creators a starting point for a soundtrack rather than requiring them to select every sound separately.

The feature also accepts existing audio as a reference. ElevenLabs describes using qualities such as genre, tempo and instrumentation to guide a new score. That is useful context for understanding the control offered: a reference shapes the generated music, while the uploaded video supplies the visual sequence it needs to accompany.

Separate layers keep editing possible

Music and sound effects appear as separate layers in ElevenCreative's editor. Creators can revise the result, change the mood or adapt it to a shorter cut. Keeping the components separate gives them a way to adjust an effect without having to accept the entire initial mix.

The API exposes options including add_sfx, separate_tracks and use_audio_as_reference. With separate_tracks enabled, the response is a ZIP containing separate music and sound-effects files. The announcement lists availability across ElevenCreative's Music Video Editor, Creative Engine, ElevenMusic, Studio and the API.

Limits to plan around

ElevenLabs specifies up to 10 videos per API request, with combined limits of 200 MB and 10 minutes of video. Those limits should be checked before treating a collection of clips as a single job. The announcement does not establish that every generated effect will be correctly timed or suitable without editing.

Franklin's reading is that the editable output is the practical advantage to test first. Try a short clip with clear visual events, listen for timing and unwanted sounds, and inspect the separate layers before using the mix. The product description establishes the workflow; it does not replace reviewing the audio in the finished video.

Read the ElevenLabs announcement.

Our read

Franklin AI Take

Separate music and effects make the initial generation easier to correct. A useful trial is a short clip with obvious visual events: check whether the effects arrive at the right moment, then adjust their layers independently. That tests the editing workflow more meaningfully than judging the first combined mix alone.