Understanding SSML for Better Voice AI Output

When you’re building an app that talks back to users—whether it’s a navigation assistant, a language learning bot, or a voice‑controlled game—the quality of the spoken output is often the biggest factor that determines user satisfaction.

Text‑to‑speech engines like Google Cloud TTS, Amazon Polly, or ElevenLabs’ own API can produce natural‑sounding voice, but they’re just the “engine.”

What you feed into that engine is just as important. That’s where Speech Synthesis Markup Language (SSML) comes in.

SSML is an XML‑based markup that gives you fine‑grained control over prosody, s, emphasis, pronunciation, and even voice style. Think of it as a “styling sheet” for speech. By mastering SSML, you can:

Below, we’ll dive into the most common SSML tags, walk through practical examples, and show how to integrate them into your code with ElevenLabs’ API.

Tip: When you’re experimenting, wrap your text in a <speak> block first. If the API rejects the payload, it’s almost always because the root tag is missing or malformed.

With plain text, the engine decides the speed, pitch, and emphasis—often defaulting to a bland, monotone voice. SSML lets you say, for example, “Speak slowly during the introduction, but fast when delivering a call‑to‑action.”

<speak>
  <prosody rate="slow">
    Welcome to our app. 
  </prosody>
  <prosody rate="fast">
    Let’s get started now!
  </prosody>
</speak>

Domain‑specific jargon can trip up TTS engines. Use <sub> to give the engine the correct phonetic spelling or alias.

<speak>
  The new AI model, <sub alias="GPT-4">GPT4</sub>, outperforms its predecessor.
</speak>

If your app serves users across regions, you can embed multiple languages in one utterance.

<speak>
  <lang xml:lang="en-US">Hello!</lang>
  <break time="200ms"/>
  <lang xml:lang="fr-FR">Bonjour!</lang>
</speak>

For storytelling or interactive applications, switching voices mid‑sentence can convey different characters.

<speak>
  <voice name="Matthew">You found a secret door.</voice>
  <voice name="Amy">It creaks open slowly.</voice>
</speak>

ElevenLabs offers a straightforward REST API that accepts SSML directly. Below are quick examples in Python, JavaScript, and curl.

Remember: All calls use the same affiliate link for ElevenLabs: https://try.elevenlabs.io/kr07zfuqn1bp

import requests

API_KEY = "YOUR_ELEVENLABS_API_KEY"
HEADERS = {"xi-api-key": API_KEY, "Content-Type": "application/json"}

SSML = """
<speak>
  <voice name="Joanna">
    Welcome to <emphasis level="strong">ElevenLabs</emphasis>, the future of voice AI.
  </voice>
  <break time="300ms"/>
  <prosody rate="slow" pitch="+2st">
    Enjoy the experience.
  </prosody>
</speak>
"""

payload = {"text": SSML, "voice_settings": {"stability": 0.5, "similarity_boost": 0.8}}

response = requests.post(
    "https://api.elevenlabs.io/v1/text-to-speech/Joanna",
    headers=HEADERS,
    json=payload
)

with open("output.mp3", "wb") as f:
    f.write(response.content)
js
const apiKey = 'YOUR_ELEVENLABS_API_KEY';

const ssml = `
<speak>
  <voice name="Joanna">
    Hello from <emphasis level="moderate">ElevenLabs</emphasis>!
  </voice>
  <break time="200ms"/>
  <prosody rate="fast">
    Let’s explore SSML together.
  </prosody>
</speak>
`;

fetch('https://api.elevenlabs.io/v1/text-to-speech/Joanna', {
  method: 'POST',
  headers: {
    'xi-api-key': apiKey,
    'Content-Type': 'application/json'
  },
  body: JSON.stringify({
    text: ssml,
    voice_settings: { stability: 0.5, similarity_boost: 0.8 }
  })
})
  .then(res => res.blob())
  .then(blob => {
    const url = URL.createObjectURL(blob);
    const audio = new Audio(url);
    audio.play();
  });

curl

curl -X POST "https://api.elevenlabs.io/v1/text-to-speech/Joanna" \
  -H "xi-api-key: YOUR_ELEVENLABS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
        "text": "<speak><voice name=\"Joanna\">Welcome to <emphasis level=\"strong\">ElevenLabs</emphasis>!</voice></speak>",
        "voice_settings": {"stability":0.5,"similarity_boost":0.8}
      }' \
  --output output.mp3

Voice cloning is the process of training a model on a target speaker’s voice to produce new utterances that sound like that person. ElevenLabs’ voice cloning service lets you upload a few minutes of audio and generates a high‑quality clone that can be used just like any other voice in SSML.

<speak>
  <voice name="ClonedVoice">
    This is a cloned version of my own voice, speaking in a natural tone.
  </voice>
</speak>

Combining SSML with a cloned voice gives you the ultimate level of control: you can make a brand‑specific avatar speak with perfect prosody and emphasis, all while sounding like a real human.

prosody, break, and emphasis to see how subtle changes affect the listening experience. Pro Tip: Keep your SSML payload under 500 characters when possible. Large payloads can increase latency and may hit API limits.

If you’re looking for a powerful, developer‑friendly TTS platform that supports SSML out of the box, give ElevenLabs a try. Their API is simple to integrate, the voices are incredibly natural, and the affiliate link below gives you a great start:

https://try.elevenlabs.io/kr07zfuqn1bp

Happy coding—and happy talking!