{How to} Enhance IVR with generative answers optimized for voice in Copilot Studio

Hello Everyone,

Today I am going to share my thoughts on the Enhancing IVR with generative answers optimised for voice in Copilot Studio.

To enhance an IVR with generative answers optimised for voice in Microsoft Copilot Studio, you essentially combine LLM-based generative responses with voice-channel best practices so answers sound natural when spoken by a bot. Below is a practical step-by-step approach used in production IVR systems.

1. Enable Generative Answers in Copilot Studio

In Microsoft Copilot Studio you can allow the bot to generate responses from knowledge sources.

Steps

1. Open your Copilot Studio bot.

2. Go to Topics → Generative Answers.

3. Enable Generative AI responses.

4. Connect knowledge sources such as:

   • SharePoint

   • Public websites

   • Dataverse

   • Uploaded documents (PDF/Word)

This allows the bot to generate answers instead of only using scripted topics.

2. Configure Voice Channel (IVR)

To make the bot work as an IVR, connect it to voice channels via:

• Azure Communication Services

• Microsoft Teams

• Dynamics 365 Customer Service

• Third-party contact centers (Genesys, Avaya, etc.)

These platforms handle:

• Speech-to-text

• Text-to-speech

• Call routing

3. Optimize Generative Answers for Voice

LLM responses are normally written for text, so you must shape them for spoken IVR.

Use Voice Response Instructions

In the Generative Answers configuration, add instructions like:

Respond in a short conversational style suitable for voice.
Use sentences under 15 words.
Avoid bullet lists and long explanations.
Pause between ideas.
If the answer is long, summarize first and offer to provide more details.

Example transformation:

Normal LLM output

Our return policy allows customers to return products within 30 days provided that the product is unused and in its original packaging.

Voice-optimized

You can return items within 30 days.
The product must be unused and in the original packaging.

4. Add Fallback Logic for IVR

In IVR flows you should always handle uncertain AI answers.

Typical pattern:

User question

     ↓

Generative Answer

     ↓

Confidence check

     ↓

If low confidence → transfer to agent

Use Power Automate actions or topic conditions to:

• escalate calls
• ask clarification questions
• repeat simplified answers

5. Limit Response Length

IVR responses must be shorter than chat responses.

Recommended limits:

Type	Length
Primary answer	1–2 sentences
Follow-up details	Optional
Total speaking time	< 15 seconds

6. Add Confirmation Prompts

Voice bots should confirm understanding.

Example:

“Your order was shipped yesterday.
Would you like the tracking number?”

This improves call flow and reduces frustration.

7. Improve Voice Naturalness (SSML)

Use Speech Synthesis Markup Language (SSML) with Azure TTS.

Example:

<speak>

Your order shipped yesterday.

<break time="500ms"/>

Would you like the tracking number?

</speak>

This works with:

• Azure AI Speech

8. Monitor and Retrain

Track voice interactions using analytics in:

• Copilot Studio analytics

• Dynamics contact center insights

Improve by:

• Adding missing knowledge

• Shortening responses

• Adjusting prompt instructions

Example: IVR Flow with Generative Answers

Caller question

      ↓

Speech to text

      ↓

Copilot Studio

      ↓

Generative Answer

      ↓

Voice optimized response

      ↓

Text to speech

      ↓

Caller hears response

That's it for today.

I hope this helps.

Malla Reddy Gurram aka @uk365guy