Blog · Guide

How to make an AI agent understand the voice notes and photos customers send you on WhatsApp

Short answer: switch on “Transcribe voice notes” and “Describe images” on your WhatsApp channel. With that, the agent reads the audio’s transcript or a description of the photo and answers in writing like any other message. They start off on a newly connected number, so without them the agent does not understand what is said in a voice note. It answers in text: it does not send voice notes today.

Why it matters for a store

Some customers would rather talk than type, and others send a photo of what they want. A bot that only reads text goes blank with exactly those who already want to buy. What you need is for those messages to reach the agent in a form it can read.

What happens when a voice note arrives

  1. The audio is transcribed to text.
  2. The agent reads that transcript as one more message, with your business profile and tools at hand.
  3. It answers in writing.
🎤 Voice note: “hi, do you have the blue dress you posted yesterday in size M? and do you ship to Austin?”
AgentHi. Yes, the blue dress is available in M, and we ship to Austin. Shall I prepare the payment link?

The store is made up. Answers come from your catalog and profile, so it is worth preparing the agent with your information.

And photos

The photo becomes a text description, and the agent works from that description. It helps with “do you have something like this?” or with understanding a screenshot. One detail: if the customer later asks about a fine point of the photo, the agent answers from the description it kept and does not look at the image again. For sending photos the other way, read how to send product photos on WhatsApp.

How to switch it on

  1. Create your free account and connect your WhatsApp number in Integrations.
  2. In the channel settings, switch on “Transcribe voice notes” and “Describe images”.
  3. Turn automatic replies on once you have tested.
  4. Send it a voice note and a photo from another phone and check the chat in Conversations.

What it spends

The agent’s reply spends 3 credits. Understanding a voice note or a photo adds 2 credits, so a voice note with its reply is 5. Compare what each plan includes in plans and pricing.

Its limits

Before you turn it on

Check how many messages go unanswered with the missed-reply calculator, and draft your base answers with the FAQ generator.

Get your agent to understand voice notes

Connect your WhatsApp, switch on the two settings and send it a voice note.

Start for free

Free plan, no credit card. See plans and pricing.

Keep reading