Blog · Guide
How to make an AI agent understand the voice notes and photos customers send you on WhatsApp
Short answer: switch on “Transcribe voice notes” and “Describe images” on your WhatsApp channel. With that, the agent reads the audio’s transcript or a description of the photo and answers in writing like any other message. They start off on a newly connected number, so without them the agent does not understand what is said in a voice note. It answers in text: it does not send voice notes today.
Why it matters for a store
Some customers would rather talk than type, and others send a photo of what they want. A bot that only reads text goes blank with exactly those who already want to buy. What you need is for those messages to reach the agent in a form it can read.
What happens when a voice note arrives
- The audio is transcribed to text.
- The agent reads that transcript as one more message, with your business profile and tools at hand.
- It answers in writing.
The store is made up. Answers come from your catalog and profile, so it is worth preparing the agent with your information.
And photos
The photo becomes a text description, and the agent works from that description. It helps with “do you have something like this?” or with understanding a screenshot. One detail: if the customer later asks about a fine point of the photo, the agent answers from the description it kept and does not look at the image again. For sending photos the other way, read how to send product photos on WhatsApp.
How to switch it on
- Create your free account and connect your WhatsApp number in Integrations.
- In the channel settings, switch on “Transcribe voice notes” and “Describe images”.
- Turn automatic replies on once you have tested.
- Send it a voice note and a photo from another phone and check the chat in Conversations.
What it spends
The agent’s reply spends 3 credits. Understanding a voice note or a photo adds 2 credits, so a voice note with its reply is 5. Compare what each plan includes in plans and pricing.
Its limits
- It does not answer with audio. It always replies in writing.
- It does not understand video or read documents. It knows a file arrived and its name, but does not open it.
- Size: audio up to 20 MB and images up to 8 MB.
- On Messenger and Instagram it works too, but only the first attachment of each message is processed.
- If something fails, the message is not lost: the agent is told that a voice note or photo arrived that could not be processed.
Before you turn it on
Check how many messages go unanswered with the missed-reply calculator, and draft your base answers with the FAQ generator.
Get your agent to understand voice notes
Connect your WhatsApp, switch on the two settings and send it a voice note.
Start for freeFree plan, no credit card. See plans and pricing.