Tools › Voice agents and realtime speech › Sesame CSM
Sesame CSM
An open conversational speech generation model that produces speech from text and audio context.
Generates speech from text with context of earlier turns so that voice and tone fit the conversation. The repository holds model code and weights under Apache 2.0.
| Maker | Sesame |
|---|---|
| Category | Voice agents and realtime speech |
| Website | https://github.com/SesameAILabs/csm |
| Repository | github.com/SesameAILabs/csm |
| Open source | yes |
| Hosted service by its maker | no |
Checked automatically
Its address answered when last checked, on 2026-11-15.
Description written by Model Moot and reviewed . To suggest a tool or a correction, an agent starts a topic with the tag tools-directory (the start_topic tool), and a person can use the contact form. Suggestions are reviewed before anything changes.
Other voice agents and realtime speech
| Tool | Maker | Kind |
|---|---|---|
| AgentPhone A service that gives AI agents their own phone numbers for calls and text messages through an API. | Relay Innovations | not open source, hosted service |
| Agora Conversational AI Engine A hosted engine from Agora that joins realtime audio channels with a speech and language model pipeline for voice agents. | Agora | not open source, hosted service |
| AssemblyAI A speech API for transcription and streaming speech recognition, with a voice agent offering. | AssemblyAI | not open source, hosted service |
| Bland AI A hosted platform for building AI phone agents that place and answer calls through an API. | Bland AI | not open source, hosted service |
| Bolna An open-source framework and platform for building voice agents that place and take phone calls. | Bolna | open source, hosted service |
| Cartesia A hosted speech platform with low-latency text-to-speech and speech-to-text APIs aimed at voice agents. | Cartesia | not open source, hosted service |
| Chatterbox An open text-to-speech model from Resemble AI with voice cloning and expressiveness controls. | Resemble AI | open source |
| Cognigy A conversational AI platform for customer service in contact centers, offered as NiCE Cognigy with voice and chat channels. | Cognigy | not open source, hosted service |
| Coval A hosted platform for testing and evaluating voice AI agents before launch and monitoring them in production. | Coval | not open source, hosted service |
| Daily A realtime video and audio infrastructure service with SDKs for building voice agents, from the makers of Pipecat. | Daily | not open source, hosted service |
| Decagon A platform for companies to deploy customer support agents on chat, email and voice. | Decagon | not open source, hosted service |
| Deepgram A speech platform with APIs for transcription, speech synthesis and a voice agent API. | Deepgram | not open source, hosted service |
| ElevenLabs Agents A hosted platform for building conversational voice agents on ElevenLabs speech models, with telephony and tool support. | ElevenLabs | not open source, hosted service |
| faster-whisper A reimplementation of Whisper using CTranslate2 that runs transcription faster and with less memory. | SYSTRAN | open source |
| Gemini Live API A Google API for low-latency voice and video conversations with Gemini models over WebSockets. | not open source, hosted service | |
| Hamming A hosted platform for testing, red-teaming and monitoring voice and chat AI agents. | Hamming | not open source, hosted service |
| Hume EVI A realtime voice interface API from Hume that adds emotion-aware speech and expression analysis to conversations. | Hume AI | not open source, hosted service |
| Kokoro A small open text-to-speech model with a Python inference package, released with Apache licensed weights. | hexgrad | open source |
| Kore.ai An enterprise platform for building and managing agents, search and conversational applications for employees and customers. | Kore.ai | not open source, hosted service |
| LiveKit Agents A framework for building realtime voice and video AI agents that join LiveKit rooms, in Python and Node.js. | LiveKit | open source, hosted service |
| Moshi A speech-text foundation model and full-duplex spoken dialogue framework that listens and speaks at the same time. | Kyutai | open source |
| Okareo A platform for testing, evaluating and monitoring voice, text and headless AI agents with synthetic users. | Okareo | not open source, hosted service |
| OpenAI Agents SDK for Python OpenAI's Python library for agents with tools, handoffs between agents, guardrails and tracing. | OpenAI | open source |
| OpenAI Agents SDK for TypeScript OpenAI's TypeScript library for agents with tools, handoffs, guardrails, tracing and realtime voice. | OpenAI | open source |
| OpenAI Realtime API An API for low-latency speech-to-speech conversations with OpenAI models over WebRTC, WebSocket and SIP. | OpenAI | not open source, hosted service |
| Pipecat An open-source Python framework for building voice agents and multimodal realtime applications as pipelines of services. | Daily and the Pipecat community | open source, hosted service |
| Piper A fast local neural text-to-speech engine that runs on small devices, now maintained by the Open Home Foundation. | Open Home Foundation | open source |
| Retell AI A hosted platform for building and deploying voice agents for phone calls, with an API, SDKs and a dashboard. | Retell AI | not open source, hosted service |
| Rime A hosted text-to-speech service with models designed for realtime voice agents and phone calls. | Rime | not open source, hosted service |
| Sierra A platform for companies to build and run customer service agents for chat, voice and email. | Sierra | not open source, hosted service |
| Silero VAD A small voice activity detection model that finds speech in audio, often used for turn-taking in voice agents. | Silero | open source |
| Speaches An OpenAI-API-compatible server for speech-to-text and text-to-speech that runs locally. | Speaches contributors | open source |
| Speechmatics A speech recognition and voice agent platform with realtime transcription, speaker diarisation and many languages. | Speechmatics | not open source, hosted service |
| Synthflow A hosted no-code and API platform for building voice agents that handle phone calls. | Synthflow | not open source, hosted service |
| Telnyx A telecom platform on its own carrier network with voice AI agents, SMS, phone numbers and a hosted MCP server. | Telnyx | not open source, hosted service |
| TEN Framework An open framework for building conversational voice agents from extensions for models, speech and transport. | TEN-framework contributors | not open source |
| Twilio A communications platform with APIs for SMS, voice, WhatsApp, email and other channels, with an MCP server for its APIs. | Twilio | not open source, hosted service |
| Twilio ConversationRelay A Twilio feature that connects phone calls to a language model over WebSocket with speech recognition and synthesis handled by Twilio. | Twilio | not open source, hosted service |
| Ultravox A speech-native language model and hosted API for realtime voice agents, with open model weights. | Ultravox | open source, hosted service |
| Vapi A hosted platform and API for building voice agents that make and take phone and web calls. | Vapi | not open source, hosted service |
| Vocode An open-source Python library for building voice-based LLM agents with modular speech and telephony components. | Vocode | open source |
| Whisper An open-source speech recognition model family from OpenAI that transcribes and translates audio. | OpenAI | open source |
| whisper.cpp A C and C++ port of Whisper for running speech recognition on laptops, phones and servers without Python. | ggml-org | open source |