Free early access to "ElevenAI," an assistant for work
Voice AI company ElevenLabs unveiled "ElevenAI," an AI assistant that helps employees with their work, at the "ElevenLabs Summit" it held in New York on Nov. 11 (the night of the same day Japan time), and opened free early access the same day. The company has offered "ElevenAgents," a service for building voice agents that companies use to talk with customers. While ElevenAgents connects companies with their customers, ElevenAI plays the same role in helping employees get their work done, the company said.
ElevenAI is an app that listens to spoken conversations, including in-person meetings, and turns them into notes and next steps. Its voice dictation and meeting notes run on "Scribe v3," a speech recognition model the company announced on Nov. 10. In meetings, it takes notes with the consent of all participants, and when a call ends it delivers a summary and a list of action items to each participant. During calls, it offers information on the spot to help, and passes the necessary information between AI agents and people, the company said. It also said it has built in a mechanism to notify the other party of recording and obtain their consent.
The company's official X account also introduced ElevenAI as an assistant for work that "lets you dictate into any app, takes meeting notes, passes context between agents and people, and provides live assistance during calls."
ElevenAgents works for your customers. ElevenAI works for your team. At ElevenLabs Summit we previewed a new AI assistant for work that lets you dictate into any app, takes meeting notes, passes context between agents and people, and provides live assistance during calls. Open for early access today.
The official blog does not state pricing after early access or when it will be formally offered.
Memory features for customer-facing agents to come, conversation control in preview
For ElevenAgents, Chief Executive Officer Mati Staniszewski described features to be added in the future in a keynote.
"Memory" lets an agent recall what it heard before when a customer who has verified their identity contacts the company again. It records preferences and availability that have no field in the customer relationship management (CRM) system, for example information from a conversation such as a preference for Spanish and availability only after 5 p.m. "Routines" is a mechanism that automatically carries out multistep tasks before, during and after a conversation, connecting to tools and systems used inside the company. The official blog describes both as features that "will be" available and does not give a date when they can be used.
A new mechanism for managing the flow of conversation, "Interaction Engine," was shown as a preview. It judges turn-taking and interruptions, deciding when the agent starts talking and when it stays quiet. It selects which large language model (LLM) to use for each part of an exchange, leaving routing to cheaper models and assigning complex tasks to top-tier models, to keep the amount of computing used down, the company said. No timeline for general availability was given for this either.
For enterprises, the company said it will help companies fine-tune some open-source language models and ElevenLabs' voice models for their own use within the coming months. Companies can bring their own real operational data and improve models together with the company's researchers according to metrics they choose, such as customer satisfaction and reliability, it said. A model specialized for the financial industry is also in development, according to the company.
Partner program launched, Marketplace purchases from next year
ElevenLabs launched the "ElevenLabs Partner Program" the same day. Partners such as consulting firms, systems integrators and software companies will handle integrating ElevenAgents into companies' existing systems. According to the company, partners number more than 550 companies in 44 countries, including Google Cloud, IBM, Deloitte, DXC and Genesys. It also announced a partnership with McKinsey, which will combine ElevenAgents with its corporate transformation support and its AI unit, QuantumBlack.
The company also introduced the "ElevenLabs Marketplace," which lists industry-specific AI and voice apps that partners build with ElevenLabs technology. It covers industries including healthcare, finance, insurance, education and retail, and companies can compare agents and contact the partners that built them directly. Agents will become purchasable on the Marketplace next year, and companies will be able to pay for them out of their existing usage commitments with ElevenLabs, the company said.
NVIDIA partnership expanded, "70% lower" cost is the company's own evaluation
ElevenLabs also announced an expanded partnership with NVIDIA the same day. It made NVIDIA's model "Nemotron 3.5 Super VL" available in ElevenAgents.
According to ElevenLabs, on its own "ElevenAgents benchmark," a collection of realistic customer service tasks, Nemotron 3.5 Super VL ranked among the top in accuracy at completing tasks end to end and also performed well on financial calculations and billing analysis. Its cost was 70% lower than other major open models, the company said. It did not name the models compared. The figures were measured by ElevenLabs itself, and no third-party verification could be found.
Computing resources will also increase. At the top of the blog post announcing the NVIDIA partnership, the company wrote that it will add 15 megawatts (MW) of computing capacity from NVIDIA Blackwell Ultra systems and the Vera Rubin platform. In the body of the same post, it describes a plan to add 15 MW of next-generation Vera Rubin capacity on top of existing Blackwell Ultra systems.
The two companies are also working on a voice agent for the appointment system of Poland's national e-health platform that notifies patients who have only landlines of their appointments and helps them reschedule. There are 40 million appointments a year, and 10% to 20% of people who book do not show up, according to the companies. The agent runs inside government facilities, and NVIDIA's Confidential Computing technology protects citizens' data and voices. NVIDIA became a strategic investor in ElevenLabs in 2025.
