TEN Agent is a realtime conversational AI agent powered by TEN. It seamlessly integrates the OpenAI Realtime API, RTC capabilities, and advanced features like weather updates, web search, computer vision, and Retrieval-Augmented Generation (RAG).
TEN is a very versatile framework. That said, TEN Agent is compatible with DeepSeek R1, try experiencing realtime conversations with DeepSeek R1!
TEN Agent is now running on the Espressif ESP32-S3 Korvo V3 development board, an excellent way to integrate realtime communication with LLM on hardware.
TEN offers a great support to make the realtime interactive epxerience even better on other LLM platform as well, check out docs for more.
Try Google Gemini Multimodal Live API with realtime vision and realtime screenshare detection capabilities, it is a ready-to-use extension, along with powerful tools like Weather Check and Web Search integrated perfectly into TEN Agent.
Describe a topic and ask TEN Agent to tell you a story while also generating images of the story to provide a more immersive experience for kids.
Category | Requirements |
---|---|
Keys | • Agora App ID and App Certificate(free minutes every month) • OpenAI API key • Deepgram ASR (free credits available with signup) • FishAudio TTS (free credits available with signup) |
Installation | • Docker / Docker Compose • Node.js(LTS) v18 |
Minimum System Requirements | • CPU >= 2 Core • RAM >= 4 GB |
For Apple Silicon Macs, uncheck “Use Rosetta for x86/amd64 emulation” in Docker settings. Note: This may result in slower build times on ARM, but performance will be normal when deployed to x64 servers.
.env
filecp ./.env.example ./.env
.env
AGORA_APP_ID=
AGORA_APP_CERTIFICATE=
docker compose up -d
docker exec -it ten_agent_dev bash
task use
task run
Open the playground at localhost:3000 to configure your agent.
Now, we have successfully set up the playground. This is just the beginning of TEN Agent. There are many different ways to explore and utilize TEN Agent. To learn more, please refer to the documentation.
Before we get started, be sure to star our repository and get instant notifications for all new releases!
Contributions are welcome! Please read the contribution guidelines first.
This project is licensed under the Apache 2.0 License - see the LICENSE file for details.