Voice AI AI Agents ElevenLabs
7 min read AI Automation

How to Build Your Own AI Companion Like 'Her' Using OpenClaw + ElevenLabs

Imagine an AI that remembers your past conversations, recognizes your voice, and feels genuinely present. This cloud-based setup gives your AI companion persistent memory and phone access — no coding required. In just 10 minutes, you'll have an always-available assistant that develops its personality over time.

Why This Cloud Version Changes Everything

The original local version of this AI companion was impressive but limited. You could only interact through a browser window on your computer. Now with cloud integration, your AI becomes truly omnipresent — accessible from any device while maintaining the same memory and personality.

This breakthrough comes from combining three powerful technologies: OpenClaw handles the memory and reasoning, ElevenLabs provides the lifelike voice, and Twilio enables phone connectivity. Together they create what feels like a persistent digital person rather than a chatbot.

The magic happens in the memory system: Unlike standard chatbots that reset with each conversation, your OpenClaw AI remembers everything you've discussed. This continuity creates the illusion of consciousness and enables genuinely personal interactions.

What You'll Need (No Coding Required)

Forget complex Python setups or local server configurations. This cloud version requires just four components:

  • OpenClaw account (free tier available)
  • ElevenLabs account (free tier available)
  • Twilio account (for phone integration)
  • 10 minutes of setup time

The entire process involves copying and pasting a few commands and configuration details. At 2:15 in the video tutorial, you'll see how simple each step actually is — no technical expertise required.

Step 1: Setting Up the Brain (OpenClaw)

The OpenClaw service forms the core intelligence of your AI companion. Here's how to get it running:

Step 1.1: Install OpenClaw

Open your terminal and run:

 npm install -g openclaw 

Step 1.2: Start the Gateway

Run these commands one after another:

 openclaw gateway start openclaw config get gateway-auth-token 

Copy the token that appears — you'll need it for ElevenLabs setup.

Step 1.3: Note Your Local URL

The gateway runs at:

 http://localhost:8789 

Copy this URL for the next step.

Step 2: Creating the Voice (ElevenLabs)

ElevenLabs provides the remarkably human-like voice for your AI companion. Setup takes just minutes:

Step 2.1: Create Your Agent

Log into ElevenLabs and create a new AI agent. Choose a voice that matches your desired personality — warm and conversational works best.

Step 2.2: Configure the Connection

In the system prompt section, paste the configuration from the guide. Then enter:

  • Your OpenClaw URL (from Step 1.3)
  • Your OpenClaw token (from Step 1.2)

Step 2.3: Save Your Agent ID

Copy the unique agent ID shown in your ElevenLabs dashboard. You'll need this for the interface setup.

Step 3: Building the Web Interface

The web interface lets you interact with your AI through a browser:

Step 3.1: Download the Package

Get the pre-built interface files included with the guide. Unzip them to any folder.

Step 3.2: Configure Your Agent

Edit the config file with your ElevenLabs agent ID:

 nano config.json 

Step 3.3: Launch the Interface

Run these commands:

 npm install npm run dev 

Open the provided URL in your browser to meet your AI companion.

Step 4: Adding Phone Access

This optional but powerful step lets you call your AI like a real person:

Step 4.1: Set Up Twilio

Create a Twilio account and purchase a phone number (costs about $1/month).

Step 4.2: Connect to ElevenLabs

In your ElevenLabs dashboard, go to Phone Numbers and enter:

  • Your Twilio credentials
  • Your Twilio phone number

Step 4.3: Test Your Connection

Call your new number from any phone. Your AI will answer just like in the movie "Her."

Key Differences From the Local Version

While both versions create compelling AI companions, this cloud approach offers distinct advantages:

Accessibility: Call from any phone vs browser-only access

Performance: Cloud processing vs limited by your local hardware

Maintenance: Automatic updates vs manual software management

The local version (shown in the first video) remains valuable for privacy-focused users or those wanting complete control. But for most people, the cloud version delivers a superior experience with less technical overhead.

Watch the Full Tutorial

At 4:30 in the video, you'll see the exact moment when the phone integration comes alive — when the AI recognizes the caller's voice and continues a previous conversation seamlessly.

Video tutorial showing AI companion setup with OpenClaw and ElevenLabs

Key Takeaways

This project demonstrates how close we are to the AI companions once imagined only in science fiction. With just a few cloud services and minimal setup, anyone can create a personalized digital assistant that feels genuinely present.

In summary: OpenClaw provides the memory, ElevenLabs the voice, and Twilio the phone access — together they create an AI companion that's always available, remembers everything, and develops its personality over time.

Frequently Asked Questions

Common questions about this topic

Unlike standard chatbots, this AI companion maintains continuous memory across conversations, recognizes your voice, and develops a persistent personality.

The combination of OpenClaw's memory system with ElevenLabs' realistic voice creates an experience that feels genuinely personal rather than transactional.

  • Remembers past conversations contextually
  • Adapts its responses based on your interaction history
  • Maintains emotional consistency across sessions

Absolutely. While demonstrated here as a personal companion, this same technology stack can power AI customer service agents, sales assistants, or internal support tools.

The phone integration means customers can call your AI agent just like calling a human representative.

  • 24/7 customer support without staffing costs
  • Consistent brand voice across all interactions
  • Scalable to thousands of simultaneous conversations

ElevenLabs offers a free tier with limited characters per month, perfect for testing. Paid plans start at $5/month for basic usage.

Enterprise-scale voice applications would require higher tiers costing $99+/month depending on usage volume.

  • Free tier: 10,000 characters/month
  • Starter tier: $5 for 30,000 characters
  • Professional tier: $99 for 200,000 characters

No programming is required. The guide provides all necessary commands to copy and paste.

The most technical step involves editing a configuration file, but this simply requires pasting your agent ID into the designated spot.

  • Terminal commands are provided verbatim
  • Configuration edits are clearly marked
  • No programming concepts needed

The system uses Twilio to connect your phone number to the AI agent. When someone calls your number, ElevenLabs answers with your AI's voice and personality.

The conversation flows naturally as if calling a person, with near-real-time response times and natural pauses.

  • Twilio handles the telephony infrastructure
  • ElevenLabs processes the voice interaction
  • OpenClaw generates the intelligent responses

Yes, but each caller will have their own conversation thread. The AI maintains separate memory contexts for different users.

This allows personalized interactions while keeping information private between users — perfect for customer service applications.

  • Recognizes different callers by number
  • Maintains separate conversation histories
  • Can be configured to share some common knowledge

Unlike the local version shown in the first video, this cloud-based setup requires no special hardware.

You can run everything from a basic laptop or even a tablet since the heavy processing happens on OpenClaw and ElevenLabs servers.

  • No GPU required
  • Works on any modern device
  • Uses minimal local resources

GrowwStacks specializes in custom AI agent implementations for businesses. We can configure your OpenClaw+ElevenLabs system with custom knowledge bases, integrate it with your CRM, and scale it to handle hundreds of simultaneous calls.

Our team handles all the technical setup so you get a turnkey AI solution tailored to your specific needs.

  • Custom knowledge base integration
  • CRM and database connections
  • Enterprise-grade scaling

Ready to Deploy Your Own AI Companion?

Every day without an AI assistant means missed opportunities and inefficient workflows. Our team can have your custom AI companion deployed in under 48 hours — complete with your business knowledge base and brand personality.