21:08Riley Brown · Tutorial
Building a Real AI Jarvis with Cursor and GPT Realtime 2
A step-by-step build of a talking, screen-controlling desktop AI companion — no coding experience required, just long prompts into Cursor.
July 1stRead if. Skip if.
READ IF YOU ARE…
- You manage or build AI agent workflows and find coordinating multiple chatbots overwhelming.
- You want to deploy shared AI assistants across a company Slack without leaking individual private credentials.
- You use autonomous browser agents that get blocked by cloud VM anti-bot detection.
SKIP IF…
- You only need basic one-off text generation from a single ChatGPT or Claude chat interface.
- You do not use automated dev tools like Cursor or team collaboration tools like Slack.
Free for members
Chat with this breakdown — free.
Sign in and you get 23 free chat messages on us — ask for the hook, quote a framework, find the exact transcript moment, generate a markdown action plan. Bring your own key when you want unlimited.
Create a free account →Where the time goes.
00:00 – 00:20
01 · Intro
Introduction to the four major updates shipped by Grokbot for managing multi-agent teams.
00:20 – 07:11
02 · Primary Bot
Demonstrating the new hierarchy model where a designated primary bot routes coding tasks to Cursor and content tasks to specialized bots.
07:11 – 14:30
03 · Team Bot Feature
Explaining the difference between personal bots and isolated team bots, and demonstrating how to deploy a content tracker bot into Slack.
14:30 – 17:40
04 · Inline Drafts for Email and Slack
Showcasing inline mini-apps inside chat threads that allow editing and one-click approval before sending emails or Slack messages.
17:40 – 19:17
05 · Local Computer Routing
Configuring Grokbot to route cloud VM browser traffic through the user's residential machine IP to prevent anti-bot blocking on sites like Target.
19:17 – 21:08
06 · Final Thoughts & Bonus Tip
Reviewing Grokbot's performance polish and sharing a workflow tip on using Composio as a universal plugin bridge across agent platforms.
Lines worth screenshotting.
- Personal bots share global skills and credentials across a single user, whereas Team Bots start with zero plugins and enforce per-seat authentication.
- A Primary Bot eliminates multi-bot context switching by parsing prompts and routing execution to dedicated worker bots automatically.
- Delegating code refactoring through a developer agent directly hooks into Cursor, runs Opus 5.5, and deploys pull requests straight to production.
- Voice calls on mobile are the lowest-friction interface for dictating complex, multi-agent delegating instructions while away from a keyboard.
- Inline draft UI cards function as interactive mini apps inside the conversation stream, creating an approval gate before external API dispatch.
- Cloud VMs hosted in data centers trigger security checks on major commercial websites; routing traffic through a local desktop IP bypasses bot blocks.
- Individual team members using a shared Slack bot connect their personal OAuth tokens, ensuring actions are attributed to the specific operator.
- Composio acts as a centralized tool and plugin registry, allowing users to swap foundational LLM backends (GPT, Claude, Grok) without reconfiguring integrations.
Hierarchical Delegation and Credential Sandboxing Are Essential for Multi-Agent Systems
OPERATIONAL ARCHITECTURE
Scaling AI agents from solo experiments to production workflows requires decoupling the master controller from specialized workers and separating personal logins from shared team environments.
Things they pointed at.
13:47toolVictor
Lines you could clip.
01:08
“You now have a primary bot whose job it is to delegate to the other bots.”
08:37
“The more you talk to your main agent and have it delegate certain tasks, the more you'll get used to the process of working with a team of agents.”
17:02
“Routing through your computer makes it look like the bot is you. It uses your IP address.”
Word for word.
Read-along
Don't just watch it. Burn it in.
See every word as it's spoken — crank it to 2× and still catch all of it. The same dual-channel trick behind Amazon's Kindle + Audible.
metaphoranalogy
If you want to use AI agents in your business to be more productive, then you're in the right place because Grokbot just launched four huge updates that make it the easiest way to run a whole team of agents for marketing, coding, or any type of task. And the last update that I'm talking about today fixes the biggest reason agents get blocked.
on the internet. So the first and biggest update to Grokbot is the addition of a primary bot. Okay, so here we are in the Grokbot desktop app.
I'm running this on a MacBook Pro. And here is a normal Grokbot. Grokbot was the first agent platform that allowed you to kind of create a team of agents in a simple interface for knowledge work.
Now, they've made some changes recently, which creates a hierarchy. And you can see the hierarchy by this little star that shows up right here. So if I click on this bot right here called GrokBot, .
Before this update, you would just have a bunch of different bots in charge of different things. Like you would have a content researcher bot, a developer bot, or you may have... multiple dev bots, depending on what project they're working on.
And you might have a researcher bot, however you want to do it. But after this update, they've introduced a hierarchy. You now have a primary bot whose job it is to delegate to the other bots.
Let me show you an example. So this is my internal tool where I basically have all of the different apps we use internally. I just call it native note.
What I want to do is I'm going to go to this my mind. Normally it looks like this. And I think this view looks really good.
Except this list view doesn't look that great. So I'm going to ask grokbot. to make a change here.
Make the page that has the My Mind page but the list view for My Mind look a lot better. Please use Opus 5 .5 for this. Make the change.
And so I'm gonna fire this off to my main agent and notice what the agent is going to do. Look at this. I'll have native note dev redo the my mind list view in Opus.
So here he's delegating it to the native note dev and you can see native note dev is now working. And so you notice here that it immediately delegated the task. I didn't ask it to delegate the task.
It immediately delegated it to the native note dev. Now the native note dev, you can see it here and here it's actually using cursor. It's going to choose the model Opus 5 .5.
I'll send you the pull request when it lands. And so I can just say, okay, yeah, and make sure he pushes directly to prod. I trust him.
And he's going to push the changes as soon as it's done so that it is live directly on the internet. And while he works, I want to talk a little bit about this. So what I normally do is I'm going to right click on my main bot or my primary bot, and I'm going to pin him to the top.
So that when I close the sidebar, I see my pinned bot, which is my team leader, my four bots on my team. I have a developer bot working on native note. I have a grok bot, which is kind of a general bot.
We have another bot who works on my agent native website. And then we have my content bot. That's basically my team right now.
And I have another type of bot, which I'll get to in just a second. And so it's still working. But one thing that's really cool about Grokbot is they're making the cursor integration much more seamless.
So if you go up here and click on your native note dev, you can actually see this little coding tab in the details. And if you click on this, it actually opens up cursor. So it literally opened up cursor and we can see the work that it's doing.
And so you can see here that it said Riley wants this ship straight to production, et cetera, et cetera. And so it's using cursor and it's just so simple inside Grok bot. I don't need to be aware of any of it.
I just talked to my main bot. He delegates to the developer bot who has all of the context about what we're building and he sends it to cursor. And if I want to open it, I can click on it right here.
And we can see here the native note dev finished his task. And if we navigate back to our website, let's go ahead and refresh this. There we go.
It is a completely different view. This looks a lot better. A very simple list of all of my Twitter bookmarks.
So in summary, the primary bot, you talk directly to this bot and then it routes. the task to the correct bot. And so it can hand off things to other bots.
So it allows for you to just kind of communicate with the same bot. I think people got overwhelmed when they had an entire team of different bots. I know I did.
And so it's I just basically just talk to this bot and it'll just route to the correct one. One thing to note is that any bot you create can become the primary bot. All you have to do is ask it and say, hey, can you now become the primary bot?
And it will actually switch the primary bot. So I use this for about three days straight since it came out. And I have one useful tip that I think people would benefit from a lot.
And so what I want you to do is I want you to try this with voice. And I want you to do this outside while on a walk. You'll think more clearly outside, go on a walk, talk to your main agent.
And the more you talk to your main agent and have it delegate certain tasks, the more you'll get used to the process of working with a team of agents. And to do this on the Grokbot iOS app, you can press this little voice button right here. Hey, buddy old pal.
Hey, what's on your mind? Hey, I need you to do some content research for me and come up with five YouTube ideas. Yeah, have the content body that.
ideas to the content bot. Very cool. And then what improvements can we make to the agent native landing page?
Taking the landing page improvements to the right bot. That's moving. Anything else you want queued while those two run?
No thanks. Good job. Glad to hear it.
Talk soon. And so look at this. Here you can see that we just had a phone call.
and it names the phone call and it has landing page improvements. And I can click on this and see our entire voice chat. So it's really good at seeing what you talk about with your voice.
And then you can see that it messaged the content bot. And now the content bot responded back to Grokbot and said, here are the five YouTube ideas from the call. I'm still going to have the agent native landing page, blah, blah, blah, blah, blah.
So he's actually delegating to the other agent. But here you can see the different ideas. And if I want to talk to the content bot, I can always just go click on this.
And I can talk to the content bot directly. But the point is, I now have a main point of contact that I can talk to and I can voice call. Highly recommend using voice calls.
And so that is a primary bot. And this... reminds me a lot of the new Claude Projects feature, which I've been talking about, which is still in beta.
But it allows you to talk to a main bot that delegates to other agents, except in Claude's case, they call them threads. The next one actually reminds me more of Claude Tag, which is another Claude feature. And so that brings me to the second huge update inside Grokbot, which is they now have a team bot.
Okay, so you'll notice here inside GrokBot, of course, we have our normal bots. We have our main or primary bot. Here we have a team bot.
And team bots are a little bit different. Actually, they're a good amount different. Team bots are meant to be used with your team.
So whenever you create a new bot, right, we could create a new bot right now. And if we created a new bot right now, we create a new bot. Hey, you're my new bot for personal use.
I want you to join the Riley bots team and you are in charge of emails. Become the email bot. I could just fire this prompt in and we're basically allowing it to join the RileyBots team.
When it joins this team, it'll share all of the plugins. So I have a lot of plugins that I've already connected. As you can see here, I can go to 23 apps installed.
These are all of the apps that I've installed into GrokBot. As soon as I add a new bot, this new bot will inherit all of those plugins and skills that we've created. It says I'm...
the email bot now joining Riley's bots team and setting that up. I found the Riley's bot section. I'm pulling myself there and renaming myself to email bot.
And you can see it just moved itself to the Riley bots team. This is a personal bot. Now the new team bots don't operate like this.
A team bot is more isolated and it's meant to be used as a team. And so a team bot is a shared bot that you can interact with in private chats like Slack, the Grokbot app and more coming.
And I'll show you exactly how to set that up. So if you make a new bot and we can actually make a team bot right now, we could create a new bot and we could actually, we could go, we could come up here and you see team bots. I could press this and say, create new team bot.
What I'm going to do is I'm going to move this to team. Hi, I'm your team's new bot. What should I help you with?
You are in charge of tracking all of the content and updating the team on all things that are content related. Your job is to keep everyone up to date on anything content related, content workflows, the metrics for the week, et cetera. If you come up to the team bot, you'll notice it has plugins, secrets, skills, and files.
And so you see here that it has none. And here we can actually add more plugins. So I'm going to go ahead and just add these plugins.
And the reason these plugins are separate is this bot is meant to be added to your Slack and used by everyone on the team. When you sign up for Grokbot, you're actually giving it access to your email. You don't want a bot that your whole team is going to use.
to use your email. That doesn't make any sense. And also on these personal bots, they have access to my Slack plugin, meaning it can send DMs and post things as me inside Slack.
You do not want a team bot, especially if you add this to shared channels, you do not want this inside Slack. What you want to do is you want to create a team bot with its own plugins, its own configurations, and you want to add that to Slack. And when you create a team bot, by default, it is just a draft.
It's not published to the team until you click publish to team, in which case it will become a normal team bot. But in order for other people to start using it on your team, what you're going to do is you're going to open up your agent's details here on the right side panel, scroll all the way down, and you're just going to click bring to your team's Slack.
And now we're going to add this to my Slack called Agent Native Inc. And we're going to connect it. And now we're going to click done.
And now inside Slack, if we scroll all the way down here, you'll see content tracker. You click on content tracker. This is the team bot that we just created.
And I can say, hey, you're the new team bot, right? And we can click one reply. Yes, that's me.
I'm the content tracker, the new team bot. What do you need? Every morning, give me an update in the, and I can go Riley, go Riley channel, please.
I'll add you to that in just a second. So I can fire this prompt. We're going to go to the Riley Emily channel.
I'm going to go ahead and I'm going to come up to members and we are actually going to add the content tracker and we're going to add this to the channel. And now we can at mention the content tracker bot and say, hey, welcome to the channel. And here you can see content tracker is finishing up another thread.
And once it's done, it'll actually respond to us here. And it responded and said, thanks, Riley Brown. Glad to be here.
Tag me whenever you want creator stats, a draft or a content check. So we created a team bot. We can give it its own skills and we can very easily add it to our Slack.
And so I don't know if I'll be using Victor anymore. Victor is an app where its entire value prop is this Teams feature. But since it's built directly into an app I already use, which is GrokBot, this is much easier and it's great.
And so this has become a lot more like CloudTag, which is the version of Cloud that lives directly in your Slack. And so some quick notes on the TeamBot is that it starts clean with no plugins, unlike personal bots. Remember, every personal bot you create, All of your personal bots share skills and plugins.
The only thing that's different between them is their system prompts and the context of their threads. They're basically all the same bot, but these team bots are very isolated and they're very different. And there's a reason for this because it is built for businesses and teams and you want to keep everything secure.
And so plugins that need a login like Gmail are connected by each. teammate individually. So you can add a Gmail plugin, but if we were to add Gmail, if Emily in my Slack were to message the content tracker bot and say, Hey, I want to connect Gmail.
She would connect her Gmail. When she asked this content tracker bot, it would use her plugin. When I contacted the con content tracker bot, it would use my Gmail plugin.
And so this is something I'll make more in -depth details in the future because it seems a little confusing at first, but that's how it works. And if you ask this bot to create a routine, this routine stays personal. And so each person's routines are their own.
And then, of course, I showed you this, but this stays hidden until you publish it. So I highly recommend what you do is you can create a bot. Then you are going to configure and test it in the Grok bot app.
When it's ready, you have to publish it. Then you should add it to Slack and do some. And then then it becomes an official team bot.
And then you should test it in Slack before you let everyone on your team use it. So the third and fourth updates to Grokbot seem somewhat subtle, but I genuinely love both of them. So the third update to Grokbot that's super useful is they now have inline drafts for email and Slack.
Let's say I'm talking to the content bot. I can say, yeah, can you draft up a quick message in Slack to John asking for thumbnails for these videos? So it used to draft a message.
or a Slack note, and it would just put a text thing here. It would just put the text of what it's going to say here, or it would summarize it. It wasn't that useful.
But now, here it's checking the thread to make sure it sounds like me. Now it gives us , which is basically a little app that I can see right here. It says the workspace to John Kayam, and it says, can you make a thumbnail for these?
And I can very easily edit this. You know, let's say I didn't want to remove this. Okay, this looks good.
Now I can click send. And now you can see when it sends. So it sends you this little UI and I can very easily verify it.
Hey, can you draft up an email to Emily saying that we're going to be working on this, these videos this week? And here you can see that it sends another little mini app that I can review and I can click show more and I can very easily edit the email really quickly or I can be like, hey, can you redo the draft? Make it a little bit longer.
And so I can edit it directly myself or I can ask the agent to do it and it will send me a new little draft mini app. There's a lot of ways that you can call it. I like the name mini app because it is, it's literally a little mini app.
And when I press send, it actually sends the email. And so now I think, okay, this looks good. I can click send and it.
can do it. And one thing you can do is say like, hey, I don't have enough time today. Can you please draft up an email to the top 10 emails that I need to respond to?
And it will do it. And it'll give you 10 little cards. And if you don't want to send something, you can always just press discard and it will discard it.
And you can kind of just go through all of the emails. And so you ask it to send an email or a Slack message. Then there's this little send gate where you approve and then the message sends.
And that's exactly how this works. And I think that this is going to be one of the biggest trends with agents, especially with personal agents in 2027. This is kind of something I've been demoing a lot for the past six months.
And this is the UI that I've always wanted, where you can message the agent to do any task. And then it will respond with some text. And then it will show you the perfect interface for that task.
In this case, it's Gmail and Slack, which is really useful. And then it shows you that interface. And then you take action within that mini app.
For example, when you... can like edit it, or you can respond to the app. It is like perfectly agent native.
And then depending on what action you do in this mini app, it triggers an action and then kind of the app gets updated. And I think. Like right now, it's just email and Slack.
Soon, it's going to be basically everything. Okay, so now I want to talk about the final update of the day for Grokbot, which is routing traffic through your computer. If you go to Grokbot and you go down to settings and you go to computer and you scroll down to the bottom, you will see network and then route traffic.
through this computer in my opinion you should have this on and i'll tell you why this is because your bot has a computer in the cloud if we go up to our bot right here we can see that it actually runs on a computer the reason why grokbot and other personal agents are so powerful is they have access to a computer with a browser right it can navigate to target For example, if you asked it to buy something on Target.
However, the further you go down the path to buying something, Target's security will block bots from doing things, right? So like your bot has a cloud VM. And so VMs can get flagged as a bot.
And this will actually prevent you from doing autonomous stuff like buying from certain websites, filling out certain forms, or just doing a ton of tasks on the VM. And so routing through your computer makes it look like the bot is you. It uses your IP address.
From Target's perspective, it will think that it is using your computer. And so routing the traffic through your computer makes it more likely the bots can actually do any task because it can route through your computer. And so this is a very simple thing to turn on.
And I think it's incredibly useful. And so I have some final thoughts. Grokbot.
Feels incredibly fast right now. I don't know why it is. Additionally, the UI is just the most polished of any agent platform out there.
And I genuinely believe I'd be using it for almost like every task if the models were at the frontier like Opus 5 .5. And then a little bonus tip. I've been using Composio.
And a Composio, and this is not sponsored by Composio, but Composio is basically a centralized place where I keep plugins and skills. And so all I have to do is set it up once here and it allows me to switch agent platforms easily. So I was using Claude for about a week and a half a lot.
And I created a bunch of skills, I added some plugins, and I added the plugins on Composio instead. And so now all I have to do is type at Composio, please use this skill or this plugin, and it can actually use them there, right? I can go to here.
If we go up here and we type Composio, we open this up, log in. Here we can actually see I have all of these plugins. I have 28 apps that I've created on Composio.
And since I can connect GPT, Grok, Claude, cursor, all of the different platforms to Composio, it's very easy to create this centralized place where all of the agents have access to the same skills, which is my biggest thing right now. I want to test the latest agent platform, but it's hard to switch from each one.
This makes it a little bit easier. So that's just kind of a bonus tip to end the episode here. And so there you go.
They added a primary bot, a team bot. They have little mini apps for inline drafts for emails and Slack, and you can route it through. your computer.
We talked about a lot today. I hope you got value from this video. I really appreciate those of you who've been watching and commenting on my videos.
Please like, subscribe. I'll see you here in the next one.
The Hook
The bait, then the rug-pull.
Riley opens directly on camera, establishing that Grokbot just solved the friction of managing a multi-agent team and eliminated the biggest blocker to autonomous web agents.
Named ideas worth stealing.
01:17model
The Agent Hierarchy Model
- Primary Bot (Delegator / Orchestrator)
- Specialized Worker Bots (Dev, Content, Research)
- Execution Engines (Cursor, Headless Browsers)
A tiered organizational structure where a human talks exclusively to one orchestrator bot that parses intent and dispatches tasks to isolated worker bots with domain context.
Steal forDesigning internal multi-agent architecture in AI business setups
16:47concept
The Mini-App Verification Gate
- Task Request
- Draft Generation
- Inline UI Card Rendering
- Human Modification / Approval
- API Execution
A safety-first agent communication pattern where outgoing messages render as interactive forms requiring human confirmation prior to dispatch.
Steal forAutonomous email, CRM, and team chat integrations
How they asked for the click.
VERBAL ASK
21:00subscribe
“Please like, subscribe. I'll see you here in the next one.”
A brief, natural sign-off on camera without hard pitches or sponsor plugs.
MENTIONED ON CAMERA
FROM THE DESCRIPTION
OTHER LINKSAlso linked in the description.
Visual structure at a glance.
