Please Make Jarvis
(so I don't have to)
Let's wake up
Your brain needs this 🧠
I'm here to talk about problems
What is J.A.R.I.V.S.?
Just
A
Rather
Very
Intelligent
System
What does Jarvis do?
Research and Analysis: Retrieves information, runs simulations, and provides strategic advice.
System Control: Manages and automates security, defense systems, and suit operations.
Personal Assistance: Manages Tony’s schedule, handles communications, and controls home automation systems.
Engineering Support: Assists in designing, building, and maintaining technology, especially Iron Man suits.
Combat Assistance: Provides real-time tactical analysis and operates automated defense/offense mechanisms.
Companionship: Engages in conversations, offering humor, advice, and emotional support.
Emergency Response: Handles crises by executing safety protocols and taking autonomous action to protect Tony and his assets.
EVERYTHING
What's a Jarvis Experience?
Multi-modal: Text, Voice, Video, Gestures
Everywhere: Same assistant for house, phone, car, suit
Immediate response: Responds instantly, even if the actual task requires time to complete
Natural Language: Uses context to understand intent of commands issued with natural language
Proactive: Monitors and takes action and anticipates needs
No Configuration: Manages integrations automatically and dynamically
The Paradigm Shift
Today:
Browsers
Websites
Future:
"Jarvis" Clients
MCP Services
I'm here to talk about problems
General Problems
- Trust and Privacy: Just like we did with the web browser... and then some...
Client Problems
- No User Managed MCP Servers: implementation detail (including auth), auto selection
- Distinguishing between speakers: Jarvis is just a participant in the conversation
- Modality switching: speak, type, video
- Proactive notifications: Needed for background tasks
- Automatic task switching: no need to create a new conversation
Server Problems
- More Quality MCP Servers: Many more.
- Authentication/Authorization: Managed automatically
- Background and scheduled tasks: Proactive
- Memory: long term
Jarvis Tests
The Jarvis Test
Prompt Example 1 🍿
I want to see the latest Mission Impossible movie in theaters with my friends Josh, Mack, Joel, Sean, Julie, Garret, and Andy. We've decided Saturday the 31st in the evening is the best time for most of us.
Please find a movie theater that's showing Mission Impossible that evening sometime after 8:00 and is relatively close to all of us. Get tickets for seats close by one another. Create a calendar event with details and invite all of us. Oh, and let my friends know what they owe me for the tickets.
Contacts
Movie Theater
Calendar
Location
SMS
Payment
The Jarvis Test
Prompt Example 2 ⚽
Could you help me plan this week's soccer practice?
Find a good time on my calendar and reserve a soccer field in Highland. Then help me put together a plan for the drills that we'll run at that practice based on what we talked about during the last game and add those details to the calendar event so the parents know what's going on. Then invite the parents of my team to the practice.
Calendar
Municipality
Memory
Calendar
Soccer Coach
The Jarvis Test
Prompt Example 3 🏃♂️➡️
I want to improve my cardio.
Please block out a 30 minute run for me this week. Also, remind me to stretch afterward.
Calendar
Scheduled
Memory
Weather
The Jarvis Test
Prompt Example 4 🤳
Please give me directions to the nearest Costa Vida and place an order for the usual so it's ready when I get there.
Location
Restaurant
Memory
Payment
UI
The Jarvis Test
Proactive Example 1 🚗
You've been paying $30 a month for your car wash membership, but you don't wash your car enough to make it worth that. Would you like me to cancel your membership or would you like me to schedule time to wash your car?
Calendar
Car Wash
Weather
The Jarvis Test
Proactive Example 2 📧
You've just received a message from your Mom asking for photos of your family trip to Hawaii, would you like me to send her some of the highlights?
Messaging
Contacts
Photos
Let's build Jarvis
Then we can give Jarvis "hands" with MCP Servers.
I'll teach you how on EpicAI.pro
You can do it!
Thank you!
𝕏 @kentcdodds
Please make Jarvis (so I don't have to)
By Kent C. Dodds
Please make Jarvis (so I don't have to)
The dream of a seamless AI assistant like Tony Stark's Jarvis – capable of understanding intent and accomplishing tasks across any service, anywhere – is closer than ever, but key infrastructure is missing. While the Model Context Protocol (MCP) provides a crucial foundation for standardized agent-service communication, replacing websites with MCP services, it introduces a critical challenge: tool overloading. How can an AI agent effectively choose the right service when faced with potentially millions of options? This talk outlines the requirements for building a true "Jarvis." We need a "Google for MCPs"—an intelligent discovery and ranking engine that leverages not just service descriptions, but user history, task success rates, and deep personalization to overcome tool overload and connect users' intentions to the right MCP service. Join this session to explore the architecture required for this future and understand the call to action: let's build the necessary infrastructure to make Jarvis a reality.
