Home

Jarvis

Company

Microsoft AI

Time

Now

Role

Designer

Info

Yuh yuh, so we started playing with the idea of something like Jarvis from Iron Man. Something kind of like that, which can help you clean up your mess.


It's a bit like a movie that you can direct on the fly. But instead of the story being center, it's an array of actionable info that helps you do things in real life, like making a decision about which car to buy. Or planning a vacation to Rio. Or basically literally anything.

It's an infinite generative visual system that maps intent to visuals, information, tools, and emotional sentiment. So deadass, like u ask for anything and see anything. Also it's in three dimensions and there's a custom character.

History

All design in the past has been to some sorta raw spec, but because we don't know what will be generated, this work is about scaffolding the details of a general system.

Like in all of history it's been: design this chair. Boom, chair. Or design this poster, or this car, or this screen, or this dress. You'll draw from the spec. But now the visuals can be anything and you don't know what they will be.


It's different from Copilot, Gemini, or ChatGPT because we're not serving text outputs. Rather it's multimedia, animated, adaptive to intent, and interactive. More, the character gestures to its evolving generative artifact like it's giving a TED talk, while evolving the artifact live. Whatever text is being rendered, it's gestural rather than being read out.

Just to get an idea of how hard of a problem this is, imagine what the right visual is for each of these prompts and then what comes out as a morphing and interactive output. After u do that, imagine what happens when the convo branches into a different topic:

Prompts

  • What car should I buy based on how I drive and where I live

  • Help me make a healthy dinner with what’s already in my fridge

  • Show me how my rent compares to similar apartments nearby

  • What’s the best city for me if I don’t want to own a car

  • Help me choose a gym based on distance, hours, and vibe

  • Compare prices for the same groceries across delivery apps

  • Show the neighborhoods in NYC I could afford on my current income

  • What’s the best airline for traveling often between LA and SF

  • Help me plan a one-week Europe trip under $2,000

  • What should I make for dinner based on what I’ve been eating

  • Show me the cost of living tradeoffs between Austin and Chicago

  • Map restaurants I’ve visited and how much I spent at each

  • Help me see if I’m spending more money or time on food

  • Rank cities where I’d save the most money by cooking at home

  • Help me pick between two cities based on how I spend weekends

  • Show me how much money I’d save by canceling unused subscriptions

  • What are my most time-wasting habits

  • Help me redesign my daily routine for more energy

  • Show me how my weekend plans align with my goals

  • What’s the best way to split my day between work, chores, and rest

  • Compare screen time between weekdays and weekends

  • Help me stop doomscrolling after 10pm

  • Show me what my most focused hours of the day are

  • Help me figure out which habits I actually stick to

  • What would my calendar look like if I only kept the important things

  • Visualize how much time I spend in transit every week

  • What part of my week gives me the most joy per hour

  • Help me plan a Sunday that resets me for the week

  • What’s the best way to use my mornings if I wake up early

  • Show me how long I’ve been procrastinating specific tasks

  • What cities match my sleep schedule and work habits

  • Visualize how many hours I spend thinking about work after hours

  • Help me design a weekend routine that isn’t just recovery

  • What neighborhoods in London are best for people who stay out late

  • Compare dating app results in different cities

  • Help me find a dog breed that fits my lifestyle

  • Show me how long I typically take to make big decisions

  • What are my most impulsive purchases this month

  • Compare the price and convenience of laundromats nearby

  • Help me figure out how much I could save by biking instead of Uber

  • Map where I usually go after 6pm during the week

  • What cities have the best late-night food scenes

  • Help me find cities where I don’t need to drive at all

  • What are the top five expenses I can easily cut

  • Show me if it’s cheaper to cook or eat out based on my receipts

  • What’s the most efficient way to get groceries in my city

  • Help me visualize what I buy but don’t actually use

  • What part of my life feels the most bloated

  • Show me what subscriptions overlap in purpose

  • What should I stop doing just because everyone else does

  • Help me plan a minimalist apartment setup

  • What would a one-bag lifestyle look like for me

  • Show me how my apartment layout could be rearranged for space

  • Help me figure out what items I never use but still store

  • What’s the best city if I want to walk everywhere, eat well, and create

  • What places in Tokyo are open past midnight and actually good

  • Help me map out a weekend trip from New York without flying

  • Compare rent, noise, and food options across Brooklyn neighborhoods

  • What’s the most livable neighborhood in Mexico City for someone like me

  • Show me where I could live in Lisbon within 10 minutes of a market

  • What cities let me live near water, eat cheap, and still work remote

  • Visualize how I navigate the city differently on weekdays vs weekends

  • What’s the fastest way to feel at home in a new place

  • Help me plan an apartment hunt without wasting time

  • Compare quality of life in Vancouver vs Berlin

  • What restaurants match my taste but I haven’t tried yet

  • Help me organize my favorite places into a custom map

  • What would my life look like if I lived 15 minutes from everything

  • Help me decide where to live based on noise sensitivity

  • Show me how many things I’ve started but never finished

  • What’s the best time of year for me to move cities

  • Visualize how often I change cities and why

  • Help me map out my year as seasons of growth and stagnation

  • What’s something I do every day but never question

  • Show me what patterns define my friendships

  • What types of people am I most drawn to and why

  • Visualize what I’ve built and what I’ve abandoned

  • What should I actually be proud of but I ignore

  • Help me compare how I act when I’m alone vs with others

  • What version of me shows up at work vs at home

  • Map the traits of people I respect vs people I tolerate

  • What risks have I taken that actually paid off

  • Visualize the turning points of my life so far

  • Help me make peace with something I keep revisiting

  • What do I want from my next chapter that I’ve never had before

  • Show me how my values have changed over time

  • What do I avoid that costs me more than it saves

  • Help me rethink what success means to me

  • What parts of my past still shape my present behavior

  • Visualize the difference between what I say I want and what I choose

  • What’s missing from my life that I never talk about

  • Help me plan a week around feeling like myself again

  • What type of work makes me lose track of time

  • What kind of project would feel like a rebirth

  • Help me decide if I should quit

  • What’s something I’ve outgrown but haven’t left

  • What do I do when no one’s watching

  • What identity am I trying to grow into

  • Visualize the kind of person I’ve become

  • What would I do if I didn’t care about being impressive