16 votes

Exciting, unlikely, or weird applications for AR-in-VR

I'm really excited for the release of the Apple Vision Pro since this seems like a major shift in how we might be interacting with computers in the future.

On the mundane things, I'd like to be able to browse the web and read articles and books while walking my dog, without craning my neck down or being oblivious to my surroundings.

However, I've had a couple ideas where the tech might go or unexpected use-cases.

  1. HUD and computer interface while driving with an emphasis on voice control and navigation. This would be far superior to touchscreen center consoles. If apple ever launches a car, I would expect the Vision to be the primary interface.
  2. Changing the "time of day" of the environment, like a sunrise alarm clock on steroids for helping those on night shift with nonstandard circadian rhythm.
  3. Altering your appearance perceived by others. Could be as subtle as wardrobe changes, presenting as a different gender, or a persona that's not human (like a fursona).

What other cool use cases can you think of, in a world where you can seamlessly manipulate the visual and auditory world around you?

17 comments

  1. [4]
    skybrian
    Link
    If you're interested in science fiction, I recommend reading the Terra Ignota series. It has a "Hive" called the Utopians. I like to think there are some proto-Utopians at Apple, because this...

    If you're interested in science fiction, I recommend reading the Terra Ignota series. It has a "Hive" called the Utopians. I like to think there are some proto-Utopians at Apple, because this thing looks like an early version of a Utopian visor.

    Along those lines, I imagine an augmented reality app that lets you tag real-world objects with comments. In the novels, the Utopian Hive has something like this that they use as a global issue tracker for all the things they want to fix in the world.

    I don't think it actually makes sense since I wouldn't want to use the Vision Pro on the street. But I guess an actual Utopian wouldn't care if they look strange?

    In the novels, they also wear cloaks that display a personal alternative version of what the world might look like behind them, sort of like a fancy screen saver. But I don't think the Vision Pro could really do that since it's mostly about displaying your eyes. Today's version might be a fancy generated background in a video chat.

    7 votes
    1. [2]
      Omnicrola
      Link Parent
      Adding to the scifi list, I'd recommend Rainbows End by Vernor Vinge. It's not the main plot of the book, but part of the near-future world is ubiquitos wearable tech which among other things...

      Adding to the scifi list, I'd recommend Rainbows End by Vernor Vinge. It's not the main plot of the book, but part of the near-future world is ubiquitos wearable tech which among other things allows you to change "channels" of AR on the real world. So for example you can choose to have downtown LA look like it existed in The Lord of the Rings.

      4 votes
      1. skybrian
        Link Parent
        Yeah, I remember liking that one, though it's been a while.

        Yeah, I remember liking that one, though it's been a while.

        1 vote
    2. LGUG2Z
      Link Parent
      I love this series, one of my all time favorites. If you ever wanna dip back into the world, I published all of my Kindle highlights from the series that focus on the world building, the...

      I love this series, one of my all time favorites. If you ever wanna dip back into the world, I published all of my Kindle highlights from the series that focus on the world building, the backgrounds to the Hives etc, with (hopefully) minimal story spoilers for people who haven't read the series before (or haven't finished it).

      2 votes
  2. [5]
    skybrian
    Link
    Maybe this is obvious, but I think concert recordings could be pretty great if you're close up and everything is actual size.

    Maybe this is obvious, but I think concert recordings could be pretty great if you're close up and everything is actual size.

    5 votes
    1. [4]
      vczf
      Link Parent
      That's an exciting idea, especially for those of us who don't like crowds! It'll depend on the quality of the speakers perhaps.

      That's an exciting idea, especially for those of us who don't like crowds! It'll depend on the quality of the speakers perhaps.

      2 votes
      1. [3]
        skybrian
        Link Parent
        The reviews I've read had positive things to say about the audio. At that price, I doubt it would be worse sound than an Airpod Pro? I wrote a short blog post with a story about how I think it...

        The reviews I've read had positive things to say about the audio. At that price, I doubt it would be worse sound than an Airpod Pro?

        I wrote a short blog post with a story about how I think it could work.

        1. [2]
          vczf
          Link Parent
          Funny lyrics on that song. Not my usual genre, but it makes me nostalgic for the days when I was first learning how to rip and burn CDs in Windows Media Player with my parents’ REM albums. Now I’m...

          Funny lyrics on that song. Not my usual genre, but it makes me nostalgic for the days when I was first learning how to rip and burn CDs in Windows Media Player with my parents’ REM albums.

          Now I’m curious to what extent AR and VR will devalue real estate. People spend big bucks for the privilege of waking up in the morning to a lovely view. What will people want next, if everybody can have paradise outside their window?

          1. skybrian
            Link Parent
            I wouldn't expect it to change any time soon because the people who spend the money on that sort of real estate probably plan on entertaining? Vision Pro is a one-person device. Even for two...

            I wouldn't expect it to change any time soon because the people who spend the money on that sort of real estate probably plan on entertaining? Vision Pro is a one-person device. Even for two people, you'd need two of them to enjoy a show together, so it's twice as much money.

  3. [4]
    click
    Link
    Once the tech gets miniaturised enough to be stylish enough to wear in public, I’ve always liked the idea of apps like Apple/Google maps being able to show you directional information as you walk...

    Once the tech gets miniaturised enough to be stylish enough to wear in public, I’ve always liked the idea of apps like Apple/Google maps being able to show you directional information as you walk or drive, such as arrows showing you where to turn, or by highlighting a path for you to follow.

    4 votes
    1. vczf
      Link Parent
      To add to this, navigation inside buildings could be super useful.

      To add to this, navigation inside buildings could be super useful.

      2 votes
    2. probodyne
      Link Parent
      Yeah, I'd love something like these in glasses form. I really wish Google had persevered with the Google Glass. Focals by North were looking interesting for a bit, but they died as well. Maybe...

      Yeah, I'd love something like these in glasses form. I really wish Google had persevered with the Google Glass. Focals by North were looking interesting for a bit, but they died as well. Maybe this one will finally stick?

      Actually, if anyone knows of some good smart glasses please recommend them, I haven't been able to find any that also look kinda normal.

      2 votes
    3. insomniacpyro
      Link Parent
      If I can get a racing game style driving line (complete with brake/acceleration colors) it would be the death of me. But damn would it be a cool looking death as I try to get drift points off the...

      If I can get a racing game style driving line (complete with brake/acceleration colors) it would be the death of me. But damn would it be a cool looking death as I try to get drift points off the edge of that cliffside road...

  4. plutonic
    Link
    I dream of having a permanent HUD that provides me with various information. I would like to see the time and temperature at all times. When I look at a business sign, I want to see the Google...

    I dream of having a permanent HUD that provides me with various information. I would like to see the time and temperature at all times. When I look at a business sign, I want to see the Google rating and some brief information about the establishment. I see the ability to pick up an object and trigger an AI to conduct an online image search, providing me with a list of web stores and their prices. It would be convenient to compare and read reviews for different tech products by simply holding up two objects. Additionally, I would like the HUD to assist with city navigation, offer optical zoom capabilities, and enable me to capture snapshots and audio/video recordings. While facial recognition is too dystopian re: John Conner, the possibilities of a HUD are endless.

    4 votes
  5. CannibalisticApple
    Link
    Years ago when working on a novel concept, one idea I had was art galleries with multiple exhibits in one room. Have empty frames on the walls, and you can cycle through different exhibits to...

    Years ago when working on a novel concept, one idea I had was art galleries with multiple exhibits in one room. Have empty frames on the walls, and you can cycle through different exhibits to change what's displayed. Obviously would work best with photos and digital art rather than traditional paintings.

    Meanwhile in college, my teacher participated in an event with a bit where people could use AR to see digital creatures. He mentioned seeing a kid waving their hand and realized they were trying to pet a creature he'd designed. He actually works with the local hospital to turn sick kids' drawings of fantastical creatures into figurines and toys they can play with.

    So something combining those two, letting kids and sick people experience a taste of fantasy in reality—well, it just makes me really happy to imagine.

    2 votes
  6. Checkmate
    Link
    Everyone's been talking about virtual reality and the metaverse, but I really think augmented reality is the future, and google glass was just way too ahead if its time. Combine this with the...

    Everyone's been talking about virtual reality and the metaverse, but I really think augmented reality is the future, and google glass was just way too ahead if its time.

    Combine this with the power of AI and smart devices, and we're going to have some really cool features.

    Little things, like seeing price totals as you pick groceries off the shelf at.

    Big things like, we have detected that your skin tone has yellowed over time and you might want to get checked for signs of jaundice....or anemia...or unusual mole detected....

    Weird things, like being able to role play kinks with a romantic partner.

    Or imagine being able to gameify your work/school day.

    Or being able to get exposure therapy for anxiety/phobias/etc. in a safe, controlled setting.

    It's going to be a revolution.

    2 votes
  7. moocow1452
    Link
    In relation to VR within a car, I'm surprised that someone hasn't kitbashed their car into the ultimate Forza controller or driver's Ed tool. Feels like it would be something that somebody would...

    In relation to VR within a car, I'm surprised that someone hasn't kitbashed their car into the ultimate Forza controller or driver's Ed tool. Feels like it would be something that somebody would partner with someone on to make that an option on some luxury model EV.

    1 vote