5 votes

Paper and interactive demo: Immersive Light Field Video with a Layered Mesh Representation

4 comments

  1. [4]
    PetitPrince
    (edited )
    Link
    This is a paper and the associated materials (explanatory video, interactive demo) of a 2020 SIGGRAPH paper around light fields. In particular, they show how to distribute usable (i.e. without a...

    This is a paper and the associated materials (explanatory video, interactive demo) of a 2020 SIGGRAPH paper around light fields. In particular, they show how to distribute usable (i.e. without a monster computer) light field video, which blows my mind.

    For those uninitiated with light fields (and to the limit of my understanding), it supercharges the concept of photography by capturing not only the intensity of light but also the direction. The early application were the lytro camera that let you refocus a picture, which I find gimmicky and not that useful/impressive.

    A more impressive demo was Welcome to Light fields, a Steam demo which made my jaw drop. This presents some sort of "VR photo" in which you can move you head and change the angle of view of the scene (within a sphere of roughly a meter in diameter).

    In this paper, they show the same but with FRAKING VR VIDEO, and without the need to have a beefy gaming rig (the demo works in a browser of my laptop).

    3 votes
    1. [3]
      skybrian
      Link Parent
      Very neat! I'm guessing you meant "distribute" rather than "disable?" Yeah, the Lytro was gimmicky but still fun to play with.

      Very neat! I'm guessing you meant "distribute" rather than "disable?"

      Yeah, the Lytro was gimmicky but still fun to play with.

      1. PetitPrince
        Link Parent
        Thanks for noticing the typo! Sometime SwiftKey is overzealous.

        Thanks for noticing the typo! Sometime SwiftKey is overzealous.

        1 vote
      2. mat
        Link Parent
        Lytro's stills camera sold fairly poorly iirc, but I read somewhere their video camera was doing a little better because video editors often do want to do things like change focus after shooting,...

        Lytro's stills camera sold fairly poorly iirc, but I read somewhere their video camera was doing a little better because video editors often do want to do things like change focus after shooting, or use selective focus in various parts of the frame.

        1 vote