KAGAMI - Ryuichi Sakamoto's Mixed Reality Concert

@designboom: . @ryuichisakamoto’s mixed-reality piano performance KAGAMI opens at @TheShedNY in New York https://t.co/IRtN1GBR5M

“Mixed Reality Concert” held at The Shed NY

• When you enter the circular room, there is an empty stage in the center.
• Equipped with MR headsets, the concert begins.
  • The figure of Ryuichi Sakamoto playing the piano appears in the center.
• Realism
  • The coat sways and the light reflects in sync with body movements.
  • It is not just an avatar captured and reproduced with animation, but a true-to-life 3D capture of “reality”.
  • I wonder if this involves some kind of volumetric video processing done frame by frame, like photogrammetry.
    • Volumetric Video
  • I have experienced VR and HoloLens to some extent, but I was still moved and amazed.
    • It was my first time experiencing such a detailed 3D image in three dimensions, and it was truly impressive.
• The experience of standing and walking around
  • This was really great (blu3mo)(blu3mo)
  • At first, I sat on a chair and watched Ryuichi Sakamoto on the stage.
  • Then, I was told that I could freely walk around.
    • I walked to a stage a little further away, stood wherever I liked, and watched the performance up close.
• The experience of sharing “Reality” with other real people
  • This is also important (blu3mo)
  • I think something similar could have been done in the form of “participating from home in VR”, but there were experiences that couldn’t be obtained that way.
    • The experience of sharing the reality/fact that “Ryuichi Sakamoto is/is present there” with other physical human beings who are present in the same space
      • Since everyone can see the piano and Ryuichi Sakamoto, no one walks into the piano.
    • Experiences like the “sense of anticipation when going to a concert by train” or “meeting up with friends and going to a concert together”
    • Sense of Time Sharing
  • (edanoshin)
    • I remembered Bluemo-kun’s talk about the power of belief when I went to see this.
      • [Believability](blu3mo)
    • I felt that Ryuichi Sakamoto was able to feel more alive because we shared the assumption that he is a deceased person. I don’t believe in supernatural creatures, but I believe in the resonance with the deceased, like visiting a grave, which is a common understanding.

@TheShedNY: Here’s a look at the collaborative process behind the mixed reality concert, KAGAMI. Shown here are Ryuichi Sakamoto, director Todd Eckert, and the Rhizomatiks Tokyo Capture team from the final day of dimensional photography. KAGAMI begins today! Tickets available. Link in bio.

They used Magic Leap (blu3mo)

• @magicleap: So exciting to see our tech being used to power unique artistic experiences. With KAGAMI, @TinDrumIO and Ryuichi Sakamoto have created a one-of-a-kind concert that fuses music, art, and the real world together, creating something truly special.#ar

• https://t.co/9gt3EeWI9i

  • The fan noise was a bit distracting at first, but I gradually stopped noticing it.