Remixed Reality： Manipulating Space and Time in Augmented Reality

https://dl.acm.org/doi/epdf/10.1145/3173574.3173703

What is it about?

• This paper proposes and organizes the possibilities of using Mixed Reality to showcase live 3D reconstruction. It suggests three types of changes: spatial, temporal, and viewpoint.

What is impressive compared to previous research?

• Existing mixed reality technologies can only use the information captured from the camera’s viewpoint. For example, if the camera is not capturing what is behind a wall, it is impossible to manipulate the reality as if there was a hole in the wall.
• Remixed reality, on the other hand, records all spatial and temporal information (within the range that can be captured by Kinect), allowing for unlimited modifications.

What is the key technology or method?

• The technical strength seems to rely on RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-camera Units. Additionally, the method of dividing the information into voxels is interesting.

How was its effectiveness validated?

• This paper does not seem to have conducted any experiments or tests. It is merely a conceptual proposal that has been accepted for presentation at CHI, which is impressive. It demonstrates the depth of the concept that the authors wanted to create.

Are there any discussions? What paper should I read next?

• Towards Understanding Diminished Reality and A Survey of Augmented Reality are both recommended.

• RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-camera Units serves as the basis for the technology, along with Kinect and Microsoft Research.

• The Dark Side of Perceptual Manipulations in Virtual Reality is interesting as it discusses the ethics of techniques like manipulating the speed of time and redirected walking.

• RealityCheck: Blending Virtual Environments with Situated Physical Reality

• GhostAR: A time-space editor for embodied authoring of human-robot collaborative task with augmented reality

• Seamless, bi-directional transitions along the reality-virtuality continuum: A conceptualization and prototype exploration

• Challenges and Design Considerations for Multimodal Asynchronous Collaboration in VR.

• Imitative Collaboration: A mirror-neuron inspired mixed reality collaboration method with remote hands and local replicas

• Distorting space, looping time