UIST XR and AI Workshop §
Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models §
- Watch the video here
- Allows communication with Large Language Models in a non-linear way.
- It seems very interesting, but specific use cases are not clear yet, so I want to use it to explore further.
Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language Models §
- Watch the video here
- Probably a UI to interact with Large Language Models as objects with input and output.
- I haven’t heard the presentation, so I will read about it later.
Generative Agents: Interactive Simulacra of Human Behavior §
Mirrorverse: Live Tailoring of Video Conferencing Interfaces §
- Watch the video here
- Allows free editing of “Zoom screens” which can be shared in a spatial.io-like manner.
- I like the demo where a Yoga Class Zoom recording is fitted into frames in real-time.
UIST2023 Vision Talk - The Ultimate Interface §
UIST2023 Vision Talk - AGI is Coming §
RealityCanvas: Augmented Reality Sketching for Embedded and Responsive Scribble Animation Effects §
- Watch the video here
- This feels like something that could be expanded into 3D/VR.
- Gives a feeling of Doraemon’s secret gadgets.
- Drawings come to life on their own.
HoloBots: Augmenting Holographic Telepresence with Mobile Robots for Tangible Remote Collaboration in Mixed Reality §
- Watch the video here
- By combining tangible interaction and holographic visual information, it can recreate a co-located experience.
- After realizing what is achievable, it might be worth reconsidering how essential tangible interaction really is.
- I believe there is value in haptic feedback.
- However, it is important to evaluate the necessity of tangible interaction beyond the movement of Virtual Objects or toio robots.