The TV show Star Trek: The Next Generation introduced millions of people to the idea of a holodeck: an immersive, realistic 3D holographic projection of a complete environment that you could interact with and even touch.
In the 21st century, holograms are already being used in a variety of ways such as medical systems, education, art, security and defence. Scientists are still developing ways to use lasers, modern digital processors, and motion-sensing technologies to create several different types of holograms which could change the way we interact.
My colleagues and I working in the University of Glasgow’s bendable electronics and sensing technologies research group have now developed a system of holograms of people using “aerohaptics”, creating feelings of touch with jets of air. Those jets of air deliver a sensation of touch on people’s fingers, hands and wrists.
In time, this could be developed to allow you to meet a virtual avatar of a colleague on the other side of the world and really feel their handshake. It could even be the first steps towards building something like a holodeck.
To create this feeling of touch we use affordable, commercially available parts to pair computer-generated graphics with carefully directed and controlled jets of air.
In some ways, it’s a step beyond the current generation of virtual reality, which usually requires a headset to deliver 3D graphics and smart gloves or handheld controllers to provide haptic feedback, a stimulation that feels like touch. Most of the wearable gadgets-based approaches are limited to controlling the virtual object that is being displayed.
Controlling a virtual object doesn’t give the feeling that you would experience when two people touch. The addition of an artificial touch sensation can deliver the additional dimension without having to wear gloves to feel objects, and so feels much more natural.
Using glass and mirrors
Our research uses graphics that provide the illusion of a 3D virtual image. It’s a modern variation on a 19th-century illusion technique known as Pepper’s Ghost, which thrilled Victorian theatregoers with visions of the supernatural onstage.
The systems uses glass and mirrors to make a two-dimensional image appear to hover in space without the need for any additional equipment. And our haptic feedback is created with nothing but air.
The mirrors making up our system are arranged in a pyramid shape with one open side. Users put their hands through the open side and interact with computer-generated objects which appear to be floating in free space inside the pyramid. The objects are graphics created and controlled by a software programme called Unity Game Engine, which is often used to create 3D objects and worlds in videogames.
Located just below the pyramid is a sensor that tracks the movements of users’ hands and fingers, and a single air nozzle, which directs jets of air towards them to create complex sensations of touch. The overall system is directed by electronic hardware programmed to control nozzle movements. We developed an algorithm which allowed the air nozzle to respond to the movements of users’ hands with appropriate combinations of direction and force.
Analysis: I feel that this article belongs in the arts section even though it equally discusses innovation in technology because it explores using 3D technology, such as holograms to create an artistic, emotional & sensorial experience for users. This technology is allowing for simple art forms, like glass and mirrors, to create the illusion that objects and people are physically in front of us. Its sensors can track human movement and use a mix of air jets to give feeling to a hologram. I question how this artistic technology can be used to account for physical touch in virtual settings. Could it be used to improve virtual experiences for those who desire a more emotional and physical connection with a service or product? It makes me feel hopeful and excited about the future of physical connection for those who might not be able to have it – whether there are proximity issues or physical disabilities involved. What if an older adult who is feeling lonely/isolated could utilize hologram technology to see their loved ones in 3d, or even an employee of a service like banking. Overall, I think hologram technology could be an artistic way to add excitement to virtual experiences.
Citation:
Ravinder Dahiya Professor of Electronics and Nanoengineering. (2023, August 16). We created holograms you can touch – you could soon shake a virtual colleague’s hand. The Conversation. https://theconversation.com/we-created-holograms-you-can-touch-you-could-soon-shake-a-virtual-colleagues-hand-167478
