Holograms to the Rescue

By Kim Bellard, May 26, 2021

Google is getting much (deserved) publicity for its Project Starline, announced at last week’s I/O conference. Project Starline is a new 3D video chat capability that promises to make your Zoom experience seem even more tedious. That’s great, but I’m expecting much more from holograms — or even better technologies. Fortunately, there are several such candidates.

For anyone who has been excited about advances in telehealth, you haven’t seen anything yet.

If you missed Google’s announcement, Project Starline was described thusly:

Imagine looking through a sort of magic window, and through that window, you see another person, life-size and in three dimensions. You can talk naturally, gesture and make eye contact.

Google says: “We believe this is where person-to-person communication technology can and should go,” because: “The effect is the feeling of a person sitting just across from you, like they are right there.”

Sounds pretty cool. The thing, though, is that you’re still looking at the images through a screen. Google can call it a “magic window” if it wants, but there’s still a screen between you and what you’re seeing.

Not so with Optical Trap Displays (OTDs). These were pioneered by the BYU holography research group three years ago, and, in their latest advance, they’ve created — what else? — floating lightsabers that emit actual beams:

Optical trap displays are not, strictly speaking, holograms. They use a laser beam to trap a particle in the air and then push it around, leaving a luminated, floating path. As the researchers describe it, it’s like “a 3D printer for light.”

Indeed, their paper in Nature speculates: “This result leads us to contemplate the possibility of immersive OTD environments that not only include real images capable of wrapping around physical objects (or the user themselves), but that also provide simulated virtual windows into expansive exterior spaces.”

I don’t know what all of that means, but it sounds awfully impressive.

The BYU researchers believe: “Unlike OTDs, holograms are extremely computationally intensive and their computational complexity scales rapidly with display size. Neither is true for OTD displays.” They need to meet Liang Shi, a Ph.D. student at MIT who is leading a team developing “tensor holography.”

Before anyone with mathemaphobia freaks out about the “tensor,” let’s just say that it is a way to produce holograms almost instantly.

Joel Kollin, a Microsoft researcher who was not involved in the research, told MIT News that the research “shows that true 3D holographic displays are practical with only moderate computational requirements.”

All of the efforts are already thinking about healthcare. Google is currently testing Project Starline in a few of its offices, but is betting big on its future It has explicitly picked healthcare as one of the first industries it is working with, aiming for trial demos later this year.

The BYU researchers see medicine as a good use for OTDs, helping doctors plan complicated surgeries: “a high-resolution MRI with an optical-trap display could show, in three dimensions, the specific issues they are likely to encounter. Like a real-life game of Operation, surgical teams will be able to plan how to navigate delicate aspects of their upcoming procedures.”

The MIT researchers believe the approach offers much promise for VR, volumetric 3D printing, microscopy, visualization of medical data, and the design of surfaces with unique optical properties.

2020 was, in essence, a coming out party for video conferencing in general and for telehealth in particular. The capabilities had been around, but it wasn’t until we were locked down and reluctant to be around others that we started to experience its possibilities. Still, though, we should be thinking of it as version 1.0.

Versions 2.0 and beyond are going to be more realistic, more interactive, and less constrained by screens. They might be holograms, tensor holograms, optical trap displays, or other technologies I’ve not aware of. I just hope it doesn’t take another pandemic for us to realize their potential.

This post is an abridged version of the original posting in Medium. Please follow Kim on Medium and on Twitter (@kimbbellard)