We’re in the midst of the “fourth wave” of artificial intelligence (AI), an era in which AI is able to sense and respond to the world around it, interacting in a productive way with people and many types of hardware and software. Thanks to deep learning advancements, AI applications can outperform humans when executing various tasks, and generative AI has shown us technology can help rapidly synthesize information, comb vast data sets, and generate new ideas. 

At present, the awesome power of generative AI is being used primarily to mimic human thought, writing, and art, but its true potential may lie in its ability to boost another emerging technology: augmented reality (AR). AR combines the real world with a digital wrapper through text, images, and audio that can be overlaid onto reality, and it’s also seeing rapid advancements. Combining AI and AR technologies is the next step in advancing human connection, collaboration, and understanding.

Enhancing Communication

AI, when used in harmony with AR, can empower people to communicate in ways that were previously impossible. The latest AR hardware can listen in on conversation and, thanks to the speed at which many machine learning algorithms can process data, spoken words can be translated into other languages in near real time. 

This empowers conversation partners who don’t speak the same language to effortlessly relay information, make plans, discuss business, or even just have a casual chat. The translated dialogue can be relayed as audio or presented as captions overlaid onto the real world, similar to closed captioning. 

Machine learning models can crunch an incredible amount of data very rapidly. The frameworks for how these models can be assigned tasks are evolving rapidly, and we can already leverage it to enhance our day-to-day communications with colleagues and clients. In the world of business, this is a massive advantage.

For example, existing tools allow coworkers in different countries or regions, who speak different languages, to communicate without a translator, enabling more on-the-fly collaboration when necessary. When combined with augmented reality, this integration gives new meaning to the term telepresence, as remote colleagues can simulate in-person meetings using three-dimensional lifelike avatars that appear in their field of view. 

With augmented reality, teams who benefit from active collaboration can offer their input on a virtual whiteboard that is accessible to all and easily interacted with. These types of tools promote visual learning and understanding and can help nudge team members who are typically quiet to jump in with their own ideas, even when they’d be reluctant to do so in a physical meeting space. And, with the power of artificial intelligence, anything written in this virtual space can be transcribed and translated if needed. 

In a world where remote work is the new norm, this technology can be a game-changer for organizations who value a healthy culture, whether it’s a business or educational institution.

Open to All

This same technology is also a boon for accessibility, allowing individuals who struggle to communicate or who are visiting a foreign country. Live translation apps have existed for some time, but by integrating these tools with augmented reality, individuals can more seamlessly converse. This is also true for individuals who require hearing accommodations, as an AR overlay of spoken dialogue can be faster and easier to read than the alternatives.

In the education realm, augmented reality provides teachers with the power to create visuals that capture the attention of students. As generative AI continues to evolve, the power to conjure 3D representations of scientific processes, anatomical models, and simulations grows. With AI tools already capable of rendering lifelike photos and art in seconds, it’s easy to see how the combination of AI and AR could turn a typically boring science lecture into a feast for the eyes. 

In entertainment, animators and video game developers can create whole worlds, storylines, and characters by simply saying aloud what they want to see. They can then tweak the results to be exactly what they are envisioning, staying true to their vision while streamlining development. The possibilities of how bringing AR to sit on top of the real world are infinite.

Cultivating Understanding

How many times have you been in a meeting where you’ve had to ask, “Can you see my screen?” By wearing AR glasses, you can share the same presentation to everyone at the same time, ensuring everyone is on the same page, engaged, and following along word for word.

This can also help users get oriented in more tangible ways outside of workplace or education settings. Attending a music festival or concert venue will be much less stressful when your desired destination – be it a band playing at a specific stage or even the restroom – is overlaid onto your field of view. 

When traveling in an unfamiliar city, finding your hotel, restaurant, or friends is as easy as following the directions you see before your eyes. AI can enhance these experiences by effortlessly adjusting the directions based on real-time traffic or event data, or highlight points of interest that you happen to glance at. For tourists, an AI tour guide can follow you along as you explore new areas, offering guidance and answering questions. 

Generative AI, coupled with AR hardware, can accelerate the creation of 3D assets, promote healthy communication, and foster a greater understanding of the world. As this technology continues to evolve, the opportunities to use it to bring people closer together across traditional barriers like language or location will grow. There’s never been a better time to marry these two technologies and explore where that union leads.