When Artificial Intelligence meets Augmented Reality

In the near future, using artificial intelligence and rendering amazing visual experiences through augmented reality, apps won’t be just part of our lives, they will become our lives — going with us anywhere we go, making us smarter, better, but more dependent on them than ever.

When apps become our eyes, hands, legs — even our brain in one way or another, they will transform into a fully immersive experience. We can see glimpses of these type of experiences with the release of ARKit and the excitement around it. Using AR and AI can create so many opportunities for both app developers and consumers.

What are App 3.0?

Unlike Web 2.0 applications like Medium, Web 3.0 eliminates the middle man. There’s no centralized database that stores the application state, and there’s no centralized web server where the backend logic resides.

Instead, you can leverage blockchain to build apps on a decentralized state machine that’s maintained by anonymous nodes on the internet.

By “state machine,” I mean a machine that maintains some given program state and future states allowed on that machine. Blockchains are state machines that are instantiated with some genesis state and have very strict rules (i.e., consensus) that define how that state can transition.

Better yet, no single entity controls this decentralized state machine — it is collectively maintained by everyone in the network.

And what about a backend server? Instead of how Medium’s backend was controlled, in Web 3.0 you can write smart contracts that define the logic of your applications and deploy them onto the decentralized state machine. This means that every person who wants to build a blockchain application deploys their code on this shared state machine.

And the front end? It pretty much stays the same, with some exceptions, which we will cover later.

Here’s what the architecture looks like:

Who should make app 3.0?


Doctors and nurses are already using their phones and tablets in hospitals to collect data on their patients. Human API already centralizes any medical data you have in one place. Connecting this data with AR features can ease the medical review process and more.Medical App Concept by Clint McManaman

Medical App Concept by Clint McManaman


Some would argue that online shopping isn’t the real reason behind the slowing down of business for malls, but Augmented Reality with AI can definitely change the way we dress. AI-powered apps can be our new stylist — collecting data from multiple sources and choosing the best clothing and style for us based on the taste of the masses. With AR we could easily try these styles with a few taps and purchase it right from within the app.A retail clothing concept by Kinect (2013)

A retail clothing concept by Kinect (2013)


The design space is going to change dramatically from technologies like AI and AR. From Architecture to Interior Design and Fashion to Product Design, everything we know is going to change. Instead of designing in a vacuum, we can finally have a context to the things we create. Moreover, for the first time ever, in some industries, digital merchandise would be equal to a physical one.uMake - a 3D design app for the iPhone and iPad using ARKit

uMake – a 3D design app for the iPhone and iPad using ARKit


The gaming industry has always been at the forefront of adapting new technologies to provide new fun experiences. AI and AR aren’t different. Modern games can understand your environment and can tailor a personalized experience to maximize user engagement and retention.

Hollywood and the film industry

Theaters aren’t going anywhere. That said, new theater experiences are being created. Instead of watching trailers for new movies as we do now, we could get more interactive experiences using AR right in our living room or if we want to go even further, maybe even personalized storylines based on our personal preferences and emotions, using AI (just imagine what Netflix knows about your watching preferences).Wingut AR, the studio started by Lord of the Rings film director Sir Peter Jackson has reveleaed its first Augemented Reality demo with ARKit

Wingut AR, the studio started by Lord of the Rings film director Sir Peter Jackson has reveleaed its first Augemented Reality demo with ARKit


Even the dating scene is going to change, maybe in a good way. Instead of being stuck in front of our 2D screens, at some point when AR glasses become a mass consumer product, we could walk outside and meet real people with the same interests that we have, creating real-life interactions and maybe finding love along the way.SIGHT Sci-Fi movie - a glimpse to the future of the dating scene

SIGHT Sci-Fi movie – a glimpse to the future of the dating scene


Becoming smarter and more knowledgeable about what we bring into our bodies is probably the main obstacle to having a good diet. This could change dramatically with high image recognition apps (well, maybe a bit better than “Not Hot Dog”) that recognize any type of food we will be eating during the day, automatically calculating its nutrition values and giving us recommendations on the spot for what we should or shouldn’t eat.AR Nutritional Value App

AR Nutritional Value App

Final Notes: The Ghost in the App

In his book, ‘The Ghost in the Machine” (1967), Arthur Koestler introduced the idea of “Holons”. Holon has an individual identity at the same time as it is a part of a larger system, it is a subsystem of the larger system.

Think about Apps 3.0 as holons. These apps are two-faced — one acting as an autonomous system using AI (service, tool, etc.) without the need for any intervention from our end. The other one, serving as a part of a higher level, in the form of immersive experiences while creating a cohesive ecosystem in which we’re constantly surrounded every day, all day.

For some of us, many of the things presented in this article could seem like Sci-Fi, but some of these trends are already happening and will grow in the next few years.

The future of apps relies on personalization, a future where the app becomes us in many different ways. We will be dependent on apps more than ever, and it’s not necessarily a bad thing. This could be a great opportunity for app developers and consumers alike.

Let’s talk about you

Get in touch