It doesn't take long to understand why the first true augmented reality glasses aren't for sale. The overall design of the eyewear is the best I have tried, and they make it easy to jump into a variety of augmented-reality experiences, from a game to a virtual art installation. I wouldn't want to look through the displays for a long period of time even if the battery allowed for it, even though the first pair overheated after about 10 minutes, and the displays are so small that I wouldn't want to look through them for a long period of time.
The limitations are aware of by snap. This generation of Spectacles is being treated like a private alpha. Since the glasses were announced in May, the company has given out pairs to hundreds of its creators and made a few notable software updates based on user feedback. Bobby Murphy, the co-founder and chief technology officer of the company, says that it was just about getting the technology out there in the hands of actual people and doing it in a way that would allow them to maximize their learning.
After months of asking for a demo, I was invited to try them out with a group of other journalists at the annual AR creator conference being held virtually this week. I tried a wide range of augmented reality experiences in the glasses, including a zombie chase, a pong game, Solar System projection, and an interactive art piece.
The demoes showed me that there is an ambitious long-term vision for augmented reality. The technical limitations of mainstream AR glasses were highlighted by the hardware.
Noupscale is a file onchorusasset.com.
The design of these augmented reality glasses is similar to past versions. The narrow, sharp-edged frame is similar to the Cybertruck ofTesla, and they come with a sturdy, magnetized case that can be turned into a charging stand.
The flexible sides of the glasses allow them to fit under prescription glasses. The creators of augmented reality can apply for and receive a pair of prescription glasses. They include stereo speakers, onboard wi-fi, and two cameras that can be used for video and detecting surfaces.
The battery lasts for only 30 minutes of use, which was the biggest limitation. Multiple pairs were ready to swap out for me if I needed them.
Noupscale is a file onchorusasset.com.
The augmented reality effects, which are called Lenses, are projected by a pair of dual waveguide displays that sync with a mobile phone. The small size of the displays, which cover roughly half of the physical lens, is the main downside to these Spectacles. The augmented reality effects looked better on a phone screen than they did in glasses, due to the small field of view. The WaveOptics waveguides were rich in color and clarity. The displays have 2,000 nits of brightness, which makes them visible in the sun, but it also makes them less efficient in the battery.
Since the announcement of the Spectacles, it has added some new software improvements. An endurance mode is used to maximize battery life when an augmented reality game is not being used. The lens can be tailored to the location. A feature coming soon called Custom Landmarkers will allow people to put lens on landmarks for others to see.
The new software update lets multiple pairs interact with the same lens when sharing a wi-fi network. One of the games that I tried with the creator of the Snap AR was a game that lets you shoot orbs of energy at your opponent with a capture button on the side of the frame. The system still needs work, since it took a couple of tries to sync our glasses.
Noupscale is a file onchorusasset.com.
I tried to get the Lenses to blow me away. Some people showed me how compelling the glasses will be once the hardware is more advanced. I tried hand tracking with one lens that let me cue different parts of a moving art piece with specific gestures. I think hand tracking is a key way to control the glasses. I placed markers around the backyard and raced through them.
The majority of the Lenses I tried felt like the basic proof of concept that I have seen in other headsets over the years. As the software and future hardware gets better, creators will dream up interesting Lenses for glasses that have been in the wild for less than a year. I have seen a few online concepts that are compelling, including exercise games, utility use cases, and augmented reality food menus.
During my demo, I took a few pictures.
The main interface for the glasses is called the lens carousel. The side of the frame has a touchpad that uses flick gestures to navigate, view recorded footage, and send it to friends without the glasses on. You can use your voice to cue a lens. Eye- tracking and more robust hand tracking are already being explored by Snap.
We fully understand that this is a long time away.
The Spectacles frame has a dedicated button for Scan, which was recently introduced in the mainSnapchat app. I scanned a plant on a table with it and my glasses recommended a few plant-related Lenses to try. It's ability to recognize objects is limited at the moment. Scan could be a staple feature for Spectacles in the years to come if it continues to get better.
The tech powered Lenses is getting more advanced. At this week's Lens Fest, Snap will be announcing a number of new tools for making Lenses smarter, including a library of music from the top music labels and the ability to pull in real-time information from outside partners. A new real-world physics engine and software called World Mesh makes it possible for Lenses to interact more naturally with the world by moving with the laws of gravity, reacting to real surfaces, and understanding the depth of a scene.
The photo was taken for The Verge.
The photo was taken for The Verge.
The photo was taken for The Verge.
The photo was taken for The Verge.
The photo was taken for The Verge.
The photo was taken for The Verge.
The photo was taken for The Verge.
Like Meta, Snap sees augmented reality glasses as the future of computing. Bobby Murphy tells me that they have been interested in and invested in augmented reality for a number of years. This is in stark contrast to how we use technology today.
A distribution system of augmented reality.
Meta and other tech companies have said that consumer-ready augmented reality eyewear isn't coming any time soon. Murphy says battery and display technology are the two key limitations of this being a number of years away.
While the tech to make quality augmented reality glasses a reality is still being developed, Snap is already betting on the future of augmented reality in the mobile phone era. According to Murphy, the main priority now as a company is to really support and empower our partners and our community to be as successful as they can be.
Noupscale is a file onchorusasset.com.
2.5 million Lenses have been made by over twenty thousand lens creators and have been viewed 3.5 trillion times. A made lens has been viewed one billion times. The head of the augmented reality platform partnerships at Snap says that they are building an insane distribution system of augmented reality.
The company is starting to focus on ways to help creators make money, including a new marketplace that lets app developers pay creators directly to use their Lenses. The creator of a Lens can give viewers an in-app gift, which they can redeem for real money. For the first time, a lens can include a link to a website, allowing a creator to link to something like an online store.
What about letting users pay with their credit cards? Murphy says that they have given thought to it. He calls NFTs a fascinating space and a good example of digital assets having a real, tangible value.
Murphy is clear that new updates to the hardware roadmap will keep coming, even though the company doesn't like to talk about it. It is making an effort to get in touch with the creators of augmented reality before it is ready for prime time. There is no guarantee that Snap will be a major player when the tech is ready, but for now it has a head start.
