One of the standout keynote presentation at  WWD23 event was the Apple Vision Pro, a stand-alone Augmented Reality headset. The device is not like any other AR headset,.  It is a standalone Spacial computer.

The first set of Virtual reality headsets were the Forte VXF1 headsets released in 1995. In 2011 Oculus Rift DK1 created by Palmer Luckey, was launched. The Oculus Rift DK2 was launched in 2014. Ever since, there have been improvements in terms of Resolution, viewing angle, processor, graphic cards, and memory from different companies.

The only VR headset that comes close to Apple Vision Pro 2 in terms of capabilities and features is the Meta Quest 2 released by Metaverse. The Oculus Quest 2 is the most popular headset in the market.

Apple Vision Pro has some great features. The creators were deliberate in the design, hardware, software, and battery. All the above factors play a huge role in determining a price tag. But first things first, what is this Apple Vision Pro?

Apple Vision Pro

Apple Vision Pro is a Spaatial computer that blends your digital content with your physical space while allowing you to experience your surroundings. Using the device makes you feel like the digital content is in front of you.

Unlike a traditional computer, Apple Vision Pro is a stand-alone device. It has no screen, external CPU, and accessories.

How do you control, move and select items? The device has sensors that allow you to control it using your hands, eyes, and voice. We will get into the details later. You can select an app, scroll through a web page or pause a movie without any input device. 

Which features should you expect from Apple Vision Pro?

New Technology

Image Credit: Apple

The Apple Vision Pro has a dual chip that merges the virtual world and your surroundings. The chips allow sufficient energy to be distributed and reduce latency.

The M1 silicon chip has different components: the CPU, GPU, RAM, neutral engine, image processors, encoders, USB controller, and SSD controller. It can operate close to 11 trillion operations per second. On the other hand, the R1 silicon chip can process inputs from sensors, cameras, and microphones and then show the image produced in 12 milliseconds. 

Design

Image Credit: Apple

The Vision Pro enclosure has 3D glass with an aluminum alloy frame that wraps perfectly around your face. The headset has a soft textile light seal in different shapes and sizes. 

The flexible strap ensures the speakers on both sides are close to your ears, while the leather headband is stretchable and breathable for cushioning and comfort. 

Visuals

Image Credit: Apple

Try picturing each eye having its own micro OLED display screen, and each display has more pixels than a 4K tv.  

The screen resolution dictates how many pixels are in a display. Vision Pro has a 3800×3000 monitor that displays 23 million pixels. A 4K Tv has a relatively lower resolution of 3840 x 2160 with close to 8.3 million pixels.

Image Credit: Apple

The display has a refresh rate of 90Hz. However, the refresh rate can go up to 96Hz at 25 fps. The refresh rate is relatively low compared to the Meta Quest 2 with 120 Hz.

Sensors

Cameras

The device has 12 in-built cameras: two forward-facing, two side-facing, and two down-facing. The cameras map out your surroundings. Two true-depth cameras project dots onto your face to create a depth map of your face. The other four cameras are Infrared ones that track your eye movement.

Image Credit: Apple

Lidar Scanner

The Light Detection and Ranging (Lidar) scanner tracks your hand movement and the environment. The sensor can track movements within 5 Meters. The true-depth face ID camera can only work within a few feet. Lidar sensors offer better focus and add or hide virtual objects within your environment.

Infrared cameras

Image Credit: Apple

Apple Vision Pro has IR cameras that work in dark places. They help in building 3D images and tracking eyes for optic authentication. The work of the illuminators is to flash Infrared light on the face as dots for Face ID. Infrared light on the inside helps in tracking eye movements and performing scans.

Apple Vision Pro has a feature called Eyesight which requires Infrared cameras to work. The feature shows your eyes on an outward-facing OLED screen whenever someone approaches you when you are using the headset.

Microphone

The mic uses voice commands to send texts, make calls, or select apps. It performs two functions: voice detection and spatial audio. It helps make the sound feel like it is coming around you.

Battery 

The Vision Pro’s battery life is only two hours. The battery pack has 6,500 mAh. Apple was limited by weight since a larger battery would be heavier. You can use Apple Vision Pro longer when plugged directly into power.

Fans 

The Apple Vision Pro has a thermal cooling system. The Vision Pro demonstration only lasted for 30 minutes. Therefore, overheating after using it for an extended time is a huge concern since the device stays on your face.

Control

You can control the Apple Vision Pro using your voice, hands, and eyes. All you need to do is look at the element you want and simply tap your fingers together to select. Additionally, Vision Pro OS has a virtual keyboard that you can use to add text.

You can double tap, zoom, pinch, and scroll or rotate using both hands. Infrared sensors track your eyes, while the bottom cameras can track your hands to make all this control possible.

Use

Image Credit: Apple

Photos and videos 

Vision Pro has a 3D camera. Additionally, you can view your photos and videos at different sizes since you can scale the view size. The panorama wrap makes you feel you are standing right where you took the photos.

Entertainment 

Imagine watching a movie without holding your phone or Ipad and without a screen and feeling fully immersed in the Movie. You can adjust the screen size to your liking, and the spatial audio feels like a surround sound system.

Work

Image Credit: Apple

Vision Pro allows you to Facetime. What does the person on the other side see since the camera isn’t pointing at your face? They see a digital avatar of your face that tracks your eye and hand movement during your call.  

You can use Vision Pro as the display for your Macbook. All you need to do is wear your headset, look at your Mac’s screen, and you have a new screen. You can place the new screen anywhere within your surrounding. You can use your Mac‘s keyboard to type your work. 

Pricing

The Apple product screams luxury, sophisticated and pricey. It is difficult to pull such a product and still make an affordable device. An Apple Vision Pro headset will be available early next year in the US for $3499.

Why the long wait?

The presentation at the WWD3 introduced the product to the audience while also giving developers a chance to create applications for the Vision OS. A couple of people got some hands-on experience with its use and provided feedback that could be useful before the final product.

My take

I am just as excited as everyone else is about this cutting-edge technology that could change how we consume digital content. I am also looking forward to other tech companies that will create similar products to give Apple a run for their money.