Image Credits: Apple

Following a demonstration lasting approximately 30 minutes, during which the key features that are currently available for testing were showcased, my conclusion is that Apple's new Apple Vision Pro represents a significant advancement in both capability and implementation of XR (mixed reality). However, it is important to note that I am not asserting that it fulfills all the promises or represents a completely novel computing paradigm, as Apple aims to achieve once it is officially released. To form a more comprehensive judgment, I will require an extended period of personal experience with the device beyond a guided demonstration.

Having extensively utilized almost every prominent VR headset and AR device since the release of the Oculus DK1 in 2013, including the latest iterations of Quest and Vive headsets, I have explored all the different experiences and attempts to popularize XR. Throughout this journey, I have been amazed and repeatedly impressed by the advancements made by hardware and software developers, as well as the standout applications for these devices, in their persistent pursuit of the elusive "killer app" that can truly captivate a wider audience.

Image Credits: Apple

There have been notable successes in the realm of social interaction, storytelling, and gaming within the XR space, such as Gorilla Tag, VRChat, and Cosmonius. Additionally, I have been deeply moved by first-person experiences created by Sundance filmmakers, which shed light on the human or animal condition.

 

However, none of these achievements possess the distinct advantages that Apple brings to the table with the Apple Vision Pro. With a staggering 5,000 patents filed over the past few years and access to abundant talent and capital, Apple demonstrates an unparalleled level of ambition. Every aspect of this device reflects Apple's unwavering determination, with no compromises made and a relentless focus on engineering excellence.

 

The hardware of the Apple Vision Pro is truly exceptional. Boasting a remarkable 24 million pixels spread across the two panels, it surpasses the visual quality of most headsets that the average consumer has encountered. The optics are superior, the headband is comfortable and easily adjustable, and there is an additional top strap to alleviate weight pressure. While Apple is still refining the options for the light seal (the cloth shroud) that will accompany the device upon its official release, the default one provided a comfortable experience for me. They are also planning to offer light seals of various sizes and shapes to cater to different facial structures. Furthermore, the power connector exhibits a clever design, featuring internal pin-type power linkages and an external twist lock mechanism for secure interconnection.

 

Image Credits: Apple

Additionally, there is a magnetic solution available for certain optical adjustments that individuals with varying vision needs may require. The onboarding process includes an automatic eye-relief calibration, precisely aligning the lenses with the center of your eyes. Gone are the manual adjustment wheels commonly found in other devices.

 
Regarding the physical design, the main frame and glass component appear aesthetically pleasing, but it's worth noting that they are quite substantial in size. Not necessarily heavy, but they do have a noticeable presence.
 
For those familiar with VR experiences, two major obstacles often encountered are motion sickness caused by latency and the sense of isolation that prolonged sessions with a device covering the eyes can create. Apple has directly addressed both of these challenges. The R1 chip, working alongside the M2 chip, boasts a system-wide polling rate of 12ms, resulting in a smooth and seamless experience without any noticeable lag or frame drops. While there was a slight motion blur effect in the passthrough mode, it did not detract from the overall experience. The displayed windows appeared crisp and moved with responsiveness.
 
Naturally, Apple's ability to mitigate these issues is attributed to the inclusion of innovative and original hardware components. Every aspect of this device showcases novel ideas, new technologies, or innovative implementations. However, all these advancements come with a price tag. At $3,500, the Apple Vision Pro falls into the high-end range of expectations, firmly positioning it as a device for power users and early adopters.

 


Image Credits: Apple

 

Apple has successfully addressed several areas where other headsets have struggled:

 1. Eye tracking and gesture control: The accuracy of eye tracking and gesture recognition on the Apple Vision Pro is exceptionally high. Hand gestures can be detected from anywhere around the headset, even if your hands are resting on your lap or on a nearby surface. Unlike other hand-tracking interfaces that require constant hand positioning in front of you, Apple's high-resolution cameras dedicated to the bottom of the device precisely track your hand movements. Additionally, an array for eye tracking ensures that after calibration, nearly everything you look at is accurately highlighted. With a simple tap of your fingers, the device responds seamlessly.

 

2. Passthrough functionality: Real-time passthrough of the surrounding environment in 4K resolution is a significant advantage of the Apple Vision Pro. This feature is particularly important for extended VR or AR sessions, as it alleviates the discomfort that can arise from being unable to see your immediate surroundings for a prolonged period. Moreover, a clever "breakthrough" mechanism automatically displays a person approaching you within your content, providing awareness of their presence. The outward-facing eyes on the device, which change appearance based on your activity, also offer visual cues for those around you, enhancing context.

 

3. High resolution for legible text: Apple's emphasis on the Apple Vision Pro as a comprehensive computing device is justified by its ability to deliver readable text. Previous virtual desktop setups often suffered from blurry views and lenses that made it challenging to read fine text comfortably and for extended periods. However, with the Apple Vision Pro, text appears incredibly crisp and legible, regardless of size or perceived distance within your virtual space.

 

These advancements collectively contribute to Apple's vision of the Apple Vision Pro as a cutting-edge device for immersive computing experiences.

 

 
Image Credits: Apple

 

During my brief experience with the Apple Vision Pro headset, there were several unexpected moments that caught my attention, showcasing the meticulous attention to detail:

 

1. Personas Play: Despite my initial skepticism, Apple managed to create a functional digital avatar based solely on a scan of your face using the Vision Pro headset. The digital representation of yourself, which serves as your avatar in FaceTime calls and other applications, successfully bridges the uncanny valley. While not flawless, the avatar accurately captures skin tension and muscle movement. Machine learning models utilize your facial expressions to interpolate a full range of facial contortions, and my interactions with a live person during a call felt natural and not unsettling. It genuinely worked.

 

2. Display Quality: The crispness of the display is worth reiterating. From detailed textures to demos featuring 3D dinosaurs, the Apple Vision Pro delivers exceptional clarity that surpasses expectations.

 

3. 3D Movies: The Apple Vision Pro excels at showcasing 3D movies, and it seems tailor-made for this format. Watching "Avatar: Way of Water" on this headset would likely impress even James Cameron himself. With the device's capability to display 3D content immediately, a diverse library of shot-on-3D movies will breathe new life into the format. While I didn't have the opportunity to capture 3D content myself, the 3D photos and videos produced directly by the Apple Vision Pro looked outstanding, though I cannot speak to the capturing process itself.

 

4. Seamless and Simple Setup: The setup process is smooth and straightforward, taking just a couple of minutes. Apple's commitment to user-friendly experiences shines through.

 

5. Impressive Interface: The interface and various apps showcased on the Apple Vision Pro are of such high quality that Apple used them directly in their keynote presentation. The interface is visually striking, with vibrant colors and a sense of presence as it interacts with other windows, casts shadows on the ground, and responds to lighting conditions.

 

While I hesitate to make definitive claims about the Apple Vision Pro's ability to fulfill Apple's vision of spatial computing, given the limited time I had with the device and its incomplete state, I must say it is exceptionally well executed. It embodies the ideal XR headset. Now, we eagerly await the developments from both Apple and third-party developers in the coming months, as well as the public's response to this innovation.