Apple WWDC 2021: Object Capture comes to the AR kit

Apple unveiled new tools and technologies designed to help developers create more engaging app experiences and make it even easier to build high-quality apps.

Xcode Cloud brings together the multiple tasks and tools required to build, test, and deliver apps using powerful cloud services, enabling individual developers and teams to be more productive and provide great apps to their users.

With In-App Events and Custom Product Pages, the App Store now provides all-new ways for developers to promote their apps and connect with users. Swift takes a massive leap forward with concurrency support built into the language, and augmented reality (AR) technologies make it easier than ever to build immersive content in apps or on the web.

“We’re thrilled to provide our developer community with powerful new tools and technologies to help create even more compelling and higher-quality apps, while engaging with their users in all new ways through the App Store,” said Susan Prescott, Apple’s vice president of Worldwide Developer Relations. “With the robust set of tools included in Xcode Cloud, continuing innovation in the Swift programming language, a wide range of new APIs, and even more ways to reach users — Apple’s platforms have never been stronger.”

Augmented Reality

Apple has the world’s largest augmented reality platform with over 1 billion AR-enabled devices powered by ARKit, a framework that allows developers to easily create AR experiences, and RealityKit, the rendering, animation, audio, and physics engine built from the ground up for AR.

RealityKit 2 introduces Object Capture, a simple and powerful API on macOS Monterey that enables developers — like Wayfair, Etsy, and more — to create high-quality, photo-realistic 3D models of real-world objects in minutes by taking photos shot on iPhone, iPad, or DSLR and transforming them into 3D models optimised for AR. These models can be viewed in AR Quick Look or added to AR scenes in Reality Composer or Xcode, making it easier than ever to build amazing AR apps. Developers like Maxon and Unity are using Object Capture to unlock entirely new ways of creating 3D content within some of the leading 3D content creation apps, such as Cinema 4D and Unity MARS.

With new APIs in RealityKit 2, developers can also create more realistic and complex AR experiences with greater visual, audio, and animation control, including custom render passes and dynamic shaders.

Xcode Cloud

Xcode Cloud is a new continuous integration and delivery cloud service designed specifically for Apple developers. Built into Xcode 13, Xcode Cloud offers a fast and simple way for developers and teams of all sizes to build, test, and deliver high-quality apps even more efficiently. Xcode Cloud can automatically build apps in the cloud to free up developers’ Macs for other tasks. Parallel testing in the cloud means developers can test on a simulated version of every current Apple device, then easily deploy a build of the app for internal testing, or deliver to external beta testers through TestFlight for instant feedback.