Mastering ARKit

Embark on a journey to build an augmented reality world. This book puts theory into practical application by building unique augmented reality apps specific to each chapter’s topic.

You’ll learn to engineer successful, well-designed, and comprehensive augmented reality applications for iOS devices. This updated edition has been thoroughly revised to cover the latest advancements in iOS 17 and Xcode 15, equipping you with the knowledge and tools to build cutting-edge augmented reality experiences. Starting with the foundation of augmented reality on Apple platforms, you will understand the building blocks and inner workings of the technologies that power augmented reality. Then, delve into the practicalities of building AR apps using ARKit, SceneKit, SpriteKit, RealityKit, and integrating with SwiftUI and advanced features like ReplayKit for recording experiences.

Explore augmented reality app business models, designs, and content for the ultimate user experience. This book covers a wide range of ARKit APIs and topics, including surface detection, 3D objects implementation, horizontal plane detection with raycast, physics by launching rocket ships, light estimation, 2D image recognition, world-mapping data for persistence, immersive audio experiences, real-time image analysis, machine learning, face and body motion capture, people occlusion, and more. Chapter by chapter, this book guides you to become an advanced augmented reality engineer for Apple’s platforms.

By the end of the book, you’ll have acquired the necessary mental models and tools to engineer delightful experiences in Apple’s augmented reality ecosystem.

What You’ll Learn

• Construct AR apps using SceneKit, SpriteKit, RealityKit, and integrate with SwiftUI.
• Leverage ARKit for advanced features like face and body motion capture, people occlusion, and world tracking.
• Incorporate 3D objects, surface detection, computer vision, and body motion capture in your apps.
• Implement persistence in AR experiences and create shared experiences using Multipeer Connectivity.

Who This Book Is For

iOS developers who want to expand their knowledge of ARKit. Ideal for those with a solid foundation in Swift and familiarity with Xcode, seeking to explore the expansive capabilities of augmented reality on Apple devices.

Table of Contents

Chapter 1: Why Augmented Reality

Chapter 2: ARKit: Under the Hood

Chapter 3: Designing and Prototyping an Augmented Reality Experience

Chapter 4: Building Your First ARKit App with Scene Kit

Chapter 5: Understanding and Implementing 3D Objects

Chapter 6: Detecting Horizontal Planes and Adding 30 Objects with Raycast in SceneKit

Chapter 7: Understanding Physics by launching a Rocket Ship

Chapter 8: light Estimation and Environment Texturing

Chapter 9: 20 Image Recognition and Filter Modification

Chapter 10: Saving and Restoring World Mapping Data to Create a Persistent AR Experience

Chapter 11: Creating lmmersive Audio Experiences

Chapter 12: Working with SpriteKit and ARKit

Chapter 13: Advancing App with Real-Time Image Analysis, Machine learning, and Vision

Chapter 14: Crafting Your Digital Universe with 30 Assets

Chapter 15: Building Shared Experiences with Multipeer Connectivity

Chapter 16: Face Tracking

Chapter 17: Simultaneously Integrate Face Tracking and World Tracking

Chapter 18: Body Motion Capture

Chapter 19: People Occlusion

Chapter 20: Working with SwiftUI and ARKit

Chapter 21: Record Augmented Reality Experiences with ReplayKit

About the Author

Jayven Nhan has worked with the biggest international and national enterprises in health care, financial banking, and entertainment streaming industries. He has published books and over 30 App Store apps. Jayven is an Apple scholar who contributes his best work to passion, fitness training, and nutrition. Passion makes problem-solving an enjoyment. Outside of coding, you may find him listening to audiobooks and podcasts, reading, or learning from YouTube videos.