Published in Heartbeat·Apr 10, 2019Writing a simple Waypoint System in Augmented Reality on iOSHave an object navigate through a set of waypoints that follow the user in this simple implementation. — One of my most frequently requested tutorials has been to have augmented reality objects interact with users in the physical world. Many have asked me for a tutorial on having AR objects follow them around. So in the spirit of those requests, what we’re going to do today is write…Swift10 min read
Published in S23NYC: Engineering·Jan 9, 2019Using Machine Learning and CoreML to control ARKitCombining image classification and augmented reality to create new experiences So far in our AR journey we’ve gone through the basics of putting objects in AR, controlling them via animations, detecting planes and placing items with hit detection and have explored various ways of visualizing algorithms in 3D space. Let’s…Coreml14 min read
Aug 30, 2018How to visualize random distribution algorithms in Swift and ARKitA tree in the forest I was recently working on a prototype where I needed to place a large amount of objects in 3D space. …Swift9 min read
Jul 1, 2018NervousText in AR, 25 years laterThis is going to be a quick post, with some background history. If you want to get right to the code, just scroll down to the 2nd part. The Beginning Almost 25 years ago, when I was a strapping young lad in college, I was put in charge of a small computer…Arkit5 min read
Published in S23NYC: Engineering·Jun 22, 2018ARKit Planes, 3D Text and Hit DetectionIn Part 2 of the series, we built up on our AR scene by providing some interactivity, and getting more familiar with SceneKit. We also looked at the rendering camera, and used it’s position (i.e. the user’s position in the real world) to drive an animation in our sphere object. …I OS10 min read
Jun 6, 2018Stop looking for the AR Holy GrailAs I keep reading more and more articles about the future of AR and the expectations that are being placed on the technology, I am seeing a lot of similarities to the misplaced pressure to be “everything to everyone” that was put on the resurgence of VR. That pressure pushed…Virtual Reality4 min read
Jun 6, 2018The Apple AR TrainYesterday Apple kicked off its annual World Wide Developer’s Conference (WWDC), and the keynote held some big surprises for its ARKit platform. Among other improvements, ARKit 2 will hold the following new functionality: 3D object detection Persistent experiences Shared experiencesApple5 min read
May 22, 2018The Match-up: SceneKit or Unity for ARKit?Last night a coworker of mine, Sonam Dhingra, gave a great talk about some of the basics of ARKit, and touched on some of the more advanced topics like touch handling on 3D objects and blend shapes. Having done AR in production for the past year at Nike (see https://9to5mac.com/2017/06/23/nike-snkrs-ios-app-augmented-reality-exclusive/…Unity11 min read
Published in S23NYC: Engineering·Apr 16, 2018ARKit, SceneKit, and How to Control the WorldIn Part 1 of this series, we went through a workflow where we processed a 3D model, created an AR project in Xcode, started an AR session and put our model in our augmented scene. In this post, we’ll begin putting our model in action, using a variety of SceneKit…I OS8 min read
Published in S23NYC: Engineering·Mar 30, 2018Getting started with ARKit and SceneKitWhile augmented reality has been a technology that has been around for many years, and increasing in accuracy for target-based experiences, the popularity of games such as Pokémon GO and the release of ARKit by Apple and AR Core by Google for Android have now brought AR to the hands…I OS11 min read