Tag Archives: ARKit

Learn How Google Bests ARKit with Android’s ARCore

Android Development, Augmented Reality, , , , , , , , , , , , , ,

Previously, we covered the strengths of ARKit 4 in our blog Learn How Apple Tightened Their Grip on the AR Market with the Release of ARKit 4. This week, we will explore all that Android’s ARCore has to offer.

All signs point toward continued growth in the Augmented Reality space. As the latest generations of devices are equipped with enhanced hardware and camera features, applications employing AR have seen increasing adoption. While ARCore represents a breakthrough for the Android platform, it is not Google’s first endeavor into building an AR platform.

HISTORY OF GOOGLE AR

In summer 2014, Google launched their first AR platform Project Tango.

Project Tango received consistent updates, but never achieved mass adoption. Tango’s functionality was limited to three devices which could run it, including the Lenovo Phab 2 Pro which ultimately suffered from numerous issues. While it was ahead of its time, it didn’t receive the level of hype ARKit did. In March 2018, Google announced that it will no longer support Project Tango and that the tech titan will be continuing AR Development with ARCore.

ARCORE

ARCore uses three main technologies to integrate virtual content with the world through the camera:

  • Motion tracking
  • Environmental understanding
  • Light estimation

It tracks the position of the device as it moves and gradually builds its own understanding of the real world. As of now, ARCore is available for development on the following devices:

ARCORE VS. ARKIT

ARCore and ARKit have quite a bit in common. They are both compatible with Unity. They both feature a similar level of capability for sensing changes in lighting and accessing motion sensors. When it comes to mapping, ARCore is ahead of ARKit. ARCore has access to a larger dataset which boosts both the speed and quality of mapping achieved through the collection of 3D environmental information. ARKit cannot store as much local condition data and information. ARCore can also support cross-platform development—meaning you can build ARCore applications for iOS devices, while ARKit is exclusively compatible with iOS devices.

The main cons of ARCore in relation to ARKit mainly have to do with their adoption. In 2019, ARKit was on 650 million devices while there were only 400 million ARCore-enabled devices. ARKit yields 4,000+ results on GitHub while ARCore only contains 1,400+. Ultimately, iOS devices are superior to software-driven Android devices—particularly given the TrueDepth Camera—meaning that AR applications will run better on iOS devices regardless of what platform they are on.

OVERALL

It is safe to say that ARCore is the more robust platform for AR development; however, ARKit is the most popular and most widely usable AR platform. We recommend spending time determining the exact level of usability you need, as well as the demographics of your target audience.

For supplementary reading, check out this great rundown of the best ARCore apps of 2021 from Tom’s Guide.

Learn How Apple Tightened Their Hold on the AR Market with the Release of ARKit 4

iOS Development, , , , , , , , , , , , ,

Since the explosive launch of Pokemon Go, AR technologies have vastly improved. Our review of the iPhone 12 concluded that as Apple continues to optimize its hardware, AR will become more prominent in both applications and marketing.

At the 2020 WWDC in June, Apple announced ARKit 4, their latest iteration of the famed augmented reality platform. ARKit 4 features some vast improvements that help Apple tighten their hold on the AR market.

LOCATION ANCHORS

ARKit 4 introduces location anchors, which allow developers to set virtual content in specific geographic coordinates (latitude, longitude, and altitude). When rebuilding the data backend for Apple Maps, Apple collected camera and 3D LiDAR data from city streets across the globe. ARKit downloads the virtual map surrounding your device from the cloud and matches it with the device’s feed to determine your location. The kicker is: all processing happens using machine learning within the device, so your camera feed stays put.

36431-67814-ARKit-xl

Devices with an A12 chip or later, can run Geo-tracking; however, location anchors require Apple to have mapped the area previously. As of now, they are supported in over 50 cities in the U.S. As the availability of compatible devices increases and Apple continues to expand its mapping project, location anchors will find increased usage.

DEPTH API

ARKit’s new Depth API harnesses the LiDAR scanner available on iPad Pro and iPhone 12 devices to introduce advanced scene understanding and enhanced pixel depth information in AR applications. When combined with 3D mesh data derived from Scene Geometry, which creates a 3D matrix of readings of the environment, the Depth API vastly improves virtual object occlusion features. The result is the instant placement of digital objects and seamless blending with their physical surroundings.

FACE TRACKING

1_tm5vrdVDr2DAulgPvDMRow

Face tracking has found an exceptional application in Memojis, which enables fun AR experiences for devices with a TrueDepth camera. ARKit 4 expands support to devices without a camera that has at least an A12. TrueDepth cameras can now leverage ARKit 4 to track up to three faces at once, providing many fun potential applications for Memojis.

VIDEO MATERIALS WITH REALITYKIT

b3b1c224-5db5-4e38-97de-76f90c32b53a

ARKit 4 also brings with it RealityKit, which adds support for applying video textures and materials to AR experiences. For example, developers will be able to place a virtual television on a wall, complete with realistic attributes, including light emission, texture roughness, and even audio. Consequentially, AR developers can develop even more immersive and realistic experiences for their users.

CONCLUSION

iOS and Android are competing for supremacy when it comes to AR development. While the two companies’ goals and research overlap, Apple has a major leg up on Google in its massive base of high-end devices and its ability to imbue them with the necessary structure sensors like TrueDepth and LiDAR.

ARKit has been the biggest AR development platform since it hit the market in 2017. ARKit 4 provides the technical capabilities tools for innovators and creative thinkers to build a new world of virtual integration.

How App Developers Can Leverage the iPhone 12 to Maximize Their Apps

iOS Development, , , , , , , , , , , , , ,

On October 23rd, four brand new iPhone 12 models were released to retailers. As the manufacturer of the most popular smartphone model in the world, whenever Apple delivers a new device its front-page news. Mobile app developers looking to capitalize on new devices must stay abreast of the latest technologies, how they empower applications, and what they signal about where the future of app development is headed.

With that in mind, here is everything app developers need to know about the latest iPhone models.

BIG DEVELOPMENTS FOR AUGMENTED REALITY

LiDAR is a method for measuring distances (ranging) by illuminating the target with laser light and measuring the reflection with a sensor
LiDAR is a method for measuring distances (ranging) by illuminating the target with laser light and measuring the reflection with a sensor

On a camera level, the iPhone 12 includes significant advancements. It is the first phone to record and edit Dolby Vision with HDR. What’s more, Apple has enhanced the iPhone’s LiDAR sensor capabilities with a third telephoto lens.

The opportunities for app developers are significant. For AR developers, this is a breakthrough—enhanced LiDAR on the iPhone 12 means a broad market will have access to enhanced depth perception, enabling smoother AR object placement. The LIDAR sensor produces a 6x increase in autofocus speed in low light settings.

The potential use cases are vast. An enterprise-level application could leverage the enhanced camera to show the inner workings of a complex machine and provide solutions. Dimly lit rooms can now house AR objects, such as Christmas decorations. The iPhone 12 provides a platform for AR developers to count on a growing market of app users to do much more with less light, and scan rooms with more detail.

The iPhone 12’s enhanced LiDAR Scanner will enable iOS app developers to employ Apple’s ARKit 4 to attain enhanced depth information through a brand-new Depth API. ARKit 4 also introduces location anchors, which enable developers to place AR experiences at a specific point in the world in their iPhone and iPad apps.

With iPhone 12, Apple sends a clear message to app developers: AR is on the rise.

ALL IPHONE 12 MODELS SUPPORT 5G

5G 2

The entire iPhone 12 family of devices supports 5G with both sub-6GHz and mmWave networks. When iPhone 12 devices leverage 5G with the Apple A14 bionic chip, it enables them to integrate with IoT devices, and perform on ML algorithms at a much higher level.

5G poses an endless array of possibilities for app developers—from enhanced UX, more accurate GPS, improved video apps, and more. 5G will reduce dependency on hardware as app data is stored in the cloud with faster transfer speeds. In addition, it will enable even more potential innovation for AR applications.

5G represents a new frontier for app developers, IoT, and much more. Major carriers have been rolling out 5G networks over the past few years, but access points remain primarily in major cities. Regardless, 5G will gradually become the norm over the course of the next few years and this will expand the playing field for app developers.

WHAT DOES IT MEAN?

Beyond the bells and whistles, the iPhone 12 sends a very clear message about what app developers can anticipate will have the biggest impact on the future of app development: AR and 5G. Applications employing these technologies will have massive potential to evolve as the iPhone 12 and its successors become the norm and older devices are phased out.

The Future of Indoor GPS Part 5: Inside AR’s Potential to Dominate the Indoor Positioning Space

Android Development, Artificial Intelligence & Machine Learning, iOS Development, , , , , , , , , , , , , , ,

In the previous installment of our blog series on indoor positioning, we explored how RFID Tags are finding traction in the indoor positioning space. This week, we will examine the potential for AR Indoor Positioning to receive mass adoption.

When Pokemon Go accrued 550 million installs and made $470 million in revenues in 2016, AR became a household name technology. The release of ARKit and ARCore significantly enhanced the ability for mobile app developers to create popular AR apps. However, since Pokemon Go’s explosive release, no application has brought AR technology to the forefront of the public conversation.

When it comes to indoor positioning technology, AR has major growth potential. GPS is the most prevalent technology navigation space, but it cannot provide accurate positioning within buildings. GPS can be accurate in large buildings such as airports, but it fails to locate floor number and more specifics. Where GPS fails, AR-based indoor positioning systems can flourish.

HOW DOES IT WORK?

AR indoor navigation consists of three modules: Mapping, Positioning, and Rendering.

via Mobi Dev
via Mobi Dev

Mapping: creates a map of an indoor space to make a route.

Rendering: manages the design of the AR content as displayed to the user.

Positioning: is the most complex module. There’s no accurate way of using the technology available within the device to determine the precise location of users indoors, including the exact floor.

AR-based indoor positioning solves that problem by using Visual Markers, or AR Markers, to establish the users’ position. Visual markers are recognized by Apple’s ARKit, Google’s ARCore, and other AR SDKs.  When the user scans that marker, it can identify exactly where the user is and provide them with a navigation interface. The further the user is from the last visual marker, the less accurate their location information becomes. In order to maintain accuracy, developers recommend placing visual markers every 50 meters.

Whereas beacon-based indoor positioning technologies can become expensive quickly, running $10-20 per beacon with a working range of around 10-100 meters of accuracy, AR visual markers are the more precise and cost-effective solution with an accuracy threshold down to within millimeters.

Via View AR
Via View AR

CHALLENGES

Performance can decline when more markers have been into an AR-based VPS because all markers must be checked to find a match. If the application is set up for a small building where 10-20 markers are required, it is not an issue. If it’s a chain of supermarkets requiring thousands of visual markers across a city, it becomes more challenging.

Luckily, GPS can help determine the building where the user is located, limiting the number of visual markers the application will ping. Innovators in the AR-based indoor positioning space are using hybrid approaches like this to maximize precision and scale of AR positioning technologies.

CONCLUSION

AR-based indoor navigation has had few cases and requires further technical development before it can roll out on a large scale, but all technological evidence indicates that it will be one of the major indoor positioning technologies of the future.

This entry concludes our blog series on Indoor Positioning, we hope you enjoyed and learned from it! In case you missed it, check out our past entries:

The Future of Indoor GPS Part 1: Top Indoor Positioning Technologies

The Future of Indoor GPS Part 2: Bluetooth 5.1′s Angle of Arrival Ups the Ante for BLE Beacons

The Future of Indoor GPS Part 3: The Broadening Appeal of Ultra Wideband

The Future of Indoor GPS Part 4: Read the Room with RFID Tags

The Best New Features of iOS 11

iOS Development, , , , , , , , , , , , , , , , ,

While we thoroughly enjoyed iOS 10’s open functionality and all it offered app developers, Apple’s premiere operating system is due for a refresh. iOS 11 has been making waves in its public beta release, here are the top upgrades coming to Apple’s landmark OS:

MAJOR UPGRADES FOR IPAD

Apple’s iOS 11 preview states right off the bat: “A giant step for iPhone. A monumental leap for iPad.” iOS 11 offers a number of improvements for iPad users.

The improved Dock now looks a lot like the macOS dock. Users can put dozens of apps in the doc and easily pull it up by swiping upward.

Need to use two apps at the same time? iOS has your back. Like Picture-In-Picture Mode for Android, which we detailed last week in our coverage of Android Oreo, iOS 11 allows you to use two apps at the same time—something that will inevitably come in handy on the large screens of the iPad.

Apple Pencil Instant Notes via Redmond Pie

APPLE PENCIL receives a major upgrade in iOS 11. Instant Markup makes it easy to mark up PDFs, screenshots and more. Instant Notes and Inline Drawing let you customize your screen. The Scan and Sign feature also makes it easy to sign important documents online and send them in the flash of an eye.

SIRI MATURES

WIRED recently detailed the path toward improving the voice of iOS: Siri. While Google and Amazon have excelled in their virtual assistant development, Siri seems to have lagged behind. iOS 11 revamps Siri’s voice to sound much more natural, while also teaching her to translate Chinese, Spanish, French, German, or Italian.

GET READY FOR AUGMENTED REALITY!

When Pokemon Go took the world by storm, “Augmented Reality” became a household name. Now, the time has come for app developers rejoice! iOS 11 features ARKit, a new development framework that makes it easy for developers to build incredible AR experiences.

ARKit allows developers to create 2D or 3D elements in the live view from iPhone and iPad camera’s in order to make them appear as if they exist in the real world. ARKit combines device motion tracking, camera scene capture, advanced scene processing, and display conveniences to make building AR experiences a breeze.

Check out some of the best AR experiences built with ARKit so far.

CAMERA TIME

Thanks to a new compression technology, iOS 11 will be able to store video using less space than ever. Additionally, the camera will allow users to loop live videos, to trim and edit live videos, to grab a still from a live photo, and to capture time and movement with long exposure photos.

Apple App Store via BGR

APP STORE REDESIGN

The rigorous standards of Apple’s App Store always lent itself to curation. With that in mind, Apple has redesigned the App Store to emphasize discovery. The new App Store will offer a completely separate tab for Games, a variety of daily stories and a tab for the best apps of the day, all curated by Apple!

FILES, PAYMENT, AND MORE

iOS 11 is a comprehensive upgrade that comes equipped with a host of other great additions, including:

– FILES: Never lose track of important documents again! The Files app makes it easy to find files stored on iOS devices, in iCloud Drive, and even across other cloud services like Box and Dropbox.

– APPLE PAY IN IMESSAGE: iOS 11 will make peer-to-peer payments easy, allowing users to send Apple Pay payments as a part of iMessage.

– CONTROL CENTER: The Control Center has received a complete redesign. The new Control Center will appear all on one page and is customizable, allowing users to personalize the design to the most helpful layout.

TAKEAWAYS

If you are an iPad user, you are truly in for a treat when iOS 11 comes out. If you only use iPhone, iOS 11 still delivers a fresh redesign with improved functionality. iOS 11 is yet another solid entry in Apple’s OS canon.