arcore 图像识别_如何使用ARCore构建增强图像应用程序

arcore 图像识别

by Ayusch Jain

通过Ayusch Jain

如何使用ARCore构建增强图像应用程序 (How to Build an Augmented Images Application with ARCore)

This article was originally posted here.

本文最初发布在这里 。

In this tutorial, you’ll learn how to place 3D models in the real world by setting the anchor as a specific scene instead of a regular plane. ARCore by Google lets you augment 2D images which can be recognized by ARCore to then place 3D models over them.

在本教程中，您将学习如何通过将锚点设置为特定场景而不是规则平面来将3D模型放置在现实世界中。 Google的ARCore可让您扩充可由ARCore识别的2D图像，然后在其上放置3D模型。

You provide some reference images and ARCore tracking determines where those images are physically located in the environment. Augmented Images are already widely used such as in books, newspapers, magazines etc.

您提供一些参考图像， ARCore跟踪确定这些图像在环境中的物理位置。 增强图像已经被广泛使用，例如书籍，报纸，杂志等。

But before you dive deeper into this tutorial, you must check out the following articles as a prerequisite to this one:

但是，在深入学习本教程之前 ，您必须先阅读以下文章，作为这篇文章的先决条件 ：

• What is ARCore by Google?

  什么是Google的ARCore？

• Building an augmented reality app using ARCore.

  使用ARCore构建增强现实应用。

Once you’re done with these two, you’ll have a basic understanding of some terminology in ARCore and Sceneform such as Scene, Anchor, Node, TransformableNode etc.

完成这两个操作后，您将对ARCore和Sceneform中的某些术语有基本了解，例如Scene，Anchor，Node，TransformableNode等。

什么是增强图像？ (What are Augmented Images?)

According to the developer docs, Augmented Images in ARCore let you build AR apps that can respond to 2D images, such as posters or product packaging, in the user’s environment. You provide a set of reference images, and ARCore tracking tells you where those images are physically located in an AR session, once they are detected in the camera view.

根据开发人员文档 ，ARCore中的增强图像可让您构建可在用户环境中响应2D图像(如海报或产品包装)的AR应用。 您提供了一组参考图像，一旦在相机视图中检测到它们，ARCore跟踪就会告诉您这些图像在AR会话中的物理位置。

Basically, using augmented images, you can turn a simple 2D image into an augmented image which can be recognized by your app and be then used to place a 3D model above it.

基本上，使用增强图像，您可以将简单的2D图像转换为可以由您的应用识别的增强图像，然后将其用于在其上方放置3D模型。

当您可能想使用增强图像时 (When you might want to use Augmented Images)

Here are some restrictions which you might want to consider before using Augmented Images:

在使用增强图像之前，您可能需要考虑以下限制：

• Your use case must not involve scanning more than 20 images simultaneously (since ARCore can only track up to 20 images at once).
  您的用例不得涉及同时扫描20张以上的图像(因为ARCore一次最多只能跟踪20张图像)。
• Size of the physical counterpart in the real world must be more than 15cm X 15cm and flat.
  现实世界中对应物理对象的大小必须大于15cm X 15cm且平坦。
• You don’t want to track moving objects. ARCore cannot track moving images, although it can start tracking once the image stops.
  您不想跟踪移动的对象。 尽管图像一旦停止，ARCore便可以开始跟踪，但它无法跟踪运动图像。
• ARCore uses feature points in the reference image and can store feature point information for up to 1000 images.
  ARCore在参考图像中使用特征点，并且最多可以存储1000个图像的特征点信息。

选择一个好的参考图像 (Choosing a good reference image)

Here are some tips to choose a good reference image to improve detectability by ARCore:

以下是一些技巧，这些技巧可以选择一个好的参考图像来提高ARCore的可检测性：

• Augmented Images support PNG, JPEG and JPG formats.
  增强图像支持PNG，JPEG和JPG格式。
• Detection is based on points of high contrast and so both color and black/white images are detected, regardless of whether a color or black/white reference image is used.
  检测基于高对比度的点，因此无论使用彩色还是黑白参考图像，都可以检测到彩色和黑白图像。
• Image’s resolution must be at least 300 X 300 pixels.
  图片分辨率必须至少为300 X 300像素。
• Using high-res images does not mean improved performance.
  使用高分辨率图像并不意味着性能会得到改善。
• Images with repetitive features such as patterns and polka dots m