arkit获取人脸深度图_AR Foundation对ARKit 4深度的支持

arkit获取人脸深度图

The new Apple iPad Pro comes equipped with a LiDAR scanner that provides enhanced scene understanding and real-world depth information to bring a new level of realism to augmented reality (AR) experiences. We have expanded AR Foundation to add these new features from ARKit 3.5 and ARKit 4 that incorporate this new depth data and scene geometry.

全新的Apple iPad Pro配备了LiDAR扫描仪，可提供增强的场景理解能力和真实世界的深度信息，为增强现实(AR)体验带来新的现实感。 我们扩展了AR Foundation，以添加来自ARKit 3.5和ARKit 4的这些新功能，这些功能合并了这些新的深度数据和场景几何。

AR Foundation now includes the following new features:

现在，AR Foundation包括以下新功能：

自动环境遮挡 (Automatic environment occlusion)

The iPad Pro running ARKit 4 produces a depth image for each frame. Each pixel in the depth image specifies the scanned distance between the device and a real-world object.

运行ARKit 4 的iPad Pro会为每个帧生成一个深度图像。 深度图像中的每个像素都指定了设备与现实对象之间的扫描距离。

AR Foundation 4.1 includes an AR Occlusion Manager that incorporates this depth information when rendering the background. When the camera background is rendered, the background renderer updates the depth buffer based on data from the scanned depth image. When virtual content is closer to the camera than real-world content, the virtual objects occlude the real world as the virtual scene is rendered. Likewise, when the virtual content is farther away, behind real-world objects, the virtual content will not be rendered to these pixels; the physical objects hide the virtual content.

AR Foundation 4.1包括一个AR遮挡管理器，在渲染背景时会合并该深度信息。 渲染相机背景时，背景渲染器会根据扫描的深度图像中的数据更新深度缓冲区。 当虚拟内容比真实世界的内容更接近相机时，虚拟对象将在渲染虚拟场景时遮挡真实世界。 同样，当虚拟内容距离更远时，在真实对象之后，虚拟内容将不会渲染到这些像素； 物理对象隐藏了虚拟内容。

This video demonstrates how automatic environment occlusion presents an improved visual integration of virtual and real-world content.

该视频演示了自动环境遮挡如何呈现虚拟和现实内容的改进视觉集成。

演示地址

深度图像 (Depth images)

Developers can also obtain raw data for additional CPU-based processing. AR Foundation 4.1 provides direct access to the pixel data comprising the depth image, which can be used for custom application behavior or input into computer vision algorithms.

开发人员还可以获取原始数据，以进行其他基于CPU的处理。 AR Foundation 4.1提供对包含深度图像的像素数据的直接访问，可用于自定义应用程序行为或输入到计算机视觉算法中。

Side-by-side with the color image (left) and depth image (right)

与彩色图像(左)和深度图像(右)并排

场景重建 (Scene reconstruction)

Using the LiDAR sensor in Apple’s new iPad Pros, ARKit scene reconstruction scans the environment to create mesh geometry representing the real-world environment. Additionally, ARKit provides an optional classification of each triangle in the scanned mesh. The per-triangle classification identifies the type of surface corresponding to the triangle’s location in the real world.

通过使用Apple新款iPad Pro中的LiDAR传感器，ARKit场景重建可以扫描环境，以创建代表真实环境的网格几何。 另外，ARKit提供了扫描网格中每个三角形的可选分类。 每个三角形的分类标识与三角形在现实世界中的位置相对应的表面类型。

Introduced with ARKit 3.5 and AR Foundation 4.0, scene reconstruction operates through the ARMeshManager. As the environment is scanned, the ARMeshManager constructs mesh geometry in the virtual scene. This mesh geometry can be used in several ways, including providing collision geometry for physics.

在ARKit 3.5和AR Foundation 4.0中引入了场景重建功能，它通过ARMeshManager进行操作。 扫描环境时，ARMeshManager在虚拟场景中构造网格几何。 可以以多种方式使用此网格几何体，包括提供物理碰撞几何体。

This video demonstrates both the mesh classification feature (the different colors represent different classified surface types) and the mesh used as collision geometry for physical interaction with virtual content.

该视频演示了网格分类功能(不同的颜色代表不同的分类表面类型)以及用作与虚拟内容进行物理交互的碰撞几何体的网格。

演示地址

在AR Foundation中尝试所有这些功能 (Try all of these features in AR Foundation)

The 4.1 versions of the AR Foundation and ARKit XR Plugin packages contain everything you need to get started and are compatible with Unity 2019 LTS and later. A sample demonstrating how to set up automatic occlusion is located in AR Foundation Samples on GitHub.

AR Foundation和ARKit XR插件包的4.1版本包含入门所需的一切，并且与Unity 2019 LTS及更高版本兼容。 GitHub上的AR Foundation Samples中提供了一个演示如何设置自动遮挡的示例 。

As always, feel free to reach out to us on the Unity Handheld AR forums if you have any questions.

与往常一样，如果您有任何疑问，请随时在Unity Handheld AR论坛上与我们联系。

We’re thrilled to bring you these latest features of ARKit via AR Foundation, and we can’t wait to see what you make next!

我们很高兴通过AR Foundation为您带来ARKit的这些最新功能，我们迫不及待地想看到您的下一步成就！

Learn how to get started.

了解如何开始 。

翻译自: https://blogs.unity3d.com/2020/06/24/ar-foundation-support-for-arkit-4-depth/

arkit获取人脸深度图