将人们带入AR（二）

作者：禮龍
声明：转发本文，请联系作者授权

Availability 可用性

---

• A12 and later A12处理器及以上
• Indoor environments 室内环境
• Occludes your own hands and feet 遮挡你手脚
• As well as other people 与其他人一样

Recap 扼要重述

---

• Occlusion between people and rendered content 遮挡人与渲染内容
• Supported in RealityKit with ARView RealityKit支持ARView
• Backwards compatible with ARSCNView 向后兼容ARSCNView
• Also enables custom composition through ARMatteGenerator 还可以通过ARMatteGenerator启用自定义合成

How Does This Work? 这是如何运作的？

它是如何工作的?

Motion Capture in AR 动作捕捉

• Tracks movements of people in real-time 实时跟踪人们的活动
• Integrated with ARKit 3 and RealityKit 结合ARKit3和RealityKit
• Powered by machine learning 由机器学习驱动
• Available on A12 and later 适用于A12及更高版本

用例

• Animate characters 动画角色
• Action/Activity recognition 动作/活动识别
• Sports and fitness analysis 运动与体能分析
• Interacting with virtual objects 与虚拟对象交互
• Semantic image analysis 语义图像分析

How to Use It? 如何使用它？

• Motion capture in RealityKit RealiltyKit中的动作捕捉
• Extracting data from skeleton in 3D 从三维骨架中提取数据
• Extracting data from skeleton in 2D 从二维骨架中提取数据

Motion Capture in RealityKit

• Quickly animate characters 快速动画角色
• Simple and easy to use API 简单易用的API
• Add your custom rigged characters 添加自定义装配字符
• Easy to access tracked person 轻松访问被跟踪的人
• Provided via AnchorEntity 通过AnchorEntity提供
• Automatically gathers motion transforms 自动收集运动变换
  

BodyTrackedEntity

• Represents a person 代表一个人
• Contains skeleton and position 包含骨骼和位置
• Updated every frame 更新每一帧
• Applies the skeleton to a .usdz model 应用个骨骼到一个.usdz模型

// Load Rigged Mesh and Tracked Person
Entity.loadBodyTrackedAsync(named: "robot")
	.sink(receiveCompletion : { // For catching failure/error },
		receiveValue: { (character) in
			guard let character = character as? BodyTrackedEntity
			else { return }
	// Get the Location Where You Want to Put Your Character
	let personAnchor = AnchorEntity(.body)
	arView.scene.addAnchor(personAnchor)
	
 	// Add the Character to that Location
 	personAnchor.addChild(character)

3D Skeleton Joints 3D骨骼关节

Extracting Data from Skeleton in 3D 从3D骨骼中提取数据

Accessing Joint Transfom 访问关节变换

ARSkeleton

Extracting Data from Skeleton in 2D 从2D骨骼中提取数据

• Detailed access to 2D skeleton elements 对2D骨架元素的详细访问
• Skeleton joints provided as normalized image coordinates 骨骼关节作为归一化的图像坐标提供
• Easy to use API 易于使用的API
• Can be used for image analysis 可用于图像分析
• Interfaced through ARBody2D 通过ARBody2D连接