作者:禮龍
声明:转发本文,请联系作者授权
Availability 可用性
- A12 and later A12处理器及以上
- Indoor environments 室内环境
- Occludes your own hands and feet 遮挡你手脚
- As well as other people 与其他人一样
Recap 扼要重述
- Occlusion between people and rendered content 遮挡人与渲染内容
- Supported in RealityKit with ARView RealityKit支持ARView
- Backwards compatible with ARSCNView 向后兼容ARSCNView
- Also enables custom composition through ARMatteGenerator 还可以通过ARMatteGenerator启用自定义合成
How Does This Work? 这是如何运作的?
它是如何工作的?
Motion Capture in AR 动作捕捉
- Tracks movements of people in real-time 实时跟踪人们的活动
- Integrated with ARKit 3 and RealityKit 结合ARKit3和RealityKit
- Powered by machine learning 由机器学习驱动
- Available on A12 and later 适用于A12及更高版本
用例
- Animate characters 动画角色
- Action/Activity recognition 动作/活动识别
- Sports and fitness analysis 运动与体能分析
- Interacting with virtual objects 与虚拟对象交互
- Semantic image analysis 语义图像分析
How to Use It? 如何使用它?
- Motion capture in RealityKit RealiltyKit中的动作捕捉
- Extracting data from skeleton in 3D 从三维骨架中提取数据
- Extracting data from skeleton in 2D 从二维骨架中提取数据
Motion Capture in RealityKit
- Quickly animate characters 快速动画角色
- Simple and easy to use API 简单易用的API
- Add your custom rigged characters 添加自定义装配字符
- Easy to access tracked person 轻松访问被跟踪的人
- Provided via AnchorEntity 通过AnchorEntity提供
- Automatically gathers motion transforms 自动收集运动变换
BodyTrackedEntity
- Represents a person 代表一个人
- Contains skeleton and position 包含骨骼和位置
- Updated every frame 更新每一帧
- Applies the skeleton to a .usdz model 应用个骨骼到一个.usdz模型
// Load Rigged Mesh and Tracked Person
Entity.loadBodyTrackedAsync(named: "robot")
.sink(receiveCompletion : { // For catching failure/error },
receiveValue: { (character) in
guard let character = character as? BodyTrackedEntity
else { return }
// Get the Location Where You Want to Put Your Character
let personAnchor = AnchorEntity(.body)
arView.scene.addAnchor(personAnchor)
// Add the Character to that Location
personAnchor.addChild(character)
3D Skeleton Joints 3D骨骼关节
Extracting Data from Skeleton in 3D 从3D骨骼中提取数据
Accessing Joint Transfom 访问关节变换
ARSkeleton
Extracting Data from Skeleton in 2D 从2D骨骼中提取数据
- Detailed access to 2D skeleton elements 对2D骨架元素的详细访问
- Skeleton joints provided as normalized image coordinates 骨骼关节作为归一化的图像坐标提供
- Easy to use API 易于使用的API
- Can be used for image analysis 可用于图像分析
- Interfaced through ARBody2D 通过ARBody2D连接