基于手势识别与情感识别的虚拟宠物设计

孙大佬和赵小弟的人机交互Project

已于 2022-09-25 17:05:00 修改

阅读量587

点赞数

文章标签：宠物 ar

于 2022-09-25 17:00:59 首次发布

本文链接：https://blog.csdn.net/qq_43590780/article/details/127039578

版权

list

introduction
Summary

introduction

In recent years, AR technology has made continuous breakthroughs and AR applications have emerged one after another.We feel that the current AR technology is enough to support us in designing a virtual pet that can interact with users.Traditional virtual pets only exist in PC-side or mobile-side devices, and the interaction mode is monotonous. It is nothing more than generating some specified reactions after the user touches, or making corresponding actions according to the user’s voice input.We felt that such a design is not user friendly enough these days and came up with some ideas accordingly.

What is AR？

Augmented Reality (AR) technology is a technology that skillfully integrates virtual information with the real world. It widely uses multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, sensing and other technical means. After simulating the virtual information generated by computer, such as text, image, 3D model, music, video, etc., it is applied to the real world. The two kinds of information complement each other, So as to realize the “enhancement” of the real world.

Problems in current research：

First, there is a sense of estrangement between virtual pets and users, and with AR technology, virtual pets can appear in the user’s familiar environment (home, office, car, etc.), which can pull the distance between users and virtual pets .

Our Idea:

Our idea is to use the current popular AI technology to add gesture recognition and emotion recognition to the virtual pet, so that the virtual pet can complete the corresponding instructions according to the user’s gesture, or scan the user’s expression to make the same expression. This greatly enriches the user experience.

gesture recognition

emotion recognition

Our Plans:

We plan to use the Unity platform to complete this design, and design a variety of cute virtual pets for users to choose from.
在这里插入图片描述

Users only need to have a device that supports the Unity AR camera to experience this virtual pet. Select a location where the user wants the virtual pet to appear, and upload the photo of the location to the program as a recognition map.
When the program is running, when the location is captured by your camera, a virtual pet will be generated at this location.The place can be a table, floor or a book.