Unity(ML-agents) for Imitaion Learning.

思考实践

于 2023-04-05 16:09:34 发布

阅读量463

点赞数 1

文章标签： unity 游戏引擎

本文链接：https://blog.csdn.net/weixin_43332715/article/details/129963590

版权

ML-Agents支持两种学习方式：强化学习(通过奖励学习)和模仿学习(通过模仿玩家行为)。模仿学习包括行为克隆(BC)和生成对抗性模仿学习(GAIL)。BC简单地复制演示行为，而GAIL则试图欺骗判别器使其认为动作来自演示。结合两者及外在奖励，能实现超越人类的表现。文章还提到了TensorBoard的可视化作用。

摘要由CSDN通过智能技术生成

ML-agent supports two types of learning:

1.RL:Learns by getting rewards.

2.Imitation:Learns by imitatating what the player does.

Imitation learning is how you teach your ai directly how to behave in order to achieve a certain goal.

Firstly,set up the scene with some randomness,so that the ai doesn't know how to solve just one specific set of positions,so we randomize

Two types of imitation learning that you can use [GAIL,BC]

BC - Behavior Cloning//行为克隆是最简单的模仿学习。

GAIL-Generative Adversarial Imitation Learning,the goal of the discriminator is to figure out if a certain action came from the agent or from the demo.so essentially over time our agent will learn how to behave like the demo in order to trick the discriminator.

GAIL works by trying to trick a discriminator into pretending that the actions came from the demo,whereas BC simply tries to copy exactly what you did ,the limitation of the BC is that it can never get better than the demos.So in order to get the best results,we need to combine all three.

First use BC ,it learns to act exactly like you,then when combined with GAIL,it learns to act similarily to you while achieving the same goal,and when combined with extrinsic rewards,it continues improving upon those two,that's how we get superhuman learning .