Pytorch Broadcast自动扩展

Pytorch Broadcast自动扩展

Broadcasting 1. Expand 2. withour copying data

1. for catual demanding
[class, students, scores]
Add bias for every students: +5 score
[4, 32, 8] + [4, 32, 8]
[4, 32, 8] + [5.0]
2. memory consumption
[4, 32, 8] => 1024
[5.0] => 1

Is it broadcasting-able?
. if current dim=1, expand to same
. if either has no dim, insert one dim and expand to same
. otherwise, NOT broadcasting-able

.Match from Last dim!
  . if current dim =1, expand to same
  . if either has no dim, insert one dim and expand to same
  . otherwise, NOT broadcasting-able