DAGs are dynamic in PyTorch
An important thing to note is that the graph is recreated from scratch; after each .backward()
call, autograd starts populating a new graph.
This is exactly what allows you to use control flow statements in your model; you can change the shape, size and operations at every iteration if needed.
1、参考: