Commit Graph

1415 Commits

Author SHA1 Message Date
Nathaniel Simard a226eabcc8
Refactor/stateless forward node (#4)
* refactor: forward + backward graph

* refactor: always use execute_ops for all ops

* refactor: extract forward and backward nodes

* feat: forward multithread safe

* refactor: backward state

* feat: backward multi-threaded

* feat: remove multi-thread backward
2022-07-25 17:59:25 -04:00
nathaniel f9cbcd4db4 feat: only use gradients struct for getting grad 2022-07-25 11:28:42 -04:00
nathaniel e430a62795 feat: build gradients struct when backward 2022-07-25 11:18:26 -04:00
nathaniel 230cd01ea1 fix: backward order 2022-07-21 07:39:47 -04:00
nathaniel 2f7f65cea5 fix: some autodiff wrong results 2022-07-21 07:07:05 -04:00
Nathaniel Simard 408210f6b6
Refactor/no reference counting on state (#3) 2022-07-20 16:56:26 -04:00
Nathaniel Simard 5e6f0aea75
fix: recorded ops and node creating wrong grad (#2) 2022-07-20 09:57:15 -04:00
Nathaniel Simard 8e80502a05
refactor: create tape only during backprop (#1) 2022-07-19 20:59:32 -04:00
nathaniel 30fadcb4d1 chore: remove old code 2022-07-19 12:50:12 -04:00
nathaniel 2084aced63 feat: implement matmul diff 2022-07-18 21:55:39 -04:00
nathaniel 5ce657ded9 feat: support sub autograd 2022-07-18 20:23:21 -04:00
nathaniel f241a6c114 fix: single recorded ops 2022-07-18 20:03:30 -04:00
nathaniel 6ee628a748 feat: implement TensorBase for ADTensor 2022-07-18 19:31:00 -04:00
nathaniel 902f431fc1 First Commit :D 2022-07-18 19:19:13 -04:00
Nathaniel Simard ebea760c54
Initial commit 2022-07-18 19:11:45 -04:00