edc683bc4b
Update module.md ( #1557 )
2024-03-29 13:14:01 -04:00
edcd92f13d
Refactor execute_dynamic with Execution struct ( #1550 )
2024-03-28 17:27:48 -04:00
efc3b2d243
[Breaking] add runtime options in wgpu init methods ( #1505 )
2024-03-28 12:44:38 -04:00
32a8d8041c
Tweak/add kind to gelu benchmark name ( #1533 )
...
* Add kind to gelu benchmark name
* [backend-comparison] Compute column size in benchmarks report
2024-03-28 12:35:15 -04:00
279be0496a
Conv Transpose: migration + decent speedup ( #1541 )
...
* convtranspose benchmark
* adjust bench
* conv transpose works
* Conv Transpose: migration + decent speedup
* delete template folder
* typos
* fix
2024-03-28 12:13:06 -04:00
b8fc3f141e
Numerically stable log_sigmoid ( #1548 )
2024-03-28 11:54:23 -04:00
70b92cb2fb
Update SUPPORTED-ONNX-OPS.md ( #1547 )
2024-03-28 10:38:53 -05:00
3a1d52067f
[backend-comparison] Fix automatic fusion activation with wgpu ( #1542 )
2024-03-27 17:40:12 -04:00
5f7fd5952a
remove exit ( #1543 )
2024-03-27 16:36:59 -05:00
9f9b52c728
[CI] Switch codecov to informational mode ( #1540 )
2024-03-27 15:19:06 -04:00
c21d5a3207
Add LeakyReLu implementation ( #1208 )
...
* Implement LeakyReLu
* Cargo fmt
* Apply suggestions
* cargo fmt
* Use float_mul_scalar
* Should be grad
* Add to books module
* Move test files
* Update leaky relu to use activation function
* Update tensor.md
* Fix failing test due to approx
* Add back the function comment
* Fix comment per PR feedback
---------
Co-authored-by: Dilshod Tadjibaev <939125+antimora@users.noreply.github.com>
2024-03-27 13:57:51 -05:00
626457e1c6
Provide Tensor Padding Helpers #960 ( #1097 )
...
* Initial padding approach
Create padding implementation for the last two dimensions of Float and Int Tensors.
Create PadMode Enum, allowing Constant padding.
Create Padding Struct with Uniform, Asymmetric, height, and width implementations.
Create tests for the padding implementation.
* Update padding.rs
remove unneeded import
* Update from Merge
Use crate Element
Swap from old from_data() to new from_data_devauto()
* Formatting Changes
Formatting changes from cargo fmt --all
* Additional Format Change
One more format change that cargo fmt didn't get the first time.
* Changes to Example
Modify Example to ensure it works.
* modify naming
better names for impl / input variables.
* Modify API
- Change Padding to PadSize.
- integrate padding value into PadMode.
- update tests and examples.
* Comments and print
Improve comments+naming and remove println
* Pad Fixes
Moved pad to numeric
Simplified PadMode Element
updated tensor creations
fixed doc example
* Fix test location
* Simplified pad API
* Fix for failed unit tests
* Remove bool_full
* Rename `pads` to `padding`
---------
Co-authored-by: Dilshod Tadjibaev <939125+antimora@users.noreply.github.com>
2024-03-27 12:46:55 -05:00
f6f6b5c0fa
Bump uuid from 1.7.0 to 1.8.0 ( #1514 )
...
Bumps [uuid](https://github.com/uuid-rs/uuid ) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/uuid-rs/uuid/releases )
- [Commits](https://github.com/uuid-rs/uuid/compare/1.7.0...1.8.0 )
---
updated-dependencies:
- dependency-name: uuid
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dilshod Tadjibaev <939125+antimora@users.noreply.github.com>
2024-03-27 12:42:06 -05:00
40a26bd2ea
Feat/backend bridge ( #1529 )
2024-03-26 19:24:45 -04:00
28233d9f59
[backend-comparison] Add Operating System information ( #1531 )
...
* [backend-comparison] Add Operating System information
* [backend-comparison] Simplify serialization of os info
2024-03-26 15:58:38 -04:00
5bac300688
Migrate/jit/interpolate ( #1528 )
...
* separate forward backward
* refactor with pool strategy
* refactor further
* pooling refactored
* refactoring for adaptive wip
* wip adaptive
* adaptive
* delete some wgsl
* avg pool backward
* clippy
* refactor interpolate files
* nearest shader
* nearest
* some boilerplate
* wip
* bilinear
* nearest backward
* cubic
* cleanup
* minor refactor
* add some white space
2024-03-26 08:57:26 -04:00
37b61ea646
Migrate/jit/adaptive avg pool backward ( #1530 )
...
* separate forward backward
* refactor with pool strategy
* refactor further
* pooling refactored
* refactoring for adaptive wip
* wip adaptive
* adaptive
* delete some wgsl
* avg pool backward
* clippy
* minor refactor
* works
* delete wgsl
2024-03-26 08:38:06 -04:00
a77979e0b6
add rms norm layer ( #1527 )
2024-03-25 18:59:11 -04:00
ea7263859a
Bump regex from 1.10.3 to 1.10.4 ( #1513 )
...
Bumps [regex](https://github.com/rust-lang/regex ) from 1.10.3 to 1.10.4.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.10.3...1.10.4 )
---
updated-dependencies:
- dependency-name: regex
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-25 16:53:35 -04:00
da5b0438ec
Migrate/jit/pooling ( #1509 )
...
* separate forward backward
* refactor with pool strategy
* refactor further
* pooling refactored
* refactoring for adaptive wip
* wip adaptive
* adaptive
* delete some wgsl
* avg pool backward
* clippy
* minor refactor
2024-03-25 16:04:58 -04:00
613e698007
Feat/swiglu ( #1507 )
2024-03-25 15:55:27 -04:00
4542ceddca
Migrate/jit/conv2d ( #1493 )
...
* conv2d but bug
* convolution done
* minor clean
* delete wgsl
2024-03-25 10:45:40 -04:00
8d378848c9
Combined PRs ( #1516 )
...
* Bump thiserror from 1.0.57 to 1.0.58
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.57 to 1.0.58.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.57...1.0.58 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump syn from 2.0.50 to 2.0.55
Bumps [syn](https://github.com/dtolnay/syn ) from 2.0.50 to 2.0.55.
- [Release notes](https://github.com/dtolnay/syn/releases )
- [Commits](https://github.com/dtolnay/syn/compare/2.0.50...2.0.55 )
---
updated-dependencies:
- dependency-name: syn
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump rayon from 1.9.0 to 1.10.0
Bumps [rayon](https://github.com/rayon-rs/rayon ) from 1.9.0 to 1.10.0.
- [Changelog](https://github.com/rayon-rs/rayon/blob/main/RELEASES.md )
- [Commits](https://github.com/rayon-rs/rayon/compare/rayon-core-v1.9.0...rayon-core-v1.10.0 )
---
updated-dependencies:
- dependency-name: rayon
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-03-25 10:14:22 -04:00
0adda72316
[backend-comparison] Add system information to benchmark results ( #1495 )
...
* Bump sysinfo crate to 0.30.7
* [backend-comparison] Add CPUs and GPUs system info to results
* [backend-comparison] Add integrated GPUs to gathered system info
* [backend-comparison] Use AutoGraphicsApi wgpu backend selection
2024-03-22 23:24:49 -04:00
6feda90a8c
Tensor expand operator ( #1508 )
...
* Improve CI cache - remove burn-tch artifacts
* PyTorch config deserializer from .pt file
* Update pytorch-model.md
* WIP
* Rename broadcast_to to expand
* Rename broadcast_to expand file
* Implemented fusion backend and fix bugs
* Remove old files
* Remove unused state
* Rename to the correct op name
* Add missing comment
* Fix expand check function doc
* Rename the leftover names
* Rename leftover names
2024-03-22 16:33:53 -05:00
dc45cf1700
Add `topk` tensor operation ( #1497 )
...
* Add topk and topk_with_indices
* Change topk_with_indices test to guarantee order (previously equal elements)
2024-03-22 10:57:20 -04:00
dd699a90a2
Migrate/jit/matmul tiling 2d ( #1472 )
...
* refactor matmul files
* wip refactor matmul
* everything is memco
* support local arrays
* advancing tiling2d
* advancing tiling2d
* advancing tiling2d
* tiling2d finished but buggy
* configurable unrolling
* not bugged
* fails on unroll
* stupid break
* tiling2d no assumption works
* clippy
* bounds check as bool
* lhs rhs as enum
* tiling 2d major refactor
* remove assign vec4
* variable declarations above loops
* fmt
* clippy
* Fix autotune + unroll
* move val
* clippy
* fmt
---------
Co-authored-by: nathaniel <nathaniel.simard.42@gmail.com>
2024-03-22 08:26:32 -04:00
0a8a3cc9e9
[xtask] Add support for cargo metadata new workspace member format ( #1500 )
2024-03-21 16:04:52 -04:00
3e4af41694
Fix sort descending for 1d case ( #1494 )
2024-03-21 07:45:37 -04:00
e8863dafd2
[backend-comparison] Refresh access token and display authenticated user name ( #1483 )
...
* [backend-comparison] Serialize both auth tokens to cache file
We need to refresh token to be able to renew an expired access token.
* [backend-comparison] Refresh access token
* [backend-comparison] Display user name with auth command
* [backend-comparison] Update README
* [backend-comparison] Fix PR comments
* [backend-comparison] Fix hyphen consistency in benchmark names
* [backend-comparison] Fix release build error when refreshing token
The reqwest must have an explicit empty body otherwise the release
build returns a 411 when refreshing the tokens without even calling
the benchmark server endpoint.
2024-03-20 15:39:32 -04:00
47a84cc980
Add tensor sorting operations ( #1488 )
...
* Add sort, sort_with_indices and argsort
* Fix wasm build
* Add sort ops autodiff
* Fix TODO parallel comment
* Fix sort_with_indices 1d and add descending options
* Fix clippy
* Fix ascending comment (configurable)
2024-03-20 14:51:04 -04:00
430f642394
Change assert_approx_eq precision from 3 to 2 ( #1491 )
2024-03-19 12:26:21 -04:00
69f1877754
New learning rate schedulers ( #1481 )
2024-03-19 08:28:42 -05:00
8911093b88
Add `flip` tensor operator ( #1468 )
2024-03-18 20:33:39 -05:00
6e58663cc1
Combined PRs ( #1487 )
...
* Bump env_logger from 0.11.2 to 0.11.3
Bumps [env_logger](https://github.com/rust-cli/env_logger ) from 0.11.2 to 0.11.3.
- [Release notes](https://github.com/rust-cli/env_logger/releases )
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md )
- [Commits](https://github.com/rust-cli/env_logger/compare/v0.11.2...v0.11.3 )
---
updated-dependencies:
- dependency-name: env_logger
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump anyhow from 1.0.80 to 1.0.81
Bumps [anyhow](https://github.com/dtolnay/anyhow ) from 1.0.80 to 1.0.81.
- [Release notes](https://github.com/dtolnay/anyhow/releases )
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.80...1.0.81 )
---
updated-dependencies:
- dependency-name: anyhow
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump arboard from 3.3.1 to 3.3.2
Bumps [arboard](https://github.com/1Password/arboard ) from 3.3.1 to 3.3.2.
- [Release notes](https://github.com/1Password/arboard/releases )
- [Changelog](https://github.com/1Password/arboard/blob/master/CHANGELOG.md )
- [Commits](https://github.com/1Password/arboard/compare/v3.3.1...v3.3.2 )
---
updated-dependencies:
- dependency-name: arboard
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump proc-macro2 from 1.0.78 to 1.0.79
Bumps [proc-macro2](https://github.com/dtolnay/proc-macro2 ) from 1.0.78 to 1.0.79.
- [Release notes](https://github.com/dtolnay/proc-macro2/releases )
- [Commits](https://github.com/dtolnay/proc-macro2/compare/1.0.78...1.0.79 )
---
updated-dependencies:
- dependency-name: proc-macro2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-03-18 11:35:41 -04:00
8a8300c1fb
Add tril_mask, triu_mask and diag_mask ops ( #1479 )
2024-03-18 10:15:40 -05:00
c729401fb2
Remove unroll in shared reduce ( #1480 )
2024-03-17 13:56:54 -04:00
d3af29c5b4
Missing `Debug` derive for Group Norm Config ( #1482 )
2024-03-17 13:12:50 -04:00
cf3c1ca80a
Migrate/jit/cat ( #1457 )
2024-03-17 11:37:36 -04:00
41d01b8e19
Migrate/jit/prod ( #1474 )
2024-03-15 18:29:30 -04:00
cfc0a4d9fb
Fix book MNIST reference (no more huggingface) ( #1471 )
2024-03-15 15:30:08 -04:00
4e68cb2175
Prints benchmark results in a neat table and attempts to run every benchmark ( #1464 )
...
* log benchmark results as table
* update with comments
* remove redundants
* ds
* in markdown format
* fix
2024-03-15 06:55:18 -04:00
4de1272344
Feat: Add Leaky Relu Model ( #1467 )
2024-03-14 10:53:40 -05:00
53eb3ecfa9
Implement Huber loss ( #1444 )
...
* Implement Huber loss
Instead of using a sign or abs function, uses clamping to compute
it outside the bounds. This is better for the autodiff backend.
* mention Huber loss in the book
* unify naming of residuals in comments
2024-03-13 12:55:46 -05:00
7a98b2f663
Add prod and prod_dim tensor ops ( #1460 )
2024-03-12 14:00:02 -05:00
80aac1dde4
Add Rank0 variant to AdaptorRecordV1 and AdaptorRecordItemV1 ( #1442 )
2024-03-12 13:08:20 -04:00
bc39e4c7a1
[CI] Use GitHub's own action to generate GitHub App token ( #1437 )
2024-03-12 13:05:32 -04:00
c52c49785d
Add linear learning rate scheduler ( #1443 )
2024-03-12 13:04:12 -04:00
278fcb3dad
Migrate/jit/mask ( #1456 )
2024-03-12 12:43:05 -04:00
fa0dfec3c7
[backend-comparison] Compile benches in dedicated target directory ( #1435 )
...
This avoids file access denied error on Windows while executing
burnbench from cargo with a release build.
2024-03-12 09:32:48 -04:00
Dilshod Tadjibaev