44e8fdd413
jit fft
2024-04-05 09:03:39 -04:00
eb44ade768
done but with a bug
2024-04-04 16:57:18 -04:00
38ee355245
Fft ( #1574 )
...
* Added placeholders for FFT module
* First working implementation of 1D FFT
* Tidied things up a bit
* More tests + placeholders for other backends
* WGPU FFT almost works but not quite yet
* WGPU FFT works
* Tidied up WGPU FFT a bit
* Added 1D ifft default implementation using 1D fft module op
* More tests, added extra buffer to WGPU to not modify tensor in place
2024-04-04 13:30:59 -04:00
ce898ff899
Fix pytorch recorder adapt_linear when using autodiff backend ( #1576 )
...
* Fix pytorch recorder adapt_linear when using autodiff backend
* Fix comment typo
2024-04-04 12:29:24 -04:00
65222761fd
[backend-comparison] Add URL to browse results on burn.dev website ( #1573 )
2024-04-04 10:06:30 -04:00
9a1459797f
[backend-comparison] Rework burnbench output to be nicer and more compact ( #1568 )
...
* [backend-comparison] Remove tui
* [backend-comparison] Add nice and compact burnbench output
* [backend-comparison] Cargo check fixes
* Tweak bar style for consistency on different terminals
* [backend-comparison] Add uploading state to nice processor
Also simplified with only one processor for both stdout and stderr
since now we also need to process stdout to detect uploading.
* [backend-comparison] Add spinner to have feedback while compiling
* [backend-comparison] Fix Compiling status message on MacOS
* [backend-comparison] Remove prefix in progress bar message
* [backend-comparison] Refactor tracker to use tick and AtomicU64
* [backend-comparison] Set OutputProcessor bounds at the trait level
* [backend-comparison] Fix typos and remove dead code
* [backend-comparison] Create run_cargo function in for loops
2024-04-03 15:41:35 -04:00
0978c8a586
Support multilabel binary cross entropy ( #1571 )
...
* Support multilabel binary cross entropy
* Add missing alloc Vec
2024-04-03 08:03:07 -04:00
93fac73e6d
Bump clap from 4.5.2 to 4.5.4 ( #1563 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.5.2 to 4.5.4.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.5.2...v4.5.4 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-02 23:31:36 -04:00
beff9a8c57
Update pytorch-model.md ( #1570 )
2024-04-02 14:17:51 -05:00
b0c5986d16
Feat/lazy init ( #1539 )
2024-04-02 10:13:35 -04:00
c4eac86ce5
[backend-comparison] Add all choice to --benches and --backends ( #1567 )
...
+ Make some tweaks in logs
2024-04-02 09:27:49 -04:00
8d210a152f
Move log_sigmoid to activation ops ( #1558 )
2024-04-02 09:25:40 -04:00
38479be726
Combined PRs ( #1566 )
...
* Bump wasm-bindgen-futures from 0.4.41 to 0.4.42
Bumps [wasm-bindgen-futures](https://github.com/rustwasm/wasm-bindgen ) from 0.4.41 to 0.4.42.
- [Release notes](https://github.com/rustwasm/wasm-bindgen/releases )
- [Changelog](https://github.com/rustwasm/wasm-bindgen/blob/main/CHANGELOG.md )
- [Commits](https://github.com/rustwasm/wasm-bindgen/commits )
---
updated-dependencies:
- dependency-name: wasm-bindgen-futures
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump reqwest from 0.11.25 to 0.11.27
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.11.25 to 0.11.27.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.25...v0.11.27 )
---
updated-dependencies:
- dependency-name: reqwest
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump tokio from 1.36.0 to 1.37.0
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.36.0 to 1.37.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.36.0...tokio-1.37.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump serde_json from 1.0.114 to 1.0.115
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.114 to 1.0.115.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.114...v1.0.115 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-04-01 10:03:19 -04:00
67994c02d5
Make backend names in JSON reports match burnbench CLI ( #1375 )
...
* Make backend names in JSON reports match burnbench CLI
- add `config_name` to `Backend` trait
- add `backend_config_name` to `Benchmark` trait
- fix documentation for JSON reports to use correct unit of time
* Revert "Make backend names in JSON reports match burnbench CLI"
This reverts commit a09edb6389
2024-04-01 09:48:44 -04:00
edc683bc4b
Update module.md ( #1557 )
2024-03-29 13:14:01 -04:00
edcd92f13d
Refactor execute_dynamic with Execution struct ( #1550 )
2024-03-28 17:27:48 -04:00
efc3b2d243
[Breaking] add runtime options in wgpu init methods ( #1505 )
2024-03-28 12:44:38 -04:00
32a8d8041c
Tweak/add kind to gelu benchmark name ( #1533 )
...
* Add kind to gelu benchmark name
* [backend-comparison] Compute column size in benchmarks report
2024-03-28 12:35:15 -04:00
279be0496a
Conv Transpose: migration + decent speedup ( #1541 )
...
* convtranspose benchmark
* adjust bench
* conv transpose works
* Conv Transpose: migration + decent speedup
* delete template folder
* typos
* fix
2024-03-28 12:13:06 -04:00
b8fc3f141e
Numerically stable log_sigmoid ( #1548 )
2024-03-28 11:54:23 -04:00
70b92cb2fb
Update SUPPORTED-ONNX-OPS.md ( #1547 )
2024-03-28 10:38:53 -05:00
3a1d52067f
[backend-comparison] Fix automatic fusion activation with wgpu ( #1542 )
2024-03-27 17:40:12 -04:00
5f7fd5952a
remove exit ( #1543 )
2024-03-27 16:36:59 -05:00
9f9b52c728
[CI] Switch codecov to informational mode ( #1540 )
2024-03-27 15:19:06 -04:00
c21d5a3207
Add LeakyReLu implementation ( #1208 )
...
* Implement LeakyReLu
* Cargo fmt
* Apply suggestions
* cargo fmt
* Use float_mul_scalar
* Should be grad
* Add to books module
* Move test files
* Update leaky relu to use activation function
* Update tensor.md
* Fix failing test due to approx
* Add back the function comment
* Fix comment per PR feedback
---------
Co-authored-by: Dilshod Tadjibaev <939125+antimora@users.noreply.github.com>
2024-03-27 13:57:51 -05:00
626457e1c6
Provide Tensor Padding Helpers #960 ( #1097 )
...
* Initial padding approach
Create padding implementation for the last two dimensions of Float and Int Tensors.
Create PadMode Enum, allowing Constant padding.
Create Padding Struct with Uniform, Asymmetric, height, and width implementations.
Create tests for the padding implementation.
* Update padding.rs
remove unneeded import
* Update from Merge
Use crate Element
Swap from old from_data() to new from_data_devauto()
* Formatting Changes
Formatting changes from cargo fmt --all
* Additional Format Change
One more format change that cargo fmt didn't get the first time.
* Changes to Example
Modify Example to ensure it works.
* modify naming
better names for impl / input variables.
* Modify API
- Change Padding to PadSize.
- integrate padding value into PadMode.
- update tests and examples.
* Comments and print
Improve comments+naming and remove println
* Pad Fixes
Moved pad to numeric
Simplified PadMode Element
updated tensor creations
fixed doc example
* Fix test location
* Simplified pad API
* Fix for failed unit tests
* Remove bool_full
* Rename `pads` to `padding`
---------
Co-authored-by: Dilshod Tadjibaev <939125+antimora@users.noreply.github.com>
2024-03-27 12:46:55 -05:00
f6f6b5c0fa
Bump uuid from 1.7.0 to 1.8.0 ( #1514 )
...
Bumps [uuid](https://github.com/uuid-rs/uuid ) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/uuid-rs/uuid/releases )
- [Commits](https://github.com/uuid-rs/uuid/compare/1.7.0...1.8.0 )
---
updated-dependencies:
- dependency-name: uuid
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dilshod Tadjibaev <939125+antimora@users.noreply.github.com>
2024-03-27 12:42:06 -05:00
40a26bd2ea
Feat/backend bridge ( #1529 )
2024-03-26 19:24:45 -04:00
28233d9f59
[backend-comparison] Add Operating System information ( #1531 )
...
* [backend-comparison] Add Operating System information
* [backend-comparison] Simplify serialization of os info
2024-03-26 15:58:38 -04:00
5bac300688
Migrate/jit/interpolate ( #1528 )
...
* separate forward backward
* refactor with pool strategy
* refactor further
* pooling refactored
* refactoring for adaptive wip
* wip adaptive
* adaptive
* delete some wgsl
* avg pool backward
* clippy
* refactor interpolate files
* nearest shader
* nearest
* some boilerplate
* wip
* bilinear
* nearest backward
* cubic
* cleanup
* minor refactor
* add some white space
2024-03-26 08:57:26 -04:00
37b61ea646
Migrate/jit/adaptive avg pool backward ( #1530 )
...
* separate forward backward
* refactor with pool strategy
* refactor further
* pooling refactored
* refactoring for adaptive wip
* wip adaptive
* adaptive
* delete some wgsl
* avg pool backward
* clippy
* minor refactor
* works
* delete wgsl
2024-03-26 08:38:06 -04:00
a77979e0b6
add rms norm layer ( #1527 )
2024-03-25 18:59:11 -04:00
ea7263859a
Bump regex from 1.10.3 to 1.10.4 ( #1513 )
...
Bumps [regex](https://github.com/rust-lang/regex ) from 1.10.3 to 1.10.4.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.10.3...1.10.4 )
---
updated-dependencies:
- dependency-name: regex
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-25 16:53:35 -04:00
da5b0438ec
Migrate/jit/pooling ( #1509 )
...
* separate forward backward
* refactor with pool strategy
* refactor further
* pooling refactored
* refactoring for adaptive wip
* wip adaptive
* adaptive
* delete some wgsl
* avg pool backward
* clippy
* minor refactor
2024-03-25 16:04:58 -04:00
613e698007
Feat/swiglu ( #1507 )
2024-03-25 15:55:27 -04:00
4542ceddca
Migrate/jit/conv2d ( #1493 )
...
* conv2d but bug
* convolution done
* minor clean
* delete wgsl
2024-03-25 10:45:40 -04:00
8d378848c9
Combined PRs ( #1516 )
...
* Bump thiserror from 1.0.57 to 1.0.58
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.57 to 1.0.58.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.57...1.0.58 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump syn from 2.0.50 to 2.0.55
Bumps [syn](https://github.com/dtolnay/syn ) from 2.0.50 to 2.0.55.
- [Release notes](https://github.com/dtolnay/syn/releases )
- [Commits](https://github.com/dtolnay/syn/compare/2.0.50...2.0.55 )
---
updated-dependencies:
- dependency-name: syn
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump rayon from 1.9.0 to 1.10.0
Bumps [rayon](https://github.com/rayon-rs/rayon ) from 1.9.0 to 1.10.0.
- [Changelog](https://github.com/rayon-rs/rayon/blob/main/RELEASES.md )
- [Commits](https://github.com/rayon-rs/rayon/compare/rayon-core-v1.9.0...rayon-core-v1.10.0 )
---
updated-dependencies:
- dependency-name: rayon
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-03-25 10:14:22 -04:00
0adda72316
[backend-comparison] Add system information to benchmark results ( #1495 )
...
* Bump sysinfo crate to 0.30.7
* [backend-comparison] Add CPUs and GPUs system info to results
* [backend-comparison] Add integrated GPUs to gathered system info
* [backend-comparison] Use AutoGraphicsApi wgpu backend selection
2024-03-22 23:24:49 -04:00
6feda90a8c
Tensor expand operator ( #1508 )
...
* Improve CI cache - remove burn-tch artifacts
* PyTorch config deserializer from .pt file
* Update pytorch-model.md
* WIP
* Rename broadcast_to to expand
* Rename broadcast_to expand file
* Implemented fusion backend and fix bugs
* Remove old files
* Remove unused state
* Rename to the correct op name
* Add missing comment
* Fix expand check function doc
* Rename the leftover names
* Rename leftover names
2024-03-22 16:33:53 -05:00
dc45cf1700
Add `topk` tensor operation ( #1497 )
...
* Add topk and topk_with_indices
* Change topk_with_indices test to guarantee order (previously equal elements)
2024-03-22 10:57:20 -04:00
dd699a90a2
Migrate/jit/matmul tiling 2d ( #1472 )
...
* refactor matmul files
* wip refactor matmul
* everything is memco
* support local arrays
* advancing tiling2d
* advancing tiling2d
* advancing tiling2d
* tiling2d finished but buggy
* configurable unrolling
* not bugged
* fails on unroll
* stupid break
* tiling2d no assumption works
* clippy
* bounds check as bool
* lhs rhs as enum
* tiling 2d major refactor
* remove assign vec4
* variable declarations above loops
* fmt
* clippy
* Fix autotune + unroll
* move val
* clippy
* fmt
---------
Co-authored-by: nathaniel <nathaniel.simard.42@gmail.com>
2024-03-22 08:26:32 -04:00
0a8a3cc9e9
[xtask] Add support for cargo metadata new workspace member format ( #1500 )
2024-03-21 16:04:52 -04:00
3e4af41694
Fix sort descending for 1d case ( #1494 )
2024-03-21 07:45:37 -04:00
e8863dafd2
[backend-comparison] Refresh access token and display authenticated user name ( #1483 )
...
* [backend-comparison] Serialize both auth tokens to cache file
We need to refresh token to be able to renew an expired access token.
* [backend-comparison] Refresh access token
* [backend-comparison] Display user name with auth command
* [backend-comparison] Update README
* [backend-comparison] Fix PR comments
* [backend-comparison] Fix hyphen consistency in benchmark names
* [backend-comparison] Fix release build error when refreshing token
The reqwest must have an explicit empty body otherwise the release
build returns a 411 when refreshing the tokens without even calling
the benchmark server endpoint.
2024-03-20 15:39:32 -04:00
47a84cc980
Add tensor sorting operations ( #1488 )
...
* Add sort, sort_with_indices and argsort
* Fix wasm build
* Add sort ops autodiff
* Fix TODO parallel comment
* Fix sort_with_indices 1d and add descending options
* Fix clippy
* Fix ascending comment (configurable)
2024-03-20 14:51:04 -04:00
430f642394
Change assert_approx_eq precision from 3 to 2 ( #1491 )
2024-03-19 12:26:21 -04:00
69f1877754
New learning rate schedulers ( #1481 )
2024-03-19 08:28:42 -05:00
8911093b88
Add `flip` tensor operator ( #1468 )
2024-03-18 20:33:39 -05:00
6e58663cc1
Combined PRs ( #1487 )
...
* Bump env_logger from 0.11.2 to 0.11.3
Bumps [env_logger](https://github.com/rust-cli/env_logger ) from 0.11.2 to 0.11.3.
- [Release notes](https://github.com/rust-cli/env_logger/releases )
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md )
- [Commits](https://github.com/rust-cli/env_logger/compare/v0.11.2...v0.11.3 )
---
updated-dependencies:
- dependency-name: env_logger
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump anyhow from 1.0.80 to 1.0.81
Bumps [anyhow](https://github.com/dtolnay/anyhow ) from 1.0.80 to 1.0.81.
- [Release notes](https://github.com/dtolnay/anyhow/releases )
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.80...1.0.81 )
---
updated-dependencies:
- dependency-name: anyhow
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump arboard from 3.3.1 to 3.3.2
Bumps [arboard](https://github.com/1Password/arboard ) from 3.3.1 to 3.3.2.
- [Release notes](https://github.com/1Password/arboard/releases )
- [Changelog](https://github.com/1Password/arboard/blob/master/CHANGELOG.md )
- [Commits](https://github.com/1Password/arboard/compare/v3.3.1...v3.3.2 )
---
updated-dependencies:
- dependency-name: arboard
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* Bump proc-macro2 from 1.0.78 to 1.0.79
Bumps [proc-macro2](https://github.com/dtolnay/proc-macro2 ) from 1.0.78 to 1.0.79.
- [Release notes](https://github.com/dtolnay/proc-macro2/releases )
- [Commits](https://github.com/dtolnay/proc-macro2/compare/1.0.78...1.0.79 )
---
updated-dependencies:
- dependency-name: proc-macro2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-03-18 11:35:41 -04:00
8a8300c1fb
Add tril_mask, triu_mask and diag_mask ops ( #1479 )
2024-03-18 10:15:40 -05:00
louisfd