Commit Graph

244 Commits

Author SHA1 Message Date
Guillaume Lagrange 4efc683df4
Upgrade to candle 0.4.1 (#1382)
* Fix python main entrypoint in book example

* Remove candle windows safeguards (#1178)

* Bump candle-core from 0.3.3 to 0.4.1

* Remove windows current known issue
2024-02-29 11:29:11 -06:00
Yu Sun 330552afb4
docs(book-&-examples): modify book and examples with new `prelude` module (#1372) 2024-02-28 13:25:25 -05:00
Louis Fortier-Dubois 576bb44bc8
Feat/autodiff/checkpoint ops (#1358) 2024-02-26 17:19:09 -05:00
Sylvain Benner 4427768570
[refactor] Move burn crates to their own crates directory (#1336) 2024-02-20 13:57:55 -05:00
Dilshod Tadjibaev 44266d5fd4
Make all struct CamelCase (#1316) 2024-02-15 13:00:37 -06:00
Dilshod Tadjibaev dfb739c89a
Rename GELU to Gelu (#1311)
* Rename GELU to Gelu

This is to follow Rust naming convention
2024-02-15 10:39:06 -06:00
Nathaniel Simard dfc65abd52
[Refactor] Just-In-Time Backend (#1280) 2024-02-12 12:15:07 -05:00
github-actions[bot] 03bbc64031
Combined PRs (#1295)
Combined PRs ➡️📦⬅️
 The following pull requests have been successfully combined on this PR:

Closes Bump thiserror from 1.0.56 to 1.0.57 #1293 Bump thiserror from 1.0.56 to 1.0.57
Closes Bump tokenizers from 0.15.1 to 0.15.2 #1292 Bump tokenizers from 0.15.1 to 0.15.2
Closes Bump bytemuck from 1.14.1 to 1.14.3 #1291 Bump bytemuck from 1.14.1 to 1.14.3
Closes Bump indicatif from 0.17.7 to 0.17.8 #1290 Bump indicatif from 0.17.7 to 0.17.8
2024-02-12 10:42:15 -05:00
Guillaume Lagrange 8f753b3aae
Update TORCH_CUDA_VERSION usage (#1284) 2024-02-10 12:01:45 -05:00
Guillaume Lagrange 88f5a3e88c
Add `burn::data::network::downloader` (#1283) 2024-02-10 11:54:33 -05:00
Nathaniel Simard a9b6dbc177
Enable burn fusion by default (#1223) 2024-02-08 11:28:02 -05:00
yurzhang 419e53bc42
Support signed value for `Tensor::arange` (#1238) 2024-02-07 09:33:01 -05:00
Guillaume Lagrange 57ee2ce717
Add `ImageFolderDataset` (#1232) 2024-02-02 16:32:38 -05:00
Sylvain Benner 4aa13d6b25
Bump Burn version to 0.13 (#1211) 2024-01-31 16:01:20 -05:00
Joshua Ferguson 4a70a0f8bc
renaming FloatTensor Ops, Primitives, and maybe functions (#1174) 2024-01-27 10:04:50 -05:00
Guillaume Lagrange b9bd42959b
Add vision/mnist dataset (#1176) 2024-01-25 16:16:39 -05:00
Dilshod Tadjibaev 0368409eb3
Add support for loading PyTorch `.pt` (weights/states) files directly to model's record (#1085) 2024-01-25 10:20:09 -05:00
unrenormalizable 4ca3e31601
Fixing jupyter nbs + ONNX IR (#1170) 2024-01-24 13:32:01 -05:00
Nathaniel Simard eaa4dc3207
Feat/recorder/custom device (#1165) 2024-01-23 13:05:41 -05:00
Sylvain Benner 9063701b53
Remove annoying cargo warning (#1108)
Package level profiles are ignored when workspace is enabled so
these lines are useless.

This commit removes them completely as panic, lto and rpath cannot be overridden from the workspace root.

Source: https://doc.rust-lang.org/cargo/reference/profiles.html#overrides

```
The precedence for which value is used is done in the following order (first match wins):

[profile.dev.package.name] — A named package.
[profile.dev.package."*"] — For any non-workspace member.
[profile.dev.build-override] — Only for build scripts, proc macros, and their dependencies.
[profile.dev] — Settings in Cargo.toml.
Default values built-in to Cargo.
Overrides cannot specify the panic, lto, or rpath settings.
```
2024-01-20 09:09:20 -05:00
Aasheesh Singh e3355524a2
Example/regression (#1150) 2024-01-19 21:28:38 -05:00
Nathaniel Simard ebb2306a6b
[burn-fusion] support multiple concurrent optimization streams (#1149) 2024-01-18 13:15:43 -05:00
Guillaume Lagrange 6079f98950
Fix missing ticks in Burn book and remove unused example dependency (#1144)
* Add missing ticks for triu and tril ops

* Removed example unused dependency
2024-01-16 09:03:17 -05:00
Guillaume Lagrange 535458e7b9
Add example for custom CSV dataset (#1129) 2024-01-11 09:24:25 -05:00
Nathaniel Simard f0e10f1499
Refactor/fusion optimization (#1104) 2024-01-06 14:22:50 -05:00
Kirill Mavreshko 97297538b1
Remove _devauto fuctions (#518) (#1110) 2024-01-06 13:36:34 -05:00
Sylvain Benner a4de93a39f
Fix import and type redefinitions in mnist example crate (#1100)
* Remove the double import for WgpuDevice
* Prioritize wgpu backend over the default ndarray when wgpu feature is set

This fixes `cargo bench --festures wgpu` as `--no-default-features` cannot be
used.
2024-01-02 12:47:44 -05:00
Nathaniel Simard b0a2b30ed1
Fix/wgpu/fusion (#1093)
* Fix fusion

* Real fix

* Fix
2023-12-22 16:53:19 -05:00
Kirill Mavreshko 1fd07fcb4a
Explicit device tensors (#1081) 2023-12-20 17:49:59 -05:00
Nathaniel Simard 042454a9db
Example: Update Text Classification (#1044)
* Example: Update Text Classification

* cargo fmt

---------

Co-authored-by: louisfd <louisfd94@gmail.com>
2023-12-18 08:42:07 -05:00
Alex Errant 610d64095e
cargo +nightly fmt (#1017) 2023-12-12 13:29:06 -05:00
David Chavez 71d3c1d142
chore(infra): Share some properties across workspace (#1039) 2023-12-12 09:39:07 -05:00
David Chavez ef09b637b9
chore(web): better panic (#1051) 2023-12-05 07:30:29 -05:00
Louis Fortier-Dubois 8fc52113bc
Chore/bump v12 (#1048) 2023-12-04 10:47:54 -05:00
Louis Fortier-Dubois 3088c466a5
patch 0.11.1 (#1047) 2023-12-04 10:18:30 -05:00
Timothy 52811f9938
Fix some issues in Burn book (#1042) 2023-12-04 09:23:47 -05:00
Nathaniel Simard ab1b5890f5
Chore/release (#1031) 2023-12-01 14:33:28 -05:00
Dilshod Tadjibaev 4192490b88
Update with demo links (#1033) 2023-12-01 13:07:13 -05:00
Nathaniel Simard 12911c3ad6
Fix/mnist inference web (#1029) 2023-12-01 12:05:31 -05:00
Nathaniel Simard f6d14f1b1a
Refactor feature flags (#1025) 2023-12-01 09:48:28 -05:00
Luni-4 ba1de9c654
Ci/Schedule dependencies checks (#1014)
* ci: Add audit file

* ci: Schedule dependencies checks

* mnist-inference-web: Remove unused dep

* Run when a new release is created

* Fix comment
2023-11-30 13:06:27 -05:00
Nathaniel Simard 630044e96b
Fix/devices api (#990) 2023-11-22 10:24:24 -05:00
Nathaniel Simard cabbaab0c4
Fix/constant tensors (#984)
* Generalize autodiff tensor

* Can have int const module

* Update example

* Support no-std with burn-import

* Fix typos

* Fix alloc problems

* Revert burn-import changes

* Fix examples

* Support Int and Bool Params

* Fix

* Add comment
2023-11-21 15:27:28 -06:00
Dilshod Tadjibaev cb616ed72c
Fix image classifier build failure by upgrading versions (#967) 2023-11-21 09:28:56 -05:00
Luni-4 445603401d
ci/Check dependencies (#895) 2023-11-19 10:35:03 -05:00
Luni-4 ec9df53d4c
ci/Fix `cargo clippy` action (#942) 2023-11-16 19:35:38 -05:00
Nathaniel Simard 322480b744
Feat/op fusion decorator (#939)
* WIP

* Impl backend decorator

* WIP

* WIP

* WIP

* WIP

* WIP

* WIP

* Refactor

* Handle graph single ops execution

* WIP

* Starting to get concrete

* WIP

* Fix locator

* Implement add ops

* Start implementing ops

* Add more ops

* Add more ops

* More float ops

* Almost finish float ops

* Almost done with Int

* Some fix

* Into float

* Implement bool ops

* Almost done with MVP

* Fix adaptive pooling

* Add fusion as backend

* Fix memory leak

* Fix

* WIP Doc

* Doc all ops enum

* Initial docs

* Clippy

* Clippy v2

* Fix typos

* Fix doc

* Fix feature flags

* Add missing ops

* Some cleanup

* Revert u128 id

* cosmetic fixes

---------

Co-authored-by: louisfd <louisfd94@gmail.com>
2023-11-09 21:21:41 -05:00
Aisuko 4e8b573f13
Fixed the wrong order of the attributes (#930)
Signed-off-by: GitHub <noreply@github.com>
2023-11-03 09:21:58 -04:00
Louis Fortier-Dubois 8742d31d16
Perf/wgpu/matmul vec4rhs (#914) 2023-10-31 08:37:17 -04:00
Nathaniel Simard 96524d40a1
[Breaking] Refactor Backend Names (#904) 2023-10-29 18:27:49 -04:00
Louis Fortier-Dubois e2a3329997
Feat/wgpu/autotune compute (#906) 2023-10-29 16:44:59 -04:00
Luni-4 7332ebcabf
ci/Add coverage as xtask task (#902) 2023-10-26 12:45:08 -04:00
Nathaniel Simard 233922d60c
Chore: Bump version for next release (#900) 2023-10-24 19:31:13 -04:00
Louis Fortier-Dubois e76b6d47de
WGPU: matmul vec4 (#897) 2023-10-24 17:23:43 -04:00
Louis Fortier-Dubois 0ab611b42e
AdamW NaN fix (#888) 2023-10-24 14:48:40 -04:00
Alex Errant 9f2bc599b8
Add a `sync` feature to common, core, and tensor (#893) 2023-10-24 14:32:01 -04:00
Louis Fortier-Dubois d96f73da0a
Feat/compute/autotune (#861)
* wip autotune compute

* too much generics

* wip

* megawip

* in progress

* first test passes

* first test passes

* fixed test

* refactor for cache hit and miss

* cleanup and fixes

* doc and stuff

* doc and stuff

* clippy

* format

* remove lifetime

* cleanup operation

* wip

* wip

* compiles

* wip mutable borrow

* refactor with autotune server

* wip tune benchmark

* test passes

* fix autotune key

* cache hit miss tests

* refactor wgpu to match burn-compute

* better operation execution

* cleanup & refactor

* test for parametered kernel

* fmt

* fmt

* clippy

* allow clippy

* fix no-std

* fmt

* review and ci

* Fix CI

* delete dummy benchmarks again

---------

Co-authored-by: nathaniel <nathaniel.simard.42@gmail.com>
2023-10-23 11:29:44 -04:00
Louis Fortier-Dubois e4d9d67526
make candle available (#886) 2023-10-23 10:00:39 -04:00
Nathaniel Simard af813d09ed
Feat/early stopping + burn train refactor (#878) 2023-10-20 11:47:31 -04:00
Nathaniel Simard dd4e72a98f
Feat/checkpoint criteria (#862)
* WIP

* Setup

* Test metrics

* Fix bug

* Cleanup
2023-10-17 09:03:11 -04:00
Nathaniel Simard 620b86de98
Feat training events (#857) 2023-10-10 13:27:03 -04:00
Nathaniel Simard 904ff1a974
Refactor burn-train (#847) 2023-10-05 13:10:54 -04:00
Dilshod Tadjibaev e2a17e4295
Add image classification web demo with WebGPU, CPU backends (#840) 2023-10-05 10:29:13 -04:00
Nathaniel Simard ce120ead3a
Improve metrics (#844) 2023-10-03 18:15:43 -04:00
Daniel Vainsencher 1e609acfe5
Bugfix: epoch and iteration were swapped. (#838)
Co-authored-by: Daniel Vainsencher <danielv@nirinor.ai>
2023-10-01 09:48:51 -04:00
Nathaniel Simard ca787d6446
Feat/async read (#833) 2023-09-28 17:09:58 -04:00
Nathaniel Simard 95e660488e
Refactor/burn compute wgpu (#826) 2023-09-25 10:42:45 -04:00
Dilshod Tadjibaev 35ca839e18
Add support for different record types in ONNX (#816) 2023-09-21 09:06:57 -04:00
Damien Elmes d7e9e75099
Fix train-minimal feature and ensure it gets tested (#802) 2023-09-16 09:52:14 -04:00
Nathaniel Simard 4f72578260
Fix compilation flags (#800) 2023-09-13 10:38:16 -04:00
Nathaniel Simard af0be5cfeb
Chore: bump version (#777) 2023-09-06 12:15:13 -04:00
Nathaniel Simard 8b3d10c4d3
Cleanup of the book + feature flags (#773)
---------

Co-authored-by: louisfd <louisfd94@gmail.com>
2023-09-06 09:16:36 -04:00
Arvid Hammarlund b58af4a4a3
Cross Entropy with label smoothing and weights. (#755) 2023-09-04 20:20:47 -04:00
Damien Elmes 5b97f1a54b
Re-export some submodules and add feature flags for them (#759) 2023-09-04 09:13:52 -04:00
Louis Fortier-Dubois 56b8e29514
Doc/building blocks more (#745) 2023-09-02 13:09:03 -04:00
Damien Elmes 520cea16df
Fix: burn-core/std depended on sqlite feature (#731) 2023-09-01 09:28:58 -04:00
Nathaniel Simard c95b34c511
Book: backend extension + custom wgpu kernel (#728) 2023-08-31 09:55:43 -04:00
Asuka Minato 0f7864f11b
Path type (#699) 2023-08-27 09:17:48 -04:00
Louis Fortier-Dubois bc27a87e9d
new clippy stuff (#687) 2023-08-24 13:20:58 -04:00
Nathaniel Simard 00d3d208b8
Add book + fix some code (#671) 2023-08-23 11:52:55 -04:00
Dilshod Tadjibaev 294a319557
Add Jupyter notebook examples (#651) 2023-08-16 18:17:12 -04:00
nathaniel 8430d187ba Update tokenizers version 2023-08-14 14:01:16 -05:00
nathaniel 8e55f60676 Fix in text classification 2023-08-14 14:01:16 -05:00
nathaniel 2203eebd70 Fix CI 2023-08-14 14:01:16 -05:00
Louis Fortier-Dubois aebd359e66
Book/guide (#632) 2023-08-14 11:58:27 -04:00
Caio Piccirillo 1d3bbaab13
Typos (#608) 2023-08-08 17:57:51 -04:00
Dilshod Tadjibaev 1554a3c898
Full support for ONNX scalar operators and Constants (#578) 2023-08-04 16:51:51 -04:00
Nathaniel Simard 0a5a2d729a
chore: bump version for next release (#533) 2023-07-26 09:46:28 -04:00
Louis Fortier-Dubois 6a25eb1461
Refactor/example/text classification (#527) 2023-07-25 09:50:00 -04:00
Luni-4 e066d95d2e
Implement padding for conv2d (#523) 2023-07-24 12:54:45 -04:00
Louis Fortier-Dubois 9aca1837c2
Example/wgpu/mnist (#514)
* add wgpu for mnist

* auto graphics api

* fix display tests

* clipy
2023-07-20 17:12:13 -04:00
Luni-4 f176f67ab6
Move main file into the bin directory for onnx_inference example (#498) 2023-07-14 10:14:37 -04:00
Luni-4 ffdb0feb29
Hide crate name in onnx-import crate and onnx-inference example (#493) 2023-07-13 19:39:17 -04:00
Dilshod Tadjibaev e62ee1269b
Fix burn-tch's random implementation for standard dist (#469) 2023-07-06 08:50:50 -04:00
Nathaniel Simard 65bf6c1cbb
Refactor index => slice (#466) 2023-07-05 16:30:11 -04:00
Dilshod Tadjibaev eda241f8cf
Add missing docs and enable missing_docs warn lint (#420) 2023-06-21 14:12:13 -04:00
Dilshod Tadjibaev fce45f51be
Doc fixes (#418) 2023-06-21 12:32:50 -04:00
Dilshod Tadjibaev 11bdceff56
Remove inference testing against dataset (#408)
This test was redundant and required the dataset to be downloaded.
2023-06-17 12:59:26 -04:00
Dilshod Tadjibaev 834c7ecc1f
Clean up cargo descriptions and formatting (#403) 2023-06-15 09:20:53 -04:00
Dilshod Tadjibaev d57ca96695
Upgrade dep versions (#399) 2023-06-14 09:55:19 -04:00