Commit Graph

195 Commits

Author SHA1 Message Date
Nathaniel Simard 96524d40a1
[Breaking] Refactor Backend Names (#904) 2023-10-29 18:27:49 -04:00
Louis Fortier-Dubois e2a3329997
Feat/wgpu/autotune compute (#906) 2023-10-29 16:44:59 -04:00
Luni-4 7332ebcabf
ci/Add coverage as xtask task (#902) 2023-10-26 12:45:08 -04:00
Nathaniel Simard 233922d60c
Chore: Bump version for next release (#900) 2023-10-24 19:31:13 -04:00
Louis Fortier-Dubois e76b6d47de
WGPU: matmul vec4 (#897) 2023-10-24 17:23:43 -04:00
Louis Fortier-Dubois 0ab611b42e
AdamW NaN fix (#888) 2023-10-24 14:48:40 -04:00
Alex Errant 9f2bc599b8
Add a `sync` feature to common, core, and tensor (#893) 2023-10-24 14:32:01 -04:00
Louis Fortier-Dubois d96f73da0a
Feat/compute/autotune (#861)
* wip autotune compute

* too much generics

* wip

* megawip

* in progress

* first test passes

* first test passes

* fixed test

* refactor for cache hit and miss

* cleanup and fixes

* doc and stuff

* doc and stuff

* clippy

* format

* remove lifetime

* cleanup operation

* wip

* wip

* compiles

* wip mutable borrow

* refactor with autotune server

* wip tune benchmark

* test passes

* fix autotune key

* cache hit miss tests

* refactor wgpu to match burn-compute

* better operation execution

* cleanup & refactor

* test for parametered kernel

* fmt

* fmt

* clippy

* allow clippy

* fix no-std

* fmt

* review and ci

* Fix CI

* delete dummy benchmarks again

---------

Co-authored-by: nathaniel <nathaniel.simard.42@gmail.com>
2023-10-23 11:29:44 -04:00
Louis Fortier-Dubois e4d9d67526
make candle available (#886) 2023-10-23 10:00:39 -04:00
Nathaniel Simard af813d09ed
Feat/early stopping + burn train refactor (#878) 2023-10-20 11:47:31 -04:00
Nathaniel Simard dd4e72a98f
Feat/checkpoint criteria (#862)
* WIP

* Setup

* Test metrics

* Fix bug

* Cleanup
2023-10-17 09:03:11 -04:00
Nathaniel Simard 620b86de98
Feat training events (#857) 2023-10-10 13:27:03 -04:00
Nathaniel Simard 904ff1a974
Refactor burn-train (#847) 2023-10-05 13:10:54 -04:00
Dilshod Tadjibaev e2a17e4295
Add image classification web demo with WebGPU, CPU backends (#840) 2023-10-05 10:29:13 -04:00
Nathaniel Simard ce120ead3a
Improve metrics (#844) 2023-10-03 18:15:43 -04:00
Daniel Vainsencher 1e609acfe5
Bugfix: epoch and iteration were swapped. (#838)
Co-authored-by: Daniel Vainsencher <danielv@nirinor.ai>
2023-10-01 09:48:51 -04:00
Nathaniel Simard ca787d6446
Feat/async read (#833) 2023-09-28 17:09:58 -04:00
Nathaniel Simard 95e660488e
Refactor/burn compute wgpu (#826) 2023-09-25 10:42:45 -04:00
Dilshod Tadjibaev 35ca839e18
Add support for different record types in ONNX (#816) 2023-09-21 09:06:57 -04:00
Damien Elmes d7e9e75099
Fix train-minimal feature and ensure it gets tested (#802) 2023-09-16 09:52:14 -04:00
Nathaniel Simard 4f72578260
Fix compilation flags (#800) 2023-09-13 10:38:16 -04:00
Nathaniel Simard af0be5cfeb
Chore: bump version (#777) 2023-09-06 12:15:13 -04:00
Nathaniel Simard 8b3d10c4d3
Cleanup of the book + feature flags (#773)
---------

Co-authored-by: louisfd <louisfd94@gmail.com>
2023-09-06 09:16:36 -04:00
Arvid Hammarlund b58af4a4a3
Cross Entropy with label smoothing and weights. (#755) 2023-09-04 20:20:47 -04:00
Damien Elmes 5b97f1a54b
Re-export some submodules and add feature flags for them (#759) 2023-09-04 09:13:52 -04:00
Louis Fortier-Dubois 56b8e29514
Doc/building blocks more (#745) 2023-09-02 13:09:03 -04:00
Damien Elmes 520cea16df
Fix: burn-core/std depended on sqlite feature (#731) 2023-09-01 09:28:58 -04:00
Nathaniel Simard c95b34c511
Book: backend extension + custom wgpu kernel (#728) 2023-08-31 09:55:43 -04:00
Asuka Minato 0f7864f11b
Path type (#699) 2023-08-27 09:17:48 -04:00
Louis Fortier-Dubois bc27a87e9d
new clippy stuff (#687) 2023-08-24 13:20:58 -04:00
Nathaniel Simard 00d3d208b8
Add book + fix some code (#671) 2023-08-23 11:52:55 -04:00
Dilshod Tadjibaev 294a319557
Add Jupyter notebook examples (#651) 2023-08-16 18:17:12 -04:00
nathaniel 8430d187ba Update tokenizers version 2023-08-14 14:01:16 -05:00
nathaniel 8e55f60676 Fix in text classification 2023-08-14 14:01:16 -05:00
nathaniel 2203eebd70 Fix CI 2023-08-14 14:01:16 -05:00
Louis Fortier-Dubois aebd359e66
Book/guide (#632) 2023-08-14 11:58:27 -04:00
Caio Piccirillo 1d3bbaab13
Typos (#608) 2023-08-08 17:57:51 -04:00
Dilshod Tadjibaev 1554a3c898
Full support for ONNX scalar operators and Constants (#578) 2023-08-04 16:51:51 -04:00
Nathaniel Simard 0a5a2d729a
chore: bump version for next release (#533) 2023-07-26 09:46:28 -04:00
Louis Fortier-Dubois 6a25eb1461
Refactor/example/text classification (#527) 2023-07-25 09:50:00 -04:00
Luni-4 e066d95d2e
Implement padding for conv2d (#523) 2023-07-24 12:54:45 -04:00
Louis Fortier-Dubois 9aca1837c2
Example/wgpu/mnist (#514)
* add wgpu for mnist

* auto graphics api

* fix display tests

* clipy
2023-07-20 17:12:13 -04:00
Luni-4 f176f67ab6
Move main file into the bin directory for onnx_inference example (#498) 2023-07-14 10:14:37 -04:00
Luni-4 ffdb0feb29
Hide crate name in onnx-import crate and onnx-inference example (#493) 2023-07-13 19:39:17 -04:00
Dilshod Tadjibaev e62ee1269b
Fix burn-tch's random implementation for standard dist (#469) 2023-07-06 08:50:50 -04:00
Nathaniel Simard 65bf6c1cbb
Refactor index => slice (#466) 2023-07-05 16:30:11 -04:00
Dilshod Tadjibaev eda241f8cf
Add missing docs and enable missing_docs warn lint (#420) 2023-06-21 14:12:13 -04:00
Dilshod Tadjibaev fce45f51be
Doc fixes (#418) 2023-06-21 12:32:50 -04:00
Dilshod Tadjibaev 11bdceff56
Remove inference testing against dataset (#408)
This test was redundant and required the dataset to be downloaded.
2023-06-17 12:59:26 -04:00
Dilshod Tadjibaev 834c7ecc1f
Clean up cargo descriptions and formatting (#403) 2023-06-15 09:20:53 -04:00
Dilshod Tadjibaev d57ca96695
Upgrade dep versions (#399) 2023-06-14 09:55:19 -04:00
Dilshod Tadjibaev e2adb294e9
Add comments and clean up readme with examples (#396) 2023-06-14 09:06:45 -04:00
Nathaniel Simard ba0ac112e1
Refactor: Burn Import use BurnGraph (#355) 2023-05-21 13:09:27 -04:00
Dilshod Tadjibaev b170b539b7
Upgrade dep versions (#359) 2023-05-21 09:07:39 -04:00
Dilshod Tadjibaev 6fece7e4cb
Dataset Improvements: Add Sqlite storage backend and HF importer improvements (#353) 2023-05-20 14:24:55 -04:00
Dilshod Tadjibaev 05763e1878
Bump version to the next minor to indicate dev (#344) 2023-05-10 18:02:08 -04:00
Nathaniel Simard 6c9a5c8e58
Refactor/record (#323) 2023-05-04 14:59:16 -04:00
Dilshod Tadjibaev 39297a6479
Readme updates (#325)
* Update text-generation readme for Mac users

* Update root readme to reference import crate

* Update import's readme

* Update torch backend
2023-05-04 14:58:44 -04:00
Dilshod Tadjibaev 314db93b7f
Add ability to load onnx state to the generated source code (#319) 2023-05-03 13:05:43 -04:00
Nathaniel Simard 78ac09fb7a
Support dilation in convolution operations (#301) 2023-04-18 10:01:11 -04:00
Nathaniel Simard bd58922784
Feat/conv stride (#300) 2023-04-16 22:03:16 -04:00
Dilshod Tadjibaev df980d534e
Add foundation for importing ONNX files (#297) 2023-04-15 10:44:50 -04:00
Nathaniel Simard d4ce825725
refactor: burn dataset (#293) 2023-04-11 18:12:28 -04:00
Nathaniel Simard 04bcf9550a
Fix/text gen example (#292) 2023-04-11 17:18:45 -04:00
Dilshod Tadjibaev ac58aa5a70
Fix compilation error (fixes #288) (#289) 2023-04-11 16:33:17 -04:00
Dilshod Tadjibaev 546c9b386c
Update README.md (#286) 2023-04-11 12:47:30 -04:00
Nathaniel Simard f45e6863d9
fix: text classification example (#285) 2023-04-11 12:46:42 -04:00
Nathaniel Simard 37b79bcc40
Add init_with for nn modules (#280) 2023-04-08 13:12:45 -04:00
Nathaniel Simard 66028dc3cf
Feat/lr scheduler (#276) 2023-04-08 13:12:27 -04:00
Nathaniel Simard f04fe101d8
Feat/module no grad (#274) 2023-04-07 09:01:27 -04:00
Nathaniel Simard ca8ee0724d
Refactor/optim (#272) 2023-04-05 12:38:53 -04:00
Nathaniel Simard d3887bcd3d
Feat/module record (#265) 2023-04-02 16:22:05 -04:00
Nathaniel Simard 73f6d1916b
Feat/record (#262) 2023-04-02 10:09:29 -04:00
Nathaniel Simard 32d38bebc3
Refactor Param wrapping only for Tensor (#259) 2023-03-31 16:45:10 -04:00
Nathaniel Simard c14c7977ec
Text classification inference example (#256) 2023-03-26 16:51:37 -04:00
Nathaniel Simard 7d7504686a
Refactor/init modules (#250) 2023-03-24 15:38:02 -04:00
Nathaniel Simard 53baa2e10d
Feat/batch norm nd (#249) 2023-03-23 17:15:39 -04:00
Nathaniel Simard 6f43d983f7
State serialization/deserialization overhaul (#247) 2023-03-23 11:02:46 -04:00
Nathaniel Simard 4e28e2a776
chore: prepare release v0.6.0 (#246) 2023-03-21 09:47:37 -04:00
nathaniel 2f91a5e4e2 fix: burn mnist wasm demo link 2023-03-20 19:31:56 -04:00
Dilshod Tadjibaev 019ccbde4c
Fix and update readme docs (#244) 2023-03-20 11:51:07 -04:00
Dilshod Tadjibaev 8e74ce4bb9
Reduce MNIST parameters and update mnist-inference-web to match (#242) 2023-03-17 19:46:26 -04:00
Nathaniel Simard c9e344a97f
Fix/batch norm (#238) 2023-03-17 09:31:52 -04:00
Dilshod Tadjibaev ed5888e701
Mnist inference web: Readme (#233) 2023-03-15 08:49:59 -04:00
Nathaniel Simard a314c7b694
Perf/optimize backward ops (#232) 2023-03-14 12:59:52 -04:00
Dilshod Tadjibaev e991ba38df
Mnist inference web: Remove wee_alloc allocator and use rust's alloc for WASM32 (#231) 2023-03-14 08:57:10 -04:00
nathaniel 7f3f8d2b22 fix: mnist inference web build for web no such dir 2023-03-13 20:13:39 -04:00
Dilshod Tadjibaev bf9d33e6fc
Add MNIST inference on the web demo crate (#228)
* Add MNIST inference on the web demo crate

* Fix problems identified during a PR review
2023-03-13 19:51:32 -04:00
Nathaniel Simard 453f4aec86
feat: pre-norm transformer (#230) 2023-03-13 19:09:35 -04:00
Nathaniel Simard 403500f018
feat(burn-core): refactor cross entropy (#229) 2023-03-13 13:47:19 -04:00
Nathaniel Simard be96160065
refactor: elems (#206) 2023-03-06 18:39:49 -05:00
Nathaniel Simard 019c5f9c44
Refactor/int backend (#197)
* Update burn-tensor API

* Migrate burn-autodiff

* Update burn-tch

* Update burn-ndarray

* Add some doc
2023-03-06 14:45:58 -05:00
Nathaniel Simard ffd3d35176
Refactor/tensor api (#191) 2023-03-05 09:23:42 -05:00
Nathaniel Simard 25deb5a13b
Refactor/autodiff (#186) 2023-02-28 20:01:26 -05:00
Dilshod Tadjibaev c510e8bfb5
Add accelerate framework support for burn-ndarray (#183) (#184) 2023-02-28 09:09:47 -05:00
Dilshod Tadjibaev fb925acc73
Make burn and burn-core packages no_std compatible (#168) (#173)
* Make burn-ndarray and burn-tensor no_std compatible (#168)
2023-02-25 09:38:01 -05:00
Nathaniel Simard e4e9a5dcca
fix(burn-tch): tensor comparison ops inplace don't have the right tch kind (#166) 2023-02-18 13:59:49 -05:00
Nathaniel Simard 7d2f43dfca
Refactor Tensor API (#163) 2023-02-17 17:31:20 -05:00
Nathaniel Simard c7963d8485
refactor: device functions (#157) 2023-01-27 18:37:21 -05:00
Nathaniel Simard b7aa066e5c
Feat/nn max pool2d (#153) 2023-01-21 17:06:39 -05:00