dnrops
/
candle
mirror of https://github.com/huggingface/candle.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,950 Commits 65 Branches 5 Tags 40 MiB
Commit Graph

112 Commits

Author SHA1 Message Date
Laurent Mazare f76bb7794a
Bumping the version number to 0.5.0. (#2009) 2024-04-04 17:48:45 +02:00
Laurent Mazare 3144150b8d
Move the tensor-tools binary in a separate crate. (#1969) 2024-03-30 15:49:37 +01:00
dependabot[bot] 356a170ae9
Update parquet requirement from 50.0.0 to 51.0.0 (#1867) 
Updates the requirements on [parquet](https://github.com/apache/arrow-rs) to permit the latest version.
- [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md)
- [Commits](https://github.com/apache/arrow-rs/compare/50.0.0...50.0.0)

---
updated-dependencies:
- dependency-name: parquet
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-03-29 21:58:15 +01:00
Laurent Mazare 18036c6ccb
Update the image crate + use the re-exported version. (#1893) 
* Update the image crate + use the re-exported version.

* Update to using ab_glyph.
 2024-03-21 10:56:41 +01:00
Laurent Mazare e7fc1daa21
Bump the crate versions to 0.4.2. (#1821) 2024-03-08 22:01:51 +01:00
Laurent Mazare 4fff5b51f5
Metavoice - first cut (#1717) 
* Add the metavoice transformer.

* Sketch the speaker-encoder module.

* Adding to the metavoice model.

* Start adding the metavoice example.

* Get some logits out.

* Load the second stage model.

* Get the second step to run.

* Tweak the example.

* Add encodec tilting.

* Glue the different bits together.

* Fix a shape issue.

* Use a constant.

* BPE tokenization.

* Add a warning.
 2024-03-02 18:50:01 +01:00
Laurent Mazare 5e526abc8c
Bump the version number to 0.4.1. (#1768) 
* Fix the block size for some cuda kernels.

* Bump the version number to 0.4.1.
 2024-02-27 14:19:59 +01:00
Laurent Mazare a83ca2ece0
Bump the crate version to 0.4.0. (#1658) 2024-02-04 19:08:01 +01:00
Laurent Mazare beadb1b434
Explicit candle version so that cargo publish can be used easily. (#1641) 2024-01-31 18:42:22 +01:00
dependabot[bot] 7e3349d7c3
Update parquet requirement from 45.0.0 to 50.0.0 (#1592) 
Updates the requirements on [parquet](https://github.com/apache/arrow-rs) to permit the latest version.
- [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md)
- [Commits](https://github.com/apache/arrow-rs/compare/45.0.0...45.0.0)

---
updated-dependencies:
- dependency-name: parquet
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-15 22:35:01 +01:00
dependabot[bot] 1257fc6719
Update safetensors requirement from 0.3.1 to 0.4.1 (#1591) 
Updates the requirements on [safetensors](https://github.com/huggingface/safetensors) to permit the latest version.
- [Release notes](https://github.com/huggingface/safetensors/releases)
- [Changelog](https://github.com/huggingface/safetensors/blob/main/RELEASE.md)
- [Commits](https://github.com/huggingface/safetensors/compare/v0.3.1...v0.3.3)

---
updated-dependencies:
- dependency-name: safetensors
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-15 22:34:40 +01:00
Laurent Mazare 86b7c01b30
Update gemm to the latest version. (#1587) 2024-01-15 09:44:51 +01:00
dependabot[bot] a897fda74e
Update memmap2 requirement from 0.7.1 to 0.9.3 (#1556) 
Updates the requirements on [memmap2](https://github.com/RazrFalcon/memmap2-rs) to permit the latest version.
- [Changelog](https://github.com/RazrFalcon/memmap2-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/RazrFalcon/memmap2-rs/compare/v0.7.1...v0.7.1)

---
updated-dependencies:
- dependency-name: memmap2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-10 16:27:59 +01:00
dependabot[bot] 6e98cf2a92
Update cudarc requirement from 0.9.14 to 0.10.0 (#1559) 
Updates the requirements on [cudarc](https://github.com/coreylowman/cudarc) to permit the latest version.
- [Release notes](https://github.com/coreylowman/cudarc/releases)
- [Commits](https://github.com/coreylowman/cudarc/compare/v0.9.14...v0.9.15)

---
updated-dependencies:
- dependency-name: cudarc
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-10 16:27:05 +01:00
dependabot[bot] 2cc1247999
Update tokenizers requirement from 0.13.4 to 0.15.0 (#1555) 
Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md)
- [Commits](https://github.com/huggingface/tokenizers/commits)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-01-10 16:26:53 +01:00
Nicolas Patry b4cb982e49
Simplifying our internal cargo dependencies. (#1529) 2024-01-07 12:04:14 +01:00
Laurent Mazare d35f0a1376
Bump the crate version to 0.3.3. (#1490) 2023-12-28 13:38:30 +01:00
Nicolas Patry 9fc210fae8
Merge pull request #1318 from huggingface/metal4 
Starting to fix some tests.
 2023-12-20 15:37:31 +01:00
Nicolas Patry 9b5e4843a6 Optimizing decode matmul (Phi at 28tok/s on M3). 
Adding some benchmark in order to help checking out matmul performance.
 2023-12-20 09:54:19 +01:00
Laurent Mazare 94817dac56
Bump the crate version to 0.3.2. (#1452) 2023-12-17 05:34:53 -06:00
Nicolas Patry 931432ed55 Fixing tests + matmul from MFA 2023-12-13 16:58:36 +01:00
Nicolas Patry c66e5d4716 Fix comments. 2023-11-20 14:13:44 +01:00
Nicolas Patry 7cfffcac10 Debugging rope. 2023-11-20 14:12:57 +01:00
Nicolas Patry 38de52bc4b Fixed matmul (display still broken without casting back to CPU first? ) 2023-11-20 14:12:57 +01:00
Nicolas Patry 39406a6721 Adding the actual backend 2023-11-20 14:12:56 +01:00
Laurent Mazare a209ce8ceb
Update for 0.3.1. (#1324) 2023-11-11 18:48:52 +00:00
Nicolas Patry 26c4e5bf1d
Metal part 1 - Scaffolding for metal. (#1308) 
* Metal part 1 - Scaffolding for metal.

* Remove tracing.
 2023-11-10 08:35:48 +01:00
Juarez Bochi 18d30005c5
Add support to UL2 model family (#1300) 
* Add support to UL2 model family

* Update docs with UL2

* Create ActivationWithOptionalGating to avoid polluting activations

* Also refactor quantized t5

* Remove useless conversion

* Revert Activation::NewGelu name change

* Remove useless return

* Apply rustfmt and clippy recommendations

* Reuse t5::ActivationWithOptionalGating in quantized version

* (cosmetic change) use a match rather than ifs + avoid early returns.

---------

Co-authored-by: Laurent <laurent.mazare@gmail.com>
 2023-11-09 18:55:09 +01:00
Laurent Mazare 2a45bcf943
Put the onnx example behind a feature flag. (#1276) 
* Put the onnx example behind a feature flag.

* Exclude the onnx bits from the workspace.

* README tweaks.
 2023-11-06 07:45:07 +01:00
Laurent Mazare 8cbb9d0e6c
Add some preliminary ONNX support (#1260) 
* Add the onnx protos.

* Move the reading bits.

* Install protoc on the CI.

* Install protoc on the cuda CI too.

* Use clap for the onnx tool.

* Tweak the CI protoc install.

* Add some simple evalution function.

* Add some binary operator support.
 2023-11-04 06:36:05 +01:00
Radamés Ajna e5dc8cb4f4
[Wasm] BLIP Example (#1183) 
* blip wasm start

* fix dependency issue, move token stream here

* vanilla js worker

* roll back vscode

* spell
 2023-10-26 07:24:02 +01:00
Laurent Mazare a193bf5f60
Another gemm update. (#1088) 2023-10-14 09:36:52 +01:00
Laurent Mazare eefad2b95f
Update to gemm 0.16.1 (#1083) 2023-10-13 06:40:20 +01:00
Laurent Mazare 5e6df4a3f7
Update to gemm-0.16. (#1082) 
* Update to gemm-0.16.

* Enable wasm-simd128.
 2023-10-12 21:56:59 +01:00
Laurent Mazare 096dee7073
Bump the version to 0.3.0. (#1014) 
* Bump the version to 0.3.0.

* Changelog update.
 2023-10-01 13:51:57 +01:00
Laurent Mazare 667f01c173
Simd128 vec-dot for q4_0. (#974) 
* Simd128 vec-dot for q4_0.

* Bugfix.

* Add wasm tests.

* Bugfix for the q40 vecdot.

* More quantization tests.
 2023-09-27 14:15:30 +01:00
Radamés Ajna 29bd6b2979
Phi 1.5 wasm module (#966) 
* add phi wasm module

* replace input with textarea

* trim input prompt

* stop on <|endoftext|>

* formatting

* clean up

* add blurb, and syntax highlighting

* add phi-v1.5 wasm

* add note

* hide Options on details

* add first token to generated text

* whitespaces for new line

* fix: abort -> aborted
 2023-09-27 06:07:11 +01:00
Laurent Mazare ccf352f3d1
Use yoke to provide a self-referential container for mmaped safetenso… (#939) 
* Use yoke to provide a self-referential container for mmaped safetensor files.

* Add the new self-owned type for safetensor files without removing the previous version.

* Add routing.

* Add an initializer for the case of multiple files.
 2023-09-23 15:43:11 +01:00
Radamés Ajna 19e52e5007
T5 Wasm (#918) 
* init t5 wasm model

* split workers for each model

* clean up

* add some ui

* readme

* index

* typo

* remove cache param, clear_kv_cache

* add max_length as param

* add model tasks option to ui

* add method to load quantized gguf from buffer

* Add quantized wasm module

* add quantized models to UI, dynamic import wasms

* link to quantized

* fix copy

* fix ModelEncoder

* fix README.md
 2023-09-22 15:31:10 +01:00
Radamés Ajna 7ad82b87e4
BERT Wasm (#902) 
* implement wasm module

* add example to workspace

* add UI explore semantic similiarity

* change status messages

* formatting

* minor changes
 2023-09-19 21:31:37 +01:00
Laurent Mazare 7dd8e12472
Bump the crate versions to v0.2.3. (#886) 
* Bump the crate version.

* Also update the python bindings.
 2023-09-18 12:14:03 +01:00
Laurent Mazare ef8cd8fea0
Update the candle-gemm version. (#885) 2023-09-18 09:36:20 +01:00
Laurent Mazare 2257f4d475
Bump the crate version + update the changelog. (#822) 2023-09-12 06:39:24 +01:00
Laurent Mazare 584171cae1
Add a wasm module for the segment anything example. (#797) 2023-09-10 12:29:37 +01:00
Laurent Mazare 618f4e4c78
Add some documentation. (#673) 
* Add some documentation.

* Bump the crate version.
 2023-08-30 11:54:00 +01:00
Nicolas Patry 4ed202447e Upgrading hf-hub. 2023-08-29 14:14:26 +02:00
Nicolas Patry dd06d93d0b Cleanup: 
- Moved around book from `examples` to `candle-book` proper (overlapping
  the book and the lib structures)
 2023-08-28 15:15:26 +02:00
Laurent Mazare a3f97c143d
Bump the crate version + update CHANGELOG. (#628) 2023-08-27 18:17:11 +01:00
Laurent Mazare 0afbc435df
Add some configurable legend for yolo detection. (#603) 
* Add some configurable legend for yolo detection.

* Clippyness.
 2023-08-25 13:50:31 +01:00
Laurent Mazare 97909e5068
Move the yolo model bits in a separate file. (#602) 
* Move the yolo model bits in a separate file.

* Improve the drawing.

* Bugfix.
 2023-08-25 12:47:55 +01:00