dnrops
/
candle
mirror of https://github.com/huggingface/candle.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
candle/Cargo.toml

80 lines
2.7 KiB
TOML
Raw Normal View History

Integrate the kernels bits.
2023-06-22 16:59:00 +08:00
[workspace]
members = [
Refactor the hierarchy.
2023-06-27 17:57:27 +08:00
"candle-core",
Add the candle-datasets crate (#322) * Move the vision datasets to a separate crate. * Move the batcher bits. * Update the readme. * Move the tiny-stories bits. --------- Co-authored-by: Jane Doe <jane.doe@example.org>
2023-08-05 15:56:50 +08:00
"candle-datasets",
Move llama in a cargo-examples directory.
2023-07-03 18:30:58 +08:00
"candle-examples",
Cleanup: - Moved around book from `examples` to `candle-book` proper (overlapping the book and the lib structures)
2023-08-15 21:42:22 +08:00
"candle-book",
Sketch the candle-nn crate. (#115) * Sketch the candle-nn crate. * Tweak the cuda dependencies. * More cuda tweaks.
2023-07-10 15:50:09 +08:00
"candle-nn",
Reenable pyo3 in the workspace list (#170) * Enable pyo3 back. * Adapt the CI.
2023-07-15 02:54:38 +08:00
"candle-pyo3",
Sketch the candle-transformers crate. (#147) * Sketch the candle-transformers crate. * Format the empty files.
2023-07-12 20:49:31 +08:00
"candle-transformers",
[Wasm] BLIP Example (#1183) * blip wasm start * fix dependency issue, move token stream here * vanilla js worker * roll back vscode * spell
2023-10-26 14:24:02 +08:00
"candle-wasm-examples/*",
Simd128 vec-dot for q4_0. (#974) * Simd128 vec-dot for q4_0. * Bugfix. * Add wasm tests. * Bugfix for the q40 vecdot. * More quantization tests.
2023-09-27 21:15:30 +08:00
"candle-wasm-tests",
Move the tensor-tools binary in a separate crate. (#1969)
2024-03-30 22:49:37 +08:00
"tensor-tools",
Integrate the kernels bits.
2023-06-22 16:59:00 +08:00
]
Put the onnx example behind a feature flag. (#1276) * Put the onnx example behind a feature flag. * Exclude the onnx bits from the workspace. * README tweaks.
2023-11-06 14:45:07 +08:00
exclude = [
"candle-flash-attn",
"candle-kernels",
Adding the actual backend
2023-11-10 02:53:14 +08:00
"candle-metal-kernels",
Put the onnx example behind a feature flag. (#1276) * Put the onnx example behind a feature flag. * Exclude the onnx bits from the workspace. * README tweaks.
2023-11-06 14:45:07 +08:00
"candle-onnx",
]
Use resolver 2 explicitely. (#597)
2023-08-25 16:35:40 +08:00
resolver = "2"
Sketch the Falcon model. (#93) * Sketch the Falcon model. * Add more substance to the falcon example. * Falcon (wip). * Falcon (wip again). * Falcon inference. * Get the weights from the api and properly generate the model. * Use the proper model. * Fix the file/revision names. * Fix bias handling. * Recompute the rot embeddings. * Fix the input shape. * Add the release-with-debug profile. * Silly bugfix. * More bugfixes. * Stricter shape checking in matmul.
2023-07-07 02:01:21 +08:00
Update the repo location. (#305)
2023-08-02 18:12:18 +08:00
[workspace.package]
Bump the version number to 0.5.1. (#2155) * Bump the version number to 0.5.1. * Fix clippy lints for 1.78. * More clippy fixes.
2024-05-03 17:17:05 +08:00
version = "0.5.1"
Update the repo location. (#305)
2023-08-02 18:12:18 +08:00
edition = "2021"
description = "Minimalist ML framework."
repository = "https://github.com/huggingface/candle"
keywords = ["blas", "tensor", "machine-learning"]
categories = ["science"]
Add the license files. (#335)
2023-08-07 21:11:27 +08:00
license = "MIT OR Apache-2.0"
Update the repo location. (#305)
2023-08-02 18:12:18 +08:00
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
[workspace.dependencies]
Update the image crate + use the re-exported version. (#1893) * Update the image crate + use the re-exported version. * Update to using ab_glyph.
2024-03-21 17:56:41 +08:00
ab_glyph = "0.2.23"
Support the Accelerate BLAS on macOS. (#325) * Add the accelerate feature. * Ffi tweaks.
2023-08-06 00:25:24 +08:00
accelerate-src = { version = "0.3.2" }
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
anyhow = { version = "1", features = ["backtrace"] }
byteorder = "1.4.3"
Bump the version number to 0.5.1. (#2155) * Bump the version number to 0.5.1. * Fix clippy lints for 1.78. * More clippy fixes.
2024-05-03 17:17:05 +08:00
candle = { path = "./candle-core", package = "candle-core", version = "0.5.1" }
candle-datasets = { path = "./candle-datasets", version = "0.5.1" }
candle-flash-attn = { path = "./candle-flash-attn", version = "0.5.1" }
candle-kernels = { path = "./candle-kernels", version = "0.5.1" }
candle-metal-kernels = { path = "./candle-metal-kernels", version = "0.5.1" }
candle-nn = { path = "./candle-nn", version = "0.5.1" }
candle-onnx = { path = "./candle-onnx", version = "0.5.1" }
candle-transformers = { path = "./candle-transformers", version = "0.5.1" }
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
clap = { version = "4.2.4", features = ["derive"] }
Optimizing decode matmul (Phi at 28tok/s on M3). Adding some benchmark in order to help checking out matmul performance.
2023-12-20 16:54:19 +08:00
criterion = { version = "0.5.1", default-features=false }
Bump cudarc version to 0.11.4 (#2230)
2024-06-01 14:18:35 +08:00
cudarc = { version = "0.11.4", features = ["std", "cublas", "cublaslt", "curand", "driver", "nvrtc", "f16", "cuda-version-from-build-system", "dynamic-linking"], default-features=false }
Metavoice - first cut (#1717) * Add the metavoice transformer. * Sketch the speaker-encoder module. * Adding to the metavoice model. * Start adding the metavoice example. * Get some logits out. * Load the second stage model. * Get the second step to run. * Tweak the example. * Add encodec tilting. * Glue the different bits together. * Fix a shape issue. * Use a constant. * BPE tokenization. * Add a warning.
2024-03-03 01:50:01 +08:00
fancy-regex = "0.13.0"
Update gemm requirement from 0.17.0 to 0.18.0 Updates the requirements on [gemm](https://github.com/sarah-ek/gemm) to permit the latest version. - [Commits](https://github.com/sarah-ek/gemm/compare/gemm@0.17.0...gemm@0.17.1) --- updated-dependencies: - dependency-name: gemm dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
2024-06-01 14:19:34 +08:00
gemm = { version = "0.18.0", features = ["wasm-simd128-enable"] }
Upgrading hf-hub.
2023-08-29 20:14:26 +08:00
hf-hub = "0.3.0"
Simd support (#448) * Import the simd intrinsics in candle-core. * simd version of reduce-sum. * Bugfix. * Fix some clippy lints.
2023-08-15 16:50:38 +08:00
half = { version = "2.3.1", features = ["num-traits", "use-intrinsics", "rand_distr"] }
Remove the deprecated wav crate in favor of hound. (#2202)
2024-05-22 03:43:35 +08:00
hound = "3.5.1"
Update the image crate + use the re-exported version. (#1893) * Update the image crate + use the re-exported version. * Update to using ab_glyph.
2024-03-21 17:56:41 +08:00
image = { version = "0.25.0", default-features = false, features = ["jpeg", "png"] }
imageproc = { version = "0.24.0", default-features = false }
Fix the mkl build. (#204) * Fix the mkl build. * Fix the build properly.
2023-07-20 02:41:11 +08:00
intel-mkl-src = { version = "0.8.1", features = ["mkl-static-lp64-iomp"] }
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
libc = { version = "0.2.147" }
log = "0.4"
Update memmap2 requirement from 0.7.1 to 0.9.3 (#1556) Updates the requirements on [memmap2](https://github.com/RazrFalcon/memmap2-rs) to permit the latest version. - [Changelog](https://github.com/RazrFalcon/memmap2-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/RazrFalcon/memmap2-rs/compare/v0.7.1...v0.7.1) --- updated-dependencies: - dependency-name: memmap2 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-10 23:27:59 +08:00
memmap2 = { version = "0.9.3", features = ["stable_deref_trait"] }
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
num_cpus = "1.15.0"
num-traits = "0.2.15"
Update parquet requirement from 50.0.0 to 51.0.0 (#1867) Updates the requirements on [parquet](https://github.com/apache/arrow-rs) to permit the latest version. - [Changelog](https://github.com/apache/arrow-rs/blob/master/CHANGELOG-old.md) - [Commits](https://github.com/apache/arrow-rs/compare/50.0.0...50.0.0) --- updated-dependencies: - dependency-name: parquet dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-30 04:58:15 +08:00
parquet = { version = "51.0.0" }
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
rand = "0.8.5"
Fix randn cpu (#382) * Change distributions Standard generates in [0, 1), Normal is correct. * Add test Not sure if this is the best place to put the test * Remove unnecessary use
2023-08-10 12:33:44 +08:00
rand_distr = "0.4.3"
Parallelise the CPU kernels for the conv ops. (#401) * Parallelise the conv2d op. * Tighter control on threading. * Also parallelise conv1d. * Add some safety comment.
2023-08-11 12:51:58 +08:00
rayon = "1.7.0"
Update safetensors requirement from 0.3.1 to 0.4.1 (#1591) Updates the requirements on [safetensors](https://github.com/huggingface/safetensors) to permit the latest version. - [Release notes](https://github.com/huggingface/safetensors/releases) - [Changelog](https://github.com/huggingface/safetensors/blob/main/RELEASE.md) - [Commits](https://github.com/huggingface/safetensors/compare/v0.3.1...v0.3.3) --- updated-dependencies: - dependency-name: safetensors dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-16 05:34:40 +08:00
safetensors = "0.4.1"
Removing `candle-hub` internal to extract into `hf-hub` standalone.
2023-07-19 21:04:38 +08:00
serde = { version = "1.0.171", features = ["derive"] }
Add support to UL2 model family (#1300) * Add support to UL2 model family * Update docs with UL2 * Create ActivationWithOptionalGating to avoid polluting activations * Also refactor quantized t5 * Remove useless conversion * Revert Activation::NewGelu name change * Remove useless return * Apply rustfmt and clippy recommendations * Reuse t5::ActivationWithOptionalGating in quantized version * (cosmetic change) use a match rather than ifs + avoid early returns. --------- Co-authored-by: Laurent <laurent.mazare@gmail.com>
2023-11-10 01:55:09 +08:00
serde_plain = "1.0.2"
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
serde_json = "1.0.99"
thiserror = "1"
Update tokenizers requirement from 0.15.0 to 0.19.1 (#2104) Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version. - [Release notes](https://github.com/huggingface/tokenizers/releases) - [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md) - [Commits](https://github.com/huggingface/tokenizers/compare/v0.15.0...v0.15.2) --- updated-dependencies: - dependency-name: tokenizers dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-22 23:10:46 +08:00
tokenizers = { version = "0.19.1", default-features = false }
Bert tracing (#184) * Add some tracing to bert. * More tracing. * Add a flag for tracing.
2023-07-18 02:40:42 +08:00
tracing = "0.1.37"
tracing-chrome = "0.7.1"
tracing-subscriber = "0.3.7"
Use yoke to provide a self-referential container for mmaped safetenso… (#939) * Use yoke to provide a self-referential container for mmaped safetensor files. * Add the new self-owned type for safetensor files without removing the previous version. * Add routing. * Add an initializer for the case of multiple files.
2023-09-23 22:43:11 +08:00
yoke = { version = "0.7.2", features = ["derive"] }
Update zip requirement from 0.6.6 to 1.1.1 (#2103) * Update zip requirement from 0.6.6 to 1.1.1 --- updated-dependencies: - dependency-name: zip dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Fix for the zip crate update. --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: laurent <laurent.mazare@gmail.com>
2024-04-22 22:23:27 +08:00
zip = { version = "1.1.1", default-features = false }
Fixing tests + matmul from MFA
2023-12-13 23:58:36 +08:00
metal = { version = "0.27.0", features = ["mps"]}
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
Sketch the Falcon model. (#93) * Sketch the Falcon model. * Add more substance to the falcon example. * Falcon (wip). * Falcon (wip again). * Falcon inference. * Get the weights from the api and properly generate the model. * Use the proper model. * Fix the file/revision names. * Fix bias handling. * Recompute the rot embeddings. * Fix the input shape. * Add the release-with-debug profile. * Silly bugfix. * More bugfixes. * Stricter shape checking in matmul.
2023-07-07 02:01:21 +08:00
[profile.release-with-debug]
inherits = "release"
debug = true