dnrops
/
candle
mirror of https://github.com/huggingface/candle.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
candle/Cargo.toml

51 lines
1.6 KiB
TOML
Raw Normal View History

Integrate the kernels bits.
2023-06-22 16:59:00 +08:00
[workspace]
members = [
Refactor the hierarchy.
2023-06-27 17:57:27 +08:00
"candle-core",
Move llama in a cargo-examples directory.
2023-07-03 18:30:58 +08:00
"candle-examples",
Very simple pyo3 bindings for candle.
2023-07-02 03:36:44 +08:00
"candle-hub",
Sketch the candle-nn crate. (#115) * Sketch the candle-nn crate. * Tweak the cuda dependencies. * More cuda tweaks.
2023-07-10 15:50:09 +08:00
"candle-nn",
Reenable pyo3 in the workspace list (#170) * Enable pyo3 back. * Adapt the CI.
2023-07-15 02:54:38 +08:00
"candle-pyo3",
Sketch the candle-transformers crate. (#147) * Sketch the candle-transformers crate. * Format the empty files.
2023-07-12 20:49:31 +08:00
"candle-transformers",
Wasm proof of concept. (#167) * Wasm proof of concept. * Run whisper inference in the browser. * Some fixes. * Move the wasm example. * Change the tokenizer config.
2023-07-14 21:51:46 +08:00
"candle-wasm-example",
Integrate the kernels bits.
2023-06-22 16:59:00 +08:00
]
Removing cuda default. Seems very important for a lot of exploring users usually on laptop without GPUs. Adding more README instructions in a follow up.
2023-07-14 22:52:15 +08:00
exclude = [
"candle-kernels",
]
Sketch the Falcon model. (#93) * Sketch the Falcon model. * Add more substance to the falcon example. * Falcon (wip). * Falcon (wip again). * Falcon inference. * Get the weights from the api and properly generate the model. * Use the proper model. * Fix the file/revision names. * Fix bias handling. * Recompute the rot embeddings. * Fix the input shape. * Add the release-with-debug profile. * Silly bugfix. * More bugfixes. * Stricter shape checking in matmul.
2023-07-07 02:01:21 +08:00
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
[workspace.dependencies]
anyhow = { version = "1", features = ["backtrace"] }
byteorder = "1.4.3"
clap = { version = "4.2.4", features = ["derive"] }
# Re-enable this once 0.9.13 as been released as it would include the cublas-f16 changes
# cudarc = { version = "0.9.13", optional = true, features = ["f16"] }
cudarc = { git = "https://github.com/LaurentMazare/cudarc.git", branch = "cublas-bf16", features = ["f16"] }
futures = "0.3.28"
Gemm update (#183) * Update the gemm dependency. * Update the comment too. * Pin the sha256 dependency.
2023-07-17 21:05:39 +08:00
# TODO: Switch back to the official gemm implementation once the following are available.
# https://github.com/sarah-ek/gemm/pull/8.
# https://github.com/sarah-ek/gemm/pull/9.
gemm = { git = "https://github.com/LaurentMazare/gemm.git", branch = "f16-vec-plus-wasm-simd" }
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
half = { version = "2.3.1", features = ["num-traits"] }
indicatif = "0.17.5"
intel-mkl-src = { version = "0.8.1", features = ["mkl-dynamic-lp64-iomp"] }
libc = { version = "0.2.147" }
log = "0.4"
memmap2 = "0.7.1"
num_cpus = "1.15.0"
num-traits = "0.2.15"
rand = "0.8.5"
reqwest = "0.11.18"
safetensors = "0.3.1"
serde = { version = "1.0.166", features = ["derive"] }
serde_json = "1.0.99"
Gemm update (#183) * Update the gemm dependency. * Update the comment too. * Pin the sha256 dependency.
2023-07-17 21:05:39 +08:00
sha256 = "=1.1.4"
Centralize the dependency versions and inherit them. (#177)
2023-07-16 14:47:17 +08:00
thiserror = "1"
tokenizers = { version = "0.13.3", default-features = false, features = ["onig"] }
tokio = "1.28.2"
tokio-test = "0.4.2"
wav = "1.0.0"
zip = { version = "0.6.6", default-features = false }
Sketch the Falcon model. (#93) * Sketch the Falcon model. * Add more substance to the falcon example. * Falcon (wip). * Falcon (wip again). * Falcon inference. * Get the weights from the api and properly generate the model. * Use the proper model. * Fix the file/revision names. * Fix bias handling. * Recompute the rot embeddings. * Fix the input shape. * Add the release-with-debug profile. * Silly bugfix. * More bugfixes. * Stricter shape checking in matmul.
2023-07-07 02:01:21 +08:00
[profile.release-with-debug]
inherits = "release"
debug = true