ad73e93da2
* Detach the tensors on batch-norm eval. * Fix pyo3 bindings. * Black tweak. * Formatting. * Also update the pyo3-onnx formatting. * Apply black. |
||
|---|---|---|
| .. | ||
| _additional_typing | ||
| py_src/candle | ||
| src | ||
| tests | ||
| .gitignore | ||
| Cargo.toml | ||
| README.md | ||
| build.rs | ||
| e5.py | ||
| pyproject.toml | ||
| quant-llama.py | ||
| stub.py | ||
| test.py | ||
| test_pytorch.py | ||
README.md
Installation
From the candle-pyo3 directory, enable a virtual env where you will want the
candle package to be installed then run.
maturin develop -r
python test.py
Generating Stub Files for Type Hinting
For type hinting support, the candle-pyo3 package requires *.pyi files. You can automatically generate these files using the stub.py script.
Steps:
- Install the package using
maturin. - Generate the stub files by running:
python stub.py
Validation:
To ensure that the stub files match the current implementation, execute:
python stub.py --check