Laurent Mazare
|
dac73edb34
|
AVX optimized q8k vecdot. (#1024)
|
2023-10-03 12:10:58 +01:00 |
|
Laurent Mazare
|
089fc3b584
|
Improve the quantized whisper setup. (#1018)
* Improve the quantized whisper setup.
* Fix the config file paths.
* Use the standard matmul where possible.
|
2023-10-02 17:17:46 +01:00 |
|
Laurent Mazare
|
263a172202
|
Improve the testing of the optimized quantized vec-dot ops (#1016)
* Expose the unopt functions for testing.
* Better testing of the optimized quantized computations.
|
2023-10-02 09:50:43 +01:00 |
|
Laurent Mazare
|
096dee7073
|
Bump the version to 0.3.0. (#1014)
* Bump the version to 0.3.0.
* Changelog update.
|
2023-10-01 13:51:57 +01:00 |
|
Laurent Mazare
|
4e55aaa51f
|
Simd128 version of the q2k-q8k vecdot product. (#1011)
* Sketch the simd128 version of q2k vecdot.
* Use a single accumulator.
* Simdify the q2k-q8k vecdot product.
* Cosmetic change.
|
2023-09-30 20:12:41 +01:00 |
|
Laurent Mazare
|
8a49e01b9d
|
Add the remaining quantized tests to the wasm suite. (#980)
|
2023-09-28 08:42:56 +01:00 |
|
Laurent Mazare
|
9cb110c44c
|
Sketch a simd128 optimized q4k vecdot. (#977)
* Sketch a simd128 optimized q4k vecdot.
* Simdify.
* More quantization optimizations.
* Again more simdification.
* Simdify the splitting loop.
|
2023-09-27 20:19:38 +01:00 |
|
Laurent Mazare
|
667f01c173
|
Simd128 vec-dot for q4_0. (#974)
* Simd128 vec-dot for q4_0.
* Bugfix.
* Add wasm tests.
* Bugfix for the q40 vecdot.
* More quantization tests.
|
2023-09-27 14:15:30 +01:00 |