langchain4j/langchain4j-jlama
Jake Luciani 21eb8b962f
Jlama revision bump, add working Q type to builder (#1825)
## Change
Bump jlama rev to 0.5.0

This rev is currently being promoted in maven so should be there in next
6 hours.

## General checklist
- [X] There are no breaking changes
- [X] I have added unit and integration tests for my change
- [X] I have manually run all the unit and integration tests in the
module I have added/changed, and they are all green
- [X] I have manually run all the unit and integration tests in the
[core](https://github.com/langchain4j/langchain4j/tree/main/langchain4j-core)
and
[main](https://github.com/langchain4j/langchain4j/tree/main/langchain4j)
modules, and they are all green
2024-09-25 08:55:25 +02:00
..
src Jlama revision bump, add working Q type to builder (#1825) 2024-09-25 08:55:25 +02:00
README.md Jlama revision bump, add working Q type to builder (#1825) 2024-09-25 08:55:25 +02:00
pom.xml Jlama revision bump, add working Q type to builder (#1825) 2024-09-25 08:55:25 +02:00

README.md

Jlama integration for langchain4j

Jlama is a Java library that provides a simple way to integrate LLM models into Java applications.

Jlama is built with Java 20+ and utilizes the new Vector API for faster inference.

Jlama uses huggingface models in safetensor format. Models must be specified using the owner/model-name format. For example, meta-llama/Llama-2-7b-chat-hf.

Pre-quantized models are maintained under https://huggingface.co/tjake