vllm/examples/offline_inference
youkaichao 2382ad29d1
[ci] fix linter (#13701)
Signed-off-by: youkaichao <youkaichao@gmail.com>
2025-02-22 20:28:59 +08:00
..
basic Merge similar examples in `offline_inference` into single `basic` example (#12737) 2025-02-20 04:53:51 -08:00
openai [CI/Build] Auto-fix Markdown files (#12941) 2025-02-08 04:25:15 -08:00
profiling_tpu [Bugfix][Example] Fix GCed profiling server for TPU (#12792) 2025-02-13 11:52:11 +08:00
audio_language.py [Model] Ultravox Model: Support v0.5 Release (#12912) 2025-02-10 22:02:48 +00:00
chat_with_tools.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
data_parallel.py [ci] fix linter (#13701) 2025-02-22 20:28:59 +08:00
disaggregated_prefill.py [Bugfix] Offline example of disaggregated prefill (#13214) 2025-02-13 20:20:47 -08:00
distributed.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
encoder_decoder.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
florence2_inference.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
llm_engine_example.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
lora_with_quantization_inference.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
mlpspeculator.py [Doc] Replace ibm-fms with ibm-ai-platform (#12709) 2025-02-04 07:05:04 +00:00
multilora_inference.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
neuron.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
neuron_int8_quantization.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
pixtral.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
prefix_caching.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
prithvi_geospatial_mae.py [Model] IBM/NASA Prithvi Geospatial model (#12830) 2025-02-11 20:34:30 -08:00
profiling.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
rlhf.py [BugFix] Pop instead of del CUDA_VISIBLE_DEVICES (#12962) 2025-02-12 00:21:50 +08:00
rlhf_colocate.py [BugFix] Pop instead of del CUDA_VISIBLE_DEVICES (#12962) 2025-02-12 00:21:50 +08:00
save_sharded_state.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
simple_profiling.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
structured_outputs.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
torchrun_example.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
tpu.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
vision_language.py [V1] Update doc and examples for H2O-VL (#13349) 2025-02-16 10:35:54 +00:00
vision_language_embedding.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00
vision_language_multi_image.py [VLM][Bugfix] Pass processor kwargs properly on init (#13516) 2025-02-19 13:13:50 +00:00
whisper.py [Misc] Add SPDX-License-Identifier headers to python source files (#12628) 2025-02-02 11:58:18 -08:00