vllm/tests/async_engine
Cyrus Leung 350f9e107f
[CI/Build] Move `test_utils.py` to `tests/utils.py` (#4425)
Since #4335 was merged, I've noticed that the definition of ServerRunner in the tests is the same as in the test for OpenAI API. I have moved the class to the test utilities to avoid code duplication. (Although it only has been repeated twice so far, I will add another similar test suite in #4200 which would duplicate the code a third time)

Also, I have moved the test utilities file (test_utils.py) to under the test directory (tests/utils.py), since none of its code is actually used in the main package. Note that I have added __init__.py to each test subpackage and updated the ray.init() call in the test utilities file in order to relative import tests/utils.py.
2024-05-13 23:50:09 +09:00
..
__init__.py [CI/Build] Move `test_utils.py` to `tests/utils.py` (#4425) 2024-05-13 23:50:09 +09:00
api_server_async_engine.py Migrate linter from `pylint` to `ruff` (#1665) 2023-11-20 11:58:01 -08:00
test_api_server.py [Core] Fix engine-use-ray broken (#4105) 2024-04-16 05:24:53 +00:00
test_async_llm_engine.py [Bugfix][Core] Fix get decoding config from ray (#4335) 2024-04-27 11:30:08 +00:00
test_chat_template.py [Frontend] Move async logic outside of constructor (#4674) 2024-05-08 22:48:33 -07:00
test_merge_async_iterators.py [Bugfix] Abort requests when the connection to /v1/completions is interrupted (#4363) 2024-04-27 09:48:37 -07:00
test_openapi_server_ray.py [CI/Build] Move `test_utils.py` to `tests/utils.py` (#4425) 2024-05-13 23:50:09 +09:00
test_request_tracker.py Add health check, make async Engine more robust (#3015) 2024-03-04 22:01:40 +00:00