autogen/test/agentchat
James Woffinden-Luey dad9c66104
Agenteval integration (#2672)
* first pass at offline agent eval integration

* Integrating AgentEval for offline scenarios

* removing old changes

* fixing notebook, updating docs

* fixing subcriteria bug

* updating class comment

* cleaning up agent constructors

* moving AgentEval agents to separate folder and adding a brief README

* fixing build breaks

* fixing formatting break

* fixing comments

* consolidating files in the agenteval folder under contrib and cleaning up imports

* fixing import ordering

* adding basic agenteval tests and fixing criteria parsing bug

* first try at adding openai agenteval tests to build process

* adding non-openai agenteval tests to build process

* updating test settings

* updating openai test

* Update test/agentchat/contrib/agent_eval/test_agent_eval.py

Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>

* Update .github/workflows/contrib-openai.yml

Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>

* test commit

* updating typing and converting to pydantic objects

* fixing test file

---------

Co-authored-by: Beibin Li <BeibinLi@users.noreply.github.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
2024-05-14 07:14:37 +00:00
..
contrib Agenteval integration (#2672) 2024-05-14 07:14:37 +00:00
extensions Update pre-commit (#2067) 2024-03-19 02:55:37 +00:00
test_agent_logging.py feat: add event logging api and more tracing (#2478) 2024-04-23 22:27:47 +00:00
test_agent_setup_with_use_docker_settings.py fix local test failures (#2386) 2024-04-15 12:34:26 +00:00
test_agent_usage.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_agentchat_utils.py Add isort (#2265) 2024-04-05 02:26:06 +00:00
test_assistant_agent.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_async.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_async_chats.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_async_get_human_input.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_cache_agent.py General Enhancements in agentchat 2.0 (#1906) 2024-03-09 15:15:19 +00:00
test_chats.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_conversable_agent.py Fix for http client (#2579) 2024-05-04 14:12:36 +00:00
test_function_and_tool_calling.py Function calling upgrade (#1443) 2024-01-31 15:30:55 +00:00
test_function_call.py Add isort (#2265) 2024-04-05 02:26:06 +00:00
test_function_call_groupchat.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_groupchat.py Add role to reflection with llm (#2527) 2024-05-14 06:46:01 +00:00
test_human_input.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_math_user_proxy_agent.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_nested.py improve test speed (#2406) 2024-04-17 20:10:18 +00:00
test_tool_calls.py Add isort (#2265) 2024-04-05 02:26:06 +00:00
tsp_prompt.txt cleanup 2023-09-16 10:57:57 +00:00