autogen/test
James Woffinden-Luey dad9c66104
Agenteval integration (#2672)
* first pass at offline agent eval integration

* Integrating AgentEval for offline scenarios

* removing old changes

* fixing notebook, updating docs

* fixing subcriteria bug

* updating class comment

* cleaning up agent constructors

* moving AgentEval agents to separate folder and adding a brief README

* fixing build breaks

* fixing formatting break

* fixing comments

* consolidating files in the agenteval folder under contrib and cleaning up imports

* fixing import ordering

* adding basic agenteval tests and fixing criteria parsing bug

* first try at adding openai agenteval tests to build process

* adding non-openai agenteval tests to build process

* updating test settings

* updating openai test

* Update test/agentchat/contrib/agent_eval/test_agent_eval.py

Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>

* Update .github/workflows/contrib-openai.yml

Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>

* test commit

* updating typing and converting to pydantic objects

* fixing test file

---------

Co-authored-by: Beibin Li <BeibinLi@users.noreply.github.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
2024-05-14 07:14:37 +00:00
..
agentchat Agenteval integration (#2672) 2024-05-14 07:14:37 +00:00
cache Streamline Testing with `pytest-cov` and `pytest` Defaults (#2490) 2024-04-29 00:27:34 +00:00
coding Feature: Add ability to use a separate python environment in local executor (#2615) 2024-05-11 06:25:20 +00:00
io Add isort (#2265) 2024-04-05 02:26:06 +00:00
oai Streamline Testing with `pytest-cov` and `pytest` Defaults (#2490) 2024-04-29 00:27:34 +00:00
test_files Agenteval integration (#2672) 2024-05-14 07:14:37 +00:00
conftest.py fix local test failures (#2386) 2024-04-15 12:34:26 +00:00
test_browser_utils.py Add isort (#2265) 2024-04-05 02:26:06 +00:00
test_code_utils.py Feature: Add ability to use a separate python environment in local executor (#2615) 2024-05-11 06:25:20 +00:00
test_function_utils.py Fix types in tool tests (#2285) 2024-04-05 15:51:49 +00:00
test_graph_utils.py Add isort (#2265) 2024-04-05 02:26:06 +00:00
test_logging.py Add isort (#2265) 2024-04-05 02:26:06 +00:00
test_notebook.py Add isort (#2265) 2024-04-05 02:26:06 +00:00
test_pydantic.py Add decorator for function calling (#1018) 2023-12-25 16:07:20 +00:00
test_retrieve_utils.py Add source to the answer for default prompt (#2289) 2024-04-10 00:45:26 +00:00
test_token_count.py Add isort (#2265) 2024-04-05 02:26:06 +00:00
twoagent.py set use_docker to default to True (#1147) 2024-01-18 17:03:49 +00:00