* first pass at offline agent eval integration
* Integrating AgentEval for offline scenarios
* removing old changes
* fixing notebook, updating docs
* fixing subcriteria bug
* updating class comment
* cleaning up agent constructors
* moving AgentEval agents to separate folder and adding a brief README
* fixing build breaks
* fixing formatting break
* fixing comments
* consolidating files in the agenteval folder under contrib and cleaning up imports
* fixing import ordering
* adding basic agenteval tests and fixing criteria parsing bug
* first try at adding openai agenteval tests to build process
* adding non-openai agenteval tests to build process
* updating test settings
* updating openai test
* Update test/agentchat/contrib/agent_eval/test_agent_eval.py
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
* Update .github/workflows/contrib-openai.yml
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
* test commit
* updating typing and converting to pydantic objects
* fixing test file
---------
Co-authored-by: Beibin Li <BeibinLi@users.noreply.github.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
* Added 'role' as a summary_args and to the reflection_with_llm flow to be able to pass the role for the summarizing prompt
* Added 'role' as a summary_args and to the reflection_with_llm flow to be able to pass the role for the summarizing prompt, minor docstring adjustments
* Added test for summary prompt role assignment
* Fixed docstrings and mocked llm-config in the test
* Update autogen/agentchat/conversable_agent.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* ran pre-commit
* ran pre-commit2
* fixed old arg name
* Delete dasdaasd
No idea what this file was about
* Fixed incorrect merge update on test_groupchat
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* update orm branch + accesibility tweaks
* general file location refactor
* add support for LocalCommandLineCodeExecutor and DockerCommandLineCodeExecutor
* update code execution config laoding
* version update
* bump version rc1
* add model type selection (openai , gemini, azure)
* add ability to test workflow
* psycopg3 support
* add close logic to build tab pop ups, enable testing of workflows in build view
* updates to dbmanager, version bump
* add max_tokens default value
* ensure sessions are used correctly in dbmanager
* initial support for migrations
* update sessions/workflow api routing for clarity.
* general refactor, + add support for initial sample workflows
* orm branch updates
* Removed incorrect Git LFS files
* update git lfs tracking
---------
Co-authored-by: Audel Rouhi <knucklessg1@gmail.com>
* Add ability to use virtual environments in local executor
* Copy environment variables from parent environment
* Fix mypy errors and formatting
* Account for venv on Windows
* Use a virtual environment context object instead of path
* Add utility method to create a virtual environment
* Remove assertion using `_venv_path`
* Add tests for `create_virtual_env`
* Modify test code and add output assertion
* Modify test code and assertion
* Execute activation script before actual command on windows
* Add docs for using a virtual env
* Initial resume
* Cleaned up resume function
* Further updating resuming group chat
* Added async resume_chat and documentation
* Added test cases, refined group chat function parameters
* compiled documentation
* Added tests to main
* Removed mdx file.
* Revert "Merge remote-tracking branch 'origin/main' into groupchatresume"
This reverts commit 8f709308f0, reversing
changes made to 8bfcb2bff1.
* Refactored resume to remove initiate_chat
* fix git history
* fix history
* Added clean-up of objects, _groupchat references, and messages_to_string updated
* Added termination-based resumption in notebook, added test cases and improved robustness on resuming messages parameter
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* Update graph_utils.py
Adds save_speaker_transitions_dict
* Update graph_utils.py
Adds export_path:str which defaults to None into visualize_speaker_transitions_dict. In there, run plt.savefig(path) if export_path is not None
* Update graph_utils.py
* Update graph_utils.py
Adds export_path functionality to visualize_speaker_transitions_dict()
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* WIP add SKAgent to proj
* Fix Unit test
* Remove accidental coommit
* Add version props
* Revert Kludge test changes
* PR comments : executionSettings and use / upgrade SemanticKernelExperimentalVersion
* Add back deleted api and constructor, mark as Obsolete
* PR feedback : Introduce SemanticKernelChatCompletionAgent. Add unit tests and refactor semanticKernelChatMessageContentConnector to be SkSequentialChatMessageContentConnector.cs
* Revert SkSequentialChatMessageContentConnector
* PR comments, remove systemMessage in SemanticKernelChatCompletionAgent
* Fix formatting
* Fix bad merge
* Revert "Fix bad merge"
This reverts commit a189ad9f42.
* Remove accidental commit
---------
Co-authored-by: luongdavid <luongdavid@microsoft.com>
* Correct link to Jupyter Code Executor in code-executors.ipynb
The link to the code executor was referencing the wrong folder.
* Update website/docs/tutorial/code-executors.ipynb
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* Update website/docs/tutorial/code-executors.ipynb
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* Fix for http client
* fixed constructor to only ignore the http_client while copying
* fixed comment formating
* removed check for http_client and added error message with docs
* fix formatting
* fix formatting
* added test for http-fix
* changed title and content of docs
* changed test func name
* Function Calling with GPTAssistantAgent
* Add Link to Notebook in Website
* Add metadata to the notebook
* formatting of H2 and H3 text
* updated to new method of function calling
* Run Pre-commit
* utilize get_function_schema
* Update token_count_utils.py
Update the token counts of new gpt models
ref: https://platform.openai.com/docs/models/gpt-4-turbo-and-gpt-4
* format code with pre-commit
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* Added requery_on_multiple_speaker_names to GroupChat and updated _finalize_speaker to requery on multiple speaker names (if enabled)
* Removed unnecessary comments
* Update to current main
* Tweak error message.
* Comment clarity
* Expanded description of Group Chat requery_on_multiple_speaker_names
* Reworked to two-way nested chat for speaker selection with default of 2 retries.
* Adding validation of new GroupChat attributes
* Updates as per @ekzhu's suggestions
* Update groupchat
- Added select_speaker_auto_multiple_template and select_speaker_auto_none_template
- Added max_attempts comment
- Re-instated support for role_for_select_speaker_messages
-
* Update conversable_agent.py
Added ability to force override role for a message to support select speaker prompt.
* Update test_groupchat.py
Updated existing select_speaker test functions as underlying approach has changed, added necessary tests for new functionality.
* Removed block for manual selection in select_speaker function.
* Catered for no-selection during manual selection mode
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Add minimum token threshold in MessageHistoryLimiter
* Update transforms tests for the threshold
* Move min_threshold_tokens from Message to Token Limiter
* Optimize _check_tokens_threshold
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
* Apply requested changes (renaming, phrasing, validations)
* Fix format
* Fix _check_tokens_threshold logic
* Update docs and notebook
* Improve phrasing
* Add min_tokens example in notebook
* Add min_tokens example in website docs
* Add min_tokens example in notebook
* Update website docs to be in sync with get_logs change
---------
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Xiaoyun Zhang