Integration test for dev branch. #792
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* added gifs and banner * add badges * added logos * new screenshots * update readme to local paths * remove styling * rounded corners on replay * image to path * update badge to use png
* fixed padding * update why agentops and star graph
* add codecov bot * add codecov bot * python 3.11
* Updated starter example * Update openai-gpt.ipynb * Update openai-gpt.ipynb * Update openai-gpt.ipynb * Update openai-gpt.ipynb
* Return token cost on session_end * Add type hint for return * Add docstring * Fix black formatting error
* revert Apply @check_init to decorators * bump version
* Updated starter example * Update openai-gpt.ipynb * Update openai-gpt.ipynb * Update openai-gpt.ipynb * Update openai-gpt.ipynb * Langchain added to documentation Closes #270 --------- Co-authored-by: akj <albertkimjunior@gmail.com>
Co-authored-by: akj <albertkimjunior@gmail.com>
* Update quickstart.mdx * Test commit * Updates Github stars with dynamic data using MDX + <script> Same format will fix #267
suck it mint growth plan, I did it my damn self
* decouple sessions and client * formatter test * formatter test * tests * black formatting * assign llm calls to sessions * worker and tracker changes * use jwt for session ids * test fixes * end all sessions * test: fix session tests * reset env between tests * formatting * add worker to session instead of client * test fixes!!! * test fixes * test coverage * singleton tests * tracker fixes * record function multiple sessions * async tests * test fix * block record function if multiple sessions * manual tests * session end fix * manual server test * notebook tests * merge main * black formatting * cleanup * docs * moar docs * add patch function * multiple sessions docs * multisession example * fix tests * review fixes * import fix * comments * helper functions
* added autogen examples * added new docs card * indexnt mdx * updated notebooks or black * remove black jupyter * revert black
* Rounds up to nearest 100, makes script elegante suck it mint growth plan, I did it my damn self * mild file struct change to accommodate more scripts * oops don't update text with error message * also handle page navs and still update data * more robust method for updates on nav * final robustification * logo update (note needs design pass) Fixes #274 pending design pass * handling dynamic adjustments on all pages * Update host-env.mdx * Update host-env.mdx * Documentation Value Prop Positioning and Readability Updates * Icon images for docs * replace crew icon * icon & style updates * added stamp img * Big intro section update - for developers * Intro animations for Terminal * transferring currently unused UI to snippets * Massive readability change (bonus update coming) * Prepping Discord CTA (not final) * COMPLETE DRAFT push (incl. Discord CTA) * minor wording change * another minor wording change * OOPS fixed breaking change sry
Tox was removed in #606, hence no point to keep this file hanging around Signed-off-by: Teo <teocns@gmail.com>
Removing a redundant module `agentops.enums` and instead moving them in the modules they belong: - Moved `EventType` enum from `enums.py` to `event.py` - Moved `EndState` enum from `enums.py` to `session.py` - Removed `enums.py` module - Updated imports across affected files - Updated dependency graph in `tach.yml` Signed-off-by: Teo <teocns@gmail.com>
* feat: Add Gemini API integration - Add GeminiProvider class for tracking Gemini API calls - Support both sync and streaming modes - Track prompts, completions, and token usage - Add test script demonstrating usage Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Pass session correctly to track LLM events in Gemini provider Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * feat: Add Gemini integration with example notebook Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Add null checks and improve test coverage for Gemini provider Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * style: Add blank lines between test functions Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Improve test coverage for Gemini provider Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * style: Fix formatting in test_gemini.py Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Add comprehensive test coverage for edge cases and error handling Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Add graceful API key handling and skip tests when key is missing Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * style: Fix formatting issues in test files Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * style: Remove trailing whitespace in test_gemini.py Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Add coverage for error handling, edge cases, and argument handling in Gemini provider Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Add streaming exception handling test coverage Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * style: Apply ruff auto-formatting to test_gemini.py Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Fix type errors and improve test coverage for Gemini provider Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Add comprehensive error handling test coverage for Gemini provider Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * style: Apply ruff-format fixes to test_gemini.py Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Configure Gemini API key before model initialization Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Update GeminiProvider to properly handle instance methods Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Use provider instance in closure for proper method binding Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Use class-level storage for original method Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Use module-level storage for original method Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * style: Apply ruff-format fixes to Gemini integration Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Move Gemini tests to unit test directory for proper coverage reporting Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Update Gemini provider to properly handle prompt extraction and improve test coverage Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Add comprehensive test coverage for Gemini provider session handling and event recording Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * style: Apply ruff-format fixes to test files Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Pass LlmTracker client to GeminiProvider constructor Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * remove extra files * fix: Improve code efficiency and error handling in Gemini provider - Add _extract_token_counts helper method - Make error handling consistent with OpenAI provider - Remove redundant session checks - Improve error message formatting - Add comprehensive documentation Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * test: Add comprehensive test coverage for Gemini provider Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * fix: Set None as default values and improve test coverage Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * build: Add google-generativeai as test dependency Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * docs: Update examples and README for Gemini integration Co-Authored-By: Alex Reibman <meta.alex.r@gmail.com> * add gemini logo image * add gemini to examples * add gemini to docs * refactor handle_response method * cleanup gemini tracking code * delete unit test for gemini * rename and clean gemini example notebook * ruff * update docs --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: Alex Reibman <meta.alex.r@gmail.com> Co-authored-by: reibs <areibman@gmail.com> Co-authored-by: Pratyush Shukla <ps4534@nyu.edu>
* added new methods and fixed issues * updated test code * more organized test * ruff * upgrade for fixes * remove `ActionEvent` from `on_llm_new_token` because @areibman said "too verbose"
This change updates the default behavior of the AgentOps logging configuration to not log to a file unless explicitly specified. Previously, users of other OpenSource libraries that integrate with AgentOps had to set the AGENTOPS_LOGGING_TO_FILE environment variable to avoid creating a log file by default. With this update, the log file will not be created unless the user sets AGENTOPS_LOGGING_TO_FILE to "true". This allows users to opt-in to local file logging if they wish to see their logs locally, rather than just on the AgentOps platform.
…h specific request filtering (#670) * test(record_tool): replace `assert len(mock_req.request_history) == N` checks with specific request filtering 1. Replaced `assert len(mock_req.request_history) == N` checks with specific request filtering 2. Added helper to find relevant requests using URL patterns 3. Made assertions more focused on the actual tool recording functionality 4. Maintained all existing functionality checks while removing dependency on request count * test(record_action): replace `assert len(mock_req.request_history) == N` checks with specific request filtering Replaced request count assertions with specific request filtering Added helper to find relevant requests using URL patterns Made assertions more focused on the actual action recording functionality Maintained all existing functionality checks while removing dependency on request count Signed-off-by: Teo <teocns@gmail.com> * test(session): replace `assert len(mock_req.request_history) == N` checks with specific request filtering Signed-off-by: Teo <teocns@gmail.com> * test(pre_init): replace `assert len(mock_req.request_history) == N` checks with specific request filtering Signed-off-by: Teo <teocns@gmail.com> * test(canary): replace `assert len(mock_req.request_history) == N` checks with specific request filtering Signed-off-by: Teo <teocns@gmail.com> --------- Signed-off-by: Teo <teocns@gmail.com>
* fix(tracker): initialize LiteLLM provider conditionally for OpenAI API patching * feat(tracker): add detection for LiteLLM calls before OpenAI initialization * refactor(tracker): remove print statements and update LiteLLM initialization variable * fix(tracker): add version check for OpenAI module before initialization * refactor(tracker): clean up whitespace in LlmTracker class methods * added appropriate comments for further reference --------- Co-authored-by: Pratyush Shukla <ps4534@nyu.edu>
* feat: add Haystack integration documentation and examples * add haystack logo * cosmetic changes to refine content * fix: update Haystack logo URL and clean up example notebooks * fix: update Haystack logo image --------- Co-authored-by: Pratyush Shukla <ps4534@nyu.edu>
* Delete styles * delete scripts --------- Co-authored-by: Pratyush Shukla <ps4534@nyu.edu>
Signed-off-by: Teo <teocns@gmail.com>
Codecov ReportAttention: Patch coverage is 📢 Thoughts on this report? Let us know! |
Contributor
|
please change the base to |
|
| GitGuardian id | GitGuardian status | Secret | Commit | Filename | |
|---|---|---|---|---|---|
| 12083425 | Triggered | Generic High Entropy Secret | d12f5f9 | tests/core_manual_tests/agentchat_agentops.ipynb | View secret |
🛠 Guidelines to remediate hardcoded secrets
- Understand the implications of revoking this secret by investigating where it is used in your code.
- Replace and store your secret safely. Learn here the best practices.
- Revoke and rotate this secret.
- If possible, rewrite git history. Rewriting git history is not a trivial act. You might completely break other contributing developers' workflow and you risk accidentally deleting legitimate data.
To avoid such incidents in the future consider
- following these best practices for managing and storing secrets including API keys and other credentials
- install secret detection on pre-commit to catch secret before it leaves your machine and ease remediation.
🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
19 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Creates an isolated test environment for each framework with
uv runand tests across multiple Python versions and multiple framework package versions.Run with
bin/tests/test-matrix-integrationfor the full suite. Other flags listed inside command file.