{ "interval": { "intervalStart": "2025-08-22T00:00:00.000Z", "intervalEnd": "2025-08-23T00:00:00.000Z", "intervalType": "day" }, "repository": "elizaos/eliza", "overview": "From 2025-08-22 to 2025-08-23, elizaos/eliza had 2 new PRs (1 merged), 2 new issues, and 6 active contributors.", "topIssues": [ { "id": "I_kwDOMT5cIs7HaHnG", "title": "Image Generation not working in Discord", "author": "harperaa", "number": 5809, "repository": "elizaos/eliza", "body": "**Describe the bug**\n\nGenerated images not appearing in discord, it shows in the webui, but not in discord.\n\n**To Reproduce**\n\nAsk to create an image, it says here it is, and describes it, but does not show up in discord.\n\nI see this in logs on webui. Executed action: GENERATE_IMAGE\n\n**Expected behavior**\n\nImage in discord.\n\n**Screenshots**\n\nIf I am missing some permission or config needed, please let me know. Again, it works in webui, but not in discord.", "createdAt": "2025-08-22T13:33:19Z", "closedAt": null, "state": "OPEN", "commentCount": 0 }, { "id": "I_kwDOMT5cIs7HWsWC", "title": "Validate Polygon related plugins work", "author": "linear", "number": 5808, "repository": "elizaos/eliza", "body": "test all plugins\n\n1. clone plugin repo\n2. run `elizaos dev` and plugins should start with test character if env are provided
\n - [ ] [https://github.com/elizaos-plugins/plugin-quickswap](https://github.com/elizaos-plugins/plugin-quickswap)\n - [ ] [https://github.com/elizaos-plugins/plugin-alethea](https://github.com/elizaos-plugins/plugin-alethea)\n - [ ] [https://github.com/elizaos-plugins/plugin-rofl](https://github.com/elizaos-plugins/plugin-rofl)\n - [ ] [https://github.com/elizaos-plugins/plugin-polymarket](https://github.com/elizaos-plugins/plugin-polymarket)\n - [ ] [https://github.com/elizaos-plugins/plugin-polygon-zkevm](https://github.com/elizaos-plugins/plugin-polygon-zkevm)\n - [ ] [https://github.com/elizaos-plugins/plugin-polygon](https://github.com/elizaos-plugins/plugin-polygon)", "createdAt": "2025-08-22T08:20:17Z", "closedAt": null, "state": "OPEN", "commentCount": 0 } ], "topPRs": [ { "id": "PR_kwDOMT5cIs6iWsk7", "title": "feat(scenarios): Add comprehensive scenario testing system", "author": "wtfsayo", "number": 5723, "body": "## Summary\n- Add ElizaOS scenario testing system with YAML-based test definitions\n- Support for both local and E2B sandboxed testing environments \n- Comprehensive evaluation engine with action tracking and LLM judges\n- Mock service support for deterministic testing\n- CLI command `elizaos scenario run` for running individual scenarios\n- Batch testing support with `bun run test:scenarios`\n\n## Key Features\n- **Environment Providers**: Local and E2B sandbox support with fallback\n- **Mock Engine**: Service call interception and response mocking\n- **Evaluation Engine**: Action tracking, response validation, trajectory analysis\n- **LLM Judgment**: AI-powered evaluation of test results\n- **Comprehensive Documentation**: Examples, specs, and usage guides\n\n## Files Added\n- Scenario CLI command implementation\n- Environment providers (Local, E2B, Mock)\n- Evaluation and reporting engines\n- 15+ example scenarios covering various test cases\n- Comprehensive documentation and guides\n\n## Testing\n- Adds `test:scenarios` script to CLI package\n- 15+ example scenarios with different complexity levels\n- E2B integration with graceful fallbacks\n- Mock service testing capabilities\n\nšŸ¤– Generated with [Claude Code](https://claude.ai/code)", "repository": "elizaos/eliza", "createdAt": "2025-08-06T10:13:37Z", "mergedAt": "2025-08-22T17:05:10Z", "additions": 25130, "deletions": 255 }, { "id": "PR_kwDOMT5cIs6k0-7e", "title": "feat: bun build, remove tsup", "author": "ChristopherTrimboli", "number": 5807, "body": "This pull request introduces a new standardized Bun-based build system for ElizaOS packages, replacing the previous use of `tsup` and related tooling. It adds reusable build utilities, custom build scripts for `@elizaos/api-client` and `@elizaos/cli`, and updates package scripts and dependencies to leverage these changes. Additionally, there are targeted fixes and improvements to messaging service payloads, environment setup, and process management.\r\n\r\n**Build System Modernization**\r\n\r\n* Added `build-utils.ts` with reusable Bun build utilities for cleaning, building, copying assets, and generating TypeScript declarations, enabling consistent builds across packages.\r\n* Replaced `tsup` with Bun-based scripts in `@elizaos/api-client` and `@elizaos/cli`, including custom build scripts (`build.ts`) and removal of `tsup.config.ts`. Updated package scripts to use Bun for build, watch, and clean operations. [[1]](diffhunk://#diff-c64f755bd238752518269ba933743007c8b7c2b3db7b2663c3cfd8eee3e66ee1R1-R59) [[2]](diffhunk://#diff-fd8bcdbf9ab496c42cc8f5a68cbb792d0cd44d138d9f35e6ef960ac6a7b97168L10-R16) [[3]](diffhunk://#diff-fd8bcdbf9ab496c42cc8f5a68cbb792d0cd44d138d9f35e6ef960ac6a7b97168L24) [[4]](diffhunk://#diff-1870665c82b8dca54d6e63c49dfa1077b64d4b37bc32f66610ff543ad7f00dcbL1-L18) [[5]](diffhunk://#diff-38a7bfc3de9135d0af986757713f0fc589a906dd9be2f715932e303ae8bc7e4cR1-R82) [[6]](diffhunk://#diff-6e2e2a1851648938b325ba84de634407a4e69a644ea61102df15ca4a8a7a9758L40-R44) [[7]](diffhunk://#diff-6e2e2a1851648938b325ba84de634407a4e69a644ea61102df15ca4a8a7a9758R59) [[8]](diffhunk://#diff-6e2e2a1851648938b325ba84de634407a4e69a644ea61102df15ca4a8a7a9758L71-L75)\r\n* Updated monorepo-level build and clean scripts in `package.json` to filter out certain packages, remove `tsup`, and improve cache handling for faster, more reliable builds. [[1]](diffhunk://#diff-7ae45ad102eab3b6d7e7896acd08c427a9b25b346470d7bc6507b6481575d519L11-R19) [[2]](diffhunk://#diff-7ae45ad102eab3b6d7e7896acd08c427a9b25b346470d7bc6507b6481575d519L52)\r\n\r\n**Messaging Service Improvements**\r\n\r\n* Refactored payload construction for channel creation methods in `MessagingService` to match server expectations, including proper handling of metadata, participant IDs, and DM channel parameters.\r\n* Fixed type handling in participant filtering logic for channel updates.\r\n\r\n**TypeScript Declaration Generation**\r\n\r\n* Enabled TypeScript declaration file (`.d.ts`) generation via Bun build scripts and updated `tsconfig.build.json` to include `\"declaration\": true`. [[1]](diffhunk://#diff-c64f755bd238752518269ba933743007c8b7c2b3db7b2663c3cfd8eee3e66ee1R1-R59) [[2]](diffhunk://#diff-38a7bfc3de9135d0af986757713f0fc589a906dd9be2f715932e303ae8bc7e4cR1-R82) [[3]](diffhunk://#diff-c4d3cf5a942b53c98c3bd2b84fbc766b044cfa190d26f1a249dd7357486a7a5aL4-R5)\r\n\r\n**Process and Environment Management**\r\n\r\n* Improved environment variable setup in CLI server manager to filter out undefined values and ensure proper module resolution.\r\n* Updated server process termination logic to ensure graceful shutdown and state cleanup.\r\n* Minor fix to plugin upgrade progress event handling for more robust logging.\r\n* Removed unused `writeFileSync` import in CLI plugin environment variable utilities.", "repository": "elizaos/eliza", "createdAt": "2025-08-22T07:00:52Z", "mergedAt": null, "additions": 11931, "deletions": 10119 }, { "id": "PR_kwDOMT5cIs6kzWrr", "title": "feat: Add AI Gateway plugin - Universal access to 100+ AI models", "author": "Dexploarer", "number": 5806, "body": "## Summary\nAdds a universal AI Gateway plugin that provides access to 100+ AI models through Vercel AI Gateway and other OpenAI-compatible gateways.\n\n## Features\n- šŸš€ **100+ AI Models** - OpenAI, Anthropic, Google, Meta, Mistral, and more through unified gateways\n- šŸ”„ **Universal Gateway Support** - Works with Vercel AI Gateway, OpenRouter, and any OpenAI-compatible endpoint\n- šŸ’¾ **Response Caching** - Built-in LRU cache for cost optimization\n- šŸ“Š **Built-in Telemetry** - Track usage and performance metrics\n- āš” **High Performance** - Automatic retry logic and connection pooling\n- šŸŽÆ **Multiple Actions** - Text generation, image generation, embeddings, and model listing\n\n## Highlights\n\n### Vercel AI Gateway Integration\n- Optimized for Vercel's AI Gateway with proper URL format (`https://ai-gateway.vercel.sh/v1`)\n- Supports Vercel's colon-based model naming convention (e.g., `openai:gpt-4o`)\n- Compatible with Vercel's app attribution headers for analytics\n\n### Flexible Provider Support\n- Works with any OpenAI-compatible API endpoint\n- Automatic model format detection (colon vs slash separators)\n- Seamless switching between providers with minimal configuration\n\n### Enterprise Features\n- Response caching with configurable TTL\n- Automatic retry logic with exponential backoff\n- OIDC authentication support for enterprise deployments\n- Comprehensive error handling and fallback mechanisms\n\n## Installation\n\nThe plugin is already published to npm for immediate use:\n```bash\nnpm install @promptordie/plugin-aigateway\n```\n\nAfter merge, it will be available as:\n```bash\nnpm install @elizaos/plugin-aigateway\n```\n\n## Configuration\n\n```env\n# Required\nAIGATEWAY_API_KEY=your_api_key_here\n\n# Optional (defaults shown)\nAIGATEWAY_BASE_URL=https://ai-gateway.vercel.sh/v1\nAIGATEWAY_DEFAULT_MODEL=openai:gpt-4o-mini\nAIGATEWAY_LARGE_MODEL=openai:gpt-4o\nAIGATEWAY_EMBEDDING_MODEL=openai:text-embedding-3-small\nAIGATEWAY_CACHE_TTL=300\nAIGATEWAY_MAX_RETRIES=3\n```\n\n## Usage\n\n```typescript\nimport aiGatewayPlugin from '@elizaos/plugin-aigateway';\n\nconst character = {\n name: 'MyAgent',\n plugins: [aiGatewayPlugin],\n settings: {\n AIGATEWAY_API_KEY: 'your-api-key'\n }\n};\n```\n\n## Test Plan\n- [x] Built successfully with `bun run build`\n- [x] All TypeScript types validated\n- [x] Published to npm registry for testing\n- [x] Tested with Vercel AI Gateway\n- [x] Tested model provider registration\n- [ ] Community testing welcomed\n\n## Documentation\nFull documentation and examples included in packages/plugin-aigateway/README.md\n\n## Related Links\n- NPM Package: https://www.npmjs.com/package/@promptordie/plugin-aigateway\n- Vercel AI Gateway Docs: https://vercel.com/docs/ai-gateway", "repository": "elizaos/eliza", "createdAt": "2025-08-22T02:36:55Z", "mergedAt": null, "additions": 4985, "deletions": 423 } ], "codeChanges": { "additions": 19463, "deletions": 3081, "files": 133, "commitCount": 47 }, "completedItems": [ { "title": "feat(scenarios): Add comprehensive scenario testing system", "prNumber": 5723, "type": "feature", "body": "## Summary\n- Add ElizaOS scenario testing system with YAML-based test definitions\n- Support for both local and E2B sandboxed testing environments \n- Comprehensive evaluation engine with action tracking and LLM judges\n- Mock service support", "files": [ "bun.lock", "package.json", "packages/cli/package.json", "packages/cli/scripts/run-all-scenarios.ts", "packages/cli/src/commands/scenario/docs/README.md", "packages/cli/src/commands/scenario/docs/analyze-past-trade.md", "packages/cli/src/commands/scenario/docs/answer-roadmap-questions.md", "packages/cli/src/commands/scenario/docs/check-evm-balance.md", "packages/cli/src/commands/scenario/docs/example_scenarios/analyze-past-trade.scenario.yaml", "packages/cli/src/commands/scenario/docs/example_scenarios/answer-roadmap-questions.scenario.yaml", "packages/cli/src/commands/scenario/docs/example_scenarios/check-evm-balance.scenario.yaml", "packages/cli/src/commands/scenario/docs/scenario-runner-spec.md", "packages/cli/src/commands/scenario/docs/scenarios.md", "packages/cli/src/commands/scenario/examples/action-tracking-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/e2b-fallback.scenario.yaml", "packages/cli/src/commands/scenario/examples/e2b-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/evaluation-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/failing-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/fully-passing.scenario.yaml", "packages/cli/src/commands/scenario/examples/invalid-missing-fields.scenario.yaml", "packages/cli/src/commands/scenario/examples/llm-judge-failure-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/llm-judge-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/mixed-results.scenario.yaml", "packages/cli/src/commands/scenario/examples/mock-e2b-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/mock-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/multi-step.scenario.yaml", "packages/cli/src/commands/scenario/examples/simple-mock-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/simple-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/trajectory-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/valid.scenario.yaml", "packages/cli/src/commands/scenario/index.ts", "packages/cli/src/index.ts", "packages/cli/src/scenarios/E2BEnvironmentProvider.ts", "packages/cli/src/scenarios/EvaluationEngine.ts", "packages/cli/src/scenarios/LocalEnvironmentProvider.ts", "packages/cli/src/scenarios/MockEngine.ts", "packages/cli/src/scenarios/Reporter.ts", "packages/cli/src/scenarios/env-loader.ts", "packages/cli/src/scenarios/providers.ts", "packages/cli/src/scenarios/runtime-factory.ts", "packages/cli/src/scenarios/schema.ts", "packages/cli/src/types/elizaos-modules.d.ts", "packages/cli/src/commands/scenario/examples/advanced-mocking-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/enhanced-mock-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/plugin-parsing-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/simple-advanced-mock-test.scenario.yaml", "packages/cli/src/scenarios/plugin-parser.ts", "packages/cli/test-plugin-parsing.ts", "packages/cli/test-scenario-validation.ts", ".github/workflows/ci.yaml", ".github/workflows/pre-release.yml", ".github/workflows/release.yaml", ".github/workflows/update-news.yml", ".gitignore", "lerna.json", "llms.txt", "packages/api-client/README.md", "packages/api-client/docs/sessions-api.md", "packages/api-client/package.json", "packages/api-client/src/__tests__/base-client.test.ts", "packages/api-client/src/__tests__/services/sessions.test.ts", "packages/api-client/src/lib/base-client.ts", "packages/api-client/src/services/sessions.ts", "packages/api-client/src/types/sessions.ts", "packages/app/package.json", "packages/autodoc/package.json", "packages/cli/src/commands/create/index.ts", "packages/cli/src/commands/plugins/utils/env-vars.ts", "packages/cli/src/commands/scenario/examples/.gitignore", "packages/cli/src/commands/scenario/examples/analyze-past-trade.scenario.yaml", "packages/cli/src/commands/scenario/examples/answer-roadmap-questions.scenario.yaml", "packages/cli/src/commands/scenario/examples/check-evm-balance.scenario.yaml", "packages/cli/src/commands/scenario/examples/natural-language-test.scenario.yaml", "packages/cli/src/commands/scenario/examples/nl-smoke.scenario.yaml", "packages/cli/src/commands/scenario/examples/execution-time-test.scenario.yaml", "packages/cli/.gitignore", "packages/cli/src/commands/scenario/examples/check-coinbase-balance.scenario.yaml", "packages/cli/src/commands/scenario/examples/test-github-issues.scenario.yaml", "packages/cli/src/commands/scenario/src/E2BEnvironmentProvider.ts", "packages/cli/src/commands/scenario/src/EvaluationEngine.ts", "packages/cli/src/commands/scenario/src/LocalEnvironmentProvider.ts", "packages/cli/src/commands/scenario/src/MockEngine.ts", "packages/cli/src/commands/scenario/src/Reporter.ts", "packages/cli/src/commands/scenario/src/env-loader.ts", "packages/cli/src/commands/scenario/src/plugin-parser.ts", "packages/cli/src/commands/scenario/src/providers.ts", "packages/cli/src/commands/scenario/src/runtime-factory.ts", "packages/cli/src/commands/scenario/src/schema.ts", "packages/plugin-dummy-services/package.json", "packages/project-starter/src/__tests__/events.test.ts", "packages/server/package.json", "packages/cli/src/commands/scenario/docs/matrix-testing.md", "packages/cli/src/commands/scenario/examples/github-issue-analysis.matrix.yaml", "packages/cli/src/commands/scenario/src/__tests__/example-validation.test.ts", "packages/cli/src/commands/scenario/src/__tests__/matrix-command.test.ts", "packages/cli/src/commands/scenario/src/__tests__/matrix-runner.test.ts", "packages/cli/src/commands/scenario/src/__tests__/matrix-schema.test.ts", "packages/cli/src/commands/scenario/src/__tests__/parameter-override.test.ts", "packages/cli/src/commands/scenario/src/__tests__/validation-demo.test.ts", "packages/cli/src/commands/scenario/src/matrix-runner.ts", "packages/cli/src/commands/scenario/src/matrix-schema.ts", "packages/cli/src/commands/scenario/src/matrix-types.ts", "packages/cli/src/commands/scenario/src/parameter-override.ts", "packages/server/src/index.ts", "packages/cli/src/commands/report/demo-html-report.ts", "packages/cli/src/commands/report/generate.ts", "packages/cli/src/commands/report/index.ts", "packages/cli/src/commands/report/src/__tests__/analysis-engine.test.ts", "packages/cli/src/commands/report/src/__tests__/html-template.test.ts", "packages/cli/src/commands/report/src/__tests__/integration.test.ts", "packages/cli/src/commands/report/src/__tests__/pdf-export.test.ts", "packages/cli/src/commands/report/src/__tests__/pdf-generator.test.ts", "packages/cli/src/commands/report/src/__tests__/template-integration.test.ts", "packages/cli/src/commands/report/src/analysis-engine.ts", "packages/cli/src/commands/report/src/assets/report_template.html", "packages/cli/src/commands/report/src/pdf-generator.ts", "packages/cli/src/commands/report/src/report-schema.ts", "packages/cli/src/commands/scenario/examples/debug-llm-judge.scenario.yaml", "packages/cli/src/commands/scenario/examples/enhanced-demo.scenario.yaml", "packages/cli/src/commands/scenario/examples/llm-judge-with-capabilities.scenario.yaml", "packages/cli/src/commands/scenario/examples/simple-test.matrix.yaml", "packages/cli/src/commands/scenario/examples/trajectory-demo.scenario.yaml", "packages/cli/src/commands/scenario/src/EnhancedEvaluationEngine.ts", "packages/cli/src/commands/scenario/src/TrajectoryReconstructor.ts", "packages/cli/src/commands/scenario/src/__tests__/capabilities-evaluation.test.ts", "packages/cli/src/commands/scenario/src/__tests__/data-aggregator.test.ts", "packages/cli/src/commands/scenario/src/__tests__/deep-clone.test.ts", "packages/cli/src/commands/scenario/src/__tests__/e2e/centralized-data.test.ts", "packages/cli/src/commands/scenario/src/__tests__/enhanced-evaluation.test.ts", "packages/cli/src/commands/scenario/src/__tests__/evaluation-integration.test.ts", "packages/cli/src/commands/scenario/examples/test-basic.scenario.yaml", "packages/cli/src/commands/scenario/src/__tests__/LocalEnvironmentProvider.test.ts", "CLAUDE.md" ] } ], "topContributors": [ { "username": "ChristopherTrimboli", "avatarUrl": "https://avatars.githubusercontent.com/u/27584221?u=0d816ce1dcdea8f925aba18bb710153d4a87a719&v=4", "totalScore": 43.3087738965761, "prScore": 43.3087738965761, "issueScore": 0, "reviewScore": 0, "commentScore": 0, "summary": null }, { "username": "Dexploarer", "avatarUrl": "https://avatars.githubusercontent.com/u/211557447?u=21a243d61cc1f87574328ae07fc64d7d7577b53d&v=4", "totalScore": 41.6167738965761, "prScore": 41.6167738965761, "issueScore": 0, "reviewScore": 0, "commentScore": 0, "summary": null }, { "username": "standujar", "avatarUrl": "https://avatars.githubusercontent.com/u/16385918?u=718bdcd1585be8447bdfffb8c11ce249baa7532d&v=4", "totalScore": 4.5, "prScore": 0, "issueScore": 0, "reviewScore": 4.5, "commentScore": 0, "summary": null }, { "username": "linear", "avatarUrl": "https://avatars.githubusercontent.com/in/20150?v=4", "totalScore": 2, "prScore": 0, "issueScore": 2, "reviewScore": 0, "commentScore": 0, "summary": null }, { "username": "harperaa", "avatarUrl": "https://avatars.githubusercontent.com/u/1330944?v=4", "totalScore": 2, "prScore": 0, "issueScore": 2, "reviewScore": 0, "commentScore": 0, "summary": null }, { "username": "wtfsayo", "avatarUrl": "https://avatars.githubusercontent.com/u/82053242?u=98209a1f10456f42d4d2fa71db4d5bf4a672cbc3&v=4", "totalScore": 0.2, "prScore": 0, "issueScore": 0, "reviewScore": 0, "commentScore": 0.2, "summary": null } ], "newPRs": 2, "mergedPRs": 1, "newIssues": 2, "closedIssues": 0, "activeContributors": 6 }