Run action

Use the uv‑based action to install, run, and upload artifacts.
jobs:
  tests:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: lastmile-ai/mcp-eval/.github/actions/mcp-eval/run@v1
        with:
          python-version: '3.11'
          tests: tests/
          run-args: '-v --max-concurrency 4'
          pr-comment: 'true'
          set-summary: 'true'
          upload-artifacts: 'true'
        env:
          ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
Sources:

Publish HTML via Pages

Enable the Pages deploy job in the provided workflow.

Badges

Artifacts include badges under mcpeval-reports/badges. Embed in README:
![MCP Tests](mcpeval-reports/badges/tests.svg)
![MCP Tool Coverage](mcpeval-reports/badges/coverage.svg)