Get mcp-eval
up and running in 5 minutes. Learn to install, configure, and run your first tests for MCP servers and agents.
🚀 Welcome to mcp-eval
! You’re about to supercharge your MCP development with powerful testing capabilities. This guide will have you testing MCP servers and agents in just 5 minutes!
mcp-eval
for your projectmcp-eval
Download Python →Install `mcp-eval` and configure API keys
mcp-eval
installed for your project.We recommend using uv to install mcp-eval
as a global tool:mcp-eval
CLI available globally on your system.mcp-eval
can test MCP servers written in any language - Python, TypeScript, Go, Rust, Java, etc. As long as your server implements the MCP protocol, mcp-eval can test it!Initialize your test project
mcpeval.yaml
with your configurationmcpeval.secrets.yaml
for secure API key storageConfigure MCP servers
Run your first test
mcp-eval init
, you might already have one. Otherwise, let’s run:-v
) shows test progressExplore your test results
tests/test_my_server.py
:
My server isn't being found
mcpeval.yaml
to ensure the server is properly configured:server_names
.Tests are timing out
API key errors
mcp-eval
expert? Here’s your learning path:
mcp-eval
and run your first tests. You’re now ready to ensure your MCP servers and agents work flawlessly. Happy testing!