Back to Directory
Eva-Agent An MCP server that autonomously evaluates web applications.
β οΈ PROJECT HAS BEEN SUNSET β οΈ
This project has been discontinued. We're building something new at withrefresh.com
π operative.sh web-eval-agent MCP Server
Let the coding agent debug itself, you've got better things to do.
π₯ Supercharge Your Debugging
operative.sh 's MCP Server launches a browser-use powered agent to autonomously execute and debug web apps directly in your code editor.
β‘ Features
π Navigate your webapp using BrowserUse (2x faster with operative backend)
π Capture network traffic - requests are intelligently filtered and returned into the context window
π¨ Collect console errors - captures logs & errors
π€ Autonomous debugging - the Cursor agent calls the web QA agent mcp server to test if the code it wrote works as epected end-to-end.
π§° MCP Tool Reference
| Tool | Purpose |
|------|---------|
| web_eval_agent | π€ Automated UX evaluator that drives the browser, captures screenshots, console & network logs, and returns a rich UX report. |
| setup_browser_state | π Opens an interactive (non-headless) browser so you can sign in once; the saved cookies/local-storage are reused by subsequent web_eval_agent runs. |
Key arguments
web_eval_agent
url (required) β address of the running app (e.g. http://localhost:3000)
task (required) β natural-language description of what to test ("run through the signup flow and note any UX issues")
headless_browser (optional, default ) β set to to hide the browser window
false
true
setup_browser_state
url (optional) β page to open first (handy to land directly on a login screen)
You can trigger these tools straight from your IDE chat, for example:
Evaluate my app at http://localhost:3000 β run web_eval_agent with the task "Try the full signup flow and report UX issues".
π Quick Start
Easy Setup with One-Click Integration
Get your API key (free) - when you create your API key, you'll see:
"Add to Cursor" button with a deeplink for instant Cursor installation
Prefilled Claude Code command with your API key automatically included
Manual Setup (macOS/Linux)
Pre-requisites (typically not needed):
brew: /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
npm: (brew install npm)
jq: brew install jq
curl -LSf https://operative.sh/install.sh -o install.sh && bash install.sh && rm install.sh
Visit your favorite IDE and restart to apply the changes
Send a prompt in chat mode to call the web eval agent tool! e.g.
Test my app on http://localhost:3000. Use web-eval-agent.
π οΈ Manual Installation curl -LsSf https://astral.sh/uv/install.sh | sh
Source environment variables after installing UV
npm install -g chromium playwright && uvx --with playwright playwright install --with-deps
Add below JSON to your relevant code editor with api key
Restart your code editor
π Updating
uv cache clean
refresh MCP server
"web-eval-agent": {
"command": "uvx",
"args": [
"--refresh-package",
"webEvalAgent",
"--from",
"git+https://github.com/Operative-Sh/web-eval-agent.git",
"webEvalAgent"
],
"env": {
"OPERATIVE_API_KEY": "<YOUR_KEY>"
}
}
π οΈ Manual Installation (Mac + Cursor/Cline/Windsurf) curl -LsSf https://astral.sh/uv/install.sh | sh)
npm install -g chromium playwright && uvx --with playwright playwright install --with-deps
Add below JSON to your relevant code editor with api key
Restart your code editor
Manual Installation (Windows + Cursor/Cline/Windsurf) We're refining this, please open an issue if you have any issues!
Do all this in your code editor terminal
curl -LSf https://operative.sh/install.sh -o install.sh && bash install.sh && rm install.sh
Get your API key at operative.sh/mcp
Install uv (curl -LsSf https://astral.sh/uv/install.sh | sh)
uvx --from git+https://github.com/Operative-Sh/web-eval-agent.git playwright install
Restart code editor
π¨ Issues
Updates aren't being received in code editors, update or reinstall for latest version: Run uv cache clean for latest
Any issues feel free to open an Issue on this repo or in the discord!
5/5 - static apps without changes weren't screencasting, fixed! uv clean + restart to get fix
Changelog
4/29 - Agent overlay update - pause/play/stop agent run in the browser
π Example MCP Server Output Report π Web Evaluation Report for http://localhost:5173 complete!
π Task: Test the API-key deletion flow by navigating to the API Keys section, deleting a key, and judging the UX.
π Agent Steps
π 1. Navigate β http://localhost:5173
π 2. Click "Login" (button index 2)
π 3. Click "API Keys" (button index 4)
π 4. Click "Create Key" (button index 9)
π 5. Type "Test API Key" (input index 2)
π 6. Click "Done" (button index 3)
π 7. Click "Delete" (button index 10)
π 8. Click "Delete" (confirm index 3)
π Flow tested successfully β UX felt smooth and intuitive.
π₯οΈ Console Logs (10)
1. [debug] [vite] connectingβ¦
2. [debug] [vite] connected.
3. [info] Download the React DevTools β¦
β¦
π Network Requests (10)
1. GET /src/pages/SleepingMasks.tsx 304
2. GET /src/pages/MCPRegistryRegistry.tsx 304
β¦
β±οΈ Chronological Timeline
01:16:23.293 π₯οΈ Console [debug] [vite] connectingβ¦
01:16:23.303 π₯οΈ Console [debug] [vite] connected.
01:16:23.312 β‘οΈ GET /src/pages/SleepingMasks.tsx
01:16:23.318 β¬
οΈ 304 /src/pages/SleepingMasks.tsx
β¦
01:17:45.038 π€ π Flow finished β deletion verified
01:17:47.038 π€ π Conclusion repeated above
ποΈ See the "Operative Control Center" dashboard for live logs.
Star History
Ecosystem Role Standard MoltPulse indexed agent.