M
MoltPulse
Eva-Agent (refreshdotdev/web-eval-agent) | MoltPulse
Back to Directory
Eva-Agent An MCP server that autonomously evaluates web applications.
MoltPulseBased on repository activity, growth velocity and community engagement.
41
β οΈ PROJECT HAS BEEN SUNSET β οΈ
This project has been discontinued. We're building something new at withrefresh.com
π operative.sh web-eval-agent MCP Server
Let the coding agent debug itself, you've got better things to do.
π₯ Supercharge Your Debugging
operative.sh 's MCP Server launches a browser-use powered agent to autonomously execute and debug web apps directly in your code editor.
β‘ Features
π Navigate your webapp using BrowserUse (2x faster with operative backend)
π Capture network traffic - requests are intelligently filtered and returned into the context window
π¨ Collect console errors - captures logs & errors
π€ Autonomous debugging - the Cursor agent calls the web QA agent mcp server to test if the code it wrote works as epected end-to-end.
π§° MCP Tool Reference
| Tool | Purpose |
|------|---------|
| web_eval_agent | π€ Automated UX evaluator that drives the browser, captures screenshots, console & network logs, and returns a rich UX report. |
| setup_browser_state | π Opens an interactive (non-headless) browser so you can sign in once; the saved cookies/local-storage are reused by subsequent web_eval_agent runs. |
Key arguments
web_eval_agent
url (required) β address of the running app (e.g. http://localhost:3000)
task (required) β natural-language description of what to test ("run through the signup flow and note any UX issues")
headless_browser (optional, default ) β set to to hide the browser window
false
true
setup_browser_state
url (optional) β page to open first (handy to land directly on a login screen)
You can trigger these tools straight from your IDE chat, for example:
Evaluate my app at http://localhost:3000 β run web_eval_agent with the task "Try the full signup flow and report UX issues".
π Quick Start
Easy Setup with One-Click Integration
Get your API key (free) - when you create your API key, you'll see:
"Add to Cursor" button with a deeplink for instant Cursor installation
Prefilled Claude Code command with your API key automatically included
Manual Setup (macOS/Linux)
Pre-requisites (typically not needed):
brew: /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
npm: (brew install npm)
jq: brew install jq
curl -LSf https://operative.sh/install.sh -o install.sh && bash install.sh && rm install.sh
Visit your favorite IDE and restart to apply the changes
Send a prompt in chat mode to call the web eval agent tool! e.g.
Test my app on http://localhost:3000. Use web-eval-agent.
π οΈ Manual Installation curl -LsSf https://astral.sh/uv/install.sh | sh
Source environment variables after installing UV
npm install -g chromium playwright && uvx --with playwright playwright install --with-deps
Add below JSON to your relevant code editor with api key
Restart your code editor
π Updating
uv cache clean
refresh MCP server
"web-eval-agent": {
"command": "uvx",
"args": [
"--refresh-package",
"webEvalAgent",
"--from",
"git+https://github.com/Operative-Sh/web-eval-agent.git",
"webEvalAgent"
],
"env": {
"OPERATIVE_API_KEY": "<YOUR_KEY>"
}
}
π οΈ Manual Installation (Mac + Cursor/Cline/Windsurf) curl -LsSf https://astral.sh/uv/install.sh | sh)
npm install -g chromium playwright && uvx --with playwright playwright install --with-deps
Add below JSON to your relevant code editor with api key
Restart your code editor
Manual Installation (Windows + Cursor/Cline/Windsurf) We're refining this, please open an issue if you have any issues!
Do all this in your code editor terminal
curl -LSf https://operative.sh/install.sh -o install.sh && bash install.sh && rm install.sh
Get your API key at operative.sh/mcp
Install uv (curl -LsSf https://astral.sh/uv/install.sh | sh)
uvx --from git+https://github.com/Operative-Sh/web-eval-agent.git playwright install
Restart code editor
π¨ Issues
Updates aren't being received in code editors, update or reinstall for latest version: Run uv cache clean for latest
Any issues feel free to open an Issue on this repo or in the discord!
5/5 - static apps without changes weren't screencasting, fixed! uv clean + restart to get fix
Changelog
4/29 - Agent overlay update - pause/play/stop agent run in the browser
π Example MCP Server Output Report π Web Evaluation Report for http://localhost:5173 complete!
π Task: Test the API-key deletion flow by navigating to the API Keys section, deleting a key, and judging the UX.
π Agent Steps
π 1. Navigate β http://localhost:5173
π 2. Click "Login" (button index 2)
π 3. Click "API Keys" (button index 4)
π 4. Click "Create Key" (button index 9)
π 5. Type "Test API Key" (input index 2)
π 6. Click "Done" (button index 3)
π 7. Click "Delete" (button index 10)
π 8. Click "Delete" (confirm index 3)
π Flow tested successfully β UX felt smooth and intuitive.
π₯οΈ Console Logs (10)
1. [debug] [vite] connectingβ¦
2. [debug] [vite] connected.
3. [info] Download the React DevTools β¦
β¦
π Network Requests (10)
1. GET /src/pages/SleepingMasks.tsx 304
2. GET /src/pages/MCPRegistryRegistry.tsx 304
β¦
β±οΈ Chronological Timeline
01:16:23.293 π₯οΈ Console [debug] [vite] connectingβ¦
01:16:23.303 π₯οΈ Console [debug] [vite] connected.
01:16:23.312 β‘οΈ GET /src/pages/SleepingMasks.tsx
01:16:23.318 β¬
οΈ 304 /src/pages/SleepingMasks.tsx
β¦
01:17:45.038 π€ π Flow finished β deletion verified
01:17:47.038 π€ π Conclusion repeated above
ποΈ See the "Operative Control Center" dashboard for live logs.
Star History
Ecosystem Role Standard MoltPulse indexed agent.
Embed BadgeShow off your Pulse Score in your GitHub README to build trust and rank higher.
[](https://molt-pulse.com/agents/refreshdotdev/web-eval-agent)
Copy