mirror of
https://github.com/KeygraphHQ/shannon.git
synced 2026-04-25 17:45:53 +03:00
[GH-ISSUE #111] Can't use Playwright #38
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/shannon-KeygraphHQ#38
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Maciejonos on GitHub (Feb 9, 2026).
Original GitHub issue: https://github.com/KeygraphHQ/shannon/issues/111
Describe the bug
Agent couldn't use Playwright, was trying to look in my repo (in /repos/) for clues, reading readme.md etc.
It was unable to find anything, then decided that it's too complex and proceeded with launching agents for read only audit, with no actual pen testing.
As it shouldn't be run on prod environments, I started it with url pointing to localhost:3000, where the actual dev website is running. Perhaps it couldn't access it from Docker perspective, but not sure if it matters - it should still be able to launch Playwright.
Isn't Playwright included in the docker image?
Additional notes
6.18.8.arch2-1
Docker version 29.2.1, build a5c7197d72
Running both API server and website on localhost. Using claude code with oauth.
Logs
@Maciejonos commented on GitHub (Feb 9, 2026):
Side note - I don't see any requests to API server as well, even with no Playwright shouldn't this be tested too? Even basics, like API key validation/bypass, rate limiting. These are pure CLI, and agents have knowledge of the API server after research.
Maybe I should have specified it in the custom config, but I just went ahead with the defaults.
I really hoped this will be an actual pen testing, not just read code -> provide summary :/
If it's an issue with my setup or not enough config please do let me know.
@ezl-keygraph commented on GitHub (Feb 9, 2026):
Thanks for reporting, could you share the full
./shannoncommand with flags, redacting repo and url?I can see that you are running a test against a locally available website. Docker containers cannot reach localhost on your host machine. Use host.docker.internal in place of localhost
@Maciejonos commented on GitHub (Feb 9, 2026):
./shannon start URL=http://localhost:3000 REPO=exampleGot it - so it should be able to launch it with URL properly specified? I mean - even if url was wrong it was not able to launch it at all. Quite hesitant to re-run it for a 3rd time.
But I really appreciate the quick response! Thanks a lot.
@ezl-keygraph commented on GitHub (Feb 9, 2026):
You can try out with
URL=http://host.docker.internal:3000and let us know if you're able to run without errors. Happy to help!@Maciejonos commented on GitHub (Feb 10, 2026):
Similar issue as above with the correct url. This time the only playwright mention in the log is in the prompt passed to another agent. There is no actual usage it.
@ezl-keygraph commented on GitHub (Feb 10, 2026):
Can you share the log snippets like you have shared in the first issue description for the last run you have tried. It would help us find the cause of the error. Thanks!