TestDriver

It should be possible to fail a test based on the result of a JS execution

Why? Faster page load Video iframe embed llms.txt generation

Support GitLab test triggering, creation, and feedback.

https://github.com/testdriverai/demo-exec-js

ExecJS should have a feature that passes/fails the test based on the value of the result.

Currently the AI will follow the user's prompt if asked to "click on the chrome icon" Instead, the AI should translate this to "circular design with a blue circle at the center, surrounded by red, green, and yellow segments forming a pinwheel-like shape" AI seems to have trouble matching the icon function to it's visual properties.

Something seems to have changed with the linux runners over the weekend - they now use chrome rather than firefox and there are 3-4 screen that show up before the normal browser window. This confuses the model so it's unable to actually navigate to any page

I expected testdriver to overwrite the .env values, rather than just appending new values to the end. This can cause issues if you are trying to update an API key

One comment, disable in the firefox setting the "remember this password" thing, as it keeps tripping up the ai in the hosted linux runners < https://support.mozilla.org/en-US/kb/disable-password-saving-firefox >