We just released a major milestone at PageWatch, AI Powered page insights.
Using GPT-4 (Vision), we can now visually inspect your site just like a regular visitor, and automatically suggest improvements.
Making this work reliably was a challenging task with the current AI models, GPT-4 is really good with certain things (like reviewing text), but rather limited in others (such as spatial reasoning). We ended up using GPT combined with more traditional methods, and plain DOM inspections to build a system that can reliably give useful feedback.
There are of course still certain limitations, for example we can only inspect the full page after it loaded, so if a site relies heavily on animations or scroll effects then those will not be seen.
ChatGPT is also not necessarily correct in all feedback it suggests, but for most sites it can provide some great insights into some things you might have missed.
https://pagewatch.ai/assets/media/video/acme.png
To see it in action (or test your page for free) check out https://pagewatch.ai/