[Show IH] Sitemapbot.io (weekend project)
Needed that kind of tool for myself: crawl given website and screenshot every page. So here it is. Any feedback is welcome.
Needed that kind of tool for myself: crawl given website and screenshot every page. So here it is. Any feedback is welcome.
Great app for a weekend project! Definitely going into my Toolkit :)
wow, thank you!
Wow, so much functionality for a weekend project, super cool.
Would love to get an overview of the tech stack you used to achieve so rapidly.
Defiantly would be cool to get some type of snapshot schedule and timeline scrubber;
I think If I was a paying user I would be concerned about the levels of image compression: eg https://sitemapbot.s3.amazonaws.com/screenshots/5be86969ec286d6965116683/4-password_reset.jpg
Awesome project 😀
Hey, thank you!
I had this idea for long time and just over week ago I've registered a domain name for it :)
Project was created last weekend, but during this weekend I've deployed everything properly.
My tech stack: Laravel+Vue+Bootstrap+mongodb+sql.
As you can see, there's no user account management as I had no time for it. Just wanted to get it live asap.
Hosting is based on Digital Ocean + AWS (S3).
In terms of image quality - because it's a free (non-paid) project, I've setup image quality to be lower, but it can be changed of course.
Hi - that looks pretty good!
One problem though is that it doesn't seem to handle special characters.
I am using some UTF codes for a toolbar, but your site shows them as the unknown character - see https://www.lifepim.com/static/img/lifepim-toolbar-live.JPG for an example.
I have tested my site on many browsers and it is appears to render ok, but this is making me wonder if I shouldn't be doing this?
Hi, thank you!
I will try to fix this asap.
Hi Mark ! Very impressed ! What technology do use for making screenshot? Some kind of headless browser?
Thank you! I use Puppeteer for making screenshots.
Really cool!
Doesn't work if I omit 'http://' from the URL. I had to figure it out by trial and error.
Also when it works there's no clear confirmation that the process started, the first thing I read was 'The url field is required' so I thought it hadn't worked. Only after I noticed at the bottom the pending website.
Currently waiting for the screenshots...
Great job.
Is it open source?
Thank you for the feedback, really useful.
I will get this fixed asap.
At the moment it's not open source.
Twitter or Google Sing up would be great. Do you have a Repo I can contribute to?
Hey, Great idea with Twitter or Google Signup. I don't have public repo for it.
Is it something like - waybackmachine ?
could be:) at the moment it just screenshots all pages on given website