What is your dream data set? I'll try and get it for you.
There is a lot of data across the internet. If you could have access to something specific, what would you want?
During my day job and while putting together scrapers for my site, I stumble upon all kinds of interesting data and am constantly surprised about what is freely available to anyone with a little bit of web and scripting skills.
Trending on Indie Hackers
Just a small bug report: your website has some z-index issues with the background on macOS Safari.
big oof.
thanks for the heads up!
A list of all existing domain names of the .be tld.
buy it for $20:
https://zonefiles.io/list/be/
(possibly a cop out)
Interesting, thanks
This comment was deleted 5 years ago.
That's a big question!
Right now, it would be a list of all residences in a few ZIP codes around my city, who owns them now, and when they last sold.
I'm working on a real estate app with a friend, and a lot of this data is available via county records/maps online. I just don't know how to scrape it. We'd use this data to populate the app for our MVP.
know python?
a nice trick to speed up / jump start any scraping project is to google "<name of site you want to scrape> scraper site:github.com". if it is a popular site, someone will have likely already published a project.
these might also be interesting sources for you:
Hey Steve, what are some examples of the types of data you come across?
lately, i have been working on putting together a dataset on rising/successful companies to add to my jobs site and so i'll use it as an example:
other useful stuff:
for non-standard example, i had been an solar engineer / analyst in a prior role. you can find weather data for free on government sites. combine this with pricing data supplied by solar manufacturers and you can model the profitability of a solar project.
there is sooo information much you can find. what interests you?