That's a whole lot of podcasts! 💪
As part of building my podcast search engine (log.fm), I got the first version of my podcast crawler up and running. It is by no means the finished code, but it is for sure a great start. The first spike is while doing the last minute tweaking and error fixing. Then I let it run unattended for about 6 hours. It found loads of podcasts!
Backstory: Since I don't have lots of spare time to work on this project, I need to add in the most amount of automation I can. So naturally turned to Python for some quick and dirty scripting. That coupled with the PHP script to parse the podcast feed, a little bit of time for it to run, and viola. I searched over 38k podcast RSS feeds. All together the app was running for about 6 hours while I slept (before waking up for my day job)
I have already gotten some great feedback from people like @pips on their thoughts on my landing page and his favorite podcast shows.
Any shows or people in particular I should look especially hard for to have on log.fm? Let me know :)
If you want you can join the waitlist on log.fm for the April beta launch!