Alertfor

Search engines do not cover all the data available on the Web. They miss the data behind search interfaces. This data is defined as deep web which is not accessible through search engines. As far as I know, currently no product offers to search deep web content. There are various innovation required to enable deep web (Google did it for surface web). One of such kind is Alertfor, it monitors deep web site(s) for new “thing” for specific keywords / phrases.

If you select (frequently) tools -> Anytime -> past 24 hours at Google search result. or selecting "sort by date" of any website. This tool is for you. Convert your search query of any website into monitoring agent. Some use cases . . .

• A citizen wants to get notifications from any Government website (e.g for her/his query).
• A Real estate agent wants to get new offerings from online listings.
• A Business owner. wants to get updates on any offerings from bulletin boards.
• A tech enthusiast. Wants to stay informed on any news aggregating sites for his interested topics.
• A small business owner wants to monitor his competitive price information.
• A lawyer, wants to get information on case hearing on his interested keywords.
• A Journalist. wants to know what are the important news happening around politicians, celebrities from various web sources (local or international).
• I am using it for Patent watching, new research papers from scholar websites on various topics (30+ key words).

Any suggestions, comments, or any special use cases for this product are most welcome.

I am a heavy searcher, I do search on the following websites frequently on various keywords . .

Google scholar, github, HN, google news, twitter, patents etc.

I was tired of searching these sites on new items (search result that are sorted by date/time). then I built a simple tool to solve this monitoring of mentions, it finds the search box of given website, submits query and extract result back. the agent has been scheduled on my PC to do on every day. Over the time, I see that I want to search on many websites at once (e.g coupon code for a product), finding xpath for search box, search result on many websites was again a problem, I solved this by training models and that solves for any website. If you are having similar requirement, you may find this tool useful. I just deployed all my tools on the cloud.