Is any Web3 developer available for consultation?
Need some help in tracking 1M+ ETH wallets & contracts and ETH Node.
I've been tracking this kind of stuff for a while (https://moonfactor.com). It's a pain with the amount of data and activity!
Do you have more information? What do you want to track from the wallets and contracts? Best bet is to use something such as BitQuery so you don't need to even interact with a node. They sync and add a bunch of useful data on top.
Yeah, but we will be doing around 500K requests/month so API will become quite expensive in this case, and also they have some limits.
It's free for 100k requests a month, 3 million is $250. I do agree can get expensive as usage scales. All a trade off. Do it with a node directly and you will pay more in engineering costs.
Good luck with it!
What are your thoughts about QuickNode , they say that node maintenance etc will be taken care by them and it's cheap .
QuickNode are a great managed solution. The price really depends on the kind of data you need. For example, it will cost more if you need to make calls on an archive or full node. There is a good article about it here:
https://www.quicknode.com/guides/infrastructure/ethereum-full-node-vs-archive-node
ChainStack have cheaper options if you need archive data:
https://chainstack.com/ethereum-archive-nodes-on-chainstack/
However, the main problem I had even with these managed solutions is that there is still a tonne of work to do to extract, clean up and load the data into a database. Without using a service that does this for you, you will need to parse a huge amount of log data.
A good example of the difference is how Ethplorer build aggregated data for wallets and expose a bulk wallet monitor api:
https://ethplorer.io/posts/bulk-api-monitor
To do that with nodes would require you to parse transaction data for each wallet that goes back potentially to the beginning and then build up token balances, then ensure you are synced to a node to keep the data accurate. It's a big job.
If you can tell me what kind of data you are interested in I can give you a better idea of where to start.
Is there a way, we can connect on a call, so I can explain in detail?
this is my email - himanshu@ambcrypto.com
Sure, I'll send an email.