Just released a new version of CritiMon that adds the option to prevent development and testing devices from reporting crashes and errors while you are working on a project.
The idea is on the first crash/error that is received, on the crash menu you can select that the crash came from a development device. This then means that if a crash comes from the same device it ignores the crash and doesn't save it, as well, not including it in the active user analysis or app release detection. This ensures that the crash reporting doesn't get flooded in crashes and errors while you are developing and you know that the crashes are only coming from your actual users.
You can from the account settings see a list of development devices and turn on and off whether or not crashes should be reported for the development device.