Hi Jon,
most customers have their own best practices around maintenance mode. From what you mentioned, we can come up with a solution that can stop/start individual collector from WebUI or can remove (and backup) entries from a running configuration to make it empty and restore it after maintenance window is over. We may also configure it such that it takes in a list of collectors/configurations to have a 1 click button into and out of maintenance window. A couple of mock ups attached.
This is something you would benefit from? We can set time to discuss further.

If my reply answered your question please click on the 'Accept as Solution' button to help others find the answer.
Thanks,
Shoaib