Editing currently deployed Dash applications

I currently have Dash applications deployed across my company that are being used by a large number of people at any given time. Problems occur when I try to add or remove a specific element from one of those applications. When I bring it back up I am hit with key errors for every element -

“KeyError: '…element1.children…element2.figure…element3.children…element4.figre” etc.

I found this post -

Where the problem is a result of the application still being open in the browser, and all the user needed to do was refresh for the key errors to go away.

This is not possible in my situation because I would need to track everyone in my company down and ask them to exit the page they have up in the browser.

Any ideas on how I can make these changes while users are in the app?