I think the only way to fix this is just to delete the parts from the plotly library that are not necessary. This process will be trial and error. Go into the plotly folder in your virtual environment, delete a folder and see if your app still works. Note down the folders that you are allowed to delete, so that you can build a script later to automatically delete the unnecessary folders after you updated plotly to a later version. If you are not allowed to delete a folder, you can go in the folder and start deleting subfolders.
One thing I noticed is that there is a jupyterlab_plotly folder that also gets installed. Most likely this one can also be removed.
If you do decide to sit down for this, consider sharing your results here, I would be very interested to see them.