Okay, I eventually found this guide:
(don’t know what took me so long)
And the key part which did break my application is that I needed to use
conda install -c plotly chart-studio
instead of pip install.
Then a simple
import chart_studio.plotly
in my graph_definitions file was enough to make my application work on plotly 4.0.
Although the import remains unused it seems to be necessary…