✊🏿 Black Lives Matter. Please consider donating to Black Girls Code today.
⚡️ Concerned about the grid? Kyle Baranko teaches how to predicting peak loads using XGBoost. Register for the August webinar!

Out of shared memory and deadlocks when lunching plotly in a multiprocessing environment

I have a problem I’ve been investigating for several days, and unfortunately, while it is hard for me to prove the source, I am pretty much certain the problem is with plotly static export (both orca and Kaleido).

When launching multiple scripts running on the same cpu they crash with an error stating out of shared memory, or, simply one hangs indefinitely.
When I cancel visualizations at all or stop exporting plotly to png the problem stops.

Ubuntu 18
/proc/sys/kernel/shmmax = 104857600
plotly 4.9.0

Are there known issues with plotly and shared memory?
Can I somehow reduce the memory consumption?
If there is any why I can better drill down the problem I’ll be happy to do so.

1 Like