Offline plotting in python is very slow on big data sets

📊 Plotly Python
1

When generating huge amount of data (50 Hz IMU data, can be full day) I got few issues.

  1. Generation time is way too big, the python to html serialisation is far from optimised.
  2. The output file wont let me unit x axis so time is duplicated per field making the file size almost double
  3. Would be much better to have the data compressed inside the file not as text, this can reduce the file size by factor 5

Please consider improving offline performance, I really like plotly but for my heavy use it is too slow and output too big.

Thanks!

3 Likes
2

You can use Scattergl instead of Scatter for large datasets.
See https://plot.ly/python/webgl-vs-svg/
However, WebGL lacks some features in comparison to SVG
https://github.com/plotly/plotly.js/issues/130