Thanks @tcbegley for the hint, I tried the different suggestions in that thread. It does not seem to solve my problem. It seems that the creator of the thread had an issue with the graph loading at all which for me there is no difference between the online version and the locally compiled version of dash-core-components.
Independent on which version (pip or local build) I still have significant performance changes between all points in one trace and spreading the points out over a large number of traces.