Show and tell: Super-fast way to share data between callbacks: Apache Plasma in-memory object store

[russellthehippo]

If you’re here, see my new post on this - I’ve built a module, brain-plasma, with a basic API for a shared-memory object namespace for Python objects on top of the Plasma API - it simplifies this process significantly.

Show and Tell - brain-plasma (fast sharing for large objects between callbacks)

As mentioned here I’ve been using Apache Plasma to solve what is still one of Dash’s biggest problems: sharing large data between callbacks, apps, and pages. Now I’ve roughly formalized some of that functionality in the PyPi package brain-plasma. It’s a simple and easy-to-use way to store Python objects, even very large Pandas dataframes or dictionaries, in a shared memory space. This method offers (imperfect, but much better) thread safety, blazing speed relative to reading from disk or Redis,…

GitHub - russellromney/brain-plasma: Shared-memory Python object namespace...