Show and tell: Super-fast way to share data between callbacks: Apache Plasma in-memory object store

You do need to convert the dataframe into a pyarrow.RecordBatch in memory in this example, as in

def write_to_plasma(...):
    ...
    record_batch = pa.RecordBatch.from_pandas(thing)
    ...

See docs:

2 Likes