Currently it seems like the upload object automatically encodes and copies the data that is uploaded which makes it impossible to process large files. Is there any way around this?

There’s an issue about this on the Dropzone issue tracker (the React component that the Dash Upload component uses). The suggestion there is to increase the timeout however according to the changelog this option was only added in 4.4 and Dash currently uses 4.2.3. The issue also mentions a chunked …

[image] sophotrope: Occasionally I can get the tab to crash but mostly the upload will progress (evidenced by watching the CPU/memory usage) Yeah, this is a limitation in Dash right now. In Dash, all of the data (the store) is stored in the web browser. This data is accessed whenever any of t…

Thanks for all the attention here. It’s very helpful. My use case: I’m doing something which may not be ideal for dash… I’m making a small application which ingests a dataset from the user and then performs some fancy machine learning tasks to analyze user’s submitted data. The program populate…

[image] sophotrope: For an MVP all I would really want is the ability for the user to go through a kind of ‘file selection’ button in order to search their local filesystem for a datafil Note that if the user is also running the app, then you can just display a dropdown with a list of the use…

To make @chriddyp ’s idea for an MVP support a client server setup, you could also embed an iframe within your dash app that points to a page with a super simple vanilla html upload form, thereby escaping the Dash app just for the upload. Then you’d need a ‘refresh’ button or some such which triggers…

Did you get any success in building the intended app @sophotrope ? I am trying to build something similar, and it would be great to know if your application was successfully built? If yes, then could you share all key learning from your project? Thanks in advance for all the help! AP

The idea of using flask instead of dash works for me. I have tested for 1GB file. Here is my code: from os.path import join from flask import Flask, flash, request from werkzeug.utils import secure_filename import dash import dash_html_components as html import os cwd = os.getcwd() UPLOAD_FOLDER = …

Hello, I’m currently writing my masters’ thesis in the field of Topological Data Analysis in combination with the classification of observations. Comprised is the implementation of the interactive analytics process as a dashboard web application. The user should be allowed to upload a csv file con…

Has the Problem of large dataset handling being Solved by Now ?.. We have used sql for data handling and its working fine, but when it comes to larger dataset greater than 50 MB same issues are faced. The web browser crashes. Could you update on this please ?

Dash Upload Component - Decoding Large Files

Dash Python

chriddyp April 7, 2018, 10:57pm 9

See Show And Tell -- Dash Resumable Upload for a new approach to uploading large files

Topic		Replies	Views
Show and Tell - dash-uploader (Upload large files) Dash Python show-and-tell	51	12735	March 6, 2024
Chrome crashes on uploading large files Dash Python	4	6950	April 7, 2018
Best Way to Handle User-Uploaded Dataset Dash Python	9	13724	November 15, 2022
Problem when use dash.datatble for large files / dash 1.13.0 Dash Python	0	289	July 6, 2020
Uploading Relatively Small Files is taking too Long in Dash Plotly Dash Python	6	2534	December 25, 2019

Dash Upload Component - Decoding Large Files

Related topics