core icon indicating copy to clipboard operation
core copied to clipboard

Allow for file uploads

Open coreation opened this issue 10 years ago • 16 comments

File uploads allow people with datasets to upload their files to the server in order to publish them. This takes away the step of that person needing to publishing the file somewhere online before publishing it.

coreation avatar Aug 21 '15 08:08 coreation

I think over here we should certainly enable the option for cloud storage. Your thoughts?

How about using http://flysystem.thephpleague.com/ for this?

pietercolpaert avatar Aug 27 '15 09:08 pietercolpaert

I was going to do that yes, a link towards #311 is welcome I think.

coreation avatar Aug 27 '15 10:08 coreation

Why is this remove from TDT6.0 it is an urgent requirement for Digipolis.

wesleydv avatar Jul 01 '16 11:07 wesleydv

Is it? I thought Digipolis had a special own place for all of their files to which they could FTP or something?

coreation avatar Jul 01 '16 11:07 coreation

Yes, could be, but we need file upload in the interface. The goal is to remove data management from the portal and put this in TDT, but for that we need file upload in the UI. The API would be used as a read-only API then.

daften avatar Jul 01 '16 11:07 daften

Are you guys planning on uploading the 200MB files as well? Because that would mean allowing to post such a large file + allowing the connecting to be open that long?

coreation avatar Jul 01 '16 11:07 coreation

Yes, but that is server settings and can be configured. First thing is the functionality :)

daften avatar Jul 01 '16 11:07 daften

Planned for the next release it is :) Will probably be implemented with an internal deadline somewhere in september I believe.

coreation avatar Jul 01 '16 11:07 coreation

I'd consider:

  • Using flysystem for storing the data on different kind of locations: http://flysystem.thephpleague.com/
  • Implementing an option to circumvent The DataTank to do magic with the file when the representation is big and cannot be loaded into memory.

pietercolpaert avatar Jul 01 '16 11:07 pietercolpaert

  • Flysystem is on our radar, we use it in other projects to connect with Dropbox and Google Drive (@daften is that an option?)
  • You mean only showing a chunk of the data, like we're doing now or?

coreation avatar Jul 01 '16 11:07 coreation

  • See #311
  • See #258

pietercolpaert avatar Jul 01 '16 11:07 pietercolpaert

Ik ken flysystem niet, maar dat ziet er wel OK uit, dus sure :)

daften avatar Jul 01 '16 12:07 daften

Flysystem is a league package, big fan :) So we can provide a configuration somewhere to add an application key of GDrive or Dropbox in order to define paths to data files?

coreation avatar Jul 01 '16 12:07 coreation

I think local file storage should also be pluggable (IMO). Remote filesystems can be cloud tools or nfs shares maybe?

daften avatar Jul 01 '16 12:07 daften

Flysystem abstract filesystems entirely, so it doesn't really matter. If we use the local file storage however, we need to build an upload functionality though. So either we focus on local, or Dropbox, Gdrive, ... . The implementation will be using Flysystem but if we know which implementation we can focus on, that'd be nice ;)

coreation avatar Jul 01 '16 12:07 coreation

Vraag ik om door onze analyste te laten bepalen dan ;)

Dieter Blomme

On 1 July 2016 at 14:15, Jan Vansteenlandt [email protected] wrote:

Flysystem abstract filesystems entirely, so it doesn't really matter. If we use the local file storage however, we need to build an upload functionality though. So either we focus on local, or Dropbox, Gdrive, ... . The implementation will be using Flysystem but if we know which implementation we can focus on, that'd be nice ;)

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/tdt/core/issues/318#issuecomment-229931818, or mute the thread https://github.com/notifications/unsubscribe/ABKhoBaANY0HINUlIUzrCuBtLW78YtSUks5qRQTqgaJpZM4FvtxS .

daften avatar Jul 01 '16 14:07 daften