parse-dashboard icon indicating copy to clipboard operation
parse-dashboard copied to clipboard

Data import

Open Vortec4800 opened this issue 8 years ago • 43 comments

I know on the hosted Parse dashboard (non-beta) there's an option to import data via JSON or CSV which is great. I haven't been able to find this option on the hosted beta dashboard, or on the parse-dashboard project.

Is this functionality available in either place? Is it a planned addition to the dashboard project, or out of scope? Seeding in data from a CSV file is a really useful feature and I was sad to not find it.

Vortec4800 avatar Apr 29 '16 18:04 Vortec4800

should be obselte now as you can import the data with mongoimport. or are there other advantages when importing via webui?

neophob avatar Apr 30 '16 15:04 neophob

That's a good and valid point. I've been treating the mongo database like a black box, so I don't mess with the way the Parse server is storing data. I suppose it wouldn't be crazy to import directly to the database.

I do still think having the capability in the dashboard would be useful from a UX standpoint. It's much easier in general and much harder to screw up. I like to hand the keys to a project over to a client, and lately that's been including a Parse dashboard login with instructions on how to do basic data management through there. It would be great if they could import data to their databases via CSV on the dashboard without needing us to get involved on the database itself. The more my clients and project stakeholders can manage on their own, the better for me.

Vortec4800 avatar Apr 30 '16 20:04 Vortec4800

I think it should be added to the dashboard by the community. My team can work on it in the future. Meanwhile, you can use cloud functions to import data. I wrote an example how you can do it: https://gist.github.com/davimacedo/c7738203a2a616b48a22fdc7c00b37d2

davimacedo avatar May 02 '16 04:05 davimacedo

I also used the import feature to import csv to my parse database. I looked up mongoimport and do not understand how it works. Can you please let me know what is the easiest way to import csv data to my parse table?

JoaqStar avatar May 10 '16 22:05 JoaqStar

I think the removal of the import function on the dashboard is extremely short sighted. As Vortex rightly points out, giving the client the ability to import simple csv data is EXTREMELY useful. Can you give any idea of a timeline for adding it back in?

sighjones avatar May 12 '16 14:05 sighjones

mongoimport can also work with CSV. Check the docs here: https://docs.mongodb.com/manual/reference/program/mongoimport/

drew-gross avatar May 12 '16 22:05 drew-gross

Yes definitely the import data via CSV/Json should be added back to Parse Dashboard.

dailyneedsapp avatar May 16 '16 09:05 dailyneedsapp

+1 for adding it back. Was very easy to use, even for someone that doesn't code.

mitchellporter avatar May 17 '16 22:05 mitchellporter

+1

ndmeiri avatar May 20 '16 19:05 ndmeiri

Hi, I don't see the import data via CSV/Json, was this added back? I accidentally deleted a class with 98 rows. Please add this button back as my data is in json format and need to import my data soon.

kikrlabs avatar May 22 '16 19:05 kikrlabs

Yes they removed the button even on the non-beta dashboard :(

RafaRuiz avatar May 26 '16 19:05 RafaRuiz

+1 This function was crucial to helping build apps fast.

KapoorKarn avatar Jun 11 '16 21:06 KapoorKarn

I'm down to put a bounty on this feature. Anyone else want to join to see if we can get it large enough for someone to tackle?

KapoorKarn avatar Jul 13 '16 13:07 KapoorKarn

+1, can't believe I can no longer do this with self hosted dashboard.

miracle7 avatar Jul 22 '16 01:07 miracle7

+1 I would very much like this feature, more or less instant CSV import was great for our use case, now uploading data using node (in the legacy .com system) which takes considerable time to complete due limits on connection rates etc.

stretchnz avatar Jul 27 '16 23:07 stretchnz

All, take a look at mongochef (http://3t.io/mongochef/), i've been using it since the removed the bulk import function from the dashboard. Mongochef has allowed me to easily add/remove/modify classes. I've been able to import semi large csv's to my dbs (roughly 10k records). For large csv files i've been doing a bulk import. There is a commercial and non-commercial option available.

I know some other have mentioned some ways to import as well, but i'm not very skilled in scripts, shells, or yadda yadda. Anyway, just wanted to post in case it helped someone.

KapoorKarn avatar Aug 04 '16 13:08 KapoorKarn

NodeChef has rolled out a feature that allows you to easily import CSV and JSON data into your Parse Server database hosted on NodeChef with just a click of a button. Documentation available here.

Knana avatar Aug 24 '16 02:08 Knana

Without this, how are we suppose to import my previous data? Directly operating on mongodb is never a good idea.

zh-wowtv avatar Sep 30 '16 12:09 zh-wowtv

Any update on this? Or know of any options, I've tried the cloud function, it doesn't work anymore.

Treverr avatar Apr 06 '17 22:04 Treverr

@Treverr I recently set up a simple tool that automates the process. JSON or CSV formatted data is supported.

AmrKafina avatar May 06 '17 15:05 AmrKafina

@AmrKafina, how can we use the tool for local databases please???

nyxee avatar Jun 18 '17 03:06 nyxee

@AmrKafina your link is dead.

ebelinski avatar Dec 12 '17 17:12 ebelinski

Hey everyone, we're not focused on this atm (importing straight to mongodb is usually the way to go) but I too would like to see this back in place :) , it was a nice feature. Considering this would be a convenience, but not a critical component, we'll probably get to this after handling other issues with the dashboard first.

We're totally open to anyone who wants to get started on this in the meantime. It would be prudent to note that if we're going to add an import function we're going to want to also add a compatible export function.

montymxb avatar Dec 14 '17 20:12 montymxb

@montymxb I have exported .json files from Parse Dashboard, from Back4App service. In their dashboard the import/export functionality is still there. When I try to do mongoimport from .json file to my local DB everything is importing fine. And I can see that data is my database through the mongo shell. But in ParseDashboard I don't see the new collections. Can you know any possible solutions for this problem?

Macstyg avatar Feb 02 '18 11:02 Macstyg

@Macstyg Hmmm, that doesn't sound quite right. I haven't worked with migrating to (or from) back4app personally so I can't attest to the process there. I would reach out to their support and see if there's something you're missing in order to do a complete import. Although it should just work. A recent migration I oversaw away from a 3rd party provider went relatively smooth via mongoimport.

montymxb avatar Feb 27 '18 02:02 montymxb

@Macstyg back4app server settings has mongo db connection string with the credentials. You can use that to connect to your back4app's mongo db and use mongoimport to import your json data that way.

wimbledon avatar Feb 27 '18 05:02 wimbledon

I believe importing the data directly wouldn't work, because parse's exports (and I assume Back4App's) have a schema different from the one you'll find in the mongodb (ie objectId in parse, _id in mongo).

AmrKafina avatar Feb 27 '18 09:02 AmrKafina

@AmrKafina You have to also import _SCHEMA collections. This is the collections that tells parse-server what classes and field types are in your classes.

wimbledon avatar Feb 27 '18 09:02 wimbledon

As noted above i would verify your _Schema collection is present and accounted for.

On Tue, Feb 27, 2018, 01:31 David Liu [email protected] wrote:

@AmrKafina https://github.com/amrkafina You have to also import _SCHEMA collections. This is the collections that tells parse-server what classes and field types are in your classes.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/parse-community/parse-dashboard/issues/307#issuecomment-368806988, or mute the thread https://github.com/notifications/unsubscribe-auth/AE1d4BgVtP5zjgbktyXddoTKoSaZCtShks5tY8tzgaJpZM4ITE42 .

montymxb avatar Feb 28 '18 03:02 montymxb

Any news on this feature? It can be very useful as collaborators do not need to login into the server and mess with commands on the database.

Simone-cogno avatar May 28 '20 12:05 Simone-cogno