linkwarden icon indicating copy to clipboard operation
linkwarden copied to clipboard

Import from LinkAce

Open alexdelprete opened this issue 2 years ago • 24 comments

Following up on Daniel's comment in #99.

I really like this project, but I have used LinkAce for 2y and in order to try it I'd really need to migrate data from it.

I exported data as html, but CSV format is available too, if needed.

LinkAce_export.zip

alexdelprete avatar Dec 09 '23 12:12 alexdelprete

This is why LinkAce import does not work: https://github.com/linkwarden/linkwarden/issues/301#issuecomment-1842730385

While not a real solution, if you manually scrub the <DD> tags their contents from your LinkAce html export, LinkWarden will import it. *you may need to clean some other non material html as well like

tags, etc but it will eventually import, but you can/will lose a lot of custom link metadata like contents of the description field that LinkAce stores in DD tag of export.

bryanhunwardsen avatar Jan 03 '24 11:01 bryanhunwardsen

Thank you Bryan, but I prefer to wait for a proper import. I'll continue with LinkAce until I will be able to properly migrate with all metadata.

alexdelprete avatar Jan 03 '24 14:01 alexdelprete

Hi @daniel31x13,

is this something that is on the radar? I understand it's not a priority, but I'd like to know if there's any hope to be able to import all my current bookmarks. Otherwise I'll move on and look for alternatives.

Please let me know, thank you.

alexdelprete avatar Jan 25 '24 21:01 alexdelprete

@alexdelprete Hey sorry yeah it's on the radar.

This is linked to #271 and one requirement for a proper import is the support for nested collections, which is on the way (#239).

Anyway that being said, this issue be fixed in the upcoming (or next) release.

daniel31x13 avatar Jan 26 '24 16:01 daniel31x13

this issue be fixed in the upcoming (or next) release.

This is AWESOME! I almost lost hope. :)

If needed, for testing, I attached my LinkAce export in OP.

Thank you so much Daniel.

alexdelprete avatar Jan 27 '24 02:01 alexdelprete

I am also waiting for this feature, already subscribed the other day. Keep up the good work!

fethomm avatar Feb 04 '24 17:02 fethomm

getting to this, and I already found the bug...

daniel31x13 avatar Feb 09 '24 22:02 daniel31x13

Any updates or ETA on this?

mztiq avatar Mar 06 '24 19:03 mztiq

Any updates or ETA on this?

I think latest version just released includes the fix, but didn't test it yet.

image

alexdelprete avatar Mar 06 '24 20:03 alexdelprete

Doesn't work for me sadly

mztiq avatar Mar 06 '24 21:03 mztiq

@mztiq yes this is already fixed. It's strange that you say that it's not fixed for you yet, are you sure you're on the latest version?

daniel31x13 avatar Mar 06 '24 21:03 daniel31x13

@mztiq yes this is already fixed. It's strange that you say that it's not fixed for you yet, are you sure you're on the latest version?

I confirm it's working for me. Imported 170 bookmarks exported from Linkace. Now the server is at 100% cpu since the start of the import, I guess it's downloading the images of the links etc. I'll let it work for a while, hoping there's no issues.

Thanks a lot @daniel31x13, I can finally switch to Linkwarden. :)

alexdelprete avatar Mar 06 '24 21:03 alexdelprete

@alexdelprete I was hoping so since I used the exact file you uploaded as a reference.

daniel31x13 avatar Mar 06 '24 21:03 daniel31x13

@alexdelprete I was hoping so since I used the exact file you uploaded as a reference.

So I'm not a good test-case. :)

Am I correct that linkwarden is now downloading things and updating the db with all screenshots, etc.? The server fans are still spinning...I don't know how long it will take...can I check anywhere what it's doing?

alexdelprete avatar Mar 06 '24 21:03 alexdelprete

@mztiq yes this is already fixed. It's strange that you say that it's not fixed for you yet, are you sure you're on the latest version?

My docker-compose.yml was still using image: ghcr.io/linkwarden/linkwarden:main instead of image: ghcr.io/linkwarden/linkwarden:latest for whatever reason.

Sorry for the confusion and yes, it's working, thanks for that! :-)

EDIT: Oh and I can confirm, CPU usage is at 100% over here too (NUC 10 with Intel Core i7)

mztiq avatar Mar 06 '24 21:03 mztiq

@alexdelprete 170 links will be finished in around 60 to 90 minutes depending on your internet connection, basically what's happening is it takes 10 links (by default), uses Playwrights headless browser and opens up the links and waits till they're are all loaded, captures them and saves them to the /data folder.

daniel31x13 avatar Mar 06 '24 21:03 daniel31x13

@mztiq happy to hear! Yeah the high CPU usage is normal and only for whenever you import a chunk of bookmarks.

daniel31x13 avatar Mar 06 '24 21:03 daniel31x13

I have a symmetric 1Gbit FTTH connection. I see low traffic right now (3-4Mbps), and I don't know why it's using all 8 cores at 100% since it finished importing. :(

Didn't think it was so cpu intensive...

alexdelprete avatar Mar 06 '24 21:03 alexdelprete

CPU usage is back to normal after peaking at 100% for around 15 minutes (133 Bookmarks).

mztiq avatar Mar 06 '24 22:03 mztiq

Thanks for adding this feature. Works as expected for me. Since all bookmarks are in Imports, is there an easy way to copy them to folders already in use?

fethomm avatar Mar 06 '24 22:03 fethomm

The closest thing we currently got is you can use the bulk actions feature to move links in batch.

daniel31x13 avatar Mar 06 '24 22:03 daniel31x13

@daniel31x13 my server is still using 4 cores at 100%, after almost 2h. :(

Should I restart the server or docker service or should I wait? it would be useful to know what actually linkwarden is doing.

alexdelprete avatar Mar 06 '24 23:03 alexdelprete

it would be useful to know what actually linkwarden is doing.

You can check out the logs and it'll say which links are currently in the queue, no need to restart.

daniel31x13 avatar Mar 06 '24 23:03 daniel31x13

You can check out the logs and it'll say which links are currently in the queue, no need to restart.

It took hours: I went to bed and in the morning I found it completed, but in the log there were no timestamps so I don't know how long it actually took, but after 3h it was still working when I decided to stop waiting.

Anyway, it's all good now. Thanks for the help Daniel.

alexdelprete avatar Mar 07 '24 19:03 alexdelprete

@daniel31x13 I think this item can be closed, 2.5.2/2.5.3 supports all features from the current LinkAce html export.

bryanhunwardsen avatar Apr 19 '24 19:04 bryanhunwardsen