firefox-scrapbook
firefox-scrapbook copied to clipboard
danny0838
Online data sync
Hi, If it's possible to add the online data sync? Maybe through WebDAV or FTP. I know the data can be synchronized by Google Drive or Dropbox, but there are a lot of small files involved. The large amount of small files will cause some sync problem from time to time. It will be much batter to pack the data in a .zip file and sync with a WebDAV or FTP server. Just like the Zotero did.
Packing the database for network traffic could be worse because the database could be very large and any minor change causes everything to be transferred again, and thus this feature is not in our developing plan.
Sorry, perhaps I didn't make myself clear. I did not mean to pack the whole database into a single file. I think it's possible to pack each page into different files. Although any minor change would need a transmission of a whole page, but I think the size of a single page is not so large, re-transmission of a single page is acceptable.
Zipping each data item before network traffic would probably enhance the performance. However, to unzip the files in the cloud service requires access authentication, which differs from one service to another, and we are not planned to code for each individual cloud service to support such feature. If this feature is important to you, writing a script or an addon for ScrapBook for your favorite service(s) would be a more viable choice.
I don't think it's necessary to unzip the files in the cloud service. Just leave the Zip file in the cloud. When the change have been made, just overwrite the Zip file directly. If the Zip in cloud is newer, just download it and unzip it locally. Write an addon for ScrapBook is actually my original plan, but JavaScript is not one of the languages that I'm familiar with. However, I may give it a try when I get a chance.
Even though we don't unzip packs in the cloud service, to dynamically zip each data item directory locally and upload those zips without other files seems to require ad hoc scripting for each cloud service, which is not what we planned to "officially" provide, at least currently. So, unfortunately, you'd have to develop it on your own.
FYI: this is somehow implemented in the successor, WebScrapBook. WebScrapBook (with PyWebScrapBook as the backend server) can save everything to a remote server, although it's not syncing. WebScrapBook also supports saving a web page as a ZIP-based archive (HTZ or MAFF) to reduce the "too many files" issue, although which is already largely overcomed by HTTP/2.0