data-transfer-project icon indicating copy to clipboard operation
data-transfer-project copied to clipboard

How can I use Solid transfer via API?

Open gobengo opened this issue 5 years ago • 4 comments

Hiya.

I have a client that would like to use DTP to transfer data to a Solid data pod.

I see that there is some code in here related to transferring contacts to/from Solid (which appears to have been started by @bwillard, who I met once at MyData 2018. Hi Brian!):

  • https://github.com/google/data-transfer-project/tree/master/extensions/data-transfer/portability-data-transfer-solid
  • https://github.com/google/data-transfer-project/tree/master/extensions/data-transfer/portability-data-transfer-solid/src/test/java/org/datatransferproject/transfer/solid

The thing is, I can't figure out how to use it when running the DTP Demo docker container using Running Locally docs.

I have created a public instance of the DTP Demo to test with.

I expect (hope) to be able to follow these steps:

  1. Go to: https://data-transfer-project.app-demos.permanent.cloud/data
  2. Choose 'contacts' from the data type dropdown. Click Next
  3. Find 'Solid' in either/both of the 'from' and 'to' "Choose a Service" dropdowns.
    • But instead I only see "Microsoft" and "Google"

I looked into the Angular app, and I believe I learned that these options come from the TransferService, which requests this API:

  • https://data-transfer-project.app-demos.permanent.cloud/api/transfer/services/CONTACTS
    • Solid isn't listed in here either.

All this leads me to believe that perhaps the solid-related code from portability-data-transfer-solid isn't activated or exposed in the API, at least by default and in the build for the docker hub container image.

Does anyone know how I can make use of the Solid transfer extension for DTP? Ideally:

  • I would see Solid as an option in the transfer contacts API: https://data-transfer-project.app-demos.permanent.cloud/api/transfer/services/CONTACTS
  • I would see solid as an option in the demo angular app
  • I could create transfers to/from Solid using the API

Appreciative to anyone who donates attention and help, bengo

gobengo avatar Nov 12 '19 09:11 gobengo

Let me take a look. If I remember correctly there was some weirdness around auth/UI.

I am super slammed with some other stuff, if this takes me a couple days to look into is that ok?

bwillard avatar Nov 14 '19 05:11 bwillard

if this takes me a couple days to look into is that ok?

@bwillard Of course, Brian. I'm not under immediate pressure.

On the other hand, we're excited to (slowly but surely) set up a repeatable solution for people to use DTP to onboard to Solid. So I am definitely grateful for your help when you can spare the cycles.

gobengo avatar Nov 14 '19 07:11 gobengo

@bwillard I would also love to understand how a service such as Solid could be used via API. AFAIK it is one of the few adapters that requires a different auth scheme other than OAuth and makes use of CookiesAndUrlAuthData. I would love to understand how you envisioned such an auth scheme to be used.

jaudriga avatar Oct 28 '20 09:10 jaudriga

I’m the client you speak of above, not sure if you ever got that working at all but if you did please let me know I would sure like to get back together with you and launch solid.

mikeadams1 avatar Oct 29 '20 22:10 mikeadams1