zeeschuimer icon indicating copy to clipboard operation
zeeschuimer copied to clipboard

recurring: Unexpected Data Format during capturing Instagram Data

Open bodilvreugdenhil opened this issue 2 months ago • 3 comments

Hi!

It seems as though this exact problem has come up again:

https://github.com/digitalmethodsinitiative/zeeschuimer/issues/27

I experienced the same error as this user when trying to capture data from Instagram. I did make sure that 4CAT and Zeeschuimer were completely up to date. Perhaps Instagram changed their data structure again recently.

Thanks in advance!

bodilvreugdenhil avatar Apr 10 '24 13:04 bodilvreugdenhil

Could you check the dataset log in 4CAT. Is the error the same as in this part: Unable to map item: KeyError-'full_name'? Or are you receiving the unexpected data format warning for a different key name?

dale-wahl avatar Apr 15 '24 08:04 dale-wahl

Yes, it is exactly that error. Unable to map item: KeyError-'full_name'

bodilvreugdenhil avatar Apr 15 '24 09:04 bodilvreugdenhil

Ah, the fix did not make the 1.40 release, but is available in the master version of 4CAT (https://github.com/digitalmethodsinitiative/4cat/commit/fa3be93bafef17e95881207604efa1212d562d9e).

You can use the “latest” Docker tag in the .env file to use the most current version of 4cat which I checked and includes the above fix. After updating 4cat, the status message of the Dataset will not update (unless you re-import the data), but all processors will use the author_fullname field appropriately.

dale-wahl avatar Apr 15 '24 09:04 dale-wahl