nft.storage icon indicating copy to clipboard operation
nft.storage copied to clipboard

Published 20 hours ago • verified publisher icon nftstorage

Remove filter when nft2 has finished copying to nft3

Open alanshaw opened this issue 3 years ago • 2 comments

The pins cron job is currently filtering out CIDs that are stored on nft2. This needs to be removed when all data has finished copying over to nft3.

https://github.com/nftstorage/nft.storage/pull/1265#discussion_r800757323

alanshaw avatar Feb 07 '22 15:02 alanshaw

Should be complete after March 24.

alanshaw avatar Mar 04 '22 16:03 alanshaw

  • [ ] I'm currently running a job to migrate pin service from IpfsCluster/IpfsCluster2 to IpfsCluster3. ⏳

It's tricky because it seems many of the same CIDs have been pinned in multiple clusters. Updating to use IpfsCluster3 often triggers violates unique constraint "pin_content_cid_service_key". So in this case we delete the pin on the old cluster since we've already recorded a pin on the new one. :weary:

Note there are 22.4m of these so it's going to take a while.

When this migration is complete we should be able to remove the filter in the cron job...

alanshaw avatar Apr 07 '22 12:04 alanshaw