filecoin-plus-large-datasets icon indicating copy to clipboard operation
filecoin-plus-large-datasets copied to clipboard

[DataCap Application] <FogMeta Lab> - <Digital Earth Africa Landsat Collection 2 Level 2>[2/2]

Open hengdingy opened this issue 2 years ago • 64 comments
trafficstars

Data Owner Name

FogMeta Lab

Data Owner Country/Region

China

Data Owner Industry

Web3 / Crypto

Website

https://fogmeta.com

Social Media

Twitter: https://twitter.com/FogMeta
GitHub: https://github.com/FogMeta

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1roqjd6ycasedmeiy6w37trugq33pr7ajig7qcmq

Custom multisig

  • [ ] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

FogMeta Lab's research spans multiple levels from system technology, infrastructure, and middleware to services and solutions, and involves future systems, network technology and business, distributed systems and management, information management, and interactive and innovative services. Based on the views on and practices in the industry, FogMeta also solves the problem of business complexity through operations optimization and other technologies.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

"Digital Earth Africa (DE Africa) provides free and open access to a copy of Landsat Collection 2 Level-2 products over Africa. These products are produced and provided by the United States Geological Survey (USGS). The Landsat series of Earth Observation satellites, jointly led by USGS and NASA, have been continuously acquiring images of the Earth’s land surface since 1972. DE Africa provides data from Landsat 5, 7 and 8 satellites, including historical observations dating back to late 1980s and regularly updated new acquisitions. New Level-2 Landsat 7 and Landsat 8 data are available after 15 to 27 days from acquisition. See Landsat Collection 2 Generation Timeline for details. USGS Landsat Collection 2 was released early 2021 and offers improved processing, geometric accuracy, and radiometric calibration compared to previous Collection 1 products. The Level-2 products are endorsed by the Committee on Earth Observation Satellites (CEOS) to be Analysis Ready Data for Land (CARD4L)-compliant. This internationally recognized certification ensures these products have been processed to a minimum set of requirements and organized into a form that allows immediate analysis with a minimum of additional user effort and interoperability both through time and with other datasets.

New Landsat data are added regularly, usually within a few hours of them being available in the usgs-landsat bucket.

There are no restrictions on Landsat data downloaded from the USGS; it can be used or redistributed as desired."

Source: https://registry.opendata.aws/deafrica-landsat/

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

IPFS, lotus, graphsplit, others/custom tool

If you answered "other/custom tool" in the previous question, enter the details here

We'd also like to use the Swan Client tool (https://github.com/filswan/go-swan-client#Graphsplit) to prepare the dataset.

Please share a sample of the data

s3://deafrica-landsat/ (649.2 TiB)
s3://deafrica-landsat-inventory/ (179.4 GiB)

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • [X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Monthly

For how long do you plan to keep this dataset stored on Filecoin

2 to 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent), Antarctica

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), HTTP or FTP server, IPFS, Shipping hard drives

How do you plan to choose storage providers

Slack, Partners, Others

If you answered "Others" in the previous question, what is the tool or platform you plan to use

We'd also like to use FilSwan platform (https://filswan.com/) to choose storage providers who meet our requirements.

If you already have a list of storage providers to work with, fill out their names and provider IDs below

The storage providers we'd like to work with are presented below. Some of them are from the FilSwan platform.
f01955033
f02029115
f03624
f010088
f02301
f08399
f02401
f01955030
f0187709
f01163272
f01402814
f01390330
f01225882
f0717969
f03223
f01395673
f01072221
f0143858
f01786736
f0836160
f032824
f01443744
f01871352
f01907556
f01955028
f01947280
f01946551
f02012951
f01970630
f0240185

How do you plan to make deals to your storage providers

Boost client, Lotus client, Others/custom tool

If you answered "Others/custom tool" in the previous question, enter the details here

Swan Client tool
https://github.com/filswan/go-swan-client

Can you confirm that you will follow the Fil+ guideline

Yes

hengdingy avatar Feb 28 '23 08:02 hengdingy

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

1PiB

Client address

f1roqjd6ycasedmeiy6w37trugq33pr7ajig7qcmq

Sunnyiscoming avatar Mar 02 '23 12:03 Sunnyiscoming

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1roqjd6ycasedmeiy6w37trugq33pr7ajig7qcmq

DataCap allocation requested

256TiB

Id

1b741402-8808-4e71-8365-e749255dde7c

Hello @hengdingy , please show more information about how much data this resource has? And please tell us ,what is your relationship with these provider IDs?

nj-steve avatar Mar 04 '23 16:03 nj-steve

Hello @hengdingy , please show more information about how much data this resource has? And please tell us ,what is your relationship with these provider IDs?

@nj-steve see this comment

hengdingy avatar Mar 05 '23 03:03 hengdingy

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebelcjqbfk5akyafs3gr7bfsffznf3h3vf7szqymezvwajw3dsh3i

Address

f1roqjd6ycasedmeiy6w37trugq33pr7ajig7qcmq

Datacap Allocated

256.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

1b741402-8808-4e71-8365-e749255dde7c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebelcjqbfk5akyafs3gr7bfsffznf3h3vf7szqymezvwajw3dsh3i

cryptowhizzard avatar Mar 08 '23 15:03 cryptowhizzard

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedrpvuzdci4bgijim4m4yykzj3t7cnmikdryiduf7p45sq4c7vigq

Address

f1roqjd6ycasedmeiy6w37trugq33pr7ajig7qcmq

Datacap Allocated

256.00TiB

Signer Address

f1xx6555qijma7igpnjspyvdunc4vfxkawnpqy5ii

Id

1b741402-8808-4e71-8365-e749255dde7c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedrpvuzdci4bgijim4m4yykzj3t7cnmikdryiduf7p45sq4c7vigq

nj-steve avatar Mar 12 '23 02:03 nj-steve

checker:manualTrigger

hengdingy avatar May 22 '23 05:05 hengdingy

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] avatar Jul 28 '23 01:07 github-actions[bot]

checker:manualTrigger

hengdingy avatar Jul 28 '23 15:07 hengdingy

checker:manualTrigger

Normalnoise avatar Aug 04 '23 15:08 Normalnoise

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] avatar Aug 15 '23 01:08 github-actions[bot]

checker:manualTrigger

hengdingy avatar Aug 17 '23 14:08 hengdingy

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Aug 30 '23 15:08 github-actions[bot]

checker:manualTrigger

hengdingy avatar Aug 31 '23 02:08 hengdingy

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1roqjd6ycasedmeiy6w37trugq33pr7ajig7qcmq

Rule to calculate the allocation request amount

100% weekly > 0.5PiB, requesting 0.5PiB

DataCap allocation requested

512TiB

Total DataCap granted for client so far

256TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.75PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
0 0 256TiB NaN 256TiB

checker:manualTrigger

Normalnoise avatar Sep 12 '23 13:09 Normalnoise

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Sep 23 '23 01:09 github-actions[bot]

keep alive

hengdingy avatar Sep 23 '23 15:09 hengdingy

checker:manualTrigger

Normalnoise avatar Oct 02 '23 14:10 Normalnoise

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Oct 13 '23 01:10 github-actions[bot]

checker:manualTrigger

hengdingy avatar Oct 15 '23 12:10 hengdingy

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Oct 26 '23 01:10 github-actions[bot]

checker:manualTrigger

Normalnoise avatar Oct 28 '23 02:10 Normalnoise

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Nov 08 '23 01:11 github-actions[bot]

keep live

hengdingy avatar Nov 09 '23 09:11 hengdingy

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Nov 20 '23 01:11 github-actions[bot]