filecoin-plus-large-datasets icon indicating copy to clipboard operation
filecoin-plus-large-datasets copied to clipboard

[DataCap Application] < Edwardext> - <Sentinel-1 SLC dataset for South and Southeast Asia, Taiwan, Korea and Japan>

Open edwardext opened this issue 2 years ago • 79 comments

Data Owner Name

European Space Agency

Data Owner Country/Region

France

Data Owner Industry

Environment

Website

https://www.esa.int/

Social Media

https://www.facebook.com/EuropeanSpac
https://www.youtube.com/user/ESA

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

400TiB

On-chain address for first allocation

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Data Type of Application

None

Custom multisig

  • [ ] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

I am a researcher and developer in blockchain technology.        
In 2020, I participated in the Filecoin Space Race as a member of the technical support team, providing technical assistance to other service providers (SPs).       
I am deeply interested in Filecoin's complex storage system and have a deep understanding of mining technology, as well as extensive industry experience.        
Through system optimization, hardware matching optimization, and process optimization, I have developed a mining system based on Lotus that is suitable for large-scale production.
I have a team of three developers in China, and we are currently developing an ecosystem application based on FVM.
Based on my recognition of Filecoin's valid data, I would like to provide the public dataset as valid data storage and recommend it to SPs that I know or work with.
I will supervise and guide my collaborating SPs to strictly follow the valid data  encapsulating rules established by the community.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

I participate in the application of the public dataset:#1827

Describe the data being stored onto Filecoin

The S1 Single Look Complex dataset is a collection of Synthetic Aperture Radar data in the C-Band wavelength gathered by SAR sensors on Sentinel-1A and Sentinel-1B, two satellites orbiting the Earth a combination revisit time of six days, operated by the European Space Agency.  The data provides radar amplitude and phase information ideal for studying natural hazards and emergency response, land applications, oil spill monitoring, sea-ice conditions, and associated climate change effects.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

others/custom tool

If you answered "other/custom tool" in the previous question, enter the details here

Self-developed packing tool

Please share a sample of the data

https://registry.opendata.aws/sentinel1-slc-seasia-pds/
s3://sentinel1-slc-seasia-pds/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • [X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Sporadic

For how long do you plan to keep this dataset stored on Filecoin

1 to 1.5 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent), Antarctica

How will you be distributing your data to storage providers

HTTP or FTP server, IPFS, Shipping hard drives, Others

How do you plan to choose storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

f01980952 CN
f01943941 CN
f0150816 CN
f02031264 SGP
f02052244 US
f02052252 US

How do you plan to make deals to your storage providers

Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

edwardext avatar Mar 24 '23 03:03 edwardext

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

400TiB

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Sunnyiscoming avatar Mar 25 '23 12:03 Sunnyiscoming

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

200TiB

Id

8514171b-ebaa-4493-90fe-db0003024b57

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

200TiB

Id

ca5a5458-9ba7-4730-be91-99669426af9b

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Continuous public dataset application. I will keep track of your subsequent allocation and encapsulating.

DirectionTechnology avatar Mar 27 '23 07:03 DirectionTechnology

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebnoqndhtb22zv6eioyx3bkaafuskmrbugqmkluspbxvq6kgqre5i

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

200.00TiB

Signer Address

f1inkdoatsbfumdvpctxbgcatscewr3rus5pxmsgi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebnoqndhtb22zv6eioyx3bkaafuskmrbugqmkluspbxvq6kgqre5i

DirectionTechnology avatar Mar 27 '23 08:03 DirectionTechnology

looks awesome and happy to support.

TimGuo7 avatar Mar 27 '23 09:03 TimGuo7

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedu2l3tz5tyem3ibv2upsyfhh7vv34n4ac2mtv5wsmao6eeh2qjkc

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

200.00TiB

Signer Address

f1yslbnnqzrjlyuxsmyxfbqcc7xthcavgpripjevi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedu2l3tz5tyem3ibv2upsyfhh7vv34n4ac2mtv5wsmao6eeh2qjkc

TimGuo7 avatar Mar 27 '23 09:03 TimGuo7

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

400TiB

Id

f5142099-87df-4824-8c5b-f78bb50b2928

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

200TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.80PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
942 1 200TiB 100 49.81TiB

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 50% of total datacap - f02031264: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 50% of total datacap - f02031264: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

There was only one node encapsulate in the first round, which was due to inconsistent SP speeds because of data transfer and device preparation. In the early stages, this was acceptable. In the next round , other SPs will gradually join to ensure that the overall encapsulation process follows the rules.

edwardext avatar Apr 04 '23 03:04 edwardext

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebhsofjy5wwmzibinf4ej4pdcllm2kwmgf22ftgnfu5hdjsj4omio

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

400.00TiB

Signer Address

f16karfxq7lxdy7izqrzrk75jf3not34k6sg6zvcy

Id

f5142099-87df-4824-8c5b-f78bb50b2928

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebhsofjy5wwmzibinf4ej4pdcllm2kwmgf22ftgnfu5hdjsj4omio

NewHuoPool avatar Apr 07 '23 07:04 NewHuoPool

checker:manualTrigger

Tom-OriginStorage avatar Apr 10 '23 02:04 Tom-OriginStorage

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 50% of total datacap - f02031264: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Communicate with applicants that there will be new SPs joining in the second round, and will continue to pay attention to the new SPs joining situation

Tom-OriginStorage avatar Apr 10 '23 03:04 Tom-OriginStorage

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebzmzzxjmb2qxr6bcis2bzb5up4tcinwyo4lke6kqtdbcmouxtnfi

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

400.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

f5142099-87df-4824-8c5b-f78bb50b2928

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebzmzzxjmb2qxr6bcis2bzb5up4tcinwyo4lke6kqtdbcmouxtnfi

Tom-OriginStorage avatar Apr 10 '23 03:04 Tom-OriginStorage

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to re-open if this is relevant, or start a new application for DataCap anytime. Thank you!

github-actions[bot] avatar May 20 '23 01:05 github-actions[bot]

checker:manualTrigger

edwardext avatar May 22 '23 03:05 edwardext

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

We are currently storing this project, and the report can explain everything. Can we reopen it? @fabriziogianni7 @simonkim0515 @panges2

edwardext avatar May 22 '23 03:05 edwardext

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

400TiB

Id

63d97bf2-6367-4967-a2e0-e87c47b22170

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

200TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.80PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
9600 4 200TiB 33.32 0B

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] avatar Jun 04 '23 01:06 github-actions[bot]