filecoin-plus-large-datasets icon indicating copy to clipboard operation
filecoin-plus-large-datasets copied to clipboard

[DataCap Application] -NOAA Joint Polar Satellite System (JPSS)

Open Swift-scouts opened this issue 2 years ago • 31 comments

Data Owner Name

tuyouhuwai

What is your role related to the dataset

Dataset Owner

Data Owner Country/Region

China

Data Owner Industry

Arts & Recreation

Website

WeChat Public:TOOYOU

Social Media

WeChat Public:TOOYOU

Total amount of DataCap being requested

8PiB

Expected size of single dataset (one copy)

930TiB

Number of replicas to store

5

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1bx6gbnj2lyze6gijuch7ivwpu3csujixwoun4ea

Data Type of Application

Public, Open Commercial/Enterprise

Custom multisig

  • [ ] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

tuyouhuwai is a professional outdoor travel club, giving outdoor enthusiasts a platform for outdoor companionship. We were founded in Hangzhou in early 2012 and are famous for our tours around Hangzhou, domestic long-distance and foreign niche depth tours.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

Outdoor landscape shooting, outdoor activity shooting, short video shooting

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (Country/Region)

None

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

No response

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

No response

Please share a sample of the data

WeChat Public:TOOYOU
Most of the works have been uploaded to WeChat Public/Video (tuyouhuwai).

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • [X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Sporadic

For how long do you plan to keep this dataset stored on Filecoin

2 to 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, Australia (continent)

How will you be distributing your data to storage providers

HTTP or FTP server

How do you plan to choose storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

No response

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

Swift-scouts avatar Nov 01 '23 08:11 Swift-scouts

It should be noted that the JPSS project is mentioned in 2115, but JPSS has multiple data addresses, 2115 only uses one of them(s3://noaa-jpss/), we chose the other one(s3://noaa-nesdis-n20-pds/). Data sources are not duplicated. https://registry.opendata.aws/noaa-jpss/

Swift-scouts avatar Nov 01 '23 08:11 Swift-scouts

Data has already been stored on the Filecoin network @Swift-scouts. Why does this request bring additional value to the ecosystem?

herrehesse avatar Nov 01 '23 09:11 herrehesse

  • Have you prepared enough token for sector pledge?
  • Are you a data preparer? What is your previous experience as a data-preparer? List previous applications and client IDs
  • How will the data be prepared? Please include tooling used and technical details
  • If you are not preparing the data, who will prepare the data? (Name and Business)
  • Has this dataset been stored on Filecoin before? If so, why are you choosing to store it again?
  • Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners.You should list Miner ID, Business Entity, Location of sps you will cooperate with.
  • Per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

Sunnyiscoming avatar Nov 01 '23 13:11 Sunnyiscoming

We have enough tokens.

Here I download the data from aws and convert it into car files. The downloaded files are packaged in 64GB or 32GB tar packages, and then boostx is used to generate car. This dataset was not previously available on filecoin, we can search for it and see the results below.Several data sets are used under this project, and I have selected one that is not stored。

图片

Swift-scouts avatar Nov 02 '23 04:11 Swift-scouts

Contact name and email information has not been all completed in the form. Please resubmit the form with complete information.

Sunnyiscoming avatar Nov 05 '23 14:11 Sunnyiscoming

Ok, we will update SPs.

Swift-scouts avatar Nov 06 '23 10:11 Swift-scouts

Have been updated

Swift-scouts avatar Nov 06 '23 10:11 Swift-scouts

@Swift-scouts you are a known abuser. @kevzak can we close this LDN ?

herrehesse avatar Nov 13 '23 12:11 herrehesse

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Nov 24 '23 01:11 github-actions[bot]

Keep this application open

Swift-scouts avatar Nov 24 '23 02:11 Swift-scouts

Some questions of application have not been completed. Please complete them. Please provide ID, City, Country, Organization of each SP here.

Sunnyiscoming avatar Dec 01 '23 14:12 Sunnyiscoming

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Dec 12 '23 01:12 github-actions[bot]

Have filled in 图片

Swift-scouts avatar Dec 12 '23 03:12 Swift-scouts

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Dec 23 '23 01:12 github-actions[bot]

Hi,How's everything?

Swift-scouts avatar Dec 23 '23 05:12 Swift-scouts

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Jan 03 '24 01:01 github-actions[bot]

Keep this open

Swift-scouts avatar Jan 03 '24 02:01 Swift-scouts

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Jan 14 '24 01:01 github-actions[bot]

Keep this open

Swift-scouts avatar Jan 14 '24 04:01 Swift-scouts

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Jan 25 '24 01:01 github-actions[bot]

Keep this open

Swift-scouts avatar Jan 26 '24 16:01 Swift-scouts

If you are a data preparer. What is your location (Country/Region) None

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details? No response

If you are not preparing the data, who will prepare the data? (Provide name and business) No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution. No response How do you plan to make deals to your storage providers No response

If you answered "Others/custom tool" in the previous question, enter the details here No response

Please answer the above problems.

Sunnyiscoming avatar Jan 28 '24 11:01 Sunnyiscoming

If you are a data preparer. What is your location (Country/Region) -Hong Kong, China.

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details? -We downloaded the data using the aws command line, packaged it using tar, and generated car files using boostx and stream-commp.

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution. -No,this dataset hasn't been stored on the Filecoin network before 图片

If you already have a list of storage providers to work with, fill out their names and provider IDs below f02838518 akcd4040 [email protected] bitwind Russia f02837226 Jerry [email protected] kinghash Britain f02859053 miaozi [email protected] chainup USA f02832475 Lee [email protected] HS88 Thailand f02096851 jerry [email protected] EdgeIPC Indonesia no Anthony f02828509 jkkts12 [email protected] hs88 Korea No jkkts12 f02812781 TVfinance [email protected] TVfinance Vietnam No Alma

How do you plan to make deals to your storage providers -boost

Swift-scouts avatar Jan 29 '24 06:01 Swift-scouts

Deleting comment

@Sunnyiscoming hasn't the permissions to post this comment.

Please, contact the assignee of this issue.

Datacap Request Trigger

Total DataCap requested

8PiB

Expected weekly DataCap usage rate

1PiB

Client address

f1bx6gbnj2lyze6gijuch7ivwpu3csujixwoun4ea

Sunnyiscoming avatar Feb 02 '24 14:02 Sunnyiscoming

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1bx6gbnj2lyze6gijuch7ivwpu3csujixwoun4ea

DataCap allocation requested

409.59TiB

Id

ee3bcbcd-53fd-4f10-bfd4-d47899b4cfdf

SP List provided: [{"providerID": "f02838518","City": "XYZ", "Country": "Russia", "SPOrg","bitwind"}, {"providerID": "f02837226","City": "XYZ", "Country": "Britain", "SPOrg","kinghash"}, {"providerID": "f02859053","City": "XYZ", "Country": "USA", "SPOrg","chainup"}, {"providerID": "f02832475","City": "XYZ", "Country": "Thailand", "SPOrg","HS88"}, {"providerID": "f02096851","City": "XYZ", "Country": "Indonesia", "SPOrg","EdgeIPC"}, {"providerID": "f02828509","City": "XYZ", "Country": "Korea", "SPOrg","hs88"}, {"providerID": "f02812781","City": "XYZ", "Country": "Vietnam", "SPOrg","TVfinance"},]

Sunnyiscoming avatar Feb 02 '24 14:02 Sunnyiscoming

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Feb 13 '24 01:02 github-actions[bot]

keep this ple

Swift-scouts avatar Feb 13 '24 06:02 Swift-scouts

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] avatar Feb 24 '24 01:02 github-actions[bot]