filecoin-plus-large-datasets icon indicating copy to clipboard operation
filecoin-plus-large-datasets copied to clipboard

[DataCap Application] <Venus Team > - <DealAccelerator 7>

Open Joss-Hua opened this issue 2 years ago • 115 comments

Data Owner Name

NOAA

Data Owner Country/Region

American Samoa

Data Owner Industry

Environment

Website

https://venushub.io

Social Media

https://linktr.ee/filecoinvenus

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

200TiB

On-chain address for first allocation

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Custom multisig

  • [ ] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

The team: Venus team

Venus team leads the development and practice of Filecoin Venus, established in 2020, Shanghai, China. Now we have decades of members from all over the world focusing on code dev and community.

Through the core dev and ecological activities and programs, we hope (and already) to have more storage service providers, users, and enthusiasts join Filecoin or provide more contributions after joining Filecoin.


The project: Venus Deal Accelerator (https://venushub.io/accelerator/)

Venus is committed to offer a fully functional deal-making experience for both storage clients and storage providers on the scale. As the Filecoin network grows and the community strives towards a more storage deal weighted growth than committed capacity growth, the Venus community takes on the challenge to help shape this vision with the Venus Deal Accelerator program.

The goal of the Venus Deal Accelerator program is to distribute as much storage deals as it can to the broader storage provider community with focuses on seamlessly bridging the sealing experience that storage providers are already familiar with to the Filecoin deal taking experience. Venus Deal Accelerator program will be responsible for applying large datacap with approved open datasets from fil-plus program and distribute storage deals to its participants running Venus storage systems.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

The data stored in Filecoin is from publicly available datasets with important information for environments via NOAA.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

graphsplit

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://registry.opendata.aws/noaa-isd/
s3://noaa-isd-pds/
https://registry.opendata.aws/noaa-ndfd/
s3://noaa-ndfd-pds/
https://registry.opendata.aws/noaa-cdr-terrestrial/
s3://noaa-cdr-leaf-area-index-fapar-pds/
https://registry.opendata.aws/noaa-cdr-atmospheric/
s3://noaa-cdr-aerosol-optical-thickness-pds/
https://registry.opendata.aws/noaa-rtma/
s3://noaa-rtma-pds/
https://registry.opendata.aws/noaa-space-weather/
s3://noaa-swpc-pds/
https://registry.opendata.aws/noaa-oar-hourly-gdp/
s3://noaa-oar-hourly-gdp-pds/
https://registry.opendata.aws/noaa-ocean-climate-stations/
s3://noaa-oar-keo-papa-pds/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • [X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Monthly

For how long do you plan to keep this dataset stored on Filecoin

Less than 1 year

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, Europe

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), HTTP or FTP server, Shipping hard drives, Others

How do you plan to choose storage providers

Slack, Filmine, Big data exchange, Others

If you answered "Others" in the previous question, what is the tool or platform you plan to use

We define VenusHub as a platform for community projects. The Deal Accelerator mentioned here is one of them. The Deal Accelerator is aimed at the storage providers of real data storage. We complete the SP screening through they' application and screening rules, and they come from the Filecoin community, so they have no interest relationship.

If you already have a list of storage providers to work with, fill out their names and provider IDs below

This list is a part of it. We are still expanding the available real data storage providers.
https://github.com/data-preservation-programs/filplus-checker-assets/tree/main/filecoin-project/filecoin-plus-large-datasets/issues/345
https://github.com/data-preservation-programs/filplus-checker-assets/tree/main/filecoin-project/filecoin-plus-large-datasets/issues/1444
We will focus on more new SPs (miners) and hope that more miners will real data provide storage for the client.

How do you plan to make deals to your storage providers

Others/custom tool

If you answered "Others/custom tool" in the previous question, enter the details here

venus-market (Droplet). The support of venus-market(Droplet) for real data storage is very mature.

Can you confirm that you will follow the Fil+ guideline

Yes

Joss-Hua avatar Mar 05 '23 06:03 Joss-Hua

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

200TiB

Client address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Sunnyiscoming avatar Mar 07 '23 06:03 Sunnyiscoming

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

DataCap allocation requested

100TiB

Id

96d36559-ad71-4a08-8542-9b190231661d

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecoscw6i226sjsjcowch5hl5ajg7imoneid42jqsplblaxovecr5s

Address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Datacap Allocated

100.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

96d36559-ad71-4a08-8542-9b190231661d

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecoscw6i226sjsjcowch5hl5ajg7imoneid42jqsplblaxovecr5s

cryptowhizzard avatar Mar 08 '23 14:03 cryptowhizzard

Continuation from same series from the same reputable client. Willing to support.

kernelogic avatar Mar 08 '23 21:03 kernelogic

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacec5r6xe46naitq6vgs6edb67eoshatvfcg4flcepvd4j7nu6m4u4q

Address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Datacap Allocated

100.00TiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

Id

96d36559-ad71-4a08-8542-9b190231661d

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec5r6xe46naitq6vgs6edb67eoshatvfcg4flcepvd4j7nu6m4u4q

kernelogic avatar Mar 08 '23 21:03 kernelogic

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

DataCap allocation requested

200TiB

Id

b2715882-0956-4ff9-9908-4062377c49d5

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

100TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.90PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
0 0 100TiB NaN 36.55TiB

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedohptfti36ocvmogbgm4ktepeir7g3zec3ofcf5lcwzik3j2t6iq

Address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Datacap Allocated

200.00TiB

Signer Address

f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q

Id

b2715882-0956-4ff9-9908-4062377c49d5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedohptfti36ocvmogbgm4ktepeir7g3zec3ofcf5lcwzik3j2t6iq

NiwanDao avatar Apr 17 '23 09:04 NiwanDao

checker:manualTrigger

SuperChaiChai avatar Apr 17 '23 10:04 SuperChaiChai

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01968673: 99.97%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

More SPs and replicas need to be added

SuperChaiChai avatar Apr 17 '23 10:04 SuperChaiChai

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceadgdhke7ws4ru235vacc26rvntjtp6mh654sjz4uzvncw7rgrqq4

Address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Datacap Allocated

200.00TiB

Signer Address

f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da

Id

b2715882-0956-4ff9-9908-4062377c49d5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceadgdhke7ws4ru235vacc26rvntjtp6mh654sjz4uzvncw7rgrqq4

SuperChaiChai avatar Apr 17 '23 10:04 SuperChaiChai

@SuperChaiChai thank you, will look for more SPs and improve data dispersion.

Joss-Hua avatar Apr 17 '23 10:04 Joss-Hua

CC @galen-mcandrew @Kevin-FF-USA .The state is chaotic. The first signature is Proposed, and the second signature is Proposed too [@.@]

Joss-Hua avatar Apr 17 '23 10:04 Joss-Hua

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacec64sekqz5odjt2g45mqlsfj3hxvxbbd7sfukc7xqel7cc7zwk2zk

Address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Datacap Allocated

200.00TiB

Signer Address

f1bp3tzp536edm7dodldceekzbsx7zcy7hdfg6uzq

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec64sekqz5odjt2g45mqlsfj3hxvxbbd7sfukc7xqel7cc7zwk2zk

laurarenpanda avatar Apr 18 '23 01:04 laurarenpanda

Always willing to support Venus Deal Accelerator! It would be great to have similar projects to help more SPs and attract more Data Owners.

laurarenpanda avatar Apr 18 '23 03:04 laurarenpanda

checker:manualTrigger

Joss-Hua avatar May 16 '23 09:05 Joss-Hua

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ All storage providers are located in the same region.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1725#issuecomment-1549292936

Joss-Hua avatar May 16 '23 09:05 Joss-Hua

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

DataCap allocation requested

400TiB

Id

e8461a63-2eaf-4050-9dae-349ec4c5e248

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

181898.9YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

-2.19B

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
6218 6 200TiB 32.85 6.46TiB

checker:manualTrigger

Joss-Hua avatar May 29 '23 05:05 Joss-Hua

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Long term reputable client and CID report looks good.

kernelogic avatar May 29 '23 07:05 kernelogic