filecoin-plus-large-datasets
filecoin-plus-large-datasets copied to clipboard
filecoin-project
[DataCap Application] <Venus Team > - <DealAccelerator 6>
Data Owner Name
NOAA
Data Owner Country/Region
American Samoa
Data Owner Industry
Environment
Website
https://venushub.io
Social Media
https://linktr.ee/filecoinvenus
Total amount of DataCap being requested
5PiB
Weekly allocation of DataCap requested
200TiB
On-chain address for first allocation
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Custom multisig
- [ ] Use Custom Multisig
Identifier
No response
Share a brief history of your project and organization
The team: Venus team
Venus team leads the development and practice of Filecoin Venus, established in 2020, Shanghai, China. Now we have decades of members from all over the world focusing on code dev and community.
Through the core dev and ecological activities and programs, we hope (and already) to have more storage service providers, users, and enthusiasts join Filecoin or provide more contributions after joining Filecoin.
The project: Venus Deal Accelerator (https://venushub.io/accelerator/)
Venus is committed to offer a fully functional deal-making experience for both storage clients and storage providers on the scale. As the Filecoin network grows and the community strives towards a more storage deal weighted growth than committed capacity growth, the Venus community takes on the challenge to help shape this vision with the Venus Deal Accelerator program.
The goal of the Venus Deal Accelerator program is to distribute as much storage deals as it can to the broader storage provider community with focuses on seamlessly bridging the sealing experience that storage providers are already familiar with to the Filecoin deal taking experience. Venus Deal Accelerator program will be responsible for applying large datacap with approved open datasets from fil-plus program and distribute storage deals to its participants running Venus storage systems.
Is this project associated with other projects/ecosystem stakeholders?
No
If answered yes, what are the other projects/ecosystem stakeholders
No response
Describe the data being stored onto Filecoin
The data stored in Filecoin is from publicly available datasets with important information for environments via NOAA.
Where was the data currently stored in this dataset sourced from
AWS Cloud
If you answered "Other" in the previous question, enter the details here
No response
How do you plan to prepare the dataset
graphsplit
If you answered "other/custom tool" in the previous question, enter the details here
No response
Please share a sample of the data
https://registry.opendata.aws/noaa-gmgsi/
s3://noaa-gmgsi-pds/
https://registry.opendata.aws/noaa-coastal-lidar/
s3://noaa-nos-coastal-lidar-pds/
https://registry.opendata.aws/noaa-ghe/
s3://noaa-ghe-pds/
https://registry.opendata.aws/noaa-s111/
s3://noaa-s111-pds/
https://registry.opendata.aws/noaa-wod/
s3://noaa-wod-pds/
https://registry.opendata.aws/noaa-cdr-oceanic/
s3://noaa-cdr-sea-surface-temp-optimum-interpolation-pds/
https://registry.opendata.aws/noaa-ufs-s2s/
s3://noaa-ufs-prototypes-pds/
https://registry.opendata.aws/noaa-ghcn/
s3://noaa-ghcn-pds/
https://registry.opendata.aws/noaa-rtofs/
s3://noaa-nws-rtofs-pds/
Confirm that this is a public dataset that can be retrieved by anyone on the Network
- [X] I confirm
If you chose not to confirm, what was the reason
No response
What is the expected retrieval frequency for this data
Monthly
For how long do you plan to keep this dataset stored on Filecoin
1 to 1.5 years
In which geographies do you plan on making storage deals
Greater China, Asia other than Greater China, North America, Europe
How will you be distributing your data to storage providers
Cloud storage (i.e. S3), HTTP or FTP server, Shipping hard drives, Others
How do you plan to choose storage providers
Slack, Filmine, Big data exchange, Others
If you answered "Others" in the previous question, what is the tool or platform you plan to use
We define VenusHub as a platform for community projects. The Deal Accelerator mentioned here is one of them. The Deal Accelerator is aimed at the storage providers of real data storage. We complete the SP screening through they' application and screening rules, and they come from the Filecoin community, so they have no interest relationship.
If you already have a list of storage providers to work with, fill out their names and provider IDs below
This list is a part of it. We are still expanding the available real data storage providers.
https://github.com/data-preservation-programs/filplus-checker-assets/tree/main/filecoin-project/filecoin-plus-large-datasets/issues/345
https://github.com/data-preservation-programs/filplus-checker-assets/tree/main/filecoin-project/filecoin-plus-large-datasets/issues/1444
We will focus on more new SPs (miners) and hope that more miners will real data provide storage for the client.
How do you plan to make deals to your storage providers
Others/custom tool
If you answered "Others/custom tool" in the previous question, enter the details here
venus-market (Droplet). The support of venus-market(Droplet) for real data storage is very mature.
Can you confirm that you will follow the Fil+ guideline
Yes
Thanks for your request!
Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
![large-datacap-requests[bot] avatar](https://avatars.githubusercontent.com/in/116297?v=4 "Published by a pub.dev verified publisher"){kind=small}
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
Datacap Request Trigger
Total DataCap requested
5PiB
Expected weekly DataCap usage rate
200TiB
Client address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
DataCap Allocation requested
Multisig Notary address
f02049625
Client address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
DataCap allocation requested
100TiB
Id
a5835230-9792-4303-9ddf-4e86d6d0659b
Request Proposed
Your Datacap Allocation Request has been proposed by the Notary
Message sent to Filecoin Network
bafy2bzaceclzlkfboep2vecczlgpqvzeqpjiijd25fosnfwj66zfst5aajpb2
Address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Datacap Allocated
100.00TiB
Signer Address
f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa
Id
a5835230-9792-4303-9ddf-4e86d6d0659b
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceclzlkfboep2vecczlgpqvzeqpjiijd25fosnfwj66zfst5aajpb2
Continuation from same series from the same reputable client. Willing to support.
Request Approved
Your Datacap Allocation Request has been approved by the Notary
Message sent to Filecoin Network
bafy2bzacebvpp6ipfw34kkylripqxvggelqnrxo272kjz4drmgmahtvkqagq4
Address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Datacap Allocated
100.00TiB
Signer Address
f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa
Id
a5835230-9792-4303-9ddf-4e86d6d0659b
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebvpp6ipfw34kkylripqxvggelqnrxo272kjz4drmgmahtvkqagq4
DataCap Allocation requested
Request number 2
Multisig Notary address
f02049625
Client address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
DataCap allocation requested
200TiB
Id
73cee57c-a8f7-4f24-a8d3-0d4ff1135d91
Stats & Info for DataCap Allocation
Multisig Notary address
f02049625
Client address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Rule to calculate the allocation request amount
100% of weekly dc amount requested
DataCap allocation requested
200TiB
Total DataCap granted for client so far
100TiB
Datacap to be granted to reach the total amount requested by the client (5PiB)
4.90PiB
Stats
| Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
|---|---|---|---|---|
| 1599 | 3 | 100TiB | 33.33 | 34.12TiB |
DataCap and CID Checker Report Summary[^1]
Storage Provider Distribution
⚠️ 1 storage providers have unknown IP location - f02086809
Deal Data Replication
✔️ Data replication looks healthy.
Deal Data Shared with other Clients[^3]
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Full report
Click here to view the full report.
![filplus-checker-app[bot] avatar](https://avatars.githubusercontent.com/in/267472?v=4 "Published by a pub.dev verified publisher"){kind=small}
DataCap and CID Checker Report Summary[^1]
Storage Provider Distribution
⚠️ All storage providers are located in the same region.
Deal Data Replication
✔️ Data replication looks healthy.
Deal Data Shared with other Clients[^3]
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Full report
Click here to view the full report.
DataCap and CID Checker Report Summary[^1]
Storage Provider Distribution
⚠️ All storage providers are located in the same region.
Deal Data Replication
✔️ Data replication looks healthy.
Deal Data Shared with other Clients[^3]
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Full report
Click here to view the full report.
Request Proposed
Your Datacap Allocation Request has been proposed by the Notary
Message sent to Filecoin Network
bafy2bzaceb5xsaemrewtf4nonrwbpv6mtizt5kswwut6oonq36ore2tkpw5r4
Address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Datacap Allocated
200.00TiB
Signer Address
f1qnumecdypgrbaebtkdfjnwt5ndacadcuas3deiq
Id
73cee57c-a8f7-4f24-a8d3-0d4ff1135d91
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb5xsaemrewtf4nonrwbpv6mtizt5kswwut6oonq36ore2tkpw5r4
Request Proposed
Your Datacap Allocation Request has been proposed by the Notary
Message sent to Filecoin Network
bafy2bzaceb372omj52moqfom66m3hqxa3tr2ksytwutuupy6whqtvslz5lwve
Address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Datacap Allocated
200.00TiB
Signer Address
f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri
Id
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb372omj52moqfom66m3hqxa3tr2ksytwutuupy6whqtvslz5lwve
DataCap and CID Checker Report Summary[^1]
Storage Provider Distribution
⚠️ All storage providers are located in the same region.
Deal Data Replication
✔️ Data replication looks healthy.
Deal Data Shared with other Clients[^3]
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Full report
Click here to view the full report.
DataCap and CID Checker Report Summary[^1]
Storage Provider Distribution
⚠️ All storage providers are located in the same region.
Deal Data Replication
✔️ Data replication looks healthy.
Deal Data Shared with other Clients[^3]
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Full report
Click here to view the full report.
Request Approved
Your Datacap Allocation Request has been approved by the Notary
Message sent to Filecoin Network
bafy2bzacebrt6mmtoj3r6bvvnps43rcfbqj5yscozkg63a2fu2tgthqewqmkq
Address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Datacap Allocated
200.00TiB
Signer Address
f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga
Id
73cee57c-a8f7-4f24-a8d3-0d4ff1135d91
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebrt6mmtoj3r6bvvnps43rcfbqj5yscozkg63a2fu2tgthqewqmkq
DataCap Allocation requested
Request number 2
Multisig Notary address
f02049625
Client address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
DataCap allocation requested
200TiB
Id
5dbd6f18-e0fb-40b4-afd4-325e38f60c14
Stats & Info for DataCap Allocation
Multisig Notary address
f02049625
Client address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Rule to calculate the allocation request amount
100% of weekly dc amount requested
DataCap allocation requested
200TiB
Total DataCap granted for client so far
100TiB
Datacap to be granted to reach the total amount requested by the client (5PiB)
4.90PiB
Stats
| Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
|---|---|---|---|---|
| 2555 | 10 | 100TiB | 21.09 | 40.48TiB |
DataCap and CID Checker Report Summary[^1]
Storage Provider Distribution
✔️ Storage provider distribution looks healthy.
Deal Data Replication
⚠️ 61.86% of deals are for data replicated across less than 4 storage providers.
Deal Data Shared with other Clients[^3]
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Full report
Click here to view the full report.
Request Approved
Your Datacap Allocation Request has been approved by the Notary
Message sent to Filecoin Network
bafy2bzaceafmztvkltx5wu5pbmonicnofg4w7mfum7clpilhuri5ds5so47rg
Address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Datacap Allocated
200.00TiB
Signer Address
f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q
Id
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceafmztvkltx5wu5pbmonicnofg4w7mfum7clpilhuri5ds5so47rg
Request Proposed
Your Datacap Allocation Request has been proposed by the Notary
Message sent to Filecoin Network
bafy2bzacebu2jwahjtj3ptvaztenrmp6bmanpx2nefcekbse6pg43xc257qz2
Address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Datacap Allocated
200.00TiB
Signer Address
f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da
Id
5dbd6f18-e0fb-40b4-afd4-325e38f60c14
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebu2jwahjtj3ptvaztenrmp6bmanpx2nefcekbse6pg43xc257qz2
CC @galen-mcandrew @Kevin-FF-USA .The state is chaotic. The first signature is Approved, and the second signature is Proposed, but the DC is allocated normally.
Request Approved
Your Datacap Allocation Request has been approved by the Notary
Message sent to Filecoin Network
bafy2bzacecwfxmd7zsrxmutm33dbhmsnvcqzfujngb2rehhjacfl7xbldsnr4
Address
f1lqnlm2j64ttld3sicwvh5jm3ctisoghhgu6m2my
Datacap Allocated
200.00TiB
Signer Address
f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga
Id
5dbd6f18-e0fb-40b4-afd4-325e38f60c14
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecwfxmd7zsrxmutm33dbhmsnvcqzfujngb2rehhjacfl7xbldsnr4
DataCap and CID Checker Report Summary[^1]
Storage Provider Distribution
⚠️ 1 storage providers sealed too much duplicate data - f02059869: 21.82%
Deal Data Replication
⚠️ 55.64% of deals are for data replicated across less than 4 storage providers.
Deal Data Shared with other Clients[^3]
⚠️ CID sharing has been observed. (Top 3)
- 147.36 TiB - f1prfhgkidn3zinxyrjmtke6zxh3xln6mxuc3h4iq - NOAA
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Full report
Click here to view the full report.
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1725#issuecomment-1549292936