filecoin-plus-large-datasets
filecoin-plus-large-datasets copied to clipboard
filecoin-project
[DataCap Application] <FogMeta Lab> - <ComStock>
Data Owner Name
FogMeta Lab
Data Owner Country/Region
China
Data Owner Industry
Web3 / Crypto
Website
https://fogmeta.com
Social Media
Twitter: https://twitter.com/FogMeta
GitHub: https://github.com/FogMeta
Total amount of DataCap being requested
5PiB
Weekly allocation of DataCap requested
1PiB
On-chain address for first allocation
f1tpennou4k6abbymhlolbbinsgnbt7keeya5zg3i
Custom multisig
- [ ] Use Custom Multisig
Identifier
No response
Share a brief history of your project and organization
FogMeta Lab's research spans multiple levels from system technology, infrastructure, and middleware to services and solutions, and involves future systems, network technology and business, distributed systems and management, information management, and interactive and innovative services. Based on the views on and practices in the industry, FogMeta also solves the problem of business complexity through operations optimization and other technologies.
Is this project associated with other projects/ecosystem stakeholders?
No
If answered yes, what are the other projects/ecosystem stakeholders
No response
Describe the data being stored onto Filecoin
“ComStock is a highly granular, bottom-up model that uses multiple data sources, statistical sampling methods, and advanced building energy simulations to estimate the annual sub-hourly energy consumption of the commercial building stock across the United States.”
Source: https://registry.opendata.aws/nrel-pds-building-stock/
Where was the data currently stored in this dataset sourced from
AWS Cloud
If you answered "Other" in the previous question, enter the details here
No response
How do you plan to prepare the dataset
IPFS, lotus, graphsplit, others/custom tool
If you answered "other/custom tool" in the previous question, enter the details here
We'd also like to use the Swan Client tool (https://github.com/filswan/go-swan-client#Graphsplit) to prepare the dataset.
Please share a sample of the data
s3://nrel-pds-building-stock/comstock/(196.2TiB)
Confirm that this is a public dataset that can be retrieved by anyone on the Network
- [X] I confirm
If you chose not to confirm, what was the reason
No response
What is the expected retrieval frequency for this data
Monthly
For how long do you plan to keep this dataset stored on Filecoin
2 to 3 years
In which geographies do you plan on making storage deals
Greater China, Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent), Antarctica
How will you be distributing your data to storage providers
Cloud storage (i.e. S3), HTTP or FTP server, IPFS, Shipping hard drives
How do you plan to choose storage providers
Slack, Partners, Others
If you answered "Others" in the previous question, what is the tool or platform you plan to use
We'd also like to use FilSwan platform (https://filswan.com/) to choose storage providers who meet our requirements.
If you already have a list of storage providers to work with, fill out their names and provider IDs below
The storage providers we'd like to work with are presented below. Some of them are from the FilSwan platform.
f01955033
f02029115
f03624
f010088
f02301
f08399
f02401
f01955030
f0187709
f01163272
f01402814
f01390330
f01225882
f0717969
f03223
f01395673
f01072221
f0143858
f01786736
f0836160
f032824
f01443744
f01871352
f01907556
f01955028
f01947280
f01946551
f02012951
f01970630
f0240185
How do you plan to make deals to your storage providers
Boost client, Lotus client, Others/custom tool
If you answered "Others/custom tool" in the previous question, enter the details here
Swan Client tool
https://github.com/filswan/go-swan-client
Can you confirm that you will follow the Fil+ guideline
Yes
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
![large-datacap-requests[bot] avatar](https://avatars.githubusercontent.com/in/116297?v=4 "Published by a pub.dev verified publisher"){kind=small}
Datacap Request Trigger
Total DataCap requested
5PiB
Expected weekly DataCap usage rate
1PiB
Client address
f1tpennou4k6abbymhlolbbinsgnbt7keeya5zg3i
DataCap Allocation requested
Multisig Notary address
f02049625
Client address
f1tpennou4k6abbymhlolbbinsgnbt7keeya5zg3i
DataCap allocation requested
256TiB
Id
c0ed1cc4-d69c-4250-967d-8942daad2ff3
s3://nrel-pds-building-stock/comstock/(196.2TiB) Why you need 5 PB datacap?
s3://nrel-pds-building-stock/comstock/(196.2TiB) Why you need 5 PB datacap?
@Sunnyiscoming Considering the retrieval success rate of current storage providers's situation, we will store the 13 copies to the Filecoin network. The buckets data size about 196.2TiB, every piece size will be 16GiB(required 32GiB datacap), so all data need 196*1024/16*32*13/1024=5096TiB datacap
After reading history, I have some questions：
Can you show more data？ Is your data publicly available？
@zcfil yes, the data is completely public. and all dataset is here: s3://nrel-pds-building-stock/comstock/(196.2TiB)
This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
DataCap and CID Checker Report[^1]
No application info found for this issue on https://filplus.d.interplanetary.one/clients.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
![filplus-checker-app[bot] avatar](https://avatars.githubusercontent.com/in/267472?v=4 "Published by a pub.dev verified publisher"){kind=small}
This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.
DataCap and CID Checker Report[^1]
No application info found for this issue on https://filplus.d.interplanetary.one/clients.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
DataCap and CID Checker Report[^1]
No application info found for this issue on https://filplus.d.interplanetary.one/clients.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
DataCap and CID Checker Report[^1]
No application info found for this issue on https://filplus.d.interplanetary.one/clients.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.
-- Commented by Stale Bot.
DataCap and CID Checker Report[^1]
No application info found for this issue on https://filplus.d.interplanetary.one/clients.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.
-- Commented by Stale Bot.
DataCap and CID Checker Report[^1]
No application info found for this issue on https://filplus.d.interplanetary.one/clients.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.
-- Commented by Stale Bot.
This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.
-- Commented by Stale Bot.
DataCap and CID Checker Report[^1]
No application info found for this issue on https://filplus.d.interplanetary.one/clients.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger