filecoin-plus-large-datasets icon indicating copy to clipboard operation
filecoin-plus-large-datasets copied to clipboard

[DataCap Application] - <JoyMe>

Open fengqiangjun opened this issue 2 years ago • 145 comments

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

  • Organization Name: joyme
  • Website / Social Media: https://www.joyme.sg/
  • Total amount of DataCap being requested (between 500 TiB and 5 PiB): 5PiB
  • Weekly allocation of DataCap requested (usually between 1-100TiB): 400TiB
  • On-chain address for first allocation: f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

JoyMe creates real connections between people and has become one of the most popular live video platforms in the world. Our app connects creators (musicians, singers, actors, DJs, storytellers and comedians) with an authentic fan base.
Our mission is to enable the independent creator community to succeed in an increasingly competitive digital environment through our ongoing commitment to security and to make JoyMe the best digital media outlet for creators.

What is the primary source of funding for this project?

Company

What other projects/ecosystem stakeholders is this project associated with?

There is no other projects/ecosystem stakeholders associated with.

Use-case details

Describe the data being stored onto Filecoin

Creators (musicians, singers, actors, DJs, storytellers and comedians) dynamic video, anchor live video.

Where was the data in this dataset sourced from?

User Uploaded and live video.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

https://www.joyme.com/

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes

What is the expected retrieval frequency for this data?

1-2 times a year

For how long do you plan to keep this dataset stored on Filecoin?

540 Days

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

HongKong or North America.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Prefer online, if needed offline can also be considered.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We would like to choose a storage provider in Hong Kong or North America . we want to choose a miner with good size and credit in filecon's ecosystem.

How will you be distributing deals across storage providers?

Store to multiple SPs

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes

fengqiangjun avatar Dec 01 '22 13:12 fengqiangjun

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

400TiB

Client address

f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

simonkim0515 avatar Dec 05 '22 19:12 simonkim0515

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

DataCap allocation requested

200TiB

Id

b399b4d3-43a5-4815-8822-1405a5d4b2c5

We are contacting sp and will start packaging shortly.

fengqiangjun avatar Feb 01 '23 08:02 fengqiangjun

Dear applicant,

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Looking at your application i have some questions: As you are brand new on Github and have no history of past applications it seems to me that applying for 5PB of datacap is a lot. One needs comprehensive knowledge of Filecoin, packing of data, distribution of data and all it's requirements coming with it. Are you brand new in the Filecoin space or have you applied for datacap in the past on different Github account names?

Can you show us visible proof of the size of your data and the storage systems you have there?

As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

cryptowhizzard avatar Feb 13 '23 14:02 cryptowhizzard

Can you send confirmation email to [email protected] using the email address of your company domain? @Sunnyiscoming please help verify and confirm.

Joss-Hua avatar Feb 14 '23 08:02 Joss-Hua

Data sample link is invalid now.

Joss-Hua avatar Feb 14 '23 08:02 Joss-Hua

@Joss-Hua @Sunnyiscoming The email has been sent, please check. 54711676370996_ pic

fengqiangjun avatar Feb 14 '23 10:02 fengqiangjun

Data sample link is invalid now.

Thanks for your reply, the above sample data link has expired, here is the new data sample link, please check. https://drive.google.com/file/d/1ViDtaOk9QXo2VnNu3yLMulL43S89aH1T/view?usp=share_link https://drive.google.com/file/d/1satxm0PmKYzHpAkydo84RCLVHEX-4pc8/view?usp=share_link https://drive.google.com/file/d/13hoTMxQUFKErmpicEeJBbOsL-zs7SCJ8/view?usp=share_link https://drive.google.com/file/d/1yGz2PvELTDGgXIorlLOxLYcLjHus3xeN/view?usp=share_link https://drive.google.com/file/d/1UCOHJTBiXd80ZajwttOj8F2F9tGOXIHK/view?usp=share_link https://drive.google.com/file/d/1g0FDuQwpyhsOyqOG9TPcjnMxoYbbjxMX/view?usp=share_link

@Joss-Hua

fengqiangjun avatar Feb 14 '23 10:02 fengqiangjun

  1. Good application. I like audio and video very much, and I am also very happy to see such data on-boarding.
  2. hi @Sunnyiscoming, please confirm the mail for the notaries.
  3. Finally, reconfirm whether the data uploaded and broadcast by users are willing to be used as public data? To avoid disputes over data rights and interests. @fengqiangjun

Joss-Hua avatar Feb 23 '23 07:02 Joss-Hua

I know that the filecoin network stores public data. No disputes will arise.

fengqiangjun avatar Feb 23 '23 07:02 fengqiangjun

Support the first round and wait for the first retrieval check

Joss-Hua avatar Feb 24 '23 10:02 Joss-Hua

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec4ym6wn6efdric5wzm245hdrl343b43rheoqion53ywq2j6re65m

Address

f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

Datacap Allocated

200.00TiB

Signer Address

f1tfg54zzscugttejv336vivknmsnzzmyudp3t7wi

Id

b399b4d3-43a5-4815-8822-1405a5d4b2c5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec4ym6wn6efdric5wzm245hdrl343b43rheoqion53ywq2j6re65m

Joss-Hua avatar Feb 24 '23 10:02 Joss-Hua

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceabndd27fwnmtbltluwn56lumbgjrutzmnyweayusngvchbgtmesq

Address

f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

Datacap Allocated

200.00TiB

Signer Address

f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da

Id

b399b4d3-43a5-4815-8822-1405a5d4b2c5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceabndd27fwnmtbltluwn56lumbgjrutzmnyweayusngvchbgtmesq

SuperChaiChai avatar May 24 '23 07:05 SuperChaiChai

  1. How much public data do you currently have? Can you screen capture and show me the size of the data you have?

  2. Are there any selected storage providers? If you have, please list it.

psh0691 avatar Jun 07 '23 01:06 psh0691

  1. How much public data do you currently have? Can you screen capture and show me the size of the data you have?
  2. Are there any selected storage providers? If you have, please list it.
  1. This is the car file we prepared for this datacap, a total of 776t.
  2. We have contacted sp in different regions, such as f01996719, f01996817, f01106276, f02190189, thank you for your support. image image

fengqiangjun avatar Jun 07 '23 02:06 fengqiangjun

I'll apply for the first round.

psh0691 avatar Jun 07 '23 04:06 psh0691

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacearssvb7kjbkjojerha7limlaihn4gbtdjzkiw5bz4bhtvlxzcmy2

Address

f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

Datacap Allocated

200.00TiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

b399b4d3-43a5-4815-8822-1405a5d4b2c5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacearssvb7kjbkjojerha7limlaihn4gbtdjzkiw5bz4bhtvlxzcmy2

psh0691 avatar Jun 07 '23 04:06 psh0691

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

  • Overall Graphsync retrieval success rate: 0.00%
  • Overall HTTP retrieval success rate: 0.00%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 90% of total datacap - f0155829: 95.68%

Deal Data Replication

⚠️ 91.32% of deals are for data replicated across less than 2 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

  • Overall Graphsync retrieval success rate: 0.86%
  • Overall HTTP retrieval success rate: 0.00%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

DataCap allocation requested

400TiB

Id

50669e69-4d26-45e7-b3a5-bc9854730cf6

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

200TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.80PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
4699 2 200TiB 63.31 49.71TiB

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedqoh3tjxsbg3z7itysif5352yv6l5zrou36lmawwxru5ojhpveey

Address

f1q6nz6hvnif6uakrebwyio74b5ggfhgvn4jqz7tq

Datacap Allocated

400.00TiB

Signer Address

f1dnb3uz7sylxk6emti3ififcvu3nlufnnsjui6ea

Id

50669e69-4d26-45e7-b3a5-bc9854730cf6

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedqoh3tjxsbg3z7itysif5352yv6l5zrou36lmawwxru5ojhpveey

mikezli avatar Jul 26 '23 10:07 mikezli

checker:manualTrigger

C00kies77 avatar Jul 26 '23 10:07 C00kies77

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

  • Overall Graphsync retrieval success rate: 2.03%
  • Overall HTTP retrieval success rate: 0.00%
  • Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f0155829: 71.47%

⚠️ 1 storage providers sealed too much duplicate data - f01302188: 28.92%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

**We have found some problems in the information provided in the Approved Comment. We could not find Address field in the information provided

Please, take a look at the comment and edit the body of the comment providing all the required information.

@mikezli

Why are you proposing when there is so much duplicate data and with almost 0% retrieval?

cryptowhizzard avatar Jul 26 '23 13:07 cryptowhizzard

Scherm­afbeelding 2023-07-26 om 15 12 15

Btw,

"In which geographies (countries, regions) do you plan on making storage deals? HongKong or North America."

It seems to me that you are storing elsewhere?

cryptowhizzard avatar Jul 26 '23 13:07 cryptowhizzard

Yes, Hong Kong and North America are the locations where we prefer to store data. However, unfortunately, we have encountered many challenges in finding service providers (SPs). Many Filecoin SPs come from the Greater China region, and since we have a company in Beijing and a larger network within the Chinese community, we initially found two SPs in China. Fortunately, we have now managed to find some reliable overseas SPs who will perform better in terms of retrieval. We will start packaging in the next few days. As newcomers to Filecoin, we still have a lot of room for improvement in selecting SPs and implementing Fil+.

Scherm­afbeelding 2023-07-26 om 15 12 15

Btw,

"In which geographies (countries, regions) do you plan on making storage deals? HongKong or North America."

It seems to me that you are storing elsewhere?

fengqiangjun avatar Jul 26 '23 14:07 fengqiangjun