GAIA-DataSet icon indicating copy to clipboard operation
GAIA-DataSet copied to clipboard

Few records of servies in July in the document of 'business' in MicroSS

Open BuleSky233 opened this issue 2 years ago • 5 comments

After I unzipped all folders of, I found that there are no records for all servies in July except webservice1 in the document of 'business'. There is also no August data in the Trace folder. Could you please provide complete data, at least the complete data of a month?

BuleSky233 avatar Feb 02 '23 09:02 BuleSky233

Thank you for your concern to GAIA-Dataset. Previously, because the data collection service crashed, the trace data in August was unavailable. So we did not release the data in August. As for the incomplete business data in July, we need to further check the consistency between the uploaded data and the database data. After the problem is fixed, we will release it as soon as possible. Sorry for the inconvenience.

Xander-cloudwise avatar Feb 02 '23 11:02 Xander-cloudwise

It seems the zip files in business folder are corrupted. I run the following command to decompress the data:

zip -s- business_split.zip -O business_full.zip
unzip business_full.zip

I got the following errors:

 error:  invalid compressed data to inflate
error: invalid zip file with overlapped components (possible zip bomb)

The output only has one file business_table_2021-08.csv. This file has 4478735 rows × 4 columns and only covers two days 2021-08-01 and 2021-08-02.

mistycheney avatar Mar 16 '23 20:03 mistycheney

It may be that the decompression problem is caused by the file being too large. You can try the following decompression command:jar xvf ***

Xander-cloudwise avatar Mar 17 '23 09:03 Xander-cloudwise

Can you provide a list of expected files after unzipping for "business" and "trace"? During unzip I got a lot of "error: invalid compressed data to inflate". Eventually some csv files are generated, but I'm not sure if they are complete. Thanks!

Below are the files I have after decompression:

"business":

  • business_table_2021-08.csv (contains data of only two days: 2021-08-01 and 2021-08-02)
  • business_table_webservice1_2021-07.csv (contains data 2021-07-01 to 2021-07-13)

"trace":

  • trace_table_dbservice1_2021-07.csv
  • trace_table_dbservice2_2021-07.csv
  • trace_table_logservice1_2021-07.csv
  • trace_table_logservice2_2021-07.csv
  • trace_table_mobservice1_2021-07.csv
  • trace_table_mobservice2_2021-07.csv
  • trace_table_redisservice1_2021-07.csv
  • trace_table_redisservice2_2021-07.csv
  • trace_table_webservice1_2021-07.csv
  • trace_table_webservice2_2021-07.csv

mistycheney avatar Mar 26 '23 18:03 mistycheney

Your decompressed file name and number of files are correct, where business contains 2 files and trace contains 10 files. It looks like your business_table_2021-08.csv file is corrupted, it should contain all data from 2021-08-01 to 2021-08-31. Please try to repair the file or download the file again.

Xander-cloudwise avatar Apr 04 '23 11:04 Xander-cloudwise