covid-19-api icon indicating copy to clipboard operation
covid-19-api copied to clipboard

mvn install giving me IllegalStateException due to higher percentage of invalid records

Open riaz opened this issue 4 years ago • 3 comments

$mvn clean install

[WARNING] java.lang.IllegalStateException: Percentage of Invalid Record 7.26158 did not meet the threshold 5.00000 at com.yahoo.covid19.database.DatabaseBuilder.validateDbRecordCount(DatabaseBuilder.java:436) at com.yahoo.covid19.database.DatabaseBuilder.build(DatabaseBuilder.java:283) at com.yahoo.covid19.database.DataFetcher.fetchDataAndProcess(DataFetcher.java:46) at com.yahoo.covid19.database.DatabaseBuilder.main(DatabaseBuilder.java:496) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:282) at java.lang.Thread.run(Thread.java:748)

riaz avatar May 01 '20 18:05 riaz

Our build fails if the data quality drops below some threshold.

From the data repo: this is probably due to zipcode and UK boroughs being included "I am not sure how you determine validity zipcodes have no wikiId region type for zipcode is “PostalZip” for boroughs it is “TertiaryAdminArea”

We are looking into it.

aklish avatar May 01 '20 22:05 aklish

You can bump the threshold until we fix the DQ checks or the data.

aklish avatar May 01 '20 22:05 aklish

ok cool, thank you for letting me know

riaz avatar May 01 '20 22:05 riaz