framework icon indicating copy to clipboard operation
framework copied to clipboard

Regression from version 5.7.2

Open jze opened this issue 2 years ago • 2 comments

Overview

I have code that works with version 5.7.2:

from frictionless import Package, Resource
r1 = Resource('https://opendata.schleswig-holstein.de/dataset/8049b860-6d5c-4ad8-a584-43bec41a6220/resource/13269a62-71af-499e-b4b2-e28882c4d6c1/download/badegewasser-stammdaten-aktuell.json')
r2 = Resource('https://opendata.zitsh.de/frictionless/badegewasser-messungen.json')
r3 = Resource('https://opendata.zitsh.de/frictionless/badegewasser-einstufung.json')
r4 = Resource('https://opendata.zitsh.de/frictionless/badegewasser-saisondauer.json')
r5 = Resource('https://opendata.zitsh.de/frictionless/badegewasser-infrastruktur-aktuell.json')
package = Package(
    name='bathing-water-quality-sh',
    title='Bathing Water Quality Schleswig-Holstein',
    resources=[r1, r2, r3, r4, r5 ]
)

# add foreign keys to connect the resources
f_keys = []
f_keys.append({
  "fields": ["BADEGEWAESSERID"],
  "reference": {
      "resource": "badegewasser-stammdaten-aktuell",        
      "fields": ["BADEGEWAESSERID"]
  }            
})
package.resources[1].schema.foreign_keys = f_keys
package.resources[2].schema.foreign_keys = f_keys
package.resources[3].schema.foreign_keys = f_keys
package.resources[4].schema.foreign_keys = f_keys

package.publish('sqlite:///badewasserqualität.sqlite')

With an up-to-date version 5.15.0 I get this error message:

frictionless.exception.FrictionlessException: [package-error] The data package has an error: descriptor is not valid (The data package has an error: 'https://opendata.schleswig-holstein.de/dataset/8049b860-6d5c-4ad8-a584-43bec41a6220/resource/13269a62-71af-499e-b4b2-e28882c4d6c1/download/badegewasser-stammdaten-aktuell.json' is not of type 'object' at property 'resources/0')

jze avatar Jul 13 '23 05:07 jze

Thank you @jze for reporting!. We will investigate.

shashigharti avatar Jul 17 '23 07:07 shashigharti

We found the root cause but it will take some time to fix it

roll avatar Aug 07 '23 14:08 roll