cbsodataR icon indicating copy to clipboard operation
cbsodataR copied to clipboard

cbsodataR in Remoteacces environment

Open bevogt opened this issue 3 years ago • 7 comments

Dear Edwin,

thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment). Are you familiar with this problem?

Best,

Benedikt

bevogt avatar Jul 20 '20 10:07 bevogt

Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-)

Best,

Edwin

Op ma 20 jul. 2020 12:01 schreef bevogt [email protected]:

Dear Edwin,

thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment). Are you familiar with this problem?

Best,

Benedikt

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA .

edwindj avatar Jul 20 '20 10:07 edwindj

Hi,

Yes I already asked for the access to the URL already in the environment and it was granted. But it still does not seem to work.

I can forward you the email discussion.

Best

Benedikt


Sent from my mobile device.

Op 20 jul. 2020 om 12:49 heeft Edwin de Jonge [email protected] het volgende geschreven:



Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-)

Best,

Edwin

Op ma 20 jul. 2020 12:01 schreef bevogt [email protected]:

Dear Edwin,

thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment). Are you familiar with this problem?

Best,

Benedikt

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/edwindj/cbsodataR/issues/26#issuecomment-660953649, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AQK5UFYV4QMRFFHKXDWMCLLR4QOLDANCNFSM4PCDZOGA.

--

Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten.

This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages.

bevogt avatar Jul 20 '20 11:07 bevogt

This what was done already. But it still does not work. Toegang vanuit een RA sessie naar de benodigde opendata URL http://opendata.cbs.nl/ODataFeed/ werkt.

image

Ik heb geprobeerd in R of de package werkt en dat lijkt zo te zijn:

image

Advies om de sessie helemaal af te sluiten en opnieuw R 3.6.2 te starten.

Indien het hierna toch niet zou werken voor de onderzoeker, kan de onderzoeker dan aangeven welke R commando's hij gebruikt?

bevogt avatar Jul 20 '20 11:07 bevogt

Strange...

You can try the following from within the remote access environment:

  1. Open a browser
  2. You can check which url is executed, by adding verbose=TRUE to cbs_get_data(). Copy this url and paste in the address bar of your browser. Does that work?

Alternatively: what R version are you using? Tip: sessionInfo()

Op ma 20 jul. 2020 om 13:17 schreef bevogt [email protected]:

Hi,

Yes I already asked for the access to the URL already in the environment and it was granted. But it still does not seem to work.

I can forward you the email discussion.

Best

Benedikt


Sent from my mobile device.

Op 20 jul. 2020 om 12:49 heeft Edwin de Jonge [email protected] het volgende geschreven:



Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-)

Best,

Edwin

Op ma 20 jul. 2020 12:01 schreef bevogt [email protected]:

Dear Edwin,

thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment). Are you familiar with this problem?

Best,

Benedikt

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA>

.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub< https://github.com/edwindj/cbsodataR/issues/26#issuecomment-660953649>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/AQK5UFYV4QMRFFHKXDWMCLLR4QOLDANCNFSM4PCDZOGA>.

--

================================================================================ Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten.

This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages.

================================================================================

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26#issuecomment-660965376, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEEOHDP3FIWST6VJJVVXZLR4QRVPANCNFSM4PCDZOGA .

edwindj avatar Jul 20 '20 11:07 edwindj

I get an error message for one URL (parse error: premature EOF) - The package successfully opens three URLs before.

When I copy-paste it to the browser I can open the URL and the file.

The RStudio version installed is 3.6

From: Edwin de Jonge [email protected] Sent: maandag 20 juli 2020 13:35 To: edwindj/cbsodataR [email protected] Cc: Benedikt Vogt [email protected]; Author [email protected] Subject: Re: [edwindj/cbsodataR] cbsodataR in Remoteacces environment (#26)

Strange...

You can try the following from within the remote access environment:

  1. Open a browser
  2. You can check which url is executed, by adding verbose=TRUE to cbs_get_data(). Copy this url and paste in the address bar of your browser. Does that work?

Alternatively: what R version are you using? Tip: sessionInfo()

Op ma 20 jul. 2020 om 13:17 schreef bevogt <[email protected]mailto:[email protected]>:

Hi,

Yes I already asked for the access to the URL already in the environment and it was granted. But it still does not seem to work.

I can forward you the email discussion.

Best

Benedikt


Sent from my mobile device.

Op 20 jul. 2020 om 12:49 heeft Edwin de Jonge <[email protected]mailto:[email protected]> het volgende geschreven:



Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-)

Best,

Edwin

Op ma 20 jul. 2020 12:01 schreef bevogt <[email protected]mailto:[email protected]>:

Dear Edwin,

thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment). Are you familiar with this problem?

Best,

Benedikt

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA>

.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub< https://github.com/edwindj/cbsodataR/issues/26#issuecomment-660953649>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/AQK5UFYV4QMRFFHKXDWMCLLR4QOLDANCNFSM4PCDZOGA>.

--

================================================================================ Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten.

This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages.

================================================================================

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26#issuecomment-660965376, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEEOHDP3FIWST6VJJVVXZLR4QRVPANCNFSM4PCDZOGA .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/edwindj/cbsodataR/issues/26#issuecomment-660973313, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AQK5UF2RUVSSUKSO5DCLIQLR4QTWRANCNFSM4PCDZOGA.

--

Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten.

This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages.

bevogt avatar Jul 28 '20 09:07 bevogt

Could you post the url in the github issue? Still strange that this is not working :-)

Best,

Edwin

Op di 28 jul. 2020 om 11:50 schreef bevogt [email protected]:

I get an error message for one URL (parse error: premature EOF) - The package successfully opens three URLs before.

When I copy-paste it to the browser I can open the URL and the file.

The RStudio version installed is 3.6

From: Edwin de Jonge [email protected] Sent: maandag 20 juli 2020 13:35 To: edwindj/cbsodataR [email protected] Cc: Benedikt Vogt [email protected]; Author [email protected] Subject: Re: [edwindj/cbsodataR] cbsodataR in Remoteacces environment (#26)

Strange...

You can try the following from within the remote access environment:

  1. Open a browser
  2. You can check which url is executed, by adding verbose=TRUE to cbs_get_data(). Copy this url and paste in the address bar of your browser. Does that work?

Alternatively: what R version are you using? Tip: sessionInfo()

Op ma 20 jul. 2020 om 13:17 schreef bevogt <[email protected] mailto:[email protected]>:

Hi,

Yes I already asked for the access to the URL already in the environment and it was granted. But it still does not seem to work.

I can forward you the email discussion.

Best

Benedikt


Sent from my mobile device.

Op 20 jul. 2020 om 12:49 heeft Edwin de Jonge <[email protected] mailto:[email protected]> het volgende geschreven:



Thx! There is no internet connection in the remote access environment so the data cannot be retrieved via internet. I will check with the people of the remote environment if it is possible to have restricted access to the cbs opendata server. It helps if you do the same :-)

Best,

Edwin

Op ma 20 jul. 2020 12:01 schreef bevogt <[email protected] mailto:[email protected]>:

Dear Edwin,

thank you for developing this great package! I tried to run it in the microdata-remoteaccess environment of CBS but i could not get it running. The same code worked perfectly fine outside the environment, but it simply did not download the data (even though the URL is accessible in the environment). Are you familiar with this problem?

Best,

Benedikt

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26, or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AAEEOHEFIVFKC3OXFV6OJG3R4QIZFANCNFSM4PCDZOGA>

.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub< https://github.com/edwindj/cbsodataR/issues/26#issuecomment-660953649>, or unsubscribe<

https://github.com/notifications/unsubscribe-auth/AQK5UFYV4QMRFFHKXDWMCLLR4QOLDANCNFSM4PCDZOGA>.

--

================================================================================

Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten.

This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages.

================================================================================

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26#issuecomment-660965376,

or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAEEOHDP3FIWST6VJJVVXZLR4QRVPANCNFSM4PCDZOGA>

.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub< https://github.com/edwindj/cbsodataR/issues/26#issuecomment-660973313>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/AQK5UF2RUVSSUKSO5DCLIQLR4QTWRANCNFSM4PCDZOGA>.

--

================================================================================ Dit bericht kan informatie bevatten die niet voor u is bestemd. Indien u niet de geadresseerde bent of dit bericht abusievelijk aan u is toegezonden, wordt u verzocht dat aan de afzender te melden en het bericht te verwijderen. De Staat aanvaardt geen aansprakelijkheid voor schade, van welke aard ook, die verband houdt met risico's verbonden aan het elektronisch verzenden van berichten.

This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. The State accepts no liability for damage of any kind resulting from the risks inherent in the electronic transmission of messages.

================================================================================

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/edwindj/cbsodataR/issues/26#issuecomment-664942938, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEEOHER27H3ERS6O4ND3DTR52NOTANCNFSM4PCDZOGA .

edwindj avatar Jul 29 '20 07:07 edwindj

Sure. sorry. this is where the error occurs http://opendata.cbs.nl/ODataFeed/odata/37713/TypedDataSet?$format=json&$skip=40000

the links before with skip=10000,skip=20000,skip=30000 do not produce an error

bevogt avatar Jul 29 '20 08:07 bevogt