During sync export getting http error 400 Client Error: Bad Request for url: https://adb-*.11.azuredatabricks.net/api/2.0/workspace/get-status?path=%5CShared

[jcbohlin]

If I use Postman, I receive the same error calling the Databricks API. If I change get-status?path=%5CShared to get-status?path=/Shared or get-status?path=%2fShared api call is successful. Notebook path in the yaml file is /Shared. Any ideas as to why it is converting / to %5C for the call to the api?

Full error text below

2022-05-18 14:03:36 [ERROR] Found exception when running generate. Traceback (most recent call last): File "C:\Python\Python39\databricks-sync\lib\site-packages\databricks_cli\sdk\api_client.py", line 121, in perform_query resp.raise_for_status() File "C:\Python\Python39\databricks-sync\lib\site-packages\requests\models.py", line 960, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://adb-*.11.azuredatabricks.net/api/2.0/workspace/get-status?path=%5CShared

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Python\Python39\databricks-sync\lib\site-packages\databricks_sync\sdk\pipeline.py", line 92, in generate async for item in self._generate(): File "C:\Python\Python39\databricks-sync\lib\site-packages\databricks_sync\sdk\generators\notebook.py", line 267, in _generate folder_perms = self.__handle_folder_permissions(folder_path, notebook) File "C:\Python\Python39\databricks-sync\lib\site-packages\databricks_sync\sdk\generators\notebook.py", line 239, in __handle_folder_permissions folder_obj = self.__service.get_status(folder_path) File "C:\Python\Python39\databricks-sync\lib\site-packages\databricks_cli\sdk\service.py", line 570, in get_status return self.client.perform_query('GET', '/workspace/get-status', data=_data, headers=headers) File "C:\Python\Python39\databricks-sync\lib\site-packages\databricks_cli\sdk\api_client.py", line 129, in perform_query raise requests.exceptions.HTTPError(message, response=e.response) requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://adb-*.11.azuredatabricks.net/api/2.0/workspace/get-status?path=%5CShared Response from server: { 'error_code': 'INVALID_PARAMETER_VALUE', 'message': "Path (\Shared) doesn't start with '/'"}

[stikkireddy]

hey @jcbohlin i think i discovered the issue. Its the use of Pathlib Path object rather than PosixPath for exporting notebooks and dbfs files. The Path object uses the underlying file path syntax (which in a windows machine its \ instead of /). I will test this on a windows machine after making the patch. In the interim if you can try to run this on a Databricks notebook or a *nix type environment. i.e azure cloud shell, etc.