csv2parquet icon indicating copy to clipboard operation
csv2parquet copied to clipboard

shutil.which problem?!

Open argenisleon opened this issue 8 years ago • 6 comments

Hi,

I am getting this error:

File "csv2parquet.py", line 330, in drill = DrillInstallation() File "csv2parquet.py", line 203, in init assert reference_executable is not None AssertionError

any help?

argenisleon avatar Aug 17 '16 02:08 argenisleon

you need to read the README and add the apache drill bin folder to the PATH environment variable.

gsemet avatar Sep 20 '16 16:09 gsemet

That cannot be the only reason I am getting the same error and I have verified back and forth that the drill bin folder is in the PATH I'm using Linux Mint 18

gnummeli avatar Nov 02 '17 14:11 gnummeli

Correction to my previous statement - the AssertionError is due to missing PATH indeed which I didn't notice is due to using sudo and that doesn't inherit the PATH variable from user. But what I get instead is an os level error: Traceback (most recent call last): File "./csv2parquet", line 333, in drill_script.run() File "./csv2parquet", line 265, in run os.rename(self.drill.location.full_path('parquet_tmp_output'), self.parquet_output) OSError: [Errno 18] Invalid cross-device link: '/tmp/ihc4wg3x/parquet_tmp_output' -> 'aret.parquet'

which as far as I can ascertain has something to do with the privilege setting of the /tmp directory Any suggestions?

gnummeli avatar Nov 02 '17 16:11 gnummeli

Resolved I replaced os.rename by shutil.move as recommended in another forum on stackoverflow and that solved the problem. I.e. would recommend to do that change in the base program as well

gnummeli avatar Nov 02 '17 16:11 gnummeli

setting the environment variable for apache-drill solve the above problem export PATH=$PATH:/home/Ubuntu/apache-drill-1.13.0/bin

But now it is showing FATAL: Drill script failed with error code 1. To troubleshoot, run with --debug and inspect files script, script_stderr and script_stdout.

How to solve this?

Thanks:)

sanjeet12 avatar Dec 29 '18 07:12 sanjeet12

setting the environment variable for apache-drill solve the above problem export PATH=$PATH:/home/Ubuntu/apache-drill-1.13.0/bin

But now it is showing FATAL: Drill script failed with error code 1. To troubleshoot, run with --debug and inspect files script, script_stderr and script_stdout.

How to solve this?

Thanks:)

how did you solve it?

pmiola73 avatar Sep 22 '21 13:09 pmiola73