lakeFS icon indicating copy to clipboard operation
lakeFS copied to clipboard

Wrap Spark client API calls to detect version mismatches

Open arielshaqed opened this issue 3 years ago • 4 comments

Typical bad installations of the Spark clients (both lakeFSFS and metadata) have mismatched versions that cause methods and classes not to be found. Wrap all calls with some layer that analyzes relevant exceptions, reports the version(s) with which this client is known to work, suggests using other versions.

arielshaqed avatar Mar 15 '22 10:03 arielshaqed

Related to #2801, which could/might help here too.

arielshaqed avatar Mar 15 '23 06:03 arielshaqed

This issue is now marked as stale after 90 days of inactivity, and will be closed soon. To keep it, mark it with the "no stale" label.

github-actions[bot] avatar Nov 01 '23 14:11 github-actions[bot]

Closing this issue because it has been stale for 7 days with no activity.

github-actions[bot] avatar Nov 11 '23 01:11 github-actions[bot]

Still needed, this is recurs.

arielshaqed avatar Nov 19 '23 08:11 arielshaqed