[Audit][SPARK-40667] Refactor File Data Source Options

[HaoYang670]

Is your feature request related to a problem? Please describe. https://github.com/apache/spark/commit/8e853933ba64bb43e02af78198bc36d471efaa18 refactored the File Data Source Options. For example, it moves the BASE_PATH_PARAM from PartitioningAwareFileIndex to FileIndexOptions.

We should move some values to the shim layer of spark340

Describe the solution you'd like A clear and concise description of what you want to happen.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context, code examples, or references to existing implementations about the feature request here.