SparkArrowFlight
SparkArrowFlight copied to clipboard
Published
20 hours ago •
BryanCutler
BryanCutler
Could not initialize class io.grpc.netty.NettyChannelBuilder
Hi @BryanCutler , I am getting an error Could not initialize class io.grpc.netty.NettyChannelBuilder when running ./bin/run_flight_example.sh. Any suggestion how to fix it? Thanks.
(spark-flight) [tahmad@tcn1449 SparkArrowFlight]$ ./bin/run_flight_example.sh
21/06/07 22:05:11 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
21/06/07 22:05:11 INFO SparkContext: Running Spark version 3.1.1
21/06/07 22:05:11 INFO ResourceUtils: ==============================================================
21/06/07 22:05:11 INFO ResourceUtils: No custom resources configured for spark.driver.
21/06/07 22:05:11 INFO ResourceUtils: ==============================================================
21/06/07 22:05:11 INFO SparkContext: Submitted application: spark-flight
21/06/07 22:05:12 INFO ResourceProfile: Default ResourceProfile created, executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: , memory -> name: memory, amount: 1024, script: , vendor: , offHeap -> name: offHeap, amount: 0, script: , vendor: ), task resources: Map(cpus -> name: cpus, amount: 1.0)
21/06/07 22:05:12 INFO ResourceProfile: Limiting resource is cpu
21/06/07 22:05:12 INFO ResourceProfileManager: Added ResourceProfile id: 0
21/06/07 22:05:12 INFO SecurityManager: Changing view acls to: tahmad
21/06/07 22:05:12 INFO SecurityManager: Changing modify acls to: tahmad
21/06/07 22:05:12 INFO SecurityManager: Changing view acls groups to:
21/06/07 22:05:12 INFO SecurityManager: Changing modify acls groups to:
21/06/07 22:05:12 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(tahmad); groups with view permissions: Set(); users with modify permissions: Set(tahmad); groups with modify permissions: Set()
21/06/07 22:05:12 INFO Utils: Successfully started service 'sparkDriver' on port 45662.
21/06/07 22:05:12 INFO SparkEnv: Registering MapOutputTracker
21/06/07 22:05:12 INFO SparkEnv: Registering BlockManagerMaster
21/06/07 22:05:12 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
21/06/07 22:05:12 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
21/06/07 22:05:12 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
21/06/07 22:05:12 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-1526e7cb-0852-4179-bf92-8cd056f7d2f4
21/06/07 22:05:12 INFO MemoryStore: MemoryStore started with capacity 396.3 MiB
21/06/07 22:05:12 INFO SparkEnv: Registering OutputCommitCoordinator
21/06/07 22:05:12 INFO Utils: Successfully started service 'SparkUI' on port 4040.
21/06/07 22:05:12 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://tcn1449:4040
21/06/07 22:05:12 INFO SparkContext: Added JAR file:///nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/target/SparkFlightConnector-1.0-SNAPSHOT.jar at spark://tcn1449:45662/jars/SparkFlightConnector-1.0-SNAPSHOT.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO SparkContext: Added JAR file:///home/tahmad/.m2/repository/org/apache/arrow/flight-core/2.0.0/flight-core-2.0.0-jar-with-dependencies.jar at spark://tcn1449:45662/jars/flight-core-2.0.0-jar-with-dependencies.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO SparkContext: Added JAR file:///home/tahmad/.m2/repository/io/grpc/grpc-netty/1.30.2/grpc-netty-1.30.2.jar at spark://tcn1449:45662/jars/grpc-netty-1.30.2.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO SparkContext: Added JAR file:///home/tahmad/.m2/repository/io/netty/netty-handler/4.1.48.Final/netty-handler-4.1.48.Final.jar at spark://tcn1449:45662/jars/netty-handler-4.1.48.Final.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO SparkContext: Added JAR file:///home/tahmad/.m2/repository/io/grpc/grpc-netty/1.38.0/grpc-netty-1.38.0.jar at spark://tcn1449:45662/jars/grpc-netty-1.38.0.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO SparkContext: Added file file:///nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/src/main/python/spark_flight_connector.py at file:///nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/src/main/python/spark_flight_connector.py with timestamp 1623096311953
21/06/07 22:05:12 INFO Utils: Copying /nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/src/main/python/spark_flight_connector.py to /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/spark_flight_connector.py
21/06/07 22:05:12 INFO Executor: Starting executor ID driver on host tcn1449
21/06/07 22:05:12 INFO Executor: Fetching file:///nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/src/main/python/spark_flight_connector.py with timestamp 1623096311953
21/06/07 22:05:12 INFO Utils: /nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/src/main/python/spark_flight_connector.py has been previously copied to /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/spark_flight_connector.py
21/06/07 22:05:12 INFO Executor: Fetching spark://tcn1449:45662/jars/SparkFlightConnector-1.0-SNAPSHOT.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO TransportClientFactory: Successfully created connection to tcn1449/10.200.207.38:45662 after 29 ms (0 ms spent in bootstraps)
21/06/07 22:05:12 INFO Utils: Fetching spark://tcn1449:45662/jars/SparkFlightConnector-1.0-SNAPSHOT.jar to /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/fetchFileTemp1201319405397786970.tmp
21/06/07 22:05:12 INFO Executor: Adding file:/tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/SparkFlightConnector-1.0-SNAPSHOT.jar to class loader
21/06/07 22:05:12 INFO Executor: Fetching spark://tcn1449:45662/jars/netty-handler-4.1.48.Final.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO Utils: Fetching spark://tcn1449:45662/jars/netty-handler-4.1.48.Final.jar to /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/fetchFileTemp7547805156352186187.tmp
21/06/07 22:05:12 INFO Executor: Adding file:/tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/netty-handler-4.1.48.Final.jar to class loader
21/06/07 22:05:12 INFO Executor: Fetching spark://tcn1449:45662/jars/grpc-netty-1.30.2.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO Utils: Fetching spark://tcn1449:45662/jars/grpc-netty-1.30.2.jar to /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/fetchFileTemp4589156977964529789.tmp
21/06/07 22:05:12 INFO Executor: Adding file:/tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/grpc-netty-1.30.2.jar to class loader
21/06/07 22:05:12 INFO Executor: Fetching spark://tcn1449:45662/jars/grpc-netty-1.38.0.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO Utils: Fetching spark://tcn1449:45662/jars/grpc-netty-1.38.0.jar to /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/fetchFileTemp6763615836128895621.tmp
21/06/07 22:05:12 INFO Executor: Adding file:/tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/grpc-netty-1.38.0.jar to class loader
21/06/07 22:05:12 INFO Executor: Fetching spark://tcn1449:45662/jars/flight-core-2.0.0-jar-with-dependencies.jar with timestamp 1623096311953
21/06/07 22:05:12 INFO Utils: Fetching spark://tcn1449:45662/jars/flight-core-2.0.0-jar-with-dependencies.jar to /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/fetchFileTemp8821868101464707767.tmp
21/06/07 22:05:12 INFO Executor: Adding file:/tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/userFiles-967416e1-f54c-4b16-a4a1-1cfa1c20acac/flight-core-2.0.0-jar-with-dependencies.jar to class loader
21/06/07 22:05:12 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43642.
21/06/07 22:05:12 INFO NettyBlockTransferService: Server created on tcn1449:43642
21/06/07 22:05:12 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
21/06/07 22:05:12 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, tcn1449, 43642, None)
21/06/07 22:05:12 INFO BlockManagerMasterEndpoint: Registering block manager tcn1449:43642 with 396.3 MiB RAM, BlockManagerId(driver, tcn1449, 43642, None)
21/06/07 22:05:12 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, tcn1449, 43642, None)
21/06/07 22:05:12 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, tcn1449, 43642, None)
21/06/07 22:05:13 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/spark-warehouse').
21/06/07 22:05:13 INFO SharedState: Warehouse path is 'file:/nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/spark-warehouse'.
21/06/07 22:05:16 INFO CodeGenerator: Code generated in 219.217418 ms
21/06/07 22:05:16 INFO SparkContext: Starting job: showString at NativeMethodAccessorImpl.java:0
21/06/07 22:05:16 INFO DAGScheduler: Got job 0 (showString at NativeMethodAccessorImpl.java:0) with 1 output partitions
21/06/07 22:05:16 INFO DAGScheduler: Final stage: ResultStage 0 (showString at NativeMethodAccessorImpl.java:0)
21/06/07 22:05:16 INFO DAGScheduler: Parents of final stage: List()
21/06/07 22:05:16 INFO DAGScheduler: Missing parents: List()
21/06/07 22:05:16 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[3] at showString at NativeMethodAccessorImpl.java:0), which has no missing parents
21/06/07 22:05:16 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 10.8 KiB, free 396.3 MiB)
21/06/07 22:05:16 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 4.9 KiB, free 396.3 MiB)
21/06/07 22:05:16 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on tcn1449:43642 (size: 4.9 KiB, free: 396.3 MiB)
21/06/07 22:05:16 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1383
21/06/07 22:05:16 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[3] at showString at NativeMethodAccessorImpl.java:0) (first 15 tasks are for partitions Vector(0))
21/06/07 22:05:16 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks resource profile 0
21/06/07 22:05:16 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0) (tcn1449, executor driver, partition 0, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
21/06/07 22:05:16 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 240 ms on tcn1449 (executor driver) (1/1)
21/06/07 22:05:16 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool
21/06/07 22:05:16 INFO DAGScheduler: ResultStage 0 (showString at NativeMethodAccessorImpl.java:0) finished in 0.393 s
21/06/07 22:05:16 INFO DAGScheduler: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job
21/06/07 22:05:16 INFO TaskSchedulerImpl: Killing all running tasks in stage 0: Stage finished
21/06/07 22:05:16 INFO DAGScheduler: Job 0 finished: showString at NativeMethodAccessorImpl.java:0, took 0.426651 s
21/06/07 22:05:16 INFO SparkContext: Starting job: showString at NativeMethodAccessorImpl.java:0
21/06/07 22:05:16 INFO DAGScheduler: Got job 1 (showString at NativeMethodAccessorImpl.java:0) with 4 output partitions
21/06/07 22:05:16 INFO DAGScheduler: Final stage: ResultStage 1 (showString at NativeMethodAccessorImpl.java:0)
21/06/07 22:05:16 INFO DAGScheduler: Parents of final stage: List()
21/06/07 22:05:16 INFO DAGScheduler: Missing parents: List()
21/06/07 22:05:16 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[3] at showString at NativeMethodAccessorImpl.java:0), which has no missing parents
21/06/07 22:05:16 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 10.8 KiB, free 396.3 MiB)
21/06/07 22:05:16 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 4.9 KiB, free 396.3 MiB)
21/06/07 22:05:16 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on tcn1449:43642 (size: 4.9 KiB, free: 396.3 MiB)
21/06/07 22:05:16 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1383
21/06/07 22:05:16 INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 1 (MapPartitionsRDD[3] at showString at NativeMethodAccessorImpl.java:0) (first 15 tasks are for partitions Vector(1, 2, 3, 4))
21/06/07 22:05:16 INFO TaskSchedulerImpl: Adding task set 1.0 with 4 tasks resource profile 0
21/06/07 22:05:16 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1) (tcn1449, executor driver, partition 1, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2) (tcn1449, executor driver, partition 2, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3) (tcn1449, executor driver, partition 3, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4) (tcn1449, executor driver, partition 4, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
21/06/07 22:05:16 INFO Executor: Running task 1.0 in stage 1.0 (TID 2)
21/06/07 22:05:16 INFO Executor: Running task 2.0 in stage 1.0 (TID 3)
21/06/07 22:05:16 INFO Executor: Running task 3.0 in stage 1.0 (TID 4)
21/06/07 22:05:16 INFO Executor: Finished task 1.0 in stage 1.0 (TID 2). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 11 ms on tcn1449 (executor driver) (1/4)
21/06/07 22:05:16 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 3.0 in stage 1.0 (TID 4). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 2.0 in stage 1.0 (TID 3). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 15 ms on tcn1449 (executor driver) (2/4)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 14 ms on tcn1449 (executor driver) (3/4)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 14 ms on tcn1449 (executor driver) (4/4)
21/06/07 22:05:16 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool
21/06/07 22:05:16 INFO DAGScheduler: ResultStage 1 (showString at NativeMethodAccessorImpl.java:0) finished in 0.022 s
21/06/07 22:05:16 INFO DAGScheduler: Job 1 is finished. Cancelling potential speculative or zombie tasks for this job
21/06/07 22:05:16 INFO TaskSchedulerImpl: Killing all running tasks in stage 1: Stage finished
21/06/07 22:05:16 INFO DAGScheduler: Job 1 finished: showString at NativeMethodAccessorImpl.java:0, took 0.024798 s
21/06/07 22:05:16 INFO SparkContext: Starting job: showString at NativeMethodAccessorImpl.java:0
21/06/07 22:05:16 INFO DAGScheduler: Got job 2 (showString at NativeMethodAccessorImpl.java:0) with 19 output partitions
21/06/07 22:05:16 INFO DAGScheduler: Final stage: ResultStage 2 (showString at NativeMethodAccessorImpl.java:0)
21/06/07 22:05:16 INFO DAGScheduler: Parents of final stage: List()
21/06/07 22:05:16 INFO DAGScheduler: Missing parents: List()
21/06/07 22:05:16 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[3] at showString at NativeMethodAccessorImpl.java:0), which has no missing parents
21/06/07 22:05:16 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 10.8 KiB, free 396.3 MiB)
21/06/07 22:05:16 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 4.9 KiB, free 396.3 MiB)
21/06/07 22:05:16 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on tcn1449:43642 (size: 4.9 KiB, free: 396.3 MiB)
21/06/07 22:05:16 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1383
21/06/07 22:05:16 INFO DAGScheduler: Submitting 19 missing tasks from ResultStage 2 (MapPartitionsRDD[3] at showString at NativeMethodAccessorImpl.java:0) (first 15 tasks are for partitions Vector(5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19))
21/06/07 22:05:16 INFO TaskSchedulerImpl: Adding task set 2.0 with 19 tasks resource profile 0
21/06/07 22:05:16 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 5) (tcn1449, executor driver, partition 5, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 1.0 in stage 2.0 (TID 6) (tcn1449, executor driver, partition 6, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 2.0 in stage 2.0 (TID 7) (tcn1449, executor driver, partition 7, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 3.0 in stage 2.0 (TID 8) (tcn1449, executor driver, partition 8, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 4.0 in stage 2.0 (TID 9) (tcn1449, executor driver, partition 9, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 5.0 in stage 2.0 (TID 10) (tcn1449, executor driver, partition 10, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 6.0 in stage 2.0 (TID 11) (tcn1449, executor driver, partition 11, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 7.0 in stage 2.0 (TID 12) (tcn1449, executor driver, partition 12, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 8.0 in stage 2.0 (TID 13) (tcn1449, executor driver, partition 13, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 9.0 in stage 2.0 (TID 14) (tcn1449, executor driver, partition 14, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 10.0 in stage 2.0 (TID 15) (tcn1449, executor driver, partition 15, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 11.0 in stage 2.0 (TID 16) (tcn1449, executor driver, partition 16, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 12.0 in stage 2.0 (TID 17) (tcn1449, executor driver, partition 17, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 13.0 in stage 2.0 (TID 18) (tcn1449, executor driver, partition 18, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 14.0 in stage 2.0 (TID 19) (tcn1449, executor driver, partition 19, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 15.0 in stage 2.0 (TID 20) (tcn1449, executor driver, partition 20, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 16.0 in stage 2.0 (TID 21) (tcn1449, executor driver, partition 21, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 17.0 in stage 2.0 (TID 22) (tcn1449, executor driver, partition 22, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 18.0 in stage 2.0 (TID 23) (tcn1449, executor driver, partition 23, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO Executor: Running task 0.0 in stage 2.0 (TID 5)
21/06/07 22:05:16 INFO Executor: Running task 1.0 in stage 2.0 (TID 6)
21/06/07 22:05:16 INFO Executor: Running task 3.0 in stage 2.0 (TID 8)
21/06/07 22:05:16 INFO Executor: Running task 2.0 in stage 2.0 (TID 7)
21/06/07 22:05:16 INFO Executor: Running task 4.0 in stage 2.0 (TID 9)
21/06/07 22:05:16 INFO Executor: Running task 5.0 in stage 2.0 (TID 10)
21/06/07 22:05:16 INFO Executor: Running task 6.0 in stage 2.0 (TID 11)
21/06/07 22:05:16 INFO Executor: Running task 7.0 in stage 2.0 (TID 12)
21/06/07 22:05:16 INFO Executor: Running task 8.0 in stage 2.0 (TID 13)
21/06/07 22:05:16 INFO Executor: Running task 9.0 in stage 2.0 (TID 14)
21/06/07 22:05:16 INFO Executor: Running task 10.0 in stage 2.0 (TID 15)
21/06/07 22:05:16 INFO Executor: Running task 11.0 in stage 2.0 (TID 16)
21/06/07 22:05:16 INFO Executor: Running task 16.0 in stage 2.0 (TID 21)
21/06/07 22:05:16 INFO Executor: Running task 18.0 in stage 2.0 (TID 23)
21/06/07 22:05:16 INFO Executor: Running task 15.0 in stage 2.0 (TID 20)
21/06/07 22:05:16 INFO Executor: Running task 17.0 in stage 2.0 (TID 22)
21/06/07 22:05:16 INFO Executor: Running task 14.0 in stage 2.0 (TID 19)
21/06/07 22:05:16 INFO Executor: Running task 12.0 in stage 2.0 (TID 17)
21/06/07 22:05:16 INFO Executor: Running task 13.0 in stage 2.0 (TID 18)
21/06/07 22:05:16 INFO Executor: Finished task 1.0 in stage 2.0 (TID 6). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 7.0 in stage 2.0 (TID 12). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 9.0 in stage 2.0 (TID 14). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO TaskSetManager: Finished task 7.0 in stage 2.0 (TID 12) in 13 ms on tcn1449 (executor driver) (1/19)
21/06/07 22:05:16 INFO Executor: Finished task 0.0 in stage 2.0 (TID 5). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO TaskSetManager: Finished task 9.0 in stage 2.0 (TID 14) in 14 ms on tcn1449 (executor driver) (2/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 5) in 16 ms on tcn1449 (executor driver) (3/19)
21/06/07 22:05:16 INFO Executor: Finished task 3.0 in stage 2.0 (TID 8). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO TaskSetManager: Finished task 1.0 in stage 2.0 (TID 6) in 20 ms on tcn1449 (executor driver) (4/19)
21/06/07 22:05:16 INFO Executor: Finished task 10.0 in stage 2.0 (TID 15). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 11.0 in stage 2.0 (TID 16). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 8.0 in stage 2.0 (TID 13). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 16.0 in stage 2.0 (TID 21). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 18.0 in stage 2.0 (TID 23). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 17.0 in stage 2.0 (TID 22). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 13.0 in stage 2.0 (TID 18). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 4.0 in stage 2.0 (TID 9). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 15.0 in stage 2.0 (TID 20). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 5.0 in stage 2.0 (TID 10). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 12.0 in stage 2.0 (TID 17). 1347 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 14.0 in stage 2.0 (TID 19). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO TaskSetManager: Finished task 3.0 in stage 2.0 (TID 8) in 20 ms on tcn1449 (executor driver) (5/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 10.0 in stage 2.0 (TID 15) in 20 ms on tcn1449 (executor driver) (6/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 8.0 in stage 2.0 (TID 13) in 20 ms on tcn1449 (executor driver) (7/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 11.0 in stage 2.0 (TID 16) in 19 ms on tcn1449 (executor driver) (8/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 16.0 in stage 2.0 (TID 21) in 18 ms on tcn1449 (executor driver) (9/19)
21/06/07 22:05:16 INFO Executor: Finished task 6.0 in stage 2.0 (TID 11). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO Executor: Finished task 2.0 in stage 2.0 (TID 7). 1448 bytes result sent to driver
21/06/07 22:05:16 INFO TaskSetManager: Finished task 18.0 in stage 2.0 (TID 23) in 18 ms on tcn1449 (executor driver) (10/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 17.0 in stage 2.0 (TID 22) in 19 ms on tcn1449 (executor driver) (11/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 4.0 in stage 2.0 (TID 9) in 22 ms on tcn1449 (executor driver) (12/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 13.0 in stage 2.0 (TID 18) in 19 ms on tcn1449 (executor driver) (13/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 15.0 in stage 2.0 (TID 20) in 20 ms on tcn1449 (executor driver) (14/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 12.0 in stage 2.0 (TID 17) in 21 ms on tcn1449 (executor driver) (15/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 14.0 in stage 2.0 (TID 19) in 20 ms on tcn1449 (executor driver) (16/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 5.0 in stage 2.0 (TID 10) in 23 ms on tcn1449 (executor driver) (17/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 6.0 in stage 2.0 (TID 11) in 24 ms on tcn1449 (executor driver) (18/19)
21/06/07 22:05:16 INFO TaskSetManager: Finished task 2.0 in stage 2.0 (TID 7) in 25 ms on tcn1449 (executor driver) (19/19)
21/06/07 22:05:16 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool
21/06/07 22:05:16 INFO DAGScheduler: ResultStage 2 (showString at NativeMethodAccessorImpl.java:0) finished in 0.032 s
21/06/07 22:05:16 INFO DAGScheduler: Job 2 is finished. Cancelling potential speculative or zombie tasks for this job
21/06/07 22:05:16 INFO TaskSchedulerImpl: Killing all running tasks in stage 2: Stage finished
21/06/07 22:05:16 INFO DAGScheduler: Job 2 finished: showString at NativeMethodAccessorImpl.java:0, took 0.034628 s
21/06/07 22:05:16 INFO CodeGenerator: Code generated in 12.130818 ms
+-----+-------------------+
|label| data|
+-----+-------------------+
| 0| 0.1061422675023499|
| 1| 0.3531905266166544|
| 0| 0.6220622377578661|
| 1|0.07753788344445356|
| 0| 0.5684901675222134|
| 1| 0.8390735354812204|
| 0|0.12210499088384252|
| 1| 0.7813106402366802|
| 0| 0.4804322317651769|
| 1| 0.6351213382436712|
+-----+-------------------+
21/06/07 22:05:16 INFO BlockManagerInfo: Removed broadcast_1_piece0 on tcn1449:43642 in memory (size: 4.9 KiB, free: 396.3 MiB)
21/06/07 22:05:16 INFO BlockManagerInfo: Removed broadcast_2_piece0 on tcn1449:43642 in memory (size: 4.9 KiB, free: 396.3 MiB)
21/06/07 22:05:16 INFO BlockManagerInfo: Removed broadcast_0_piece0 on tcn1449:43642 in memory (size: 4.9 KiB, free: 396.3 MiB)
21/06/07 22:05:16 INFO CodeGenerator: Code generated in 18.925053 ms
21/06/07 22:05:16 INFO SparkContext: Starting job: count at SparkFlightConnector.scala:15
21/06/07 22:05:16 INFO DAGScheduler: Got job 3 (count at SparkFlightConnector.scala:15) with 24 output partitions
21/06/07 22:05:16 INFO DAGScheduler: Final stage: ResultStage 3 (count at SparkFlightConnector.scala:15)
21/06/07 22:05:16 INFO DAGScheduler: Parents of final stage: List()
21/06/07 22:05:16 INFO DAGScheduler: Missing parents: List()
21/06/07 22:05:16 INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsArrowRDD[8] at mapPartitions at SparkFlightConnector.scala:15), which has no missing parents
21/06/07 22:05:16 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 14.7 KiB, free 396.3 MiB)
21/06/07 22:05:16 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 6.5 KiB, free 396.3 MiB)
21/06/07 22:05:16 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on tcn1449:43642 (size: 6.5 KiB, free: 396.3 MiB)
21/06/07 22:05:16 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1383
21/06/07 22:05:16 INFO DAGScheduler: Submitting 24 missing tasks from ResultStage 3 (MapPartitionsArrowRDD[8] at mapPartitions at SparkFlightConnector.scala:15) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
21/06/07 22:05:16 INFO TaskSchedulerImpl: Adding task set 3.0 with 24 tasks resource profile 0
21/06/07 22:05:16 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 24) (tcn1449, executor driver, partition 0, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 25) (tcn1449, executor driver, partition 1, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 26) (tcn1449, executor driver, partition 2, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 27) (tcn1449, executor driver, partition 3, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 4.0 in stage 3.0 (TID 28) (tcn1449, executor driver, partition 4, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 5.0 in stage 3.0 (TID 29) (tcn1449, executor driver, partition 5, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 6.0 in stage 3.0 (TID 30) (tcn1449, executor driver, partition 6, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 7.0 in stage 3.0 (TID 31) (tcn1449, executor driver, partition 7, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 8.0 in stage 3.0 (TID 32) (tcn1449, executor driver, partition 8, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 9.0 in stage 3.0 (TID 33) (tcn1449, executor driver, partition 9, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 10.0 in stage 3.0 (TID 34) (tcn1449, executor driver, partition 10, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 11.0 in stage 3.0 (TID 35) (tcn1449, executor driver, partition 11, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 12.0 in stage 3.0 (TID 36) (tcn1449, executor driver, partition 12, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 13.0 in stage 3.0 (TID 37) (tcn1449, executor driver, partition 13, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 14.0 in stage 3.0 (TID 38) (tcn1449, executor driver, partition 14, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 15.0 in stage 3.0 (TID 39) (tcn1449, executor driver, partition 15, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 16.0 in stage 3.0 (TID 40) (tcn1449, executor driver, partition 16, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 17.0 in stage 3.0 (TID 41) (tcn1449, executor driver, partition 17, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 18.0 in stage 3.0 (TID 42) (tcn1449, executor driver, partition 18, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 19.0 in stage 3.0 (TID 43) (tcn1449, executor driver, partition 19, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 20.0 in stage 3.0 (TID 44) (tcn1449, executor driver, partition 20, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 21.0 in stage 3.0 (TID 45) (tcn1449, executor driver, partition 21, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 22.0 in stage 3.0 (TID 46) (tcn1449, executor driver, partition 22, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO TaskSetManager: Starting task 23.0 in stage 3.0 (TID 47) (tcn1449, executor driver, partition 23, PROCESS_LOCAL, 4578 bytes) taskResourceAssignments Map()
21/06/07 22:05:16 INFO Executor: Running task 0.0 in stage 3.0 (TID 24)
21/06/07 22:05:16 INFO Executor: Running task 3.0 in stage 3.0 (TID 27)
21/06/07 22:05:16 INFO Executor: Running task 5.0 in stage 3.0 (TID 29)
21/06/07 22:05:16 INFO Executor: Running task 8.0 in stage 3.0 (TID 32)
21/06/07 22:05:16 INFO Executor: Running task 4.0 in stage 3.0 (TID 28)
21/06/07 22:05:16 INFO Executor: Running task 13.0 in stage 3.0 (TID 37)
21/06/07 22:05:16 INFO Executor: Running task 1.0 in stage 3.0 (TID 25)
21/06/07 22:05:16 INFO Executor: Running task 18.0 in stage 3.0 (TID 42)
21/06/07 22:05:16 INFO Executor: Running task 2.0 in stage 3.0 (TID 26)
21/06/07 22:05:16 INFO Executor: Running task 17.0 in stage 3.0 (TID 41)
21/06/07 22:05:16 INFO Executor: Running task 16.0 in stage 3.0 (TID 40)
21/06/07 22:05:16 INFO Executor: Running task 15.0 in stage 3.0 (TID 39)
21/06/07 22:05:16 INFO Executor: Running task 14.0 in stage 3.0 (TID 38)
21/06/07 22:05:16 INFO Executor: Running task 12.0 in stage 3.0 (TID 36)
21/06/07 22:05:16 INFO Executor: Running task 11.0 in stage 3.0 (TID 35)
21/06/07 22:05:16 INFO Executor: Running task 9.0 in stage 3.0 (TID 33)
21/06/07 22:05:16 INFO Executor: Running task 10.0 in stage 3.0 (TID 34)
21/06/07 22:05:16 INFO Executor: Running task 7.0 in stage 3.0 (TID 31)
21/06/07 22:05:16 INFO Executor: Running task 6.0 in stage 3.0 (TID 30)
21/06/07 22:05:16 INFO Executor: Running task 21.0 in stage 3.0 (TID 45)
21/06/07 22:05:16 INFO Executor: Running task 20.0 in stage 3.0 (TID 44)
21/06/07 22:05:16 INFO Executor: Running task 19.0 in stage 3.0 (TID 43)
21/06/07 22:05:16 INFO Executor: Running task 22.0 in stage 3.0 (TID 46)
21/06/07 22:05:16 INFO Executor: Running task 23.0 in stage 3.0 (TID 47)
21/06/07 22:05:16 INFO BaseAllocator: Debug mode disabled.
21/06/07 22:05:16 INFO DefaultAllocationManagerOption: allocation manager type not specified, using netty as the default type
21/06/07 22:05:16 INFO CheckAllocator: Using DefaultAllocationManager at memory-netty-2.0.0.jar!/org/apache/arrow/memory/DefaultAllocationManagerFactory.class
21/06/07 22:05:17 ERROR Executor: Exception in task 7.0 in stage 3.0 (TID 31)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 17.0 in stage 3.0 (TID 41)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 13.0 in stage 3.0 (TID 37)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 19.0 in stage 3.0 (TID 43)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 16.0 in stage 3.0 (TID 40)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 4.0 in stage 3.0 (TID 28)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 18.0 in stage 3.0 (TID 42)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 23.0 in stage 3.0 (TID 47)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 0.0 in stage 3.0 (TID 24)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 6.0 in stage 3.0 (TID 30)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 22.0 in stage 3.0 (TID 46)
java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;CLjava/lang/Object;)V
at io.grpc.Metadata$Key.validateName(Metadata.java:742)
at io.grpc.Metadata$Key.<init>(Metadata.java:750)
at io.grpc.Metadata$Key.<init>(Metadata.java:668)
at io.grpc.Metadata$AsciiKey.<init>(Metadata.java:959)
at io.grpc.Metadata$AsciiKey.<init>(Metadata.java:954)
at io.grpc.Metadata$Key.of(Metadata.java:705)
at io.grpc.Metadata$Key.of(Metadata.java:701)
at io.grpc.internal.GrpcUtil.<clinit>(GrpcUtil.java:80)
at io.grpc.internal.AbstractManagedChannelImplBuilder.<clinit>(AbstractManagedChannelImplBuilder.java:90)
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 12.0 in stage 3.0 (TID 36)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 15.0 in stage 3.0 (TID 39)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 20.0 in stage 3.0 (TID 44)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 1.0 in stage 3.0 (TID 25)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 11.0 in stage 3.0 (TID 35)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 8.0 in stage 3.0 (TID 32)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 14.0 in stage 3.0 (TID 38)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 3.0 in stage 3.0 (TID 27)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 9.0 in stage 3.0 (TID 33)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 2.0 in stage 3.0 (TID 26)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 10.0 in stage 3.0 (TID 34)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 21.0 in stage 3.0 (TID 45)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR Executor: Exception in task 5.0 in stage 3.0 (TID 29)
java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 WARN TaskSetManager: Lost task 21.0 in stage 3.0 (TID 45) (tcn1449 executor driver): java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 ERROR TaskSetManager: Task 21 in stage 3.0 failed 1 times; aborting job
21/06/07 22:05:17 INFO TaskSetManager: Lost task 9.0 in stage 3.0 (TID 33) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 1]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 17.0 in stage 3.0 (TID 41) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 2]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 23.0 in stage 3.0 (TID 47) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 3]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 5.0 in stage 3.0 (TID 29) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 4]
21/06/07 22:05:17 INFO TaskSchedulerImpl: Cancelling stage 3
21/06/07 22:05:17 INFO TaskSchedulerImpl: Killing all running tasks in stage 3: Stage cancelled
21/06/07 22:05:17 INFO TaskSchedulerImpl: Stage 3 was cancelled
21/06/07 22:05:17 INFO TaskSetManager: Lost task 18.0 in stage 3.0 (TID 42) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 5]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 14.0 in stage 3.0 (TID 38) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 6]
21/06/07 22:05:17 INFO DAGScheduler: ResultStage 3 (count at SparkFlightConnector.scala:15) failed in 0.256 s due to Job aborted due to stage failure: Task 21 in stage 3.0 failed 1 times, most recent failure: Lost task 21.0 in stage 3.0 (TID 45) (tcn1449 executor driver): java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Driver stacktrace:
21/06/07 22:05:17 INFO TaskSetManager: Lost task 19.0 in stage 3.0 (TID 43) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 7]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 8.0 in stage 3.0 (TID 32) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 8]
21/06/07 22:05:17 INFO DAGScheduler: Job 3 failed: count at SparkFlightConnector.scala:15, took 0.261533 s
21/06/07 22:05:17 INFO TaskSetManager: Lost task 20.0 in stage 3.0 (TID 44) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 9]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 15.0 in stage 3.0 (TID 39) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 10]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 1.0 in stage 3.0 (TID 25) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 11]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 3.0 in stage 3.0 (TID 27) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 12]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 16.0 in stage 3.0 (TID 40) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 13]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 7.0 in stage 3.0 (TID 31) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 14]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 13.0 in stage 3.0 (TID 37) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 15]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 12.0 in stage 3.0 (TID 36) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 16]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 0.0 in stage 3.0 (TID 24) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 17]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 6.0 in stage 3.0 (TID 30) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 18]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 2.0 in stage 3.0 (TID 26) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 19]
21/06/07 22:05:17 INFO TaskSetManager: Lost task 11.0 in stage 3.0 (TID 35) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 20]
21/06/07 22:05:17 WARN TaskSetManager: Lost task 22.0 in stage 3.0 (TID 46) (tcn1449 executor driver): java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;CLjava/lang/Object;)V
at io.grpc.Metadata$Key.validateName(Metadata.java:742)
at io.grpc.Metadata$Key.<init>(Metadata.java:750)
at io.grpc.Metadata$Key.<init>(Metadata.java:668)
at io.grpc.Metadata$AsciiKey.<init>(Metadata.java:959)
at io.grpc.Metadata$AsciiKey.<init>(Metadata.java:954)
at io.grpc.Metadata$Key.of(Metadata.java:705)
at io.grpc.Metadata$Key.of(Metadata.java:701)
at io.grpc.internal.GrpcUtil.<clinit>(GrpcUtil.java:80)
at io.grpc.internal.AbstractManagedChannelImplBuilder.<clinit>(AbstractManagedChannelImplBuilder.java:90)
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
21/06/07 22:05:17 INFO TaskSetManager: Lost task 4.0 in stage 3.0 (TID 28) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 21]
21/06/07 22:05:17 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool
21/06/07 22:05:17 INFO TaskSetManager: Lost task 10.0 in stage 3.0 (TID 34) on tcn1449, executor driver: java.lang.NoClassDefFoundError (Could not initialize class io.grpc.netty.NettyChannelBuilder) [duplicate 22]
21/06/07 22:05:17 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool
Traceback (most recent call last):
File "/nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/src/main/python/flight_example.py", line 82, in <module>
main()
File "/nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/src/main/python/flight_example.py", line 36, in main
SparkFlightConnector.put(df, host, port, flight_desc)
File "/nfs/home3/tahmad/tahmad/flight/SparkArrowFlight/src/main/python/spark_flight_connector.py", line 8, in put
jconn.put(dataframe._jdf, host, int(port), descriptor)
File "/home/tahmad/anaconda2/envs/spark-flight/lib/python3.8/site-packages/pyspark/python/lib/py4j-0.10.9-src.zip/py4j/java_gateway.py", line 1304, in __call__
File "/home/tahmad/anaconda2/envs/spark-flight/lib/python3.8/site-packages/pyspark/python/lib/pyspark.zip/pyspark/sql/utils.py", line 111, in deco
File "/home/tahmad/anaconda2/envs/spark-flight/lib/python3.8/site-packages/pyspark/python/lib/py4j-0.10.9-src.zip/py4j/protocol.py", line 326, in get_return_value
py4j.protocol.Py4JJavaError: An error occurred while calling o38.put.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 21 in stage 3.0 failed 1 times, most recent failure: Lost task 21.0 in stage 3.0 (TID 45) (tcn1449 executor driver): java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Driver stacktrace:
at org.apache.spark.scheduler.DAGScheduler.failJobAndIndependentStages(DAGScheduler.scala:2253)
at org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2(DAGScheduler.scala:2202)
at org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2$adapted(DAGScheduler.scala:2201)
at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:2201)
at org.apache.spark.scheduler.DAGScheduler.$anonfun$handleTaskSetFailed$1(DAGScheduler.scala:1078)
at org.apache.spark.scheduler.DAGScheduler.$anonfun$handleTaskSetFailed$1$adapted(DAGScheduler.scala:1078)
at scala.Option.foreach(Option.scala:407)
at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:1078)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2440)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2382)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2371)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49)
at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:868)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2202)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2223)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2242)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2267)
at org.apache.spark.rdd.RDD.count(RDD.scala:1253)
at com.ibm.codait.SparkFlightConnector.put(SparkFlightConnector.scala:15)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:282)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:238)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoClassDefFoundError: Could not initialize class io.grpc.netty.NettyChannelBuilder
at org.apache.arrow.flight.FlightClient$Builder.build(FlightClient.java:612)
at com.ibm.codait.SparkFlightConnector.$anonfun$put$1(SparkFlightConnector.scala:18)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.ArrowRDD.$anonfun$mapPartitions$2$adapted(ArrowRDD.scala:58)
at org.apache.spark.sql.execution.arrow.MapPartitionsArrowRDD.compute(ArrowRDD.scala:99)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
21/06/07 22:05:17 INFO SparkContext: Invoking stop() from shutdown hook
21/06/07 22:05:17 INFO SparkUI: Stopped Spark web UI at http://tcn1449:4040
21/06/07 22:05:17 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
21/06/07 22:05:17 INFO MemoryStore: MemoryStore cleared
21/06/07 22:05:17 INFO BlockManager: BlockManager stopped
21/06/07 22:05:17 INFO BlockManagerMaster: BlockManagerMaster stopped
21/06/07 22:05:17 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
21/06/07 22:05:17 INFO SparkContext: Successfully stopped SparkContext
21/06/07 22:05:17 INFO ShutdownHookManager: Shutdown hook called
21/06/07 22:05:17 INFO ShutdownHookManager: Deleting directory /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98/pyspark-4839d1c0-0554-45df-9a75-fafeedeab78c
21/06/07 22:05:17 INFO ShutdownHookManager: Deleting directory /tmp/localPyFiles-bec30ded-f03e-4724-9ec0-c0d85f9ab18d
21/06/07 22:05:17 INFO ShutdownHookManager: Deleting directory /tmp/spark-f994ff27-d546-4990-aa8e-170a795c94cd
21/06/07 22:05:17 INFO ShutdownHookManager: Deleting directory /tmp/spark-9b804900-6173-438b-b606-7c9ad4f7ad98
@tahashmi I think this requires guava-20.0.jar rather than spark's older version as well as protobuf-java-3.4.0.jar.
