[Create Spark Context(livy)] Execute failed: scala/Serializable (java.lang.NoClassDefFoundError) ...
Hi,
I tried to create spark context with livy and a spark on yarn cluster.
HDFS connection works, and livy connection is finished, but “Create Spark Context” node gives this error.
I installed scala on livy server.
Spark version is 3.4.1 and scala version is 2.13.14
Here’s images that provide you information.
Should I reinstall the Scala packages? or the Spark packages?
or Do I need modify Configuration file?
I tried to figure out to fix this error, but it’s hard
Please guide me.