[Create Spark Context(livy)] Execute failed: scala/Serializable (java.lang.NoClassDefFoundError) ...

Hi,

I tried to create spark context with livy and a spark on yarn cluster.

HDFS connection works, and livy connection is finished, but “Create Spark Context” node gives this error.

I installed scala on livy server.

Spark version is 3.4.1 and scala version is 2.13.14

Here’s images that provide you information.

Should I reinstall the Scala packages? or the Spark packages?

or Do I need modify Configuration file?

I tried to figure out to fix this error, but it’s hard

Please guide me.