Inquiry about python library in Databricks's spark cluster

Hello.

I’m trying to use a spark cluster in databricks connected to a knime pyspark source node.

So I connected this cluster using the Create Databricks Environment node and it works fine.

I also installed the “mlflow” library on this cluster in databricks, and when I ran the python code with the mlflow library, it ran fine.

But when I ran the same python code on the pyspark source node in knime, it failed.

So I’m wondering how I can control the python library in this case.

I’d appreciate if someone can help me :slight_smile: