Memory Issue Knime Version 5.3
Hi everyone,
I’ve been experiencing memory problems with KNIME 5.3 since updating. I’m running KNIME on a laptop with 8GB RAM and a 2GB graphics card.
I’m frequently getting “Out of Memory” errors, especially when working with workflows that involve Python nodes. I’ve attached my
knime.logfile for reference.
I’ve already tried modifying the
knime.inifile (see below), but the issue persists. I’ve noticed that KNIME seems to be launching multiple Python processes, which might be contributing to the problem.
Here’s my current
knime.iniconfiguration:
-vm
plugins/org.knime.binary.jre.win32.x866417.0.5.20221116/jre/bin/server/jvm.dll
-startup
plugins/org.eclipse.equinox.launcher_1.6.700.v20240213-1244.jar
–launcher.library
plugins/org.eclipse.equinox.launcher.win32.win32.x86641.2.900.v20240213-1244
–launcher.defaultAction
openFile
-vmargs
-Djava.security.properties=plugins/org.knime.binary.jre.win32.x866417.0.5.20221116/security.properties
-Djdk.httpclient.allowRestrictedHeaders=content-length
-Djdk.httpclient.allowRestrictedHeaders=content-length
-Dorg.apache.cxf.bus.factory=org.knime.cxf.core.fragment.KNIMECXFBusFactory
-Dorg.apache.cxf.bus.factory=org.knime.cxf.core.fragment.KNIMECXFBusFactory
-Djdk.httpclient.allowRestrictedHeaders=content-length
-Dorg.apache.cxf.bus.factory=org.knime.cxf.core.fragment.KNIMECXFBusFactory
-Dorg.apache.cxf.transport.http.forceURLConnection=true
-Djdk.httpclient.allowRestrictedHeaders=content-length
-Darrow.enableunsafememory_access=true
-Darrow.memory.debug.allocator=false
-Darrow.enablenullcheckforget=false
-Dorg.apache.cxf.bus.factory=org.knime.cxf.core.fragment.KNIMECXFBusFactory
-Dorg.apache.cxf.transport.http.forceURLConnection=true
–add-opens=java.security.jgss/sun.security.jgss.krb5=ALL-UNNAMED
–add-exports=java.security.jgss/sun.security.jgss=ALL-UNNAMED
–add-exports=java.security.jgss/sun.security.jgss.spi=ALL-UNNAMED
–add-exports=java.security.jgss/sun.security.krb5.internal=ALL-UNNAMED
–add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED
-Dorg.apache.cxf.bus.factory=org.knime.cxf.core.fragment.KNIMECXFBusFactory
-Dorg.apache.cxf.transport.http.forceURLConnection=true
–add-opens=java.xml/com.sun.org.apache.xerces.internal.parsers=ALL-UNNAMED
–add-opens=java.xml/com.sun.org.apache.xerces.internal.util=ALL-UNNAMED
-server
-Dsun.java2d.d3d=false
-Dosgi.classloader.lock=classname
-XX:+UnlockDiagnosticVMOptions
-Dsun.net.client.defaultReadTimeout=0
-Dknime.xml.disableexternalentities=true
-Dknime.table.cache=SMALL
-Dcomm.disabledynamicservice=true
-Dp2.trustedAuthorities=https://update.knime.com
-Declipse.e4.inject.javax.warning=false
-Dorg.eclipse.ecf.provider.filetransfer.excludeContributors=org.eclipse.ecf.provider.filetransfer.httpclientjava
–add-opens=java.base/java.lang=ALL-UNNAMED
–add-opens=java.base/java.lang.invoke=ALL-UNNAMED
–add-opens=java.base/java.net=ALL-UNNAMED
–add-opens=java.base/java.nio=ALL-UNNAMED
–add-opens=java.base/java.nio.channels=ALL-UNNAMED
–add-opens=java.base/java.util=ALL-UNNAMED
–add-opens=java.base/sun.nio.ch=ALL-UNNAMED
–add-opens=java.base/sun.nio=ALL-UNNAMED
–add-opens=java.desktop/javax.swing.plaf.basic=ALL-UNNAMED
–add-opens=java.base/sun.net.www.protocol.http=ALL-UNNAMED
–add-opens=java.base/sun.net.www.protocol.https=ALL-UNNAMED
–add-opens=java.base/java.util.regex=ALL-UNNAMED
-Xms1024m
-Xmx4096m
-Dorg.eclipse.swt.browser.IEVersion=11001
-Dsun.awt.noerasebackground=true
-Dequinox.statechange.timeout=30000
-Dorg.knime.container.cellsinmemory=4000
Any suggestions on how to resolve this would be greatly appreciated.
Thanks!