Spark Memory Settings

Document created by LG Champion on Sep 20, 2007Last modified by LG Champion on Sep 20, 2007
Version 2Show Document
  • View in full screen mode

To limit the memory usage one can add parameters to the JVM. These may lead to OutOfMemory errors if the values are too low. With these parameters one can only limit the Java heap and the Permsize but not the native heap of javaw.exe which manages the threads, the garbage collector etc. within the JVM.

See Spark JVM Settings for a general description how to add Java System Properties to Spark, one could add: