GC Overhead Limit Error on ETL Running Pentaho 9.3

This section outlines how to resolve GC Overhead limit error.

When running ETL jobs or transformations involving large amounts of data via Spoon on a system running Pentaho 9.3, memory is gradually consumed until it hits the limit. It then displays an error message stating the GC overhead limit was exceeded, for example:

ERROR (version 9.3.0.0-428, build 9.3.0.0-428 from 2022-04-12 04.56.25 by buildguy) : UnexpectedError: ERROR (version 9.3.0.0-428, build 9.3.0.0-428 from 2022-04-12 04.56.25 by buildguy) : java.lang.OutOfMemoryError: GC overhead limit exceeded at org.pentaho.di.trans.steps.dimensionlookup.DimensionLookup.lookupValues (DimensionLookup.java:338) at org.pentaho.di.trans.steps.dimensionlookup.DimensionLookup.processRow (DimensionLookup.java:232) at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62) at java.lang.Thread.run(Unknown Source)

As a workaround, you must disable the Gather Performance Metrics option.

Note: This issue does not affect jobs or transformations executed via Kitchen.

To resolve this issue:

1. On the repository, start Spoon.
2. Log in as admin/admin.
3. Open the Full Load or Create job.
4. In the Run Options dialog box, ensure Gather Performance Metrics is deselected.
5. Run the job (F9).