JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2020/04/07 03:53:42 - please wait

Help Connectors and Pipelines
1

I am trying to import a table from Oracle database to MemSQL using replication tool. The number of rows on this table are 39765284 and around 1GB in size. While running the replication, I am getting following error, can someone help me here if any where I need to increase the size of Java or Memory. Suggest please.

Error

                              Oracle   -->   MemSQL

Progress: 0.00%

Elapsed time: 00:00:09               ETA: Inf                     Rate: 0.00

Table name Rows Size Progress ETA Rate

BALANCE_FS 0 0 Inf 0.00

JVMDUMP039I Processing dump event “systhrow”, detail “java/lang/OutOfMemoryError” at 2020/04/07 03:53:42 - please wait.
JVMDUMP032I JVM requested System dump using ‘/u001/replicate/replicate-cli/core.20200407.035342.4955.0001.dmp’ in response to an event
JVMDUMP010I System dump written to /u001/replicate/replicate-cli/core.20200407.035342.4955.0001.dmp
JVMDUMP032I JVM requested Heap dump using ‘/u001/replicate/replicate-cli/heapdump.20200407.035342.4955.0002.phd’ in response to an event
JVMDUMP010I Heap dump written to /u001/replicate/replicate-cli/heapdump.20200407.035342.4955.0002.phd
JVMDUMP032I JVM requested Java dump using ‘/u001/replicate/replicate-cli/javacore.20200407.035342.4955.0003.txt’ in response to an event
JVMDUMP010I Java dump written to /u001/replicate/replicate-cli/javacore.20200407.035342.4955.0003.txt
JVMDUMP032I JVM requested Snap dump using ‘/u001/replicate/replicate-cli/Snap.20200407.035342.4955.0004.trc’ in response to an event
JVMDUMP010I Snap dump written to /u001/replicate/replicate-cli/Snap.20200407.035342.4955.0004.trc
JVMDUMP013I Processed dump event “systhrow”, detail “java/lang/OutOfMemoryError”.
JVMDUMP039I Processing dump event “systhrow”, detail “java/lang/OutOfMemoryError” at 2020/04/07 03:53:58 - please wait.
JVMDUMP032I JVM requested Heap dump using ‘/u001/replicate/replicate-cli/heapdump.20200407.035358.4955.0005.phd’ in response to an event
JVMDUMP010I Heap dump written to /u001/replicate/replicate-cli/heapdump.20200407.035358.4955.0005.phd
JVMDUMP032I JVM requested Java dump using ‘/u001/replicate/replicate-cli/javacore.20200407.035358.4955.0006.txt’ in response to an event
JVMDUMP010I Java dump written to /u001/replicate/replicate-cli/javacore.20200407.035358.4955.0006.txt
JVMDUMP032I JVM requested Snap dump using ‘/u001/replicate/replicate-cli/Snap.20200407.035358.4955.0007.trc’ in response to an event
JVMDUMP010I Snap dump written to /u001/replicate/replicate-cli/Snap.20200407.035358.4955.0007.trc
JVMDUMP013I Processed dump event “systhrow”, detail “java/lang/OutOfMemoryError”.

2

Hello @Suvendu. Looks like Replicate is running out of JVM memory. You can increase the memory by following below steps.

  1. open file replicate-cli/bin/replicate in any editor.

  2. You will find lines like below at the end of the file
    # Collect all arguments for the java command, following the shell quoting and substitution rules
    eval set – $DEFAULT_JVM_OPTS $JAVA_OPTS $REPLICANT_OPTS -classpath “”$CLASSPATH"" tech.replicant.Main “$APP_ARGS”

  3. Add “-Xms50g -Xmx50g” where 50 is the memory size in GB. Add this after eval set – . The modified lines will look like below
    # Collect all arguments for the java command, following the shell quoting and substitution rules
    eval set – “-Xms50g -Xmx50g” $DEFAULT_JVM_OPTS $JAVA_OPTS $REPLICANT_OPTS -classpath “”$CLASSPATH"" tech.replicant.Main “$APP_ARGS”

Note: You can specify the memory size to 80% to 90% for your available system memory.

This will run the replicate Java process with specified max memory. Should solve the issue.

3

Thanks Parth, it’s the correct solution. After I added the memory parameters, I was able to replicate the table successfully.

1 Like