Reputation: 29
We are trying to use AWS Glue for our ETL process. While running AWS Glue job process is being killed due to Out of memory error.
LogType:stdout
Log Upload Time:Mon Jan 08 20:35:34 +0000 2018
LogLength:129
Log Contents:
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="kill -9 %p"
# Executing /bin/sh -c "kill -9 6635"...
End of LogType:stdout
And I am not sure if I can set Java heap size in AWS Glue.
Thanks, Harish
Upvotes: 1
Views: 1228
Reputation: 29
This was causing due to circular reference JSON document in source.
Upvotes: 1