Reputation: 401
can any one explain what is VERTEX_FAILURE error in Hive while using Tez execution engine ? Also what is the root cause of it?
Upvotes: 0
Views: 9581
Reputation: 3696
This error is because Tez containers are not allocating enough memory to run the query.
Solution: you have to increase memory for resources with adjusting following parameters.
tez.am.resource.memory.mb=4096
tez.am.java.opts=-server -Xmx3276m -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+UseParallelGC
hive.tez.container.size=4096
hive.tez.java.opts=-server -Xmx3276m -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+UseParallelGC
Upvotes: 3