CODEWITHSUNDEEP
hadoophdfsbigdata
G Krishna Sampath
G Krishna Sampath

Reputation: 97

DFSOutputStream ResponseProcessor exception in Hadoop

I have been facing this problem when I am trying to put a file in hdfs from local system. Below I have pasted the error

15/04/06 15:26:01 WARN hdfs.DFSClient: DFSOutputStream ResponseProcessor exception  for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11540
java.io.IOException: Bad response ERROR for block BP-828097856-192.168.2.80-1424273979398:blk_1073752341_11540 from datanode 192.168.2.82:50010
    at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:897)

Upvotes: 3

Views: 7544

Answers (2)

Nguyen
Nguyen

Reputation: 1

First, check your cluster healthy status with: hdfs dfsadmin -report, pay attention to the Capacity, DFS Used, DFS Remaining properties. Then, check the disk on datanode 192.168.2.82 to see whether the disk is full or having some bad sectors. From the exception it's pretty clear that you're experiencing error relating to datanode's disk.

Upvotes: 0

Dragonborn
Dragonborn

Reputation: 1815

Try doing hadoop fsck / -blocks -locations -files to clear up any lost blocks.

Upvotes: 1

Related Questions