Working on newly configured cluster. Can browse HDFS but any write attempt produces an error:
|
1 2 |
WARN [Thread-6] hdfs.DFSClient (DFSOutputStream.java:run(557)) - DataStreamer Exception org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /tmp/hive/index.html._COPYING_ could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and no node(s) are excluded in this operation. |
Also I can create and view tables in Hive, but any insert attempt fails with the same error. Formatting name node, restarting services did not help. In my case solution was to edit hdfs-site.xml and leave the only one slash after file: prefix in parameters:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
<configuration> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>dfs.namenode.name.dir</name> <value>file:/home/hadoopdata/hdfs/namenode</value> </property> <property> <name>dfs.datanode.data.dir</name> <value>file:/home/hadoop/data/hdfs/datanode</value> </property> </configuration> |
