Support Questions
Find answers, ask questions, and share your expertise

parquet-jackson-1.4.1.jar could only be replicated to 0 nodes instead of minReplication (=1)

parquet-jackson-1.4.1.jar could only be replicated to 0 nodes instead of minReplication (=1)

Expert Contributor

Please suggest me the solution as hdfs dfsadmin -report shows me the datanodes are running.

Note: /tmp/sqoop-hadoop/compile/f6fc6f3475bb2e2696a0819336ef1153/v_r_system.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/11/14 18:04:41 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/f6fc6f3475bb2e2696a0819336ef1153/v_r_system.jar
16/11/14 18:04:41 INFO mapreduce.ImportJobBase: Beginning import of v_r_system
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/DBHADOOP/installations/hadoop-2.4.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/DBHADOOP/installations/hbase-0.98.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/11/14 18:04:41 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
16/11/14 18:04:42 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
16/11/14 18:04:42 INFO client.RMProxy: Connecting to ResourceManager at namenode1/10.40.17.183:6002
16/11/14 18:04:42 WARN hdfs.DFSClient: DataStreamer Exception
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /tmp/hadoop-yarn/staging/hadoop/.staging/job_1479117755724_0014/libjars/parquet-jackson-1.4.1.jar could only be replicated to 0 nodes instead of minReplication (=1).  There are 2 datanode(s) running and no node(s) are excluded in this operation.
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget(BlockManager.java:1430)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:2684)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:584)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:440)
1 REPLY 1

Re: parquet-jackson-1.4.1.jar could only be replicated to 0 nodes instead of minReplication (=1)

Guru

@Amit Dass

Are you already past this: https://wiki.apache.org/hadoop/CouldOnlyBeReplicatedTo ?

If yes, you can try the following

hdfs fsck /