Cloudera Community
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
zing
user rank
Explorer

Re: Cannot get a file on HDFS becouse of "java.lan...

by Explorer in Support Questions
‎08-27-2017 11:51 PM
‎08-27-2017 11:51 PM
Thank you.   Errors have disappered after executing commands. That's very useful.   ... View more

Re: Cannot get a file on HDFS becouse of "java.lan...

by Explorer in Support Questions
‎04-11-2017 01:12 AM
‎04-11-2017 01:12 AM
Hi. Thanks to reply.   I have 3 hadoop clusters that is same version. But this error happens to only one cluster. The version of flunetd which send data to hadoop  is different from other clusters.   First, I will upgrade flunetd. After uprade, I will tell you the result.   Thank you.     ... View more

Re: Cannot get a file on HDFS becouse of "java.lan...

by Explorer in Support Questions
‎04-05-2017 05:45 PM
‎04-05-2017 05:45 PM
Hello.   The error has happened. But no trace messages is in active namenode logs.   2017-04-06 08:08:01,571 WARN org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Inconsistent number of corrupt replicas for blk_1124785595_195687655 blockMap has 0 but corrupt replicas map has 1 2017-04-06 08:08:01,571 WARN org.apache.hadoop.hdfs.web.resources.ExceptionHandler: INTERNAL_SERVER_ERROR java.lang.ArrayIndexOutOfBoundsException 2017-04-06 08:08:01,716 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: updatePipeline(block=BP-396578656-10.1.24.1-1398308945648:blk_1124823444_195767215, newGenerationStamp=195767253, newLength=12040, newNodes=[10.1.24.24:50010, 10.1.24.55:50010, 10.1.24.25:50010], clientName=DFSClient_NONMAPREDUCE_1100616919_56) 2017-04-06 08:08:01,717 INFO BlockStateChange: BLOCK* Removing stale replica from location: [DISK]DS-bc2b3178-d3e5-49a4-9bc6-189804bf833e:NORMAL:10.1.24.24:50010 2017-04-06 08:08:01,717 INFO BlockStateChange: BLOCK* Removing stale replica from location: [DISK]DS-0fdfc364-08c8-4f90-b20e-151c332060b6:NORMAL:10.1.24.55:50010 2017-04-06 08:08:01,717 INFO BlockStateChange: BLOCK* Removing stale replica from location: [DISK]DS-17ad7233-40c6-4a68-a4a6-449c975c27ef:NORMAL:10.1.24.25:50010 The file is written through webhdfs by fluentd.   Version. CDH 5.10.0-1.cdh5.10.0.p0.41 fluentd 0.10.50 fluent-plugin-webhdfs 0.2.1 Thank you. ... View more

Re: Cannot get a file on HDFS becouse of "java.lan...

by Explorer in Support Questions
‎04-04-2017 06:14 PM
‎04-04-2017 06:14 PM
Thanks to your reply. Logs have already rotated, so I cannot find the exception message. As the error often happen, I will put the exception message later.   Thank you. ... View more

Cannot get a file on HDFS becouse of "java.lang.Ar...

by Explorer in Support Questions
‎04-04-2017 01:38 AM
‎04-04-2017 01:38 AM
Hello.   MapReduce job couldn't start because a file cannot be readable. When I tried to access the file, the following error happened.     org.apache.hadoop.ipc.RemoteException(java.lang.ArrayIndexOutOfBoundsException): java.lang.ArrayIndexOutOfBoundsException at org.apache.hadoop.ipc.Client.call(Client.java:1466) at org.apache.hadoop.ipc.Client.call(Client.java:1403) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230) at com.sun.proxy.$Proxy11.getListing(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:559) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:256) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104) at com.sun.proxy.$Proxy12.getListing(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:2080)   My action.   (1) sudo -u hdfs hdfs fsck / 　fsck is stopped just in front of the error file. the result is "Failed" /services/chikayo-dsp-bidder/click/hive/day=20170403/13.fluentd01.sv.infra.log 244412 bytes, 1 block(s): OK /services/chikayo-dsp-bidder/click/hive/day=20170403/13.fluentd02.sv.infra.log 282901 bytes, 1 block(s): OK /services/chikayo-dsp-bidder/click/hive/day=20170403/13.fluentd03.sv.infra.log 280334 bytes, 1 block(s): OK /services/chikayo-dsp-bidder/click/hive/day=20170403/14.fluentd01.sv.infra.log 258240 bytes, 1 block(s): OK FSCK ended at Mon Apr 03 18:16:08 JST 2017 in 3074 milliseconds null Fsck on path '/services/chikayo-dsp-bidder' FAILED (2) sudo -u hdfs hdfs dfsadmin -report Configured Capacity: 92383798755328 (84.02 TB) Present Capacity: 89209585066072 (81.14 TB) DFS Remaining: 19736633480052 (17.95 TB) DFS Used: 69472951586020 (63.19 TB) DFS Used%: 77.88% Under replicated blocks: 0 Blocks with corrupt replicas: 2 Missing blocks: 0 Missing blocks (with replication factor 1): 0 Now, the error file is restored automatically. "Blocks with corrupt repilicas" is 0.   Question.   (1)Can I restore same error file manually ? (2)What is the trigger by which restore is started ?   Thank you. ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎03-23-2020 12:26 AM
Community Statistics
Member Since ‎04-04-2017 12:52 AM
Last Visited ‎03-23-2020 12:26 AM
Posts 5