Support Questions
Find answers, ask questions, and share your expertise

The directory item limit of /tmp/logs/<<Appln >>/logs is exceeded: limit=1048576 items=1048576

Explorer

We are using CDH 5.4.5 with parcels. In the hdfs logs we see the following

 

The directory item limit of /tmp/logs/<<appln>/logs is exceeded: limit=1048576 items=1048576

 

Error as follows

 

2016-01-25 05:34:31,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 76 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.mkdirs from 10.80.34.22:42733 Call#3937671 Retry#0: org.apache.hadoop.hdfs.protocol.FSLimitException$MaxDirectoryItemsExceededException: The directory item limit of /tmp/logs/<<appln>>/logs is exceeded: limit=1048576 items=1048576

2016-01-25 05:34:45,873 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:<<appln>>@PROD.HADOOP.COM (auth:TOKEN) cause:org.apache.hadoop.hdfs.protocol.FSLimitException$MaxDirectoryItemsExceededException: The directory item limit of /tmp/logs/<<appln>>/logs is exceeded: limit=1048576 items=1048576

2016-01-25 05:34:45,873 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.mkdirs from 10.80.34.8:48244 Call#3987372 Retry#0: org.apache.hadoop.hdfs.protocol.FSLimitException$MaxDirectoryItemsExceededException: The directory item limit of /tmp/logs/<<appln>>/logs is exceeded: limit=1048576 items=1048576

2016-01-25 05:34:46,231 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:<<appln>>@PROD.HADOOP.COM (auth:TOKEN) cause:org.apache.hadoop.hdfs.protocol.FSLimitException$MaxDirectoryItemsExceededException: The directory item limit of /tmp/logs/<<appln>>/logs is exceeded: limit=1048576 items=1048576

2016-01-25 05:34:46,231 INFO org.apache.hadoop.ipc.Server: IPC Server handler 119 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.mkdirs from 10.80.34.23:51099 Call#4006916 Retry#0: org.apache.hadoop.hdfs.protocol.FSLimitException$MaxDirectoryItemsExceededException: The directory item limit of /tmp/logs/<<appln>>/logs is exceeded: limit=1048576 items=1048576



[root@PROD server tmp]# hadoop fs -copyFromLocal test /tmp/logs/<<appln>>/logs
copyFromLocal: The directory item limit of /tmp/logs/<<appln>>/logs is exceeded: limit=1048576 items=1048576
[root@PROD server tmp]#

 

can you let me know the reason?