Member since
11-30-2017
3
Posts
0
Kudos Received
0
Solutions
10-30-2019
06:02 AM
Hello,
I am receiving the following warning at Yarn of the Hadoop cluster
WARN org.apache.hadoop.ipc.Server: Large response size 1791897 for call org.apache.hadoop.yarn.api.ApplicationClientProtocolPB.getApplications from Call#31976 Retry#0
The above message is appearing every minute and when I try to run a third-party tool which use Livy and Spark this message is appearing every 2-3 seconds.
I tried to set the following configuration at “HDFS Service Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml” property of hdfs without any result.
<property> <name>ipc.server.max.response.size</name> <value>5242880</value> </property>
Could you help me deal with the warning?
Thank you very much
... View more
Labels:
- Labels:
-
Apache YARN
05-08-2019
01:10 AM
Thank you very much for your response. Comparing CDH Hadoop to Isilon HDFS which of the two do you consider as the best main storage? There are certain conditions or use cases (eg performance, consistency, scalability, stability, storage space utilization, reliability, etc) at which you consider that the one is better than the other?
... View more
05-06-2019
08:19 AM
Hello,
I would like to ask you some questions about the usage of Isilon. First of all, which do you consider that are the best practices of the architecture of a cluster comparing Isilon HDFS with CDH HDFS at the moment? Do you think that Isilon has limitations comparing with CDH HDFS eg security(sentry,kerberos,ldap), performance, etc? Could I combine the two above solutions eg 1. extending an existed CDH HDFS cluster with Isilon 2. using of Isilon as a backup of an existed CDH HDFS cluster or I have to create a new cluster which uses only Isilon?
Finally, as I can see Isilon is not supported from CDH 6.2. Which will be the next version of CDH which will support it?
Thank you very much, Lefteris Souvleros
... View more
Labels:
- Labels:
-
Apache Sentry
-
HDFS
-
Kerberos