Hi, Check for the total no of applications in the Application history path, if the total no of files is more try to increase the heap size and look whether it works. Alternatively look for the spark history server logs too for any errors. Thanks AKR
... View more
I am getting below error when trying to access file browser via Hue; Cannot access: /user/user02/. StandbyException: Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error (error 403) Please advise.
... View more
Hi, This Error will happen when "Spark executor-memory is too small for spark to start" . Please refer to the upstream jira for more details. https://issues.apache.org/jira/browse/SPARK-12759 Thanks AKR
... View more
I'm using cloudera manager, once i added the node i need to provide the url for the cloudera manager packages, once this step finish, an automatic step kicked to distribute the parcels.
... View more
vmem checks have been disabled in CDH almost since their introduction. The vmem check is not stable and highly dependent on Linux version and distro. If you run CDH you are already running with it disabled. Wilfred
... View more
We solved the issue. Looks like it is a ulimit related problem. We raised user limits under /etc/security/limits.d/ And then we created a file under /etc/systemd/system/cloudera-scm-agent.service.d/override.conf To override service-level limits And we raised the value echo "65536" > /sys/fs/cgroup/pids/system.slice/cloudera-scm-agent.service/pids.max (instead of rebooting).
... View more
To add, For sizing a datanode heap it's similar to namenode heap, its recommend 1GB per 1M blocks. As a block could be as small a 1byte or as large as 128MB, the requirement of heap space is the same.
... View more
