Thanks very much for the answer in detail! I think I followed most of the steps except step a. I just reviewed configuration in my ambari server. I confirmed that Admin->Kerberos was disable. But I found some relevant configs in core-site.xml like below. hadoop.security.authentication: simple hadoop.security.authorization: false hadoop.security.auth_to_local: DEFAULT It seemed that I couldn't delete these configs. So is this cluster in secure mode? If yes, how can I disable security thoroughly? Thanks!
... View more
Hi, I am running hdp2.5 on ubuntu14.04 with hadoop2.7.3. I am trying to use Docker Executor Container in yarn. I have overrided yarn.nodemanager.container-executor.class with org.apache.hadoop.yarn.server.nodemanager.DockerContainerExecutor. It seemed that I could restart yarn successfully. But when i was trying to launch a MR job, I got an error "Container image must not be null". Actually I have set images for containers like this: -Dmapreduce.map.env="yarn.nodemanager.docker-container-executor.image-name=sequenceiq/hadoop-docker:2.4.1" \
-Dyarn.app.mapreduce.am.env="yarn.nodemanager.docker-container-executor.image-name=sequenceiq/hadoop-docker:2.4.1" \ I knew that hdp2.4.x doesn't support Docker Executor Container from an relevant question. In short, I have two questions: 1. does hdp2.5.x support Docker Executor Container? 2. if it does, how can I fix the above problem? Thanks in advance!
... View more