@Sai Dileep Good to know that your original issue is resolved. For the logging related issue please check what is the output of the following command and if your changes are getting reflected there? Specially the "zookeeper.log.file" and the "zookeeper.root.logger" if it is pointing correctly # ps -ef | grep zookeeper 516 969 0 0 Apr03 ? 00:01:52 /usr/lib/jvm/java/bin/java -Dzookeeper.log.dir=/var/log/zookeeper -Dzookeeper.log.file=zookeeper-zookeeper-server-sandbox.hortonworks.com.log -Dzookeeper.root.logger=INFO,ROLLINGFILE ........................ . Although it is good practice to have the hostname appended to the zookeeper log file name that way it makes it easier for us to differentiate between logs from different hosts. # grep 'ZOO_LOG_FILE' /usr/hdp/current/zookeeper-server/bin/zkServer.sh ZOO_LOG_FILE=zookeeper-$USER-server-$HOSTNAME.log . ... View more

@Sai Dileep Please try the following: 1). Make sure that your "Advanced zookeeper-log4j" from Ambari UI has the following lines to make sure that we are running the zookeeper in DEBUG mode and the log file location is including the correct "${zookeeper.log.dir}" log4j.rootLogger=DEBUG, CONSOLE, ROLLINGFILE . . log4j.appender.ROLLINGFILE.File=${zookeeper.log.dir}/zookeeper.log 2). Restart the zookeeper and then check the log. Please share the log. /var/log/zookeeper/zookeeper.log 3). Also please check the OS resources are enough or not? # free -m # top 4). Try deleting the PID file of zookeerper and then restart again. /var/run/zookeeper/zookeeper_server.pid . ... View more

@heta desai Copying snippet from: http://stackoverflow.com/questions/16546040/store-images-videos-into-hadoop-hdfs It is absolutely possible without doing anything extra. Hadoop provides us the facility to read/write binary files. So, practically anything which can be converted into bytes can be stored into HDFS(images, videos etc). To do that Hadoop provides something called asSequenceFiles. SequenceFile is a flat file consisting of binary key/value pairs. The SequenceFile provides a Writer, Reader and Sorter classes for writing, reading and sorting respectively. So, you could convert your image/video file into a SeuenceFile and store it into the HDFS. . Some Examples: http://www.tothenew.com/blog/how-to-manage-and-analyze-video-data-using-hadoop/ https://content.pivotal.io/blog/using-hadoop-mapreduce-for-distributed-video-transcoding . ... View more

@darkz yu Please check the "templeton.hive.properties" values from your "Advanced webhcat-site" in ambari UI. Then verify if you are able to connect to the host/port defined there using telnet? Example: templeton.hive.properties = hive.metastore.local=false,hive.metastore.uris=thrift://erie1.example.com:9083,hive.metastore.sasl.enabled=false,hive.metastore.execute.setugi=true,hive.metastore.warehouse.dir=/apps/hive/warehouse So try checking the port is actually opened and reachable from remote host? Example: telnet erie1.example.com 9083 . If you are not able to access the mentioned host /port from remote client then please check your firewall (iptables) rules and make the port accessible from remote host. ... View more

@rakesh kumar Security settings dictate whether DistCp should be run on the source cluster or the destination cluster. The general rule-of-thumb is that if one cluster is secure and the other is not secure, DistCp should be run from the secure cluster (Where as you are trying to distcp from insecure to secure hadoop cluster) otherwise there may be security- related issues. When copying data from a secure cluster to an non-secure cluster, the following configuration setting is required for the DistCp client: <property> <name>ipc.client.fallback-to-simple-auth-allowed</name> <value>true</value> </property> When copying data from a secure cluster to a secure cluster, the following configuration setting is required in the core-site.xml file: <property> <name>hadoop.security.auth_to_local</name> <value></value> <description>Maps kerberos principals to local user names</description> </property> . See Hortonworks recommendation suggests "one cluster is secure and the other is not secure, DistCp should be run from the secure cluster" ... View more

In the mean time , HDP2.6 is released, you might want check the release notes. http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_release-notes/content/ch_relnotes.html ... View more