@bess rim Mon cher c'est un problème de droits! What are the permissions on the file are you installing as root or another user ? Mieux installer comme root ! ... View more

@Anil Reddy Kafka server expects that it receives at least one heartbeat within the session time out. So the consumer tries to do a heartbeat at most (session time out/heartbeat times). Some heartbeats might be missed. So your heartbeat time should not be more than 1/3 of the session time out. ( refer to the docs) ... View more

@Mazin Mohammed Next time remember to upload the - OS type and version - Ambari and HDP version - Cluster size On the KDC server under [REALMS] /etc/krb5kdc/kdc.conf set the max_life = 14h 0m 0s (2 weeks) Having said that did you copy the /etc/krb5.conf to all the node? Then on the clients check that the krb5.conf ,you should have renew_lifetime = 7d in the krb5.conf this will ,mean you kerberos ticket is valid 7 days and normally it should auto renew Hope that helps ... View more

@Hardik Dave All clients software should be able to lauch a job on the cluster to be process and view through the RM UI ! For the Hive table its usually in HDFS usually in /user/hive/warehouse/xxx someting like this hdfs dfs -ls /apps/hive/warehouse/prodtest.db Found 4 items drwxrwxrwx - hive hdfs 02016-10-2900:54/apps/hive/warehouse/prodtest.db/t1 drwxrwxrwx - hive hdfs 02016-10-2900:54/apps/hive/warehouse/prodtest.db/t2 drwxrwxrwx - hive hdfs 02016-10-2900:54/apps/hive/warehouse/prodtest.db/t3 drwxrwxrwx - hive hdfs 02016-10-2900:54/apps/hive/warehouse/prodtest.db/t4 You should be able to creat a table on the fly after your processing create database if not exists prodtest; use prodtest; --no LOCATION create table t1 (i int); create EXTERNAL table t2(i int); create table t3(i int) PARTITIONED by(b int); create EXTERNAL table t4(i int) PARTITIONED by(b int); --with LOCATION create table t5 (i int) LOCATION '/tmp/tables/t5'; create EXTERNAL table t6(i int) LOCATION '/tmp/tables/t6'; Just examples ... View more

@manoj kumar I can see the error you forgot the last bit after the hdp.repo ...... wget -nv http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.4.2.0/hdp.repo -O /etc/yum.repos.d/hdp.repo Once you have run this command then you command should succeed let me know as the repos will be visible 🙂 ... View more

@manoj kumar Please could you try the below yum repolist all sudo yum-config-manager --enable epel Then rerun sudo yum install atlas-metadata_2_3_* ... View more

@Hardik Dave I a real world situation you connect to the edge node which has all the client libraries & configs.ie in a simple 6 node cluster 2 namenodes (HA setup) and 3 datanode (rep factor of 3 ) and 1 edge node is where the client softwares ie hive,flume,sqoop,HFDS are installed and connections to the cluster should be restricted only through the edge node. During deployment of the cluster the jar files are copied to the sharedlib if not it can be done after. You should be able to invoke hive from the edge node As the root user on the edge node # su - hive mm [root@myserver 0]# su - hdfs [hdfs@myserver ~]$ hive WARNING: Use "yarn jar" to launch YARN applications. Logging initialized using configuration in file:/etc/hive/2.5.0.0-817/0/hive-log4j.properties hive show databases; ..... hive> create database olum; OK Time taken: 11.821 seconds hive> use olum; OK Time taken: 5.593 seconds hive> hive> CREATE TABLE olum (surname string, name string, age INT); OK Time taken: 8.024 seconds hive> INSERT INTO olum VALUES ('James', 'Bond', 22), ('Peter','Welsh', 33); Query ID = hdfs_20161220082127_de77b9f0-953d-4442-a280-aa93dcc30d9c Total jobs = 1 Launching Job 1 out of 1 Tez session was closed. Reopening... Session re-established. You should see something like this ... View more

@subash sharma Is Hive-Hook enabled? Check that the hooks are enable in the Ranger config ... View more

@Satish Sarapuri How did you look for the db folder? Usually running the below command # su - hdfs $ hdfs dfs -ls / This should give you ,the most probably hdfs dfs -ls /apps/hive/warehouse/ And also check the below property in the hive-site.xml file <property> <name>hive.metastore.warehouse.dir</name> <value>/usr/hive/warehouse </value> <description>location of the warehouse directory</description> </property> ... View more