Member since
07-26-2016
49
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3512 | 11-28-2017 09:54 PM |
11-30-2017
09:44 PM
Hive version : Hive 1.1.0-cdh5.13.0, Still i didnt get the solution...
... View more
11-29-2017
12:56 AM
Hi Tristanzajonc, Thanks for the explanation. I am using cdsw for testing only. So, i choosen the domain service with extention of xip.io But , while i am launching the session it displaying as below : It stays in schedulling phase and Terminal also not opening in client side. Firewall restriction also i have done. Please guide me Thanks.
... View more
11-28-2017
09:54 PM
1 Kudo
After updating the ip address in cloudera manager level. ned to do the following. #cdsw reset Next Intialize the CDSW #cdsw init Automaticly the IP address will update. Thanks.
... View more
11-28-2017
09:38 PM
Hi Team, I have configured CDSW 1.2 on Cloudera Name node server. Unfortunalty the IP address are changed, Due to dynamic ip problem. I have Updated the Ip addressess as per link for cloudera manager. http://bigdatathinker.blogspot.in/2013/12/cloudera-manager-update-hostname-or-ip.html But now i want to update the ip address for CDSW. Please guide me. Thanks.
... View more
11-21-2017
12:53 AM
command : sudo -u hdfs hdfs fsck -list-corruptfileblocks For deleting corrupted files : sudo -u hdfs hdfs fsck / -delete Thanks.
... View more
09-11-2017
10:06 PM
Please check the hive-site.xml file and Guide me. <configuration> <property> <name>hive.metastore.uris</name> <value>thrift://quickstart.cloudera:9083</value> </property> <property> <name>hive.metastore.client.socket.timeout</name> <value>300</value> </property> <property> <name>hive.metastore.warehouse.dir</name> <value>/user/hive/warehouse</value> </property> <property> <name>hive.warehouse.subdir.inherit.perms</name> <value>true</value> </property> <property> <name>hive.auto.convert.join</name> <value>true</value> </property> <property> <name>hive.auto.convert.join.noconditionaltask.size</name> <value>20971520</value> </property> <property> <name>hive.optimize.bucketmapjoin.sortedmerge</name> <value>false</value> </property> <property> <name>hive.smbjoin.cache.rows</name> <value>10000</value> </property> <property> <name>hive.server2.logging.operation.enabled</name> <value>true</value> </property> <property> <property> <name>hive.server2.logging.operation.log.location</name> <value>/var/log/hive/operation_logs</value> </property> <property> <name>mapred.reduce.tasks</name> <value>-1</value> </property> <property> <name>hive.exec.reducers.bytes.per.reducer</name> <value>67108864</value> </property> <property> <name>hive.exec.copyfile.maxsize</name> <value>33554432</value> </property> <property> <name>hive.exec.reducers.max</name> <value>1099</value> </property> <property> <name>hive.vectorized.groupby.checkinterval</name> <value>4096</value> </property> <property> <name>hive.vectorized.groupby.flush.percent</name> <value>0.1</value> </property> <property> <name>hive.compute.query.using.stats</name> <value>false</value> </property> <property> <name>hive.vectorized.execution.enabled</name> <value>true</value> </property> <property> <property> <name>hive.vectorized.execution.reduce.enabled</name> <value>false</value> </property> <property> <name>hive.merge.mapfiles</name> <value>true</value> </property> <property> <name>hive.merge.mapredfiles</name> <value>false</value> </property> <property> <name>hive.cbo.enable</name> <value>false</value> </property> <property> <name>hive.fetch.task.conversion</name> <value>minimal</value> </property> <property> <name>hive.fetch.task.conversion.threshold</name> <value>268435456</value> </property> <property> <name>hive.limit.pushdown.memory.usage</name> <value>0.1</value> </property> <property> <name>hive.merge.sparkfiles</name> <value>true</value> </property> <property> <name>hive.merge.smallfiles.avgsize</name> <value>16777216</value> </property> <property> <name>hive.merge.size.per.task</name> <value>268435456</value> </property> <property> <name>hive.optimize.reducededuplication</name> <value>true</value> </property> <property> <name>hive.optimize.reducededuplication.min.reducer</name> <value>4</value> </property> <property> <name>hive.map.aggr</name> <value>true</value> </property> <property> <name>hive.map.aggr.hash.percentmemory</name> <value>0.5</value> </property> <property> <name>hive.optimize.sort.dynamic.partition</name> <value>false</value> </property> <property> <name>hive.execution.engine</name> <value>mr</value> </property> <property> <name>spark.executor.memory</name> <value>52428800</value> </property> <property> <name>spark.driver.memory</name> <value>52428800</value> </property> <property> <name>spark.executor.cores</name> <value>1</value> </property> <property> <property> <name>spark.yarn.driver.memoryOverhead</name> <value>64</value> </property> <property> <name>spark.yarn.executor.memoryOverhead</name> <value>64</value> </property> <property> <name>spark.dynamicAllocation.enabled</name> <value>true</value> </property> <property> <name>spark.dynamicAllocation.initialExecutors</name> <value>1</value> </property> <property> <name>spark.dynamicAllocation.minExecutors</name> <value>1</value> </property> <property> <name>spark.dynamicAllocation.maxExecutors</name> <value>2147483647</value> </property> <property> <name>hive.metastore.execute.setugi</name> <value>true</value> </property> <property> <name>hive.support.concurrency</name> <value>true</value> </property> <property> <name>hive.zookeeper.quorum</name> <value>quickstart.cloudera</value> </property> <property> <property> <name>hive.zookeeper.client.port</name> <value>2181</value> </property> <property> <name>hbase.zookeeper.quorum</name> <value>quickstart.cloudera</value> </property> <property> <name>hbase.zookeeper.property.clientPort</name> <value>2181</value> </property> <property> <name>hive.zookeeper.namespace</name> <value>hive_zookeeper_namespace_hive</value> </property> <property> <name>hive.cluster.delegation.token.store.class</name> <value>org.apache.hadoop.hive.thrift.MemoryTokenStore</value> </property> <property> <name>hive.server2.enable.doAs</name> <value>true</value> </property> <property> <name>hive.server2.use.SSL</name> <value>false</value> </property> <property> <name>spark.shuffle.service.enabled</name> <value>true</value> </property> </configuration> Thanks, Syam.
... View more
09-11-2017
09:47 PM
Kudu is like HBase..
... View more
09-11-2017
05:11 AM
Thanks for the reply. I created the ORC format table only. You can see the details in first post. Apache Kudu is like hive ? Thanks, Syam.
... View more
09-11-2017
04:36 AM
Hi Ujjwal, Thanks for the reply. This is quickstart Vm machine 5.8. Uninstalling is not the solution i think. Thanks, Syam
... View more