Member since
05-30-2018
1322
Posts
715
Kudos Received
148
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4038 | 08-20-2018 08:26 PM | |
| 1936 | 08-15-2018 01:59 PM | |
| 2369 | 08-13-2018 02:20 PM | |
| 4100 | 07-23-2018 04:37 PM | |
| 5006 | 07-19-2018 12:52 PM |
10-14-2016
04:06 AM
@Sunile Manjee, is your Ambari Metrics Service running ? (specifically Ambari Metric Collector)? You may want to try restarting AMS Collector and then restart Activity Explorer.
... View more
10-14-2016
03:22 AM
I found the issue. I was using PQS on node which is did not install PQS. I created secondary index pointing to PQS installed by ambari and all is good.
... View more
05-09-2018
02:56 AM
If that doesn't work, try running as the HDFS superuser sudo -u hdfs hdfs dfsadmin -safemode leave sudo -u hdfs hdfs dfs -mkdir /user/admin sudo -u hdfs hdfs dfs -chown root:hdfs /user/admin
... View more
10-17-2016
03:52 AM
Sunile. For daemons such as NM and RM, I can hard-code JMS port number. However, how to set different JMX port number on a number of JVM containers running on the same slave node? For example, I can configure 18 container per node, how could I set the port number to 8001-8018? Maybe I can use ZK, or some kind of script.
... View more
10-11-2016
08:43 PM
@Sunile Manjee
Integration between Spark and HBase relies simply on HBaseContext which provides HBase configuration to Spark Executor. So, to answer which protocol is used, the answer is simple RPC. Please check following link for more details. https://hbase.apache.org/book.html#spark and here is the github link to HBase Spark module. https://github.com/apache/hbase/tree/master/hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark
... View more
11-07-2018
05:59 AM
It was a misunderstanding with the infrastructure team thanks nathan for the quick answer
... View more
10-07-2016
05:24 PM
3 Kudos
Hi @Sunile. I suspect this is not a firm number but a bang-for-the-buck recommendation - i.e. you will get the most substantial relative performance improvements with dataset sizes that can remain in-cache.
In Carter and Nita's recent blog post, they go into testing 10TB TPC-DS datasets - much larger than the aggregate cluster LLAP cache size. They wanted to see (direct quote) "if LLAP can truly tackle the big data challenge or if it’s limited to reporting roles on smaller datasets."
What they found was that (another quote) "If we look at the full results, we see substantial performance benefits across the board, with an average speedup of around 7x. The biggest winners are smaller-scale ad-hoc or star-schema-join type queries, but even extremely complex queries realized almost 2x benefit versus Hive 1."
... View more
07-06-2018
01:39 PM
Will it be possible to create namespace on the custom hdfs path ?
... View more
10-07-2016
01:30 AM
argh never mind. I found it. you have to go to ambari, hive, config, and enable interactive query. then it will go through install steps.
... View more