Member since
09-24-2015
816
Posts
488
Kudos Received
189
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2664 | 12-25-2018 10:42 PM | |
12208 | 10-09-2018 03:52 AM | |
4205 | 02-23-2018 11:46 PM | |
1890 | 09-02-2017 01:49 AM | |
2212 | 06-21-2017 12:06 AM |
04-03-2016
04:30 AM
You need to check instructions for your BI tool but I believe it means to create a directory in your local file system (Linux) on your edge node and copy the package there, not in HDFS, and no need to use Ambari for that.
... View more
04-03-2016
03:53 AM
2 Kudos
Hi @suno bella, edge node refers to a dedicated node (machine) where no Hadoop services are running, and where you install only so-called Hadoop clients (hdfs, Hive, HBase etc. clients). In your case your BI tool will also play a role of a Hadoop client. A client means that only respective component client libraries and scripts will be installed, together with its config files. If you change config through Ambari, then Ambari will automatically refresh config files on the edge node as well. In a small, test cluster without an edge node you can select one node where Hadoop services are running (for example, a master node) to play a role of your edge node. (In a large cluster with many users there are usually multiple edge nodes.) As the "edge node folder" you can use any folder on the edge node you decide to use. Hope this helps.
... View more
04-02-2016
04:51 AM
Hi @Anshul Sisodia, can you try to restart Ambari Metrics, and if you just did some Ambari config changes then also restart HBase. Also, I see that you have many minor GC compactions, they are fast but happen too often. OTOH, you have allocated only 4G for your RS, and have about 50G free on both RS nodes. Can you ramp them up to 16G, or at least 8G, and increase New gen to at least 1G. Either way, that latency looks wrong.
... View more
04-01-2016
01:31 AM
1 Kudo
No problems. Yes, many components are packed in the Sandbox and they are all hungry for memory 🙂 On Azure you need at least 7G to run the Sandbox comfortably. It may also run on 3.5G but it will be tight. Okay, enjoy the tutorials and let us know if you face any other issues.
... View more
04-01-2016
12:55 AM
1 Kudo
Hi @Przemysław Rząd, It looks like Ambari is not running. Can you try to login into your instance and run /root/start_ambari.sh script. Or you can try to restart your instance, Ambari is supposed to start on instance startup.
... View more
03-30-2016
08:05 AM
4 Kudos
Hi @Adi Jabkowsky, the balancer is running in the background and it's slow by design. No need to worry. You can keep on using the cluster, running jobs, etc. Increasing the balancer bandwidth to 100M/s is good, and running from command line instead from Ambari is also a good choice. To have a better sense of completion, and better insight into required time, you can run next time first with 20% threshold and then run again reducing it to 15% and 10%.
... View more
03-29-2016
06:01 AM
1 Kudo
Hi @Rohit Sureka, and welcome to HCC! Yes, you can access HBase from almost any Yarn-running component like MapReduce, Hive, Pig, or Spark. Here are some links: Hive HBase integration, Spark on HBase, and HBase and MapReduce.
... View more
03-28-2016
11:21 AM
1 Kudo
Are you using an existing Mysql DB? This often happens when the Hive DB user doesn't have privileges to access Hive DB from another host. If you let Ambari install and create new Hive DB then Ambari will set them. You can inspect your current users and give privileges using following commands (assuming your Hive user is called 'hive'): SELECT User,Host FROM mysql.user;
SHOW GRANTS FOR 'hive'@'%'; -- Possibly returns nothing
GRANT ALL PRIVILEGES ON hive.* TO 'hive'@'%'; The last command will solve all your troubles, but you can also replace '%' with the host name of the node where Hive Metastore is running.
... View more
03-27-2016
04:56 AM
2 Kudos
Hi @John Garrigan, your specs are a little imprecise, but can you try this: select count(distinct Z) from t1 where locate(Y, X)>0; -- for example:
select count(distinct Z) from t1 where locate("Java", X)>0; Note that, as stated, your condition on "Y^" (usually expressed as "Y*") is superfluous, since if Y is there then any superstring of Y will be there too.
... View more
03-23-2016
06:03 AM
1 Kudo
@Mohamed Ashiq, If your topics look like above (old ones refer to brokers 0,1,2,... and new ones to 1001, 1002, ...) then the solution is to visit meta.properties files on each disk of each broker and edit "broker.id" property, changing it from 1001, 1002, ... to 0, 1, 2, ...
... View more