Member since
09-24-2015
816
Posts
488
Kudos Received
189
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3173 | 12-25-2018 10:42 PM | |
| 14192 | 10-09-2018 03:52 AM | |
| 4763 | 02-23-2018 11:46 PM | |
| 2481 | 09-02-2017 01:49 AM | |
| 2912 | 06-21-2017 12:06 AM |
04-18-2016
05:41 AM
If you still have "kafka-broker/port" can you try setting it to 9092. Since Alerts are a part of Ambari it will be good to know what's your Ambari version, and have you upgraded Ambari recently? Also, please check the file /etc/kakfa/conf/server.properties and make sure "listeners" contain the correct port. In same rare cases it can happen that Ambari doesn't apply actual settings to config files.
... View more
04-18-2016
04:59 AM
Yes, you have a permission problem on your input file: Permission denied: user=admin, access=WRITE, inode="/employees/part-m-00000":hdfs:hdfs:drwxr-xr-x As an immediate remedy you can change permissions, for example: su - hdfs -c "hdfs dfs -chmod -R +w /employees/" Long term, it's the best to run all you commands using an end-user account (not hdfs, root, admin etc.), In Sandbox-2.4 you can use a user called "maria-dev". So when you run sqoop, do "su - maria_dev" first, and run your commands, and when you use Ambari views, login into Ambari also as maria_dev. In this way you can avoid permissions issues. Edit: Before doing "su - maria_dev", create the user "maria_dev" on the local OS, run this as root: "useradd maria_dev". This is a one-time prep operation.
... View more
04-16-2016
02:09 PM
Yes, you can change Oozie DB later, just follow that guide, start with Step 3.2, 3.3 or 3.4 depending which DB flavor you want to use, then go to Step 4, and finally in Ambari-->Oozie, in the Oozie server block update DB properties accordingly.
... View more
04-16-2016
01:42 PM
Hi @karthik sai, you can ignore the first warning for now, and can revisit RAM allocation on each node once the cluster is up, and redistribute any remaining RAM. Regarding the DB for Oozie, Derby is default but not recommended for production. You can replace it with MySql, Postgres or Ambari, here is the guide.
... View more
04-16-2016
07:11 AM
Hi @Sunille Manjee, if you enable audit to log4j then you decide by yourself where to send audits by configuring log4appender properties.However, I'm not sure how exactly to do that: This document talks abut "Logging using Log4j" by configuring log4j.logger.xaaudit property. And there is also an example of Ranger-4 log4j audit to Kafka here, which uses slightly different property. No mention of this in docs for latest versions of Ranger, but I guess it can be done somehow.
... View more
04-16-2016
06:53 AM
Hi @Wellington De Oliveira, please see my answer of April 9 above, and update mysql-connector-java.jar which is a symbolic link, to point to the latest version of the driver.
... View more
04-15-2016
09:46 AM
Hi @tunglq it, which files do you have in mind? After installing HDP cluster there are a number of system (cluster) file written in HDFS but no jobs are running (Ambari metrics in embedded mode and Ranger audit can write files all the time but they are a special case). Folders like apps, hdp, system, tmp, user etc. are created and populated automatically during the cluster upgrade.
... View more
04-15-2016
06:16 AM
2 Kudos
Hi @ARUNKUMAR RAMASAMY, Phoenix query server is optional and you can safely skip it for the time being. It provides access to Phonex for "thin clients" but they are yet to come (Avatica, Calcite). You can read more here. If you want to install it then it's enough to install it on one node, for example, collocated with your HBase master.
... View more
04-15-2016
05:56 AM
Ah, okay, I understand now. Steps are already given in the Ambari Upgrade guide, though some of them have many details, and talk about other OS like Suse and Ubuntu, and talk about Kerberos yes/no, Ganglia yes/no and so on. You can extract only steps applicable to your cluster from Chapters 2, 3, and 4 of the guide: Chapter 2. Getting Ready to Upgrade Ambari and HDP Chapter 3. Upgrading Ambari Chapter 4. Upgrading HDP and then as you proceed with the upgrade you can mark completed steps, and for each step you can write down any comments/observations to refer to them later.
... View more
04-15-2016
05:35 AM
Hi @Indrajit swain, Login as admin. maria_dev is a read-only user. On Sandbox port 8888 (http://localhost:8888) click "View advanced options" and scroll to the very bottom to find instructions how to enable the admin account.
... View more