Member since
12-08-2016
36
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
511 | 01-04-2017 01:21 AM |
12-11-2018
09:50 PM
09-26-2018
10:28 AM
@Sai Sankar If the users are to be added to Ambari first as well, we would do one prior step to my previous post to first create the user in ambari. Ex; curl -u admin:admin -H "X-Requested-By: ambari" -X POST -d '{"Users/user_name":"newuser1","Users/password":"newpassw0rd","Users/active":"true","Users/admin":"false"}' http://<ambari-server>:8080/api/v1/users then follow up with the example from my previous comment, to add the user to the hive view.
... View more
08-24-2018
06:32 PM
What exception do you see when running the query? You can check the hive view logs in Ambari Server For Hive View 1.5, you can check /var/log/ambari-server/hive-next-view/hive-view.log For Hive View 1.0: /var/log/ambari-server/ambari-server.log You may also check hiveserver2.log file on Hiveserver2 host while creating a table.
... View more
08-24-2018
02:59 AM
@Sai Sankar Can you please elaborate your query a bit more. Following are some old references of Tomcat+Hadoop JIras: There are some JIRAs where we see "httpfs" switch from Tomcat to Jetty like: https://issues.apache.org/jira/browse/HDFS-10860 Also please see : https://issues.apache.org/jira/browse/HADOOP-13812 (Upgrade Tomcat for hadoop) Similarly for Hadoop KMS tomcat weak cipher issue: https://issues.apache.org/jira/browse/HADOOP-14083
... View more
08-22-2018
07:51 PM
@sankar t Please check your cat /etc/ambari-server/conf/log4j.properties file to find out the correct path for your log files. Ple
... View more
03-28-2017
07:29 PM
1 Kudo
Yes its possible to switch between different queue and make use of the resources. But the user which you are using to access hive should have access to other queue which you are trying to switch, which will be decided by the person who has access to ambari- admin console. To try hive --hiveconf tez.queue.name=DEV2. Choosing Tez or mapred depends on your need. If the user doesnt have access then the query will fail.
... View more
11-16-2017
03:30 PM
I tried this, and it worked for me, ALTER TABLE tablename DROP IF EXISTS PARTITION (load_s=timestamp '2017-02-22 12:21:39'); The sentence "IF EXISTS" goes after the "DROP". Regards.
... View more
02-28-2017
06:19 PM
@peeyush Thanks for your help. Followed the same and issue been resolved.
... View more
02-22-2017
04:59 PM
@Sankar T can you take a look at the class generated after your sqoop and verify the data type for binary_id?
... View more
03-13-2017
06:49 PM
Yes, the audit log will serve the purpose. Note that, in some cases,
it is not straightforward to search the log for deletion since a
directory (or a file) may not be deleted directly -- it may be deleted
as a part of the deletion of its parent/ancestor directory. So we
should first search the full path in the log. If it is not found,
search the parent directory path and so on. It will be more complicated if deletion and re-creation occurred repeatedly. For example 1) user A: create /foo 2) user A: create /foo/bar 3) user A: del /foo 4) user B: create /foo 5) user B: del /foo
Who has deleted /foo/bar? It is easy to mistakenly take user B as the answer. B is the last user deleted foo but B
is not the user deleted /foo/bar. In such case, we should first
determine when the target directory/file is created and then search what
happened of it starting from the creation time. You can imagine that it is even harder to find out the correct answer if the path or the parent/ancestor paths are moved/renamed. We need to pay extra attention if the rename operation is involved.
... View more
01-09-2017
08:20 PM
Use -doas <arg> doAs user, impersonates as the specified user Documentation Impersonation, doAs
The -doas option allows the current user to impersonate other users when interacting with the Oozie system. The current user must be configured as a proxyuser in the Oozie system. The proxyuser configuration may restrict from which hosts a user may impersonate users, as well as users of which groups can be impersonated.
... View more
01-09-2017
04:54 PM
@Sankar T - Can you please accept my answer if it helped!
... View more
01-04-2017
07:56 PM
@clukasik - Thanks for the reply. I tried your query and it worked , here is my observations. show partitions tablename; partition_dt=2017-01-03 10%3A20%3A13
partition_dt=2017-01-03 10%3A20%3A14
partition_dt=2017-01-03 10%3A20%3A15
select patition_dt, count(1) from tablename group by partition_dt; 2017-01-03 10:20:13.0 | 2191
2017-01-03 10:20:14.0 | 7888
2017-01-03 10:20:15.0 | 1647
Note: %3A should be replaced with : while quering. select count(1) from tablename where partition_dt="2017-01-03 10:20:13";
+-------+--+
| _c0 |
+-------+--+
| 2191 |
+-------+--+
1 row selected (3.643 seconds) select count(1) from tablename where partition_dt="2017-01-03 10:20:14";
+-------+--+
| _c0 |
+-------+--+
| 7888 |
+-------+--+
1 row selected (0.101 seconds) select count(1) from tablename where partition_dt="2017-01-03 10:20:15";
+-------+--+
| _c0 |
+-------+--+
| 1647 |
+-------+--+
1 row selected (0.101 seconds) Sampling i used below query. select * from tablename where partition_dt="2017-01-03 10:20:15" limit 5;
... View more
12-14-2016
01:36 AM
Best way to store is probably followed by best for what kind of usage Sankar. I believe that reading value stored in String is fairly simple than trying to read something that is in binary format. It depends on how you want to use it, then how you want to store it.
... View more
12-23-2016
12:00 PM
@Sankar T Please read Wangda's blog if you are planning to setup yarn node labels - https://wangda.live/2016/04/16/suggestions-about-how-to-better-use-yarn-node-label/
... View more
12-13-2016
03:51 PM
@Kuldeep Kulkarni Let me ask the question with example. sudo -u ***** oozie job -oozie http://hpchdp2.hpc.com:11000/oozie -config job.properties -run when i submitted a Oozie job thru command line/thru Falcon Scripts. I would like to store Job id , application ID in a hbase/hive table. Looking for an API's which will help me to do the same.
... View more
12-13-2016
04:02 PM
Apache Nifi, Spark, Flink, Sqoop, Flume. Lots of tools, it really depends on what you are doing. NIFI has plug and play and lots of sources. This is my choice for most use cases.
... View more
08-24-2018
08:09 PM
@Sagar Shimpi : will this process cleanup physical folders and dependencies automatically by running curl command or Ambari service deletion ? if not , do we need to delete manually ? thanks in advance.
... View more