Member since
12-08-2016
36
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1271 | 01-04-2017 01:21 AM |
09-26-2018
10:17 AM
They are new to Ambari as well. Example : a new team would like to get into Ambari as well as Hive view. Currently i am doing 1) creating ambari user 2) Assign hive view. This works if users are countable. Now if i would like to do for 100/200 members, what approach should i follow ? @jonathan sneep
... View more
09-26-2018
04:28 AM
I would like to add 100 users to hive view in Ambari in easier way.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
08-24-2018
08:09 PM
@Sagar Shimpi : will this process cleanup physical folders and dependencies automatically by running curl command or Ambari service deletion ? if not , do we need to delete manually ? thanks in advance.
... View more
08-24-2018
02:38 AM
Labels:
- Labels:
-
Apache Hadoop
08-22-2018
07:48 PM
Ambari is not writting any log information. even ambari-server.out is also not having error log for that period.
... View more
08-22-2018
07:05 PM
@amarnath reddy pappu - I don't see a log during failed period. is there a way to know why logs are not written ?
... View more
08-22-2018
06:55 PM
@Pedro Andrade @amarnath reddy pappu @Akhil S Naik - thanks for your quick reply.
I am seeing below statements repeatedly. unable to get exact error phrase/word. any help please . thanks in advance [ambari-client-thread-9015] StackAdvisorRunner:** - Stack-advisor output=/var/run/ambari-server/stack-recommendations/2/stackadvisor.out,
error=/var/run/ambari-server/stack-recommendations/2/stackadvisor.err Rest all statements are INFO/WARN no error.
... View more
03-28-2017
07:53 PM
Let me make it clear HDFS Level- we have only valid partitions (parition1,parition2) Table Level - we have both valid(parition1,partition2) and invalid partitions(partition3,partition4). I would like to drop only invalid partitions(partition3,partition4). -> Unable to drop by passing Url encoded characters & Timestamp. -> Created invalid partition at HDFS level, unable to drop. -> Issued MCSK REPAIR command , post success also unable to drop. Thanks
... View more
03-28-2017
07:39 PM
It is not working and notified to Hortonworks team. Soon I got the answer will post it here.
... View more
03-28-2017
07:07 PM
Adding to that , we are able to drop the partitions at HDFS level, but those invalid partitions were not dropped even after MCSK REPAIR TABLE command too.
... View more
03-16-2017
12:54 PM
Deepesh - it did not worked. Getting below error. With IF EXIST Error: Error while compiling statement: FAILED: ParseException line 1:75 mismatched input 'IF' expecting ( near 'PARTITION' in drop partition statement (state=42000,code=40000) Without IF EXIST - Error: Error while compiling statement: FAILED: SemanticException Unexpected unknown partitions for (load_s = 2017-02-22 12:21:39.0) (state=42000,code=40000)
... View more
03-15-2017
07:19 PM
Let me make it clear HDFS Level- we have only valid partitions (parition1,parition2) Table Level - we have both valid(parition1,partition2) and invalid partitions(partition3,partition4). I would like to drop only invalid partitions(partition3,partition4). -> Unable to drop by passing Url encoded characters & Timestamp. -> Created invalid partition at HDFS level, unable to drop. -> Issued MCSK REPAIR command , post success also unable to drop. ALTER TABLE tablename DROP PARTITION IF EXISTS (load_s='2017-02-22 12:21:39'); - did not worked. ALTER TABLE tablename DROP PARTITION (load_s='2017-02-22 12:21:39'); - did not worked. ALTER TABLE tablename DROP PARTITION (load_s='2017-02-22 12%3A21%3A39'); - did not worked.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
02-28-2017
06:19 PM
@peeyush Thanks for your help. Followed the same and issue been resolved.
... View more
02-23-2017
02:48 AM
Recently we had HDP 2.5.3 version upgrade, post validation steps we are checking Falcon job flows. we got a strange error stating -"cluster Entry vertex must exist" . did any one had the same and any fix ? Even after Falcon server restart is not solving the issue. I could see some one have raised Falcon Jira request too. https://issues.apache.org/jira/browse/FALCON-1955 any help , greatly appreciated.
... View more
Labels:
- Labels:
-
Apache Falcon
-
Apache Hadoop
-
Apache Oozie
02-08-2017
06:27 PM
@Artem Ervits Thanks for your reply. I tried it but no results and no errors.
... View more
02-06-2017
08:58 PM
I had used the following sqoop command to import db2 data which is defined as BLOB into Hive in ORC format. sqoop import \ --connect "jdbc:db2://******/DB22" --username ***** --password '******' \ --table temp --map-column-hive row_id=String,binary_id=Binary --map-column-java row_id=String -m 1 --hcatalog-database temp_database --hcatalog-table temp_table --create-hcatalog-table --hcatalog-storage-stanza "stored as orcfile" 1) Table is created in Hive (one column is having binary data,rest of the columns are in STRING format) and when I do , select count(*) from temp_table; -- I am able to get the count When I select without that one Binary column also ,I am able to pull the result. But, 2) When I try to select something (including Binary column) from that table like below. select * from temp_table limit 1; I am getting below error:, Please help.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Sqoop
01-19-2017
01:37 PM
Labels:
- Labels:
-
Apache Hadoop
01-09-2017
04:18 PM
Thank you @Kuldeep Kulkarni
... View more
01-06-2017
03:58 PM
@Kuldeep Kulkarni - Thanks for your reply. Can you please help me with Oozie CLI to get the list of the jobs whose schdule is between 8AM-5pm EST.
... View more
01-05-2017
03:01 PM
Labels:
- Labels:
-
Apache Hadoop
-
Apache Oozie
01-04-2017
07:56 PM
@clukasik - Thanks for the reply. I tried your query and it worked , here is my observations. show partitions tablename; partition_dt=2017-01-03 10%3A20%3A13
partition_dt=2017-01-03 10%3A20%3A14
partition_dt=2017-01-03 10%3A20%3A15
select patition_dt, count(1) from tablename group by partition_dt; 2017-01-03 10:20:13.0 | 2191
2017-01-03 10:20:14.0 | 7888
2017-01-03 10:20:15.0 | 1647
Note: %3A should be replaced with : while quering. select count(1) from tablename where partition_dt="2017-01-03 10:20:13";
+-------+--+
| _c0 |
+-------+--+
| 2191 |
+-------+--+
1 row selected (3.643 seconds) select count(1) from tablename where partition_dt="2017-01-03 10:20:14";
+-------+--+
| _c0 |
+-------+--+
| 7888 |
+-------+--+
1 row selected (0.101 seconds) select count(1) from tablename where partition_dt="2017-01-03 10:20:15";
+-------+--+
| _c0 |
+-------+--+
| 1647 |
+-------+--+
1 row selected (0.101 seconds) Sampling i used below query. select * from tablename where partition_dt="2017-01-03 10:20:15" limit 5;
... View more
01-04-2017
01:21 AM
@clukasik- Thanks for your reply. Table is loaded 3 times today.I would like to know count for each partition. I tried to run a query "select count(*) from db.tablename where partition_dt="2017-01-03 10%3A20%3A13" , tried like keyword both did not give results. Note: select count(*)f rom db.table where partition_dt ='2017-01-03' gives count for the day. I Agree with your comment, but it is an existing application. I will make sure new design won't have too many partitions.
... View more