Member since
06-01-2017
87
Posts
11
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1005 | 11-24-2016 12:23 PM | |
885 | 10-13-2016 01:55 PM |
12-13-2016
06:36 AM
@mqureshi, Thanks for your response. We using sqoop data from oracle tables to HDFS( HIVE external table), and then insert into ORC table in HIVE to support data analytics. And our HIVE currently not turn ACID on. Most of tables size currently less than 1TBs. Now there is requirement to update the imported table data in HIVE, because of the source data updated. I seached on web and found it seems ACID are not very good on performance when update and the ACID tables are also not recognized outside of HIVE(e.g. SPARK). We are looking for a most performance approach for it. So I considered to implemented it by using hbase storagehandler or sqoop merge ?
... View more
12-12-2016
12:40 PM
Can I implement such scenario: 1.One data copy 2.UPDATE/DELETE/INSERT in Hbase 3.Query Table in Hive. 4.How about the performance of query in hive compare to ORC? 5.Or just turn on ACID in HIVE to implement above? Thanks
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Hive
12-12-2016
08:26 AM
@aengineer @Kuldeep Kulkarni Thanks for your reseponse. One more question, Will standby namenode into safemode whenever restart it?
... View more
12-08-2016
07:27 AM
I deployed Namenode HA in HDP2.5. Is there a method or steps to restart namenode which won't put namenode into safemode or into safemode with less duration as possible?
... View more
Labels:
- Labels:
-
Apache Hadoop
12-08-2016
07:14 AM
How about create views in source databases.
... View more
12-05-2016
02:41 AM
-rw-r--r-- 1 hdfs hadoop 33230744768 Dec 2 23:59 hdfs-audit.log.2016-12-02
-rw-r--r-- 1 hdfs hadoop 21023710437 Dec 3 23:59 hdfs-audit.log.2016-12-03
-rw-r--r-- 1 hdfs hadoop 10840252416 Dec 4 23:59 hdfs-audit.log.2016-12-04
... View more
12-05-2016
02:40 AM
I found the hdfs-audit.log is increasing very quickly. It is fulling /var/log -rw-r--r-- 1 hdfs hadoop 33230744768 Dec 2 23:59 hdfs-audit.log.2016-12-02
-rw-r--r-- 1 hdfs hadoop 21023710437 Dec 3 23:59 hdfs-audit.log.2016-12-03
-rw-r--r-- 1 hdfs hadoop 10840252416 Dec 4 23:59 hdfs-audit.log.2016-12-04 How can I control the size of hdfs-audit.log? Why it is so large size? Thanks
... View more
Labels:
- Labels:
-
Apache Hadoop
12-02-2016
10:45 AM
Besides 300 bugs, what new features since HDP 2.5.0?
... View more