Member since
04-03-2019
21
Posts
9
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6088 | 10-13-2017 10:56 AM | |
3934 | 10-12-2017 11:45 AM | |
13806 | 09-29-2017 08:32 AM | |
3237 | 09-27-2017 04:37 AM | |
2467 | 06-07-2017 03:23 PM |
10-14-2017
05:01 AM
@viswanath Can you post your sql statement the select query
... View more
10-13-2017
10:56 AM
@Daniel Perry Beeline expects the HQL file to be local file system. So If your HQL file is in HDFS, you should first download it to local file system, then feed it to Beeline.
... View more
10-12-2017
11:45 AM
Solution: Go to Ambari Hive Configs page. Then find Custom hive-site Add following arguments: hive.downloaded.resources.dir=/tmp/hive/${hive.session.id}_resources Then save the modification and do a Rolling Restart of related component. We can delete all ages {session_id}_resources folder under /tmp, and start a hive client, run some SQL, then check the new session folder will be generated in /tmp/hive/ folder.
... View more
10-12-2017
11:39 AM
I found there are 10,000+ folder owned by hive:hadoop under /tmp locally, folder name is {session_id}_resources(eg. 0003f01d-07e5-4caa-bb4f-61e62d35f426_resources). And the folder is empty, can I delete them? And how can I config to store them in another folder? They have been there 1 month ago. No one use these folder anymore. I think it is created by hive session. I found JIRA describe similar bug: https://issues.apache.org/jira/browse/HIVE-4546, but this bug has been fixed from hive version 0.12.0. The hive version here is 1.2.1.2.6. It shouldn't have this issue again. Any idea on how to prevent leaving these hive session folder? Or is there a way to have these in a subfolder, e.g. /tmp/hive_session/0003f01d-07e5-4caa-bb4f-61e62d35f426_resources/
... View more
Labels:
- Labels:
-
Apache Hive
10-03-2017
02:56 PM
NIFI run out of disk, when I try to restart NiFi, I got the following error in nifi-app.log: ERROR [main] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@2f6b3859 unexpectedly reached End-of-File when reading from Partition-88 for Transaction ID 175735849; assuming crash and ignoring this transaction I found this article on the similar issue,https://community.hortonworks.com/questions/135687/nifi-not-getting-started-in-cluster.html This article suggest to delete flowfile_repository to restore it. Do we have more smooth solution, which do not need to delete flowfile_repository and content_repository? Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
10-02-2017
01:07 PM
this one works for me, and don't need to regenerate key for ambari server and other ambari agents
... View more
09-29-2017
08:32 AM
2 Kudos
@vsubramanian hdfs dfs -ls /user/hdfs The above can direct show hidden files, you can directly see the below, for example drwx------ - hdfs hdfs 0 2017-07-13 02:00 /user/hdfs/.Trash
drwxr-xr-x - hdfs hdfs 0 2017-04-06 14:21 /user/hdfs/.hiveJars
drwxr-xr-x - hdfs hdfs 0 2017-06-29 09:12 /user/hdfs/.sparkStaging
drwxr-xr-x - hdfs hdfs 0 2017-04-24 15:54 /user/hdfs/SSP00805
where you can see the file start with a dot.
... View more
09-29-2017
08:21 AM
this one also helpful: http://data-flair.training/blogs/hadoop-2-x-vs-hadoop-3-x-comparison/
... View more
09-29-2017
07:47 AM
@Riddhi Sam I found these two article, one compare for Hadoop1 Vs Hadoop2, and one compare for Hadoop2 VS Hadoop3 Hope it can answer your question.
... View more