Member since
07-09-2016
83
Posts
17
Kudos Received
2
Solutions
12-19-2016
11:43 PM
My use case requires to write in a delimited format. INSERT OVERWRITE LOCAL fits perfectly for this. I wish we had a way to custom delimit the content retrieved through SelectHiveQL processor, so I couldn't opt it. I agree it's a good option of writing to HDFS instead. I will attempt to modify the process, but I still wonder why it wouldn't work with write to Local filesystem, through NiFi.
... View more
12-19-2016
11:37 PM
What I understand is that Hive temporarily uses the /tmp on the HDFS to write into and then copies over to Local directory. So, in the ranger the recursive access to /tmp HDFS folder has been issued. But, the issue still persists with NiFi
... View more
12-18-2016
07:25 AM
Ranger is specific to HDFS. I am referring to the issue with Hive writing to the local file system, see Hive statement in my summary above. And, /tmp directory is accessible by any user
... View more
12-16-2016
10:12 PM
I cannot get the following query run using PutHiveQL processor, it fails with the permission denied exception. I see that the processor emulates the same behavior as in Beeline.
But, I have been able to run the query from Hive CLI and writes to a file as expected. So, we know that Hive shell is an option, but can you let me know if there is any specific settings that causes this behavior in Beeline (Hive2) preventing to write to local filesystem?
insert overwrite local directory '/tmp' select current_date from dual
Error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [xxxxx] does not have [WRITE] privilege on [/tmp] (state=42000,code=40000)
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
12-06-2016
05:09 PM
Thank you, that was it! It would good if they get listed in the Attribute tab as well.
... View more
12-06-2016
04:45 AM
How to capture the filesize and the filename, which can be found in the details section of the flowfile? I understand that the filename is listed in the attribute section, but is there a way to know the variable name for filesize?
kafka-flow-file.jpg
... View more
Labels:
- Labels:
-
Apache NiFi
11-01-2016
07:26 AM
How do I view the flowfile attributes names/values once it processor completes processing and move it to queue. Wanted to be able to see the flow file attribute/name values available, such that they can be used in subsequent processor expressions.
... View more
Labels:
- Labels:
-
Apache NiFi