Member since
03-07-2018
6
Posts
0
Kudos Received
0
Solutions
04-04-2018
07:59 PM
Hello hortonworks family! I have two columns in a hive table that look something like this: code codeset AB AB123,MU124 LM LM123,LM234 I need to verify that all elements in codeset column contain the value in code column so in the above example the first row would be false and the second row would be true. Is there a simple way to do this that I am missing? I already read about array_contains but that returns true if just one element matches, I need all elements to contain what's in the code column. Thanks in advance.
... View more
Labels:
- Labels:
-
Apache Hive
03-08-2018
03:19 PM
This worked great, thank you!
... View more
03-07-2018
07:44 PM
I have a process that fetches files from an ftp location and processes them HDFS -> hive. At the end of the day I would like to reconcile that I loaded all files on FTP into the hive table. The hive table has a field for filename so I can get the distinct listing of files loaded for that day using the selectHiveQL processor. I tried getting the list of files off FTP from the listFTP processor but it is just queueing up 20 zero byte files. I envisioned being able to just listFTP -> MergeContent to have a text file of all filenames in ftp directory and then somehow compare the results of selectHiveQL and listFTP/mergecontent but mergecontent doesnt even run with the zero byte files input. Any suggestions on how to do this correctly?
... View more
Labels:
- Labels:
-
Apache NiFi