Member since
12-22-2016
11
Posts
0
Kudos Received
0
Solutions
01-20-2018
06:47 PM
I have orc files in external path of Hive ORC table. I want to merge the ORC files in this path to single file using the Orc Core API: <code>publicstaticList<Path> mergeFiles(Path outputPath,OrcFile.WriterOptions options,List<Path> inputFiles)throwsIOExceptionMerges multiple ORC files that all have the same schema to produce a single ORC file.The merge will reject files that aren't compatible with the merged file so the output list may be shorter than the input list. The stripes are copied as serialized byte buffers. The user metadata are merged and files that disagree on the value associated with a key will be rejected.
For this i need to initialize WriterOptions(Properties tableProperties, Configuration conf) with tableProperties populated with that of the external table from hive. Any help in this is much appreciated?
... View more
Labels:
09-16-2017
06:27 AM
without using rest api..
... View more
09-16-2017
06:24 AM
can i programatically stop another processor using execute script or custom processor? I see some methods like publicProcessGroup getGroup(finalString id) in org.apache.nifi.controller.FlowController.java. Does nifi provide api like this which can be used in custom processors?
... View more
Labels:
09-16-2017
05:16 AM
@Frank Maritato Can i run your python code in ExecuteScript processor - which means i am stopping an processor from another one within nifi. If yes? will your code work if security for nifi is enabled like LDAP authentication. Can you show light on "nifiapi" is it an api provided by nifi.
... View more
08-05-2017
05:13 PM
I want to query all the provenance of a particular processor( I will pass the id of the processor) within specified processor group only ( I will pass the processor group id) (These are the ones which i get if i right click a processor and hit Data Provenance). I tried passing the request body {"provenance":{"results":"provenanceEvents": [{"componentId": "04a12312-12335....."}]}} But did not get the desired results... Illustrations with results is highly appreciated..
... View more
Labels:
08-03-2017
05:48 PM
How does ".dynamicallyModifiesClasspath" communicates to the framework to update classpath with external paths? Basic search lead to AbstractConfiguredComponent.java which identifies this and invokes "reload(additionalUrls)". Could not find what this method does?
... View more
Labels:
02-28-2017
09:09 AM
Yes, because we are using a generic application user id and we would have it encrypted in a property file.
... View more
02-23-2017
02:38 PM
Thanks Matt, so in case if am using an Apache HTTP client package and executing the above rest calls within in a executable jar file, then i would need need to do decryption of encrypted password and hit it in the way above...
... View more
02-23-2017
01:07 PM
After LDAP configuration, if i execute a curl command and make NIFI REST Client call: "curl -i -k -X GET https://URL/nifi-api/flow/process-groups/16fc1e19-12ed-133d-079e-613116e15383" i get the error: "Unable to perform the desired action due to insufficient permissions. Contact the system administrator.". Which means i need to use one of the options mentioned in /nifi-api/access/ - to authenticate and then perform the above curl command to succeed. The REST calls against /nifi-api/access works meaning: "curl -i -k -X GET https://URL/nifi-api/access" returns: "{"accessStatus":{"status":"UNKNOWN","message":"No credentials supplied, unknown user."}}"
... View more
Labels:
02-23-2017
12:51 PM
Currently in HiveConnectionPool, the box where we enter password is textarea and the password characters that we type are visible. After finishing, the password will no longer be visible as it is a sensitive property. One of the end-users made a request to us that the characters should not be visible when the admin types the password for the first time ( this will rather be done by a admin through remote connect during deployment). Rather they meant it should behave like password box and not like text area...
... View more
02-22-2017
05:55 PM
In controller-services, for ex: HiveConnectionPool there is a property called "Password". Is it possible to add the capability of hidden show (input type="password") like behaviour? through code changes in NIFI framework ?
... View more