Member since
06-08-2017
1049
Posts
518
Kudos Received
312
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9996 | 04-15-2020 05:01 PM | |
6001 | 10-15-2019 08:12 PM | |
2447 | 10-12-2019 08:29 PM | |
9682 | 09-21-2019 10:04 AM | |
3542 | 09-19-2019 07:11 AM |
11-20-2019
02:56 AM
Hello @rohinimathursjc The best way to get the list of Hive external tables and Managed tables is using hive metastore. yes by applying some quires on hive metastore tables we can divide both Hive external tables and Managed tables . please follow the below link to get the queries https://askdoubts.com/question/list-of-hive-internal-tables-from-metadata/#comment-20
... View more
10-16-2019
05:07 AM
@Shu_ashu Thank you for the solution. I have got the issue resolved as it is working as expected.
... View more
10-14-2019
01:13 AM
@Shu_ashu Great!. With the instructions you have given me, the output file is created correctly. I also tried the option: CREATE TABLE AS scenariox_out AS SELECT select count (*) from scenariox; And the output file was created in: /user/hive/warehouse/scenariox.db/scenariox/scenariox_out/000000_0 Thank you. You have a good day
... View more
10-02-2019
06:03 PM
Hi All, I am doing a similar POC. We are trying to implement batch ingestion using NiFi. Problem statement: I am preparing a SQL query and put the query in the processor using REST API. But, I want to stop the processor group after the ingestion is done because for the next run I will put the query with update CDC column value. Can someone please help me with the logic of stopping the processor after the ingestion is done, because to modify the processor, it has to be stopped
... View more
09-25-2019
03:44 AM
Hi Vijay, Sorry, haven't able to nail down the cause yet, but can you collect EXPLAIN EXTENDED of the query and share the output as attachment to the post? EXPLAIN EXTENDED select * from tdb1.t1 where bs1_dt=2017-06-23; EXPLAIN EXTENDED select * from tdb1.t1; I would like to check how HS2 does the query plan and see if there is any clue. Cheers Eric
... View more
09-21-2019
10:04 AM
@budati For this case define your avro schema(with one field) to read incoming flowfile with some delimiter that doesn't exist in flowfile. So that whole row will be read as string then we can filter out the records by using not like (or) using regex operator in apache calicite. Select * from flowfile where col1 not like 'SKIP' Now output flowfile will not having any records that have SKIP in them and this solution will work dynamically for any number of columns.
... View more
09-19-2019
07:11 AM
1 Kudo
@budati i don't think there is a way to combine all 3 processors into one. We still need to use ExecuteSQL -> ConvertAvroToJson -> EvaluateJsonPath to extract the values from the flowfile. If the answer was helpful to resolve your issue, Accept the answer to close the thread 🙂
... View more
09-10-2019
07:59 AM
1 Kudo
Found the solution! Just needed to apply the regex (?:"b":.\w+?)(\d+) thanks to @Shu_ashu
... View more
09-09-2019
07:54 PM
@ANMAR Try with this regex in ExtractText processor. (?:"x":.\w+?)(\d+) This regex will extract only the digit in "x" key and adds that value for "y" key in ReplaceText processor.
... View more