About Shu_ashu

Shu_ashu · ‎06-25-2019

@Juhyeon Yun Configure directory as /user/paxata/job and keep recursive sub directories to true will list all the files in the sub directories. Similar question reported in this HCC thread.

ask_bill_brooks · ‎06-18-2019

The above question and the reply thread below was originally posted in the Community Help Track. On Tue Jun 18 03:04 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself.

Shu_ashu · ‎06-11-2019

@jingyong zou The issue is with the flowfile format that is passed through the processor. As ConvertAvroToJson processor accepts only Avro format but i think you are passing Json format to the processor which is causing java.io.IOException: Not a data file error.

Shu_ashu · ‎06-05-2019

@3nomis ConvertRecord processor is still running as we can see running threads as one at top right corner of the processor. If it is running for ever (or) you are not convinced with performance then you can try splitting the 2GB file into smaller chunks by using SplitRecord processor then use MergeRecord processor to merge them back by using Defragment as merge strategy.

Shu_ashu · ‎06-04-2019

@Haijin Li Try with this and this approaches and also to test out the regex serde functionality, Create new file using vi editor in shell and move it to HDFS directory and create table on top of this directory.

ask_bill_brooks · ‎06-04-2019

The above querstion and the entire reply thread below was originally posted in the Community Help Track. On Tue Jun 4 03:55 UTC 2019, a member of the HCC moderation staff moved it to the Data Processing track. The Community Help Track is intended for questions about using the HCC site itself.

negiraj1989 · ‎05-02-2019

Thanks @Shu I had done the same in my case with some minor modifications.

bsivalingam83 · ‎04-29-2019

@Shu I have the read/write permissions to the config and creds files for NiFi user while setting the AWS CLI on the nifi nodes...

Shu_ashu · ‎04-20-2019

@James Fowler We need to use ReplaceText processor after GenerateTableFetch processor and replace select * with: select col1, UCR_COST_IN_$ as UCR_COST_IN from table //replace * with column names and add an alias

Mahendiran_P · ‎04-25-2019

Thanks, Shu.. It is working now

Online	Offline
Last Visited	‎04-04-2021 06:38 PM

Member Since	‎06-08-2017 08:15 PM
Last Visited	‎04-04-2021 06:38 PM
Posts	1,049
Kudos received	516

Cloudera Community

Re: Get column values in comma separated value

Re: nifi Json data using routeonattributeto to spl...

Re: HIVE MANAGED TABLE

Re: CSV file with Duplicate Headers

Re: NIFI - SQL Server Lookup

Re: NIFI: HDFS how to get files under multiple dir...

Re: DetectDuplicate error "unable to communicate ...

Re: NIFI ConvertAvroToJSON java.io.IOException: No...

Re: Nifi Convert Json to Parquet

Re: Create a hive table upon a fixed-width log fil...

Re: Count(*) not working on Hbase mapped Hive Tab...

Re: array response is having escape character

Re: AWS Comprehend API CLI command using NiFi

Re: Column name with Special Character ($) and (#)...

Re: SPARK HIVE - Parquet and Snappy format - Table...