Reply
Cloudera Employee
Posts: 211
Registered: ‎03-23-2015

Re: error_message : You have exceeded your daily reque

You can give that a try, however, I believe hive staging directory should not affect the result.

Have you used parquet-tools to analyze the data in the parquet file?
Contributor
Posts: 44
Registered: ‎09-14-2017

Re: error_message : You have exceeded your daily reque

No I am not sure how to use these tools. 

Cloudera Employee
Posts: 211
Registered: ‎03-23-2015

Re: error_message : You have exceeded your daily reque

If you are using CDH, you should already have parquet-tools command line available. If not, you can get it from here:
https://github.com/apache/parquet-mr/tree/master/parquet-tools

You just need to run:

parquet-tools cat /path/to/parquet-file.parq

Please note that the path is on local file system, not in HDFS.

And then you can grep the output to search for string "error_message".

Contributor
Posts: 44
Registered: ‎09-14-2017

Re: error_message : You have exceeded your daily reque

Thanks will try that and see.

Contributor
Posts: 44
Registered: ‎09-14-2017

Re: error_message : You have exceeded your daily reque

You are absolutely right! The fifth file 000004_0 in the parquet hive table directory had one string that matched the row value in the beeline SQL output. I am sure the other strings will also be in the data. So it finally confirms that everything is working fine without any errors in hive. Thanks for all your help as this really confused me but I did learn couple of new things so thanks again!!

 

$ parquet-tools cat 000004_0 | grep '(7256823 row(s) affected)'
triptype = (7256823 row(s) affected)

 

 

Highlighted
Cloudera Employee
Posts: 211
Registered: ‎03-23-2015

Re: error_message : You have exceeded your daily reque

Glad that we identified the issue!
Announcements