error_message : You have exceeded your daily reque

[#1]

Hi, while running a Hive SQL group by query on few million rows I get a message in the results mixed with the output:

error_message : You have exceeded your daily reque

(xxxxxx row(s) affected)

results : []

this is mixed with some actual data output. Anyone has seen this error message?

[#2]

You can give that a try, however, I believe hive staging directory should not affect the result.

Have you used parquet-tools to analyze the data in the parquet file?

[#3]

No I am not sure how to use these tools. 

[#4 · Accepted solution]

If you are using CDH, you should already have parquet-tools command line available. If not, you can get it from here:
https://github.com/apache/parquet-mr/tree/master/parquet-tools

You just need to run:

parquet-tools cat /path/to/parquet-file.parq

Please note that the path is on local file system, not in HDFS.

And then you can grep the output to search for string "error_message".

[#5]

Thanks will try that and see.

[#6]

You are absolutely right! The fifth file 000004_0 in the parquet hive table directory had one string that matched the row value in the beeline SQL output. I am sure the other strings will also be in the data. So it finally confirms that everything is working fine without any errors in hive. Thanks for all your help as this really confused me but I did learn couple of new things so thanks again!!

$ parquet-tools cat 000004_0 | grep '(7256823 row(s) affected)'
triptype = (7256823 row(s) affected)

[#7]

Glad that we identified the issue!