Saving output of impala query to hdfs

gimp077 — Fri, 16 Sep 2022 12:53:55 GMT

Is it possible to save the output of an impala query to hdfs .

Sample query

impala-shell --ssl -i "${load_balancer}" -f  "${2}" -o "${3}"

Would like to have it saved not to local but to hdfs.

Thanks

Re: Saving output of impala query to hdfs

AcharkiMed — Tue, 27 Feb 2018 12:43:16 GMT

Hi @gimp077

I think there is two ways to do it:

1- You can put the output of impala-query in HDFS after you get it in a system file with PUT HDFS command:

sudo -u hdfs hdfs dfs -put "${3}" hdfs_path

2- You can use a directe insert into a result_table (stored in HDFS) just before your select statement:

INSERT INTO result_tables YOUR_QUERY

question Re: Saving output of impala query to hdfs in Archives of Support Questions (Read Only)

Saving output of impala query to hdfs

Re: Saving output of impala query to hdfs