Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

hive rest api : cannot query tables ?

avatar
Expert Contributor

Unable to query hive tables... was able to retrive the schema of tables, couldn't get the data of the table?

16 REPLIES 16

avatar

avatar
Expert Contributor

@Neeraj Sabharwal We have configured webhcat and is working fine to retrieve the schema http://<IP Address>:50111/templeton/v1/version/hive?user.name=hive result : {"module":"hive","version":"1.2.1.2.3.4.0-3485"} but while running a query to retrieve the data of a hive table , its throwing {

error: null;

}

avatar

avatar

@Krishna Srinivas Please see this...it's in my vm

Job is still running.

[hive@sandbox ~]$ curl -s -d execute="select+*+from+nstest;” \

> -d statusdir=“nstest.output" \

> 'http://localhost:50111/templeton/v1/hive?user.name=hive'

{"id":"job_1454999065989_0008"}[hive@sandbox ~]$

1970-screen-shot-2016-02-10-at-50927-am.png

avatar

avatar
Expert Contributor

@Neeraj Sabharwal Thanq for the detailed description and yes the jobs are getting initiated the same way, but am afraid couldn't get it from the google rest api client. How can we execute a query from rest api client, whenever am initiating its throwing

error:null

avatar

@Krishna Srinivas Do you have connectivity to cluster from google rest api? If connectivity is there then you are all set and if not then its bigger problem.

avatar
Expert Contributor

@Neeraj Sabharwal hiveexecutequery.png Please find the document, I am able to do the query but can't see the results from the API. My interest is an application using this api to pull the data

avatar

@Krishna Srinivas Your job got submitted and now , you need to access output from HDFS. Not possible to display data on screen yet...WIP

avatar
Explorer

Hello guys,

This is exaclty what I need, query a Hive Table and show results on screen, is it already implemented?

Thank you

avatar
Mentor

@Krishna Srinivas try webhcat

curl -s -d execute="select+*+from+sample_08;" \

-d statusdir="output" \

'http://localhost:50111/templeton/v1/hive?user.name=root'

# if you ls on the directory, it will have two files, stderr and stdout

hdfs dfs -ls output

# if the job succeeded, you can cat the stdout file and view the results

hdfs dfs -cat output/stdout

avatar
Expert Contributor

@Neeraj Sabharwal @Artem Ervits Hi , Have tried the same curl -s -d execute="select+*+from+table1;" -d statusdir="status" 'http://<IP add>:50111/templeton/v1/hive?user.name=hive' {"id":"job_1455079614548_0015"} Its showing as ID of job but the status directory is not getting creating in hdfs.

hdfs dfs -ls status ls: `status': No such file or directory

avatar
Mentor

Provide full path to sttus dir. "/user/username/status" @Krishna Srinivas

avatar
Expert Contributor

@Neeraj Sabharwal @Artem Ervits We have been referring to the URL

https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference but unfortunately its not too clear for executing queries using webhcat

avatar
New Contributor

I am also facing same problem, it returns job_id but on cluster these files are not created.

anyone able to resolve this ?

avatar
New Contributor

Hello guys,

2019 and i still have the same problem with hive api rest . I can successfully run the request :

hduser@master:~$ curl -s -d execute="select+*+from+mytable;" -d statusdir="/home/output" 'http://localhost:50111/templeton/v1/hive?user.name=HIVEU'

and when i want to display the job results :

hduser@master:~$ hdfs dfs -ls output

hduser@master:~$ ls: `output': No such file or directory


Can anyone please give some hepl !

Labels