Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 10-12-2016 08:42 PM
I created a hive table as follows :
CREATE EXTERNAL TABLE tweetdata(created_at STRING,
text STRING,
person STRUCT<
screen_name:STRING,
name:STRING,
locations:STRING,
description:STRING,
created_at:STRING,
followers_count:INT,
url:STRING>
) ROW FORMAT SERDE 'com.cloudera.hive.serde.JSONSerDe' location '/user/flume/tweets';
but I am getting errors doing selecting
iam using HDP2.5
hive>
> describe tweetdata;
OK
created_at string from deserializer
text string from deserializer
person struct<screen_name:string,name:string,locations:string,description:string,created_at:string,followers_count:int,url:string> from deserializer
Time taken: 0.076 seconds, Fetched: 3 row(s)
hive> select person.name, text from tweetdata;
OK
Failed with exception java.io.IOException:org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
at [Source: java.io.StringReader@4668c5ea; line: 1, column: 2]
Time taken: 0.077 seconds
hive>
Created 10-12-2016 09:59 PM
I fixed this error by using another serde "org.openx.data.jsonserde.JsonSerDe "
Created 10-12-2016 08:52 PM
I just created an empty simple table with no structures and its showing the same behavior .what am I missing here?
Logging initialized using configuration in file:/etc/hive/2.5.0.0-1245/0/hive-log4j.properties
hive> create external table load_tweets(id BIGINT,text STRING)
> ROW FORMAT SERDE 'org.apache.hive.hcatalog.data.JsonSerDe'
> LOCATION '/user/flume/tweets';
OK
Time taken: 1.003 seconds
hive> describe load_tweets;
OK
id bigint from deserializer
text string from deserializer
Time taken: 0.268 seconds, Fetched: 2 row(s)
hive>
> ;
hive> select * from load_tweets;
OK
Failed with exception java.io.IOException:org.apache.hadoop.hive.serde2.SerDeException: org.codehaus.jackson.JsonParseException: Unexpected character ('O' (code 79)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
at [Source: java.io.ByteArrayInputStream@5b8402e0; line: 1, column: 2]
Time taken: 1.386 seconds
hive>
Created 10-12-2016 09:59 PM
I fixed this error by using another serde "org.openx.data.jsonserde.JsonSerDe "