Reply
Champion
Posts: 746
Registered: ‎05-16-2016

Re: Hive not responding for Twitter analysis

[ Edited ]

Could you verify your hive/lib folder whether you have the  hive-serdes-1.0-SNAPSHOT.jar , if not please download it and add it and please excute the select statement. 

Contributor
Posts: 49
Registered: ‎07-26-2016

Re: Hive not responding for Twitter analysis

I already added this jar in hive/lib.

and also while creating and analyzing the table in hive editor I am adding the jar via ADD jar /usr/lib/hive/lib/hive-serdes-1.0-SNAPSHOT.jar

 

Thanks,

Syam.

Champion
Posts: 746
Registered: ‎05-16-2016

Re: Hive not responding for Twitter analysis

Could you share your json raw data

Contributor
Posts: 49
Registered: ‎07-26-2016

Re: Hive not responding for Twitter analysis

[ Edited ]

Hi Guna,

 

This is the format of data which is streaming into the HDFS via flume

file name - flume.14789706789

 

Objavro.schemaä {"type":"record","name":"Doc","doc":"adoc","fields":[{"name":"id","type":"string"},{"name":"user_friends_count","type":["int","null"]},{"name":"user_location","type":["string","null"]},{"name":"user_description","type":["string","null"]},{"name":"user_statuses_count","type":["int","null"]},{"name":"user_followers_count","type":["int","null"]},{"name":"user_name","type":["string","null"]},{"name":"user_screen_name","type":["string","null"]},{"name":"created_at","type":["string","null"]},{"name":"text","type":["string","null"]},{"name":"retweet_count","type":["long","null"]},{"name":"retweeted","type":["boolean","null"]},{"name":"in_reply_to_user_id","type":["long","null"]},{"name":"source","type":["string","null"]},{"name":"in_reply_to_status_id","type":["long","null"]},{"name":"media_url_https","type":["string","null"]},{"name":"expanded_url","type":["string","null"]}]} × ®'!2§­Ú‘2ð·¢$799507499485372416 ˆ 台灣 –挖糧及偷窺用帳號
FGO、メルスト、Maplestory和刀劍亂舞坑底。
台灣人です,日本語下手すみません
18↑です †1 8 Aka live300730 (2016-11-18T02:00:16Z vRT @shoko55mmts: えっ、、、、 https://t.co/DEVgNO3teA   ¨<a href="http://twitter.com/download/android" rel="nofollow">Twitter for Android</a>  ^https://pbs.twimg.com/media/CxgQ35jUUAA2W2e.jpg €http://twitter.com/shoko55mmts/status/799407505453379584/photo/1$799507499468673025 ° "Noel Roeim Fisher di just want everybody here to know i'm **bleep**ing *** ô‚
è moe gayevak (2016-11-18T02:00:16Z <ENOUGH https://t.co/2GU0rQksZY  ¤<a href="http://twitter.com/download/iphone" rel="nofollow">Twitter for iPhone</a> $799507503683956737 ” Z好きなことだけ 主にRTしてます。 € N Masami masami_msm71 (2016-11-18T02:00:17Z ŒRT @nankuru28: ダンナの単身赴任先の博多で「中洲のママさんと会うんだ~」って私の話を娘は「修羅場?どうしよう?!」って思ったらしい。「楽しく飲んできた!!」って聞いて「この女に恋愛と結婚の相談はしない」って心に固く誓ったそうだ(^◇^)甲羅のサイズが違い過ぎて無理…   ¨<a href="http://twitter.com/download/android" rel="nofollow">Twitter for Android</a> × ®'!2§­Ú‘2ð·

 

 

Thanks,

Syam.

Highlighted
Explorer
Posts: 6
Registered: ‎04-27-2018

Re: Hive not responding for Twitter analysis

Hello

I have the same problem , the files that flume is writing have the next format:

Objavro.schemaä {"type":"record","name":"Doc","doc":"adoc","fields":[{"name":"id","type":"string"},{"name":"user_friends_count","type":["int","null"]},{"name":"user_location","type":["string","null"]},{"name":"user_description","type":["string","null"]},{"name":"user_statuses_count","type":["int","null"]},{"name":"user_followers_count","type":["int","null"]},{"name":"user_name","type":["string","null"]},{"name":"user_screen_name","type":["string","null"]},{"name":"created_at","type":["string","null"]},{"name":"text","type":["string","null"]},{"name":"retweet_count","type":["long","null"]},{"name":"retweeted","type":["boolean","null"]},{"name":"in_reply_to_user_id","type":["long","null"]},{"name":"source","type":["string","null"]},{"name":"in_reply_to_status_id","type":["long","null"]},{"name":"media_url_https","type":["string","null"]},{"name":"expanded_url","type":["string","null"]}]} ÄSܸf8ê°T£bn]ºgð&1040215149905412097 Ö *Volta Redonda, Brasil r20 / flamenguista / futuro policial rodoviário federal / ’” Þ Teixeira nycollasbt (2018-09-13T14:26:32Z ^@dudacurtii Estudar nem da futuro Maria Eduarda ü²øÙ ¤<a href="http://twitter.com/download/iphone" rel="nofollow">Twitter for iPhone</a> €À¾Ä‚ËïÄSܸf8ê°T£bn]ºg
Objavro.schemaä {"type":"record","name":"Doc","doc":"adoc","fields":[{"name":"id","type":"string"},{-13T14:26:32Z ìRT @FOR_yangsejong: 180912

 

How can i read this file with hive?

thanks 

regards

Announcements