Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

Hive not responding for Twitter analysis

Re: Hive not responding for Twitter analysis

Contributor

I already added this jar in hive/lib.

and also while creating and analyzing the table in hive editor I am adding the jar via ADD jar /usr/lib/hive/lib/hive-serdes-1.0-SNAPSHOT.jar

 

Thanks,

Syam.

Re: Hive not responding for Twitter analysis

Champion

Could you share your json raw data

Re: Hive not responding for Twitter analysis

Contributor

Hi Guna,

 

This is the format of data which is streaming into the HDFS via flume

file name - flume.14789706789

 

Objavro.schemaä {"type":"record","name":"Doc","doc":"adoc","fields":[{"name":"id","type":"string"},{"name":"user_friends_count","type":["int","null"]},{"name":"user_location","type":["string","null"]},{"name":"user_description","type":["string","null"]},{"name":"user_statuses_count","type":["int","null"]},{"name":"user_followers_count","type":["int","null"]},{"name":"user_name","type":["string","null"]},{"name":"user_screen_name","type":["string","null"]},{"name":"created_at","type":["string","null"]},{"name":"text","type":["string","null"]},{"name":"retweet_count","type":["long","null"]},{"name":"retweeted","type":["boolean","null"]},{"name":"in_reply_to_user_id","type":["long","null"]},{"name":"source","type":["string","null"]},{"name":"in_reply_to_status_id","type":["long","null"]},{"name":"media_url_https","type":["string","null"]},{"name":"expanded_url","type":["string","null"]}]} × ®'!2§­Ú‘2ð·¢$799507499485372416 ˆ 台灣 –挖糧及偷窺用帳號
FGO、メルスト、Maplestory和刀劍亂舞坑底。
台灣人です,日本語下手すみません
18↑です †1 8 Aka live300730 (2016-11-18T02:00:16Z vRT @shoko55mmts: えっ、、、、 https://t.co/DEVgNO3teA   ¨<a href="http://twitter.com/download/android" rel="nofollow">Twitter for Android</a>  ^https://pbs.twimg.com/media/CxgQ35jUUAA2W2e.jpg €http://twitter.com/shoko55mmts/status/799407505453379584/photo/1$799507499468673025 ° "Noel Roeim Fisher di just want everybody here to know i'm **bleep**ing *** ô‚
è moe gayevak (2016-11-18T02:00:16Z <ENOUGH https://t.co/2GU0rQksZY  ¤<a href="http://twitter.com/download/iphone" rel="nofollow">Twitter for iPhone</a> $799507503683956737 ” Z好きなことだけ 主にRTしてます。 € N Masami masami_msm71 (2016-11-18T02:00:17Z ŒRT @nankuru28: ダンナの単身赴任先の博多で「中洲のママさんと会うんだ~」って私の話を娘は「修羅場?どうしよう?!」って思ったらしい。「楽しく飲んできた!!」って聞いて「この女に恋愛と結婚の相談はしない」って心に固く誓ったそうだ(^◇^)甲羅のサイズが違い過ぎて無理…   ¨<a href="http://twitter.com/download/android" rel="nofollow">Twitter for Android</a> × ®'!2§­Ú‘2ð·

 

 

Thanks,

Syam.

Highlighted

Re: Hive not responding for Twitter analysis

Explorer

Hello

I have the same problem , the files that flume is writing have the next format:

Objavro.schemaä {"type":"record","name":"Doc","doc":"adoc","fields":[{"name":"id","type":"string"},{"name":"user_friends_count","type":["int","null"]},{"name":"user_location","type":["string","null"]},{"name":"user_description","type":["string","null"]},{"name":"user_statuses_count","type":["int","null"]},{"name":"user_followers_count","type":["int","null"]},{"name":"user_name","type":["string","null"]},{"name":"user_screen_name","type":["string","null"]},{"name":"created_at","type":["string","null"]},{"name":"text","type":["string","null"]},{"name":"retweet_count","type":["long","null"]},{"name":"retweeted","type":["boolean","null"]},{"name":"in_reply_to_user_id","type":["long","null"]},{"name":"source","type":["string","null"]},{"name":"in_reply_to_status_id","type":["long","null"]},{"name":"media_url_https","type":["string","null"]},{"name":"expanded_url","type":["string","null"]}]} ÄSܸf8ê°T£bn]ºgð&1040215149905412097 Ö *Volta Redonda, Brasil r20 / flamenguista / futuro policial rodoviário federal / ’” Þ Teixeira nycollasbt (2018-09-13T14:26:32Z ^@dudacurtii Estudar nem da futuro Maria Eduarda ü²øÙ ¤<a href="http://twitter.com/download/iphone" rel="nofollow">Twitter for iPhone</a> €À¾Ä‚ËïÄSܸf8ê°T£bn]ºg
Objavro.schemaä {"type":"record","name":"Doc","doc":"adoc","fields":[{"name":"id","type":"string"},{-13T14:26:32Z ìRT @FOR_yangsejong: 180912

 

How can i read this file with hive?

thanks 

regards

Re: Hive not responding for Twitter analysis

Champion

Untitled.pngUntitledA.png