Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi GetTwitter/PutFile Unreadable Characters

Highlighted

NiFi GetTwitter/PutFile Unreadable Characters

New Contributor

I setup a NiFi process which includes GetTwitter and PutFile. But noticed there are some unreadable characters in the output of PutFile on Linux.

Here are some example from one output: \u2026, \u003c, \u003e, etc

But these are actual readable characters in original twitter as: "...", "<", ">", etc.

Just curious how to deal with these unreadable characters. I would like these can be displayed as original characters.

Thanks.

Output from PutFile with unreadable characters:

{"created_at":"Mon Apr 23 20:58:28 +0000 2018","id":988522516141359104,"id_str":"988522516141359104","text":"RT @aliasvaughn: 18. And we see the results: trump ALWAYS does what is best for Putin and SCREAMS if sanctions are implemented. Most of the\u2026","source":"\u003ca href=\"http:\/\/twitter.com\/download\/iphone\" rel=\"nofollow\"\u003eTwitter for iPhone\u003c\/a\u003e","truncated":false,"in_reply_to_status_id":null,"in_reply_to_status_id_str":null,"in_reply_to_user_id":null,"in_reply_to_user_id_str":null,"in_reply_to_screen_name":null,"user":{"id":36771921,"id_str":"36771921","name":"lois mcdade","screen_name":"irishgilly","location":"Pacific North West","url":null,"description":"I am Trumps idea of an \" Alt Leftist without a permit\" Since the polite request hasn\u2019t worked, I WILL BLOCK U IF U ADD ME TO A LIST.","translator_type":"none","protected":false,"verified":false,"followers_count":5918,"friends_count":5889,"listed_count":12,"favourites_count":87934,"statuses_count":92432,"created_at":"Thu Apr 30 21:03:27 +0000 2009","utc_offset":-18000,"time_zone":"Quito","geo_enabled":true,"lang":"en","contributors_enabled":false,"is_translator":false,"profile_background_color":"EDECE9","profile_background_image_url":"http:\/\/abs.twimg.com\/images\/themes\/theme3\/bg.gif","profile_background_image_url_https":"https:\/\/abs.twimg.com\/images\/themes\/theme3\/bg.gif","profile_background_tile":false,"profile_link_color":"088253","profile_sidebar_border_color":"D3D2CF","profile_sidebar_fill_color":"E3E2DE","profile_text_color":"634047","profile_use_background_image":true,"profile_image_url":"http:\/\/pbs.twimg.com\/profile_images\/366207543\/twitterProfilePhoto_normal.jpg","profile_image_url_https":"https:\/\/pbs.twimg.com\/profile_images\/366207543\/twitterProfilePhoto_normal.jpg","default_profile":false,"

72410-putfileoutput.jpg

Related twitter data:

{ "created_at" : "Mon Apr 23 20:58:28 +0000 2018", "id" : 988522516141359104, "id_str" : "988522516141359104", "text" : "RT @aliasvaughn: 18. And we see the results: trump ALWAYS does what is best for Putin and SCREAMS if sanctions are implemented. Most of the…", "source" : "<a href=\"http://twitter.com/download/iphone\" rel=\"nofollow\">Twitter for iPhone</a>", "truncated" : false, "in_reply_to_status_id" : null, "in_reply_to_status_id_str" : null, "in_reply_to_user_id" : null, "in_reply_to_user_id_str" : null, "in_reply_to_screen_name" : null, "user" : { "id" : 36771921, "id_str" : "36771921", "name" : "lois mcdade", "screen_name" : "irishgilly", "location" : "Pacific North West", "url" : null, "description" : "I am Trumps idea of an \" Alt Leftist without a permit\" Since the polite request hasn’t worked, I WILL BLOCK U IF U ADD ME TO A LIST.", "translator_type" : "none", "protected" : false, "verified" : false, "followers_count" : 5918, "friends_count" : 5889, "listed_count" : 12, "favourites_count" : 87934, "statuses_count" : 92432, "created_at" : "Thu Apr 30 21:03:27 +0000 2009", "utc_offset" : -18000, "time_zone" : "Quito",