Member since
10-17-2016
45
Posts
10
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1276 | 04-21-2017 06:14 PM | |
4831 | 04-19-2017 05:59 PM | |
1133 | 04-11-2017 08:24 PM |
04-21-2017
06:15 PM
Deployed latest versions and able to access required hive processors.
... View more
04-21-2017
06:14 PM
Closed issue with data error.
... View more
04-19-2017
05:59 PM
1 Kudo
Thanks @Timothy Spann. Looked at your comments just now after i did some modifications to existing nar file. I edited the current ScanAttribute file to iterate the dictionary words and check for its presence in twitter message. Customizing is good and look forward to make more solutions integrated into NiFi.
... View more
04-19-2017
03:47 PM
1 Kudo
@Timothy Spann : Greetings. I need your assistance in customizing processor - ScanAttribute. Flow file data considering it as tweet_msg attribute needs to be checked if it contains dictionary file words.
... View more
04-17-2017
05:45 PM
1 Kudo
ScanAttribute processor works fine for matching exact value and not substring of attribute value. I looked into the code {{if (dictionary.contains(entry.getValue())) }} which means matching condition if dictionary words contain any of attribute words. In my case attribute is a tweet - collection of words and would fail all as unmatched. Need to look at a logic to see if attribute : tweet (collection of words) contain dictionary words. Customization of processor or other ways of extract text from tweet attribute.
... View more
04-11-2017
08:24 PM
Resolved Solution Steps * Firewall restriction removal * Twitter Credentials regeneration * Restart of NIFI deleting provenance repository * Ensured NTP server is sync Worked fine.
... View more
04-11-2017
04:04 PM
NiFi processor - GetTwitter with correct twitter credentials (Consumer Key, Consumer secret, Access token, Access token secret) is not working. Throws error : Received error HTTP_ERROR: HTTP/1.1 401 Authorization Required. Will attempt to reconnect. It used to work fine for me in different environments. I have checked with network team on port blocks earlier and resolved Failed to establish Connection error. I tried multiple times of regenerating keys and updating the processor but still same error. Please advice.
... View more
Labels:
- Labels:
-
Apache NiFi
01-19-2017
04:38 PM
1 Kudo
Hi. Considering a spark sql or data set with 400 columns and 1 million rows. Not all rows have all 400 columns populated and essentially they cant be as not null columns as well. Need to understand if null value consumes space in memory and if so how much does it take. Do we have any fact sheet or article of all data types size in bytes or bits.
... View more
Labels:
- Labels:
-
Apache Spark
12-20-2016
11:00 PM
@Timothy Spann :: Whats missing in zeppelin version of Hortonworks sandbox 2.4 on azure causing this error.
... View more