Member since
04-28-2016
46
Posts
8
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
8263 | 11-03-2017 11:04 AM | |
6895 | 06-16-2016 09:19 AM | |
2247 | 05-20-2016 09:42 AM | |
1751 | 05-13-2016 12:26 PM | |
3458 | 05-10-2016 10:06 AM |
05-13-2016
12:26 PM
1 Kudo
The issue is with the role size and it has been resolved afterchanging the rollsize in the twitter conf file as below. TwitterAgent.sinks.HDFS.hdfs.rollsize=67100884
... View more
05-12-2016
05:45 AM
@Timothy Spann Flume version : 1.6.0 installed in HDP 2.4 using Ambari 2.2.1 Twitter messages are looking normal JSON. I changed JAVA_OPTS value also but no luck. mapreduce.map.java.opts is -Xmx1228m if i increase it is coming back to default automatically. Please suggest. Thanks in advance.!
... View more
05-11-2016
01:05 PM
Getting "Twitter4J Async Dispatcher[0]" java.lang.OutOfMemoryError: Java heap space while streaming data from Twitter ERROR channel.ChannelProcessor: Error while writing to required channel: FileChannel FileChannel { dataDirs: [/var/log/flume/data] }
java.lang.OutOfMemoryError: Java heap space
at com.google.protobuf.ByteString.copyFrom(ByteString.java:192)
at com.google.protobuf.ByteString.copyFrom(ByteString.java:204)
at org.apache.flume.channel.file.Put.writeProtos(Put.java:89)
at org.apache.flume.channel.file.TransactionEventRecord.toByteBuffer(TransactionEventRecord.java:174)
at org.apache.flume.channel.file.Log.put(Log.java:642)
at org.apache.flume.channel.file.FileChannel$FileBackedTransaction.doPut(FileChannel.java:468)
at org.apache.flume.channel.BasicTransactionSemantics.put(BasicTransactionSemantics.java:93)
at org.apache.flume.channel.BasicChannelSemantics.put(BasicChannelSemantics.java:80)
at org.apache.flume.channel.ChannelProcessor.processEvent(ChannelProcessor.java:265)
at org.apache.flume.source.twitter.TwitterSource.onStatus(TwitterSource.java:173)
at twitter4j.StatusStreamImpl.onStatus(StatusStreamImpl.java:75)
at twitter4j.StatusStreamBase$1.run(StatusStreamBase.java:114)
at twitter4j.internal.async.ExecuteThread.run(DispatcherImpl.java:116)
Exception in thread "Twitter4J Async Dispatcher[0]" java.lang.OutOfMemoryError: Java heap space
at com.google.protobuf.ByteString.copyFrom(ByteString.java:192)
at com.google.protobuf.ByteString.copyFrom(ByteString.java:204)
at org.apache.flume.channel.file.Put.writeProtos(Put.java:89)
at org.apache.flume.channel.file.TransactionEventRecord.toByteBuffer(TransactionEventRecord.java:174)
at org.apache.flume.channel.file.Log.put(Log.java:642)
at org.apache.flume.channel.file.FileChannel$FileBackedTransaction.doPut(FileChannel.java:468)
at org.apache.flume.channel.BasicTransactionSemantics.put(BasicTransactionSemantics.java:93)
at org.apache.flume.channel.BasicChannelSemantics.put(BasicChannelSemantics.java:80)
at org.apache.flume.channel.ChannelProcessor.processEvent(ChannelProcessor.java:265)
at org.apache.flume.source.twitter.TwitterSource.onStatus(TwitterSource.java:173)
at twitter4j.StatusStreamImpl.onStatus(StatusStreamImpl.java:75)
at twitter4j.StatusStreamBase$1.run(StatusStreamBase.java:114)
at twitter4j.internal.async.ExecuteThread.run(DispatcherImpl.java:116)
... View more
Labels:
- Labels:
-
Apache Flume
05-10-2016
10:06 AM
1 Kudo
@Predrag Minovic This issue has been fixed after removing interactive from /usr/hdp/current/hbase-master/bin/hirb in line no.134 Thanks for all your help 🙂
... View more
05-10-2016
08:56 AM
In debug mode also same issue. Zookeeper server and clients are up and running in all 3 nodes. Service check for Hbase failed.
... View more
05-10-2016
07:28 AM
@Predrag Minovic Same issue in debug mode also.
Service check for Zookeeper succeeded. But service check for Hbase failed with the below error log. stderr:
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/service_check.py", line 88, in <module>
HbaseServiceCheck().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/service_check.py", line 84, in service_check
logoutput = True
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 121, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 238, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of ' /usr/hdp/current/hbase-client/bin/hbase --config /usr/hdp/current/hbase-client/conf shell /var/lib/ambari-agent/tmp/hbase-smoke.sh && /var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh /usr/hdp/current/hbase-client/conf ida8c0a001_date491016 /usr/hdp/current/hbase-client/bin/hbase' returned 1. ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
stdout:
2016-05-10 12:49:23,216 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2016-05-10 12:49:23,230 - File['/var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh'] {'content': StaticFile('hbaseSmokeVerify.sh'), 'mode': 0755}
2016-05-10 12:49:23,243 - Writing File['/var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh'] because it doesn't exist
2016-05-10 12:49:23,244 - Changing permission for /var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh from 644 to 755
2016-05-10 12:49:23,262 - File['/var/lib/ambari-agent/tmp/hbase-smoke.sh'] {'content': Template('hbase-smoke.sh.j2'), 'mode': 0755}
2016-05-10 12:49:23,263 - Writing File['/var/lib/ambari-agent/tmp/hbase-smoke.sh'] because it doesn't exist
2016-05-10 12:49:23,264 - Changing permission for /var/lib/ambari-agent/tmp/hbase-smoke.sh from 644 to 755
2016-05-10 12:49:23,265 - Execute[' /usr/hdp/current/hbase-client/bin/hbase --config /usr/hdp/current/hbase-client/conf shell /var/lib/ambari-agent/tmp/hbase-smoke.sh && /var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh /usr/hdp/current/hbase-client/conf ida8c0a001_date491016 /usr/hdp/current/hbase-client/bin/hbase'] {'logoutput': True, 'tries': 6, 'user': 'ambari-qa', 'try_sleep': 5}
ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
2016-05-10 12:49:30,579 - Retrying after 5 seconds. Reason: Execution of ' /usr/hdp/current/hbase-client/bin/hbase --config /usr/hdp/current/hbase-client/conf shell /var/lib/ambari-agent/tmp/hbase-smoke.sh && /var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh /usr/hdp/current/hbase-client/conf ida8c0a001_date491016 /usr/hdp/current/hbase-client/bin/hbase' returned 1. ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
2016-05-10 12:49:42,468 - Retrying after 5 seconds. Reason: Execution of ' /usr/hdp/current/hbase-client/bin/hbase --config /usr/hdp/current/hbase-client/conf shell /var/lib/ambari-agent/tmp/hbase-smoke.sh && /var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh /usr/hdp/current/hbase-client/conf ida8c0a001_date491016 /usr/hdp/current/hbase-client/bin/hbase' returned 1. ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
2016-05-10 12:49:54,597 - Retrying after 5 seconds. Reason: Execution of ' /usr/hdp/current/hbase-client/bin/hbase --config /usr/hdp/current/hbase-client/conf shell /var/lib/ambari-agent/tmp/hbase-smoke.sh && /var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh /usr/hdp/current/hbase-client/conf ida8c0a001_date491016 /usr/hdp/current/hbase-client/bin/hbase' returned 1. ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
2016-05-10 12:50:06,916 - Retrying after 5 seconds. Reason: Execution of ' /usr/hdp/current/hbase-client/bin/hbase --config /usr/hdp/current/hbase-client/conf shell /var/lib/ambari-agent/tmp/hbase-smoke.sh && /var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh /usr/hdp/current/hbase-client/conf ida8c0a001_date491016 /usr/hdp/current/hbase-client/bin/hbase' returned 1. ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
2016-05-10 12:50:18,559 - Retrying after 5 seconds. Reason: Execution of ' /usr/hdp/current/hbase-client/bin/hbase --config /usr/hdp/current/hbase-client/conf shell /var/lib/ambari-agent/tmp/hbase-smoke.sh && /var/lib/ambari-agent/tmp/hbaseSmokeVerify.sh /usr/hdp/current/hbase-client/conf ida8c0a001_date491016 /usr/hdp/current/hbase-client/bin/hbase' returned 1. ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134
ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134 Any help would be appreciated !
... View more
05-10-2016
06:56 AM
@vpoornalingam @Jitendra Yadav @Pranay Vyas Any suggestion on this please. Thanks in advance!
... View more
05-10-2016
06:37 AM
1 Kudo
while opening Hbase shell from command line as below [hbase$host ~] $ hbase shell getting below error.
ArgumentError: wrong number of arguments (3 for 2)
(root) at /usr/hdp/2.4.0.0-169/hbase/bin/hirb.rb:134 Please advise on this.
... View more
Labels:
05-09-2016
11:58 AM
@vpoornalingam Thank you so much for the help sir. I have done the re-installation as you suggested. Additionally i have downloaded the jar files and placed inside the /usr/hdp/current/hbase/lib folder. the issue is fixed. Hbase master is up and running. thank you very much for the help.
... View more
05-09-2016
11:44 AM
@Jitendra Yadav Thank you for the quick help. I am able to find the HBASE_CLASSPATH inside hbase-env.sh file
... View more
- « Previous
- Next »