Member since
06-25-2015
14
Posts
1
Kudos Received
0
Solutions
06-13-2017
01:27 PM
Hi Team, From yarn I see some job is failing with the below error. Diagnostics: Exception from container-launch.
Container id: container_1497268223309_0295_02_000001
Exit code: 13
Stack trace: ExitCodeException exitCode=13:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:601)
at org.apache.hadoop.util.Shell.run(Shell.java:504)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 13
Failing this attempt. Failing the application. Thanks Chaitanya
... View more
06-13-2017
09:47 AM
Hi Team, I am getting connection while connecting the spark interpreter from Zeppelin error with Connection refused at, need some help on this. ERROR [2017-06-13 04:42:31,363] ({Thread-101} RemoteInterpreterEventPoller.java[run]:102) - Can't get RemoteInterpreterEvent org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:53) at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37) at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60) at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861) at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435) at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:92) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller.run(RemoteInterpreterEventPoller.java:100) Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.thrift.transport.TSocket.open(TSocket.java:187) at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51) ... 7 more Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at org.apache.thrift.transport.TSocket.open(TSocket.java:182) ZEPPELIN_CLASSPATH: ::/opt/cloudera/zeppelin-0.7.1-bin-all/lib/interpreter/*:/opt/cloudera/zeppelin-0.7.1-bin-all/lib/*:/opt/cloudera/zeppelin-0.7.1-bin-all/*::/opt/cloudera/zeppelin-0.7.1-bin-all/conf
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/cloudera/zeppelin-0.7.1-bin-all/lib/interpreter/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/zeppelin-0.7.1-bin-all/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
java.lang.reflect.InvocationTargetException
... View more
Labels:
- Labels:
-
Apache Zeppelin
04-18-2017
10:08 PM
1 Kudo
Hi Romainr , As suggested, I switch to new version of HUE 3.12. After changing the below character set, those are working as expected. Thanks for your suggestion. mysql> ALTER TABLE desktop_document2 modify column name varchar(255) CHARACTER SET utf8; Query OK, 4 rows affected (0.26 sec) Records: 4 Duplicates: 0 Warnings: 0 mysql> ALTER TABLE desktop_document2 modify column description longtext CHARACTER SET utf8; Query OK, 4 rows affected (0.16 sec) Records: 4 Duplicates: 0 Warnings: 0 mysql> ALTER TABLE desktop_document2 modify column search longtext CHARACTER SET utf8; Query OK, 4 rows affected (0.15 sec) Records: 4 Duplicates: 0 Warnings: 0 Regards Chaitanya
... View more
04-14-2017
05:20 AM
After restarting the NIFI entire flow running fine and getting data as expected. Thanks Chaitanya
... View more
04-12-2017
12:51 PM
@Ryan Cicak I followed procedure, but i am getting the handshake Exception and I made false "nifi.remote.input.secure" still didnt help. Please help me did I miss anything. 2017-04-12 06:13:50,696 INFO [StandardProcessScheduler Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled GetFile[id=616d3e3e-015b-1000-0000-000000000000] to run with 1 threads 2017-04-12 06:13:51,006 ERROR [Timer-Driven Process Thread-1] o.a.n.r.c.socket.EndpointConnectionPool EndpointConnectionPool[Cluster URL=http://hdf.hadoop.com:9090/nifi/] failed to communicate with Peer[url=nifi://namenode.hadoop.com:10000,CLOSED] due to org.apache.nifi.remote.exception.HandshakeException: org.apache.nifi.remote.exception.ProtocolException: Expected to receive ResponseCode, but the stream did not have a ResponseCode 2017-04-12 06:13:51,008 ERROR [Timer-Driven Process Thread-1] o.a.nifi.remote.StandardRemoteGroupPort RemoteGroupPort[name=from minifi,target=http://hdf.hadoop.com:9090/nifi/] failed to communicate with http://hdf.hadoop.com:9090/nifi/ due to org.apache.nifi.remote.exception.HandshakeException: org.apache.nifi.remote.exception.ProtocolException: Expected to receive ResponseCode, but the stream did not have a ResponseCode 2017-04-12 06:13:51,020 INFO [NiFi Site-to-Site Connection Pool Maintenance] o.apache.nifi.remote.client.PeerSelector org.apache.nifi.remote.client.PeerSelector@1656d5bc Successfully refreshed Peer Status; remote instance consists of 1 peers
2017-04-12 06:14:01,023 ERROR [Timer-Driven Process Thread-3] o.a.n.r.c.socket.EndpointConnectionPool EndpointConnectionPool[Cluster URL=http://hdf.hadoop.com:9090/nifi/] failed to communicate with Peer[url=nifi://namenode.hadoop.com:10000,CLOSED] due to org.apache.nifi.remote.exception.HandshakeException: org.apache.nifi.remote.exception.ProtocolException: Expected to receive ResponseCode, but the stream did not have a ResponseCode 2017-04-12 06:14:01,023 ERROR [Timer-Driven Process Thread-3] o.a.nifi.remote.StandardRemoteGroupPort RemoteGroupPort[name=from minifi,target=http://hdf.hadoop.com:9090/nifi/] failed to communicate with http://hdf.hadoop.com:9090/nifi/ due to org.apache.nifi.remote.exception.HandshakeException: org.apache.nifi.remote.exception.ProtocolException: Expected to receive ResponseCode, but the stream did not have a ResponseCode 2017-04-12 06:14:11,036 ERROR [Timer-Driven Process Thread-2] o.a.n.r.c.socket.EndpointConnectionPool EndpointConnectionPool[Cluster URL=http://hdf.hadoop.com:9090/nifi/] failed to communicate with Peer[url=nifi://namenode.hadoop.com:10000,CLOSED] due to org.apache.nifi.remote.exception.HandshakeException: org.apache.nifi.remote.exception.ProtocolException: Expected to receive ResponseCode, but the stream did not have a ResponseCode 2017-04-12 06:14:11,036 ERROR [Timer-Driven Process Thread-2] o.a.nifi.remote.StandardRemoteGroupPort RemoteGroupPort[name=from minifi,target=http://hdf.hadoop.com:9090/nifi/] failed to communicate with http://hdf.hadoop.com:9090/nifi/ due to org.apache.nifi.remote.exception.HandshakeException: org.apache.nifi.remote.exception.ProtocolException: Expected to receive ResponseCode, but the stream did not have a ResponseCode 2017-04-12 06:14:21,049 ERROR [Timer-Driven Process Thread-4] o.a.n.r.c.socket.EndpointConnectionPool EndpointConnectionPool[Cluster URL=http://hdf.hadoop.com:9090/nifi/] failed to communicate with Peer[url=nifi://namenode.hadoop.com:10000,CLOSED] due to org.apache.nifi.remote.exception.HandshakeException: org.apache.nifi.remote.exception.ProtocolException: Expected to receive ResponseCode, but the stream did not have a ResponseCode Thanks Chaitanya
... View more
04-11-2017
02:34 PM
Hi Team, I am trying to build site-to-site communication from Minifi to Nifi which is unsuccessful due to the parameters are overwrite and getting the error. could you pls help me on this and let me know did i miss anything. nifi.remote.input.host=192.168.245.105 nifi.remote.input.secure=false nifi.remote.input.socket.port=8022 nifi.remote.input.http.enabled=true nifi.remote.input.http.transaction.ttl=30 sec [root@namenode conf]# vi nifi.properties [root@namenode conf]# diff nifi.properties nifi.properties_bkp 29,34d28 < nifi.remote.input.host=192.168.245.105 < nifi.remote.input.secure=false < nifi.remote.input.socket.port= < nifi.remote.input.http.enabled=true < nifi.remote.input.http.transaction.ttl=30 sec < [root@namenode conf]# diff nifi.properties nifi.properties_bkp [root@namenode conf]# 2017-04-11 19:05:01,970 INFO [main] org.apache.nifi.minifi.MiNiFiServer Loading Flow... 2017-04-11 19:05:18,166 INFO [main] o.a.nifi.util.FileBasedVariableRegistry Loaded 92 properties from system properties and environment variables 2017-04-11 19:05:18,166 INFO [main] o.a.nifi.util.FileBasedVariableRegistry Loaded a total of 92 properties. Including precedence overrides effective accessible registry key size is 92 2017-04-11 19:05:18,389 INFO [main] o.a.n.p.MiNiFiPersistentProvenanceRepository Recovered records 2017-04-11 19:05:18,393 INFO [main] o.a.n.p.MiNiFiPersistentProvenanceRepository Created new Provenance Event Writers for events starting with ID 0 2017-04-11 19:05:18,397 INFO [main] o.a.n.c.repository.FileSystemRepository Initializing FileSystemRepository with 'Always Sync' set to false 2017-04-11 19:05:18,529 INFO [main] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@25290bca finished recovering records. Performing Checkpoint to ensure proper state of Partitions before updates 2017-04-11 19:05:18,529 INFO [main] org.wali.MinimalLockingWriteAheadLog Successfully recovered 0 records in 9 milliseconds 2017-04-11 19:05:18,543 INFO [main] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@25290bca checkpointed with 0 Records and 0 Swap Files in 14 milliseconds (Stop-the-world time = 5 milliseconds, Clear Edit Logs time = 6 millis), max Transaction ID -1 2017-04-11 19:05:18,566 INFO [main] o.apache.nifi.controller.FlowController Not enabling RAW Socket Site-to-Site functionality because nifi.remote.input.socket.port is not set 2017-04-11 19:05:18,567 INFO [main] o.apache.nifi.controller.FlowController Not enabling HTTP(S) Site-to-Site functionality because the 'nifi.remote.input.http.enabled' property is not true
2017-04-11 19:05:18,857 INFO [main] o.apache.nifi.controller.FlowController Successfully synchronized controller with proposed flow 2017-04-11 19:05:19,149 INFO [main] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@709ed6f3 finished recovering records. Performing Checkpoint to ensure proper state of Partitions before updates 2017-04-11 19:05:19,150 INFO [main] org.wali.MinimalLockingWriteAheadLog Successfully recovered 0 records in 179 milliseconds 2017-04-11 19:05:19,276 INFO [main] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@709ed6f3 checkpointed with 0 Records and 0 Swap Files in 126 milliseconds (Stop-the-world time = 64 milliseconds, Clear Edit Logs time = 51 millis), max Transaction ID -1 2017-04-11 19:05:19,285 INFO [main] o.a.n.c.r.WriteAheadFlowFileRepository Successfully restored 0 FlowFiles 2017-04-11 19:05:19,317 INFO [main] o.apache.nifi.controller.FlowController Starting 0 processors/ports/funnels 2017-04-11 19:05:19,317 INFO [main] o.apache.nifi.controller.FlowController Started 0 Remote Group Ports transmitting 2017-04-11 19:05:19,325 INFO [main] org.apache.nifi.minifi.MiNiFiServer Flow loaded successfully. 2017-04-11 19:05:19,327 INFO [main] org.apache.nifi.BootstrapListener Successfully initiated communication with Bootstrap 2017-04-11 19:05:19,328 INFO [main] org.apache.nifi.minifi.MiNiFi Controller initialization took 17357217758 nanoseconds. Thanks in advance Chaitanya
... View more
Labels:
- Labels:
-
Apache MiNiFi
-
Apache NiFi
04-09-2017
10:43 PM
Hi Romainr, This is i got from hue when accessing data by hive query editor but, I am able to get the result from hive cli as expected. " It might also be fixed in a more recent Hue" -- As infomed that there is fix in newer versions could you pls help me, how can I upgrade. I am using Hue 3.9 tarbal, Please help me how can I upgrade to new version, In additon to that please help me how can i get import the workflows,coordinatos and bundles in to new version of hue [ as i see 84 tables in the hue database and it is 78 earlier]. Thanks in advance Regards Chaitanya
... View more
04-06-2017
08:03 AM
Hi All, While running query in hive query editor from HUE I am getting the below error, tried changed the collation to UTF8 but still getting the same error. "Incorrect string value: '\xC5\x9F\xC4\xB1k ...' for column 'query' at row 1" Mysql version: 5.6 HUE version: 3.9 mysql> show table status like 'desktop_document2'; +-------------------+--------+---------+------------+------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+---- ---------+------------+-----------------+----------+----------------+---------+ | Name | Engine | Version | Row_format | Rows | Avg_row_length | Data_length | Max_data_length | Index_length | Data_free | Auto_increment | Create_time | Upd ate_time | Check_time | Collation | Checksum | Create_options | Comment | +-------------------+--------+---------+------------+------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+---- ---------+------------+-----------------+----------+----------------+---------+ | desktop_document2 | InnoDB | 10 | Compact | 94 | 39217 | 3686400 | 0 | 114688 | 4194304 | 50193 | 2017-04-06 16:56:23 | NUL L | NULL | utf8_general_ci | NULL | | | +-------------------+--------+---------+------------+------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+---- ---------+------------+-----------------+----------+----------------+---------+ 1 row in set (0.00 sec) Thanks Chaitanya
... View more
Labels:
- Labels:
-
Cloudera Hue
04-05-2017
04:33 AM
@Romainr could you pls help us in importing the existing workflows, coordinators and bundles, as we are running hue 3.9 currenlty and want to test hue 3.12 as i see there are quite good features add in and will move ahead to upgrade. thanks Chaitanya
... View more
03-30-2017
06:07 AM
@Matt Clarke After adding the property "nifi.security.encrypt.configuration.password" in Custom nifi-ambari-config it is working as expected. Thank you very much for your help. nifi.jpg Regards Chaitanya
... View more
