Member since
01-27-2016
46
Posts
40
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1888 | 10-24-2016 05:39 PM | |
1518 | 03-30-2016 06:02 PM | |
2471 | 02-28-2016 04:37 PM | |
4757 | 02-07-2016 07:57 AM |
02-23-2016
06:07 PM
1 Kudo
btw I am using a Postgres DB for oozie if that matters by any means ...
... View more
02-23-2016
06:05 PM
1 Kudo
No, unfortunately falcon never worked, oozie though is up and running ...
... View more
02-23-2016
06:03 PM
1 Kudo
Did a delete of the Falcon service already several times (through curl commands) .... delete worked but after reinstall no change ... any other advise? btw ... all other services are running well by now 🙂
... View more
02-23-2016
05:33 PM
2 Kudos
Dear Experts, I am trying to start Falcon on my cluster (HDP-2.3.4.0-3485, Ambari 2.2), but unfortunately it doesn't start up I get the following message in the ambari error log: ----- Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/FALCON/0.5.0.2.1/package/scripts/falcon_server.py", line 165, in <module>
FalconServer().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute
File "/var/lib/ambari-agent/cache/common-services/FALCON/0.5.0.2.1/package/scripts/falcon_server.py", line 46, in start
self.configure(env, upgrade_type=upgrade_type)
File "/var/lib/ambari-agent/cache/common-services/FALCON/0.5.0.2.1/package/scripts/falcon_server.py", line 41, in configure
falcon('server', action='config', upgrade_type=upgrade_type)
File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
return fn(*args, **kwargs)
File "/var/lib/ambari-agent/cache/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py", line 86, in falcon
owner = params.falcon_user)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/__init__.py", line 94, in find_provider
ImportError: No module named properties_file ----- Checking the /var/log/falcon directory for logs the directory unfortunately is empty ... Any hint is appreciated! Thanks & br, Rainer
... View more
Labels:
- Labels:
-
Apache Falcon
02-07-2016
07:57 AM
Dear All, I found the solution to the problem ... zookeeper has to be installed on the nodes the supervisors are running on ... why that is? I don't know ... thanks for your support!
... View more
02-06-2016
09:55 PM
1 Kudo
I am getting into it ... 🙂
... View more
02-06-2016
09:55 PM
1 Kudo
http://hortonworks.com/hadoop-tutorial/simulating-transporting-realtime-events-stream-apache-kafka/#section_4
... View more
02-06-2016
09:52 PM
1 Kudo
storm.zookeeper.servers in the storm config is set to my three servers running zookeeper (as per Ambaris default) so unfortunately this isn't the solution 😞
... View more
02-06-2016
08:31 PM
1 Kudo
Thanks Neeraj, though I don't understand the following: my storm nimbus is installed and running on a node where zookeeper is running on default port 2181. As I am using the storm topology from the tutorial (and I assume the topology is running from the nimbus node) does that mean the zookeeper address is somewhat hardcoded in the topology? ... I deployed the topology though from a node where zookeeper is not running (if that matters) ... As I am just starting with Storm playing around I might just have a lack of understanding for how things working together, so sorry for that!
... View more
02-06-2016
06:54 PM
1 Kudo
Dear All, just trying to run the tutorial and everything works fine until I start the Kafka Producer.
My Setup: HDP-2.3.4.0-3485 on a 3N Yarn Setup I am getting the following error in the k-event-processor-3-1454777987-worker-6700.log
2016-02-06 17:28:05.220 o.a.z.ZooKeeper [INFO] Client environment:java.io.tmpdir=/tmp
2016-02-06 17:28:05.220 o.a.z.ZooKeeper [INFO] Client environment:java.compiler=<NA>
2016-02-06 17:28:05.220 o.a.z.ZooKeeper [INFO] Client environment:os.name=Linux
2016-02-06 17:28:05.220 o.a.z.ZooKeeper [INFO] Client environment:os.arch=amd64
2016-02-06 17:28:05.220 o.a.z.ZooKeeper [INFO] Client environment:os.version=3.10.0-229.14.1.el7.x86_64
2016-02-06 17:28:05.220 o.a.z.ZooKeeper [INFO] Client environment:user.name=storm
2016-02-06 17:28:05.220 o.a.z.ZooKeeper [INFO] Client environment:user.home=/home/storm
2016-02-06 17:28:05.220 o.a.z.ZooKeeper [INFO] Client environment:user.dir=/home/storm
2016-02-06 17:28:05.221 o.a.z.ZooKeeper [INFO] Initiating client connection, connectString=.....:2181,....:2181,....:2181, sessionTimeout=20000 watcher=org.apache.curator.ConnectionState@209d0f1c
2016-02-06 17:28:05.283 o.a.c.f.i.CuratorFrameworkImpl [INFO] Starting
2016-02-06 17:28:05.286 o.a.z.ClientCnxn [INFO] Opening socket connection to server .....:2181. Will not attempt to authenticate using SASL (unknown error)
2016-02-06 17:28:05.286 o.a.z.ZooKeeper [INFO] Initiating client connection, connectString=localhost sessionTimeout=20000 watcher=org.apache.curator.ConnectionState@33745cd
2016-02-06 17:28:05.287 o.a.z.ClientCnxn [INFO] Socket connection established to .....:2181, initiating session
2016-02-06 17:28:05.318 o.a.z.ClientCnxn [INFO] Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2016-02-06 17:28:05.319 o.a.z.ClientCnxn [WARN] Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.8.0_60]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) ~[?:1.8.0_60]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) ~[zookeeper-3.4.6.2.3.4.0-3485.jar:3.4.6-3485--1]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125) [zookeeper-3.4.6.2.3.4.0-3485.jar:3.4.6-3485--1]
2016-02-06 17:28:05.340 o.a.z.ClientCnxn [INFO] Session establishment complete on server hdp1n1.aye1vpcdev/10.0.202.157:2181, sessionid = 0x152b6fb9a45005e, negotiated timeout = 20000
2016-02-06 17:28:05.345 o.a.c.f.s.ConnectionStateManager [INFO] State change: CONNECTED
2016-02-06 17:28:05.434 o.a.z.ClientCnxn [INFO] Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
2016-02-06 17:28:05.435 o.a.z.ClientCnxn [WARN] Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
Any Idea what I am doing wrong?
... View more
Labels:
- Labels:
-
Apache Storm