Member since
06-07-2017
12
Posts
0
Kudos Received
0
Solutions
09-29-2017
07:47 PM
Unfortunately, Distcp does not work for AWS cluster. I could not add the creditential of AWS in the command (xxxx.pem File).
... View more
09-29-2017
02:25 PM
ok. Installing NIFI on AWS would take a lot time. Is there another way without using NIFI? distcp is also a tool to copy data between two clusters but I am not sure that it works for AWS Cluster.
... View more
09-27-2017
01:08 PM
@mqureshi thanks for the idea. Now, NIFI ist not installed on the AWS Cluster (Edge Node) only locally. ist that to be done first ? I hink with gethdfs and puthdfs processors of nifi at the local Cluster could be work !!!
... View more
09-26-2017
08:34 PM
I have a local hdp Cluster in meinem local machine and also NIFI installed. On the AWS I installed another hdp Cluster which is not kerberized. My Problem is how to copy all my data from the local cluster to the cluster in AWS using NIFI. Can I use puthdfs? How can I configure it for AWS? I will be thankful if someone can help.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache NiFi
06-27-2017
10:14 AM
@rdoktorics thanks. I tried the following statement and restarted cloudbreak. Unfortunately, cloudbreak does not work properly!! did I miss anything? export CB_JAVA_OPTS="-Dhttp.proxyHost=webproxy.comp.db.de -Dhttp.proxyPort=8080 -Dhttps.proxyHost=webproxy.comp.db.de -Dhttps.proxyPort=8080 -Dhttp.nonProxyHosts=172.17.0.1|*.service.consul|*.node.dc1.consul -Dcb.customData='sudo echo proxy=http://webproxy.comp.db.de:8080 >> /etc/yum.conf'"
... View more
06-21-2017
03:04 PM
your solution does not work. I get the same error.
... View more
06-21-2017
10:21 AM
To your information. I use cloudbreak 1.16
... View more
06-21-2017
10:19 AM
@pdarvasi thank you for the hints. Unfortunatly, I could not find the order "/var/log/recipes". yes the recipe has been applied to all the hostgroups. I will try change the Profile as you mentioned.
... View more
06-20-2017
09:12 AM
it is a PRE recipe. It should set Proxy for Internet connection. in Attatchement you find also a section of the log.
... View more
06-19-2017
02:58 PM
Following is a screenshot of the error in the event history:error2.jpg
... View more