Member since
05-02-2017
28
Posts
1
Kudos Received
0
Solutions
06-06-2017
01:38 AM
1 Kudo
How to make nifi support tensorflow? Is there any plugins for it? Thank you!
... View more
Labels:
- Labels:
-
Apache NiFi
05-27-2017
03:28 AM
I means the NIFI UI support for multiple language and processor support for tenserflow?
... View more
05-27-2017
03:26 AM
Does nifi support for multiple language and support for tenserflow? Thank you!
... View more
Labels:
- Labels:
-
Apache NiFi
05-15-2017
09:53 AM
@Sebastian Carroll I have try to use nifi-toolkit-1.0.0, but it is the same with 1.2.0. I will try it on the linux again.
... View more
05-15-2017
09:21 AM
I used NIFI 1.2.0 on windows and use the same command, tls-toolkit.bat standalone -n localhost -C 'CN=scarroll,OU=NIFI' -O -o security_output, but it missing following files, it is very ...... : ( ├── CN=scarroll_OU=NIFI-O.p12
├── CN=scarroll_OU=NIFI-O.password
├── CN=scarroll_OU=NIFI.p12
├── CN=scarroll_OU=NIFI.password
... View more
05-15-2017
09:01 AM
@Sebastian Carroll NIFI 1.2.0 After ./bin/tls-toolkit.sh standalone -n localhost -C 'CN=scarroll,OU=NIFI'-O -o ../security_output, the output is as following: nifi-key.key nifi-cert.pem -localhost ├── keystore.jks ├── nifi.properties └── truststore.jks There is no .p12 file. How to make the chrome to import the crt ? Thank you for your help.
... View more
05-15-2017
08:12 AM
I used 'bin/tls-toolkit.sh standalone -n localhost' to generate the localhost folder and copy three files, keystore.jks truststore.jks nifi.properties,into the nifi conf. After start up the nifi, the background log shows 'https://localhost:9443/nifi successfully start'. When I open the browser, it shows This site can’t provide a secure connection localhost didn’t accept your login certificate, or one may not have been provided.
Try contacting the system admin. ERR_BAD_SSL_CLIENT_AUTH_CERT What's wrong with it? Thank you!
... View more
- Tags:
- NiFi
Labels:
- Labels:
-
Apache NiFi
05-10-2017
09:10 AM
@Jay SenSharma I used local repository to install zepplin. zeppelin_2_6_0_3_8-0.7.0.2.6.0.3-8.noarch.rpm file size is 444,023,540. After I manually install the rpm, there is still no interpreter.json. The HDP-2.6.0.3-centos7-rpm.tar.gz is downloaded from hortonworks. So is the rpm file not correct?
... View more
05-10-2017
08:53 AM
@Jay SenSharma I use a new vm, after installed, there is still no interpreter.json
... View more
05-10-2017
08:31 AM
In the NIFI UI , I dont find anywhere to save the data flow and create a new one. Does NIFI support multiple data flow?
... View more
Labels:
- Labels:
-
Apache NiFi
05-10-2017
08:09 AM
no interpreter.json in /etc/zeppelin/2.6.0.3-8/0/ In ambari, it said 'Zeppelin Notebook Install' is ok , but Zeppelin Notebook Start is in error.
... View more
05-10-2017
08:07 AM
@Jay SenSharma Install log as following:
2017-05-10 15:51:11,483 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://centos7-node1:50070/webhdfs/v1/user/zeppelin/test?op=GETCONTENTSUMMARY&user.name=hdfs'"'"' 1>/tmp/tmpLkIcfO 2>/tmp/tmpCqb2wx''] {'logoutput': None, 'quiet': False}
2017-05-10 15:51:11,586 - call returned (0, '')
2017-05-10 15:51:11,589 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://centos7-node1:50070/webhdfs/v1/user/zeppelin/test?op=LISTSTATUS&user.name=hdfs'"'"' 1>/tmp/tmp7aAsPe 2>/tmp/tmpRGXYla''] {'logoutput': None, 'quiet': False}
2017-05-10 15:51:11,693 - call returned (0, '')
2017-05-10 15:51:11,694 - HdfsResource['/apps/zeppelin'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'default_fs': 'hdfs://centos7-node1:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'owner': 'zeppelin', 'recursive_chown': True, 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'directory', 'action': ['create_on_execute'], 'recursive_chmod': True}
2017-05-10 15:51:11,695 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://centos7-node1:50070/webhdfs/v1/apps/zeppelin?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpFhNh1j 2>/tmp/tmpk5jfXw''] {'logoutput': None, 'quiet': False}
2017-05-10 15:51:11,863 - call returned (0, '')
2017-05-10 15:51:11,865 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT '"'"'http://centos7-node1:50070/webhdfs/v1/apps/zeppelin?op=SETOWNER&user.name=hdfs&owner=zeppelin&group='"'"' 1>/tmp/tmpOksNqz 2>/tmp/tmpJrpz2v''] {'logoutput': None, 'quiet': False}
2017-05-10 15:51:11,957 - call returned (0, '')
2017-05-10 15:51:11,958 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://centos7-node1:50070/webhdfs/v1/apps/zeppelin?op=GETCONTENTSUMMARY&user.name=hdfs'"'"' 1>/tmp/tmpjGaxgM 2>/tmp/tmp947hnh''] {'logoutput': None, 'quiet': False}
2017-05-10 15:51:12,054 - call returned (0, '')
2017-05-10 15:51:12,057 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://centos7-node1:50070/webhdfs/v1/apps/zeppelin?op=LISTSTATUS&user.name=hdfs'"'"' 1>/tmp/tmpECye1L 2>/tmp/tmpXOLS_r''] {'logoutput': None, 'quiet': False}
2017-05-10 15:51:12,157 - call returned (0, '')
2017-05-10 15:51:12,159 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT '"'"'http://centos7-node1:50070/webhdfs/v1/apps/zeppelin/zeppelin-spark-dependencies_2.10-0.7.0.2.6.0.3-8.jar?op=SETOWNER&user.name=hdfs&owner=zeppelin&group='"'"' 1>/tmp/tmprkWRI3 2>/tmp/tmp1jJ4pn''] {'logoutput': None, 'quiet': False}
2017-05-10 15:51:12,263 - call returned (0, '')
2017-05-10 15:51:12,265 - HdfsResource['/apps/zeppelin/zeppelin-spark-dependencies_2.10-0.7.0.2.6.0.3-8.jar'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'source': '/usr/hdp/current/zeppelin-server/interpreter/spark/dep/zeppelin-spark-dependencies_2.10-0.7.0.2.6.0.3-8.jar', 'default_fs': 'hdfs://centos7-node1:8020', 'replace_existing_files': True, 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'owner': 'zeppelin', 'group': 'zeppelin', 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'file', 'action': ['create_on_execute'], 'mode': 0444}
2017-05-10 15:51:12,267 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://centos7-node1:50070/webhdfs/v1/apps/zeppelin/zeppelin-spark-dependencies_2.10-0.7.0.2.6.0.3-8.jar?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmphduhJH 2>/tmp/tmpprjCXq''] {'logoutput': None, 'quiet': False}
2017-05-10 15:51:12,365 - call returned (0, '')
2017-05-10 15:51:12,367 - DFS file /apps/zeppelin/zeppelin-spark-dependencies_2.10-0.7.0.2.6.0.3-8.jar is identical to /usr/hdp/current/zeppelin-server/interpreter/spark/dep/zeppelin-spark-dependencies_2.10-0.7.0.2.6.0.3-8.jar, skipping the copying
2017-05-10 15:51:12,368 - HdfsResource[None] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'default_fs': 'hdfs://centos7-node1:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf'}
2017-05-10 15:51:12,368 - Execute['/usr/hdp/current/zeppelin-server/bin/zeppelin-daemon.sh start >> /var/log/zeppelin/zeppelin-setup.log'] {'user': 'zeppelin'}
2017-05-10 15:51:15,990 - Will retry 29 time(s), caught exception: interpreter.json not found. waiting for Zeppelin server to start.... Sleeping for 5 sec(s)
Command failed after 1 tries
... View more
05-10-2017
07:57 AM
After installed ZEPPELIN, it doesn't start. How to resolve it? Thank you! File "/var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.6.0.2.5/package/scripts/master.py", line 415, in check_zeppelin_server raise Fail("interpreter.json not found. waiting for Zeppelin server to start...")
resource_management.core.exceptions.Fail: interpreter.json not found. waiting for Zeppelin server to start...
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Zeppelin
05-08-2017
03:08 AM
@Jay SenSharma I found in the env there is already HADOOP_HOME in it.After remove it , ambari works okay. Thank you!
... View more
05-08-2017
02:01 AM
Ambari HDFS NN can not start, details as following. I have setted 777 to 'hdfs-config.sh', but it doesn't work. I dont know how to resolve it. Is there any idea? Thank you ! /usr/hdp/2.6.0.3-8//hadoop-hdfs/bin/hdfs.distro:Line 39: /root/hadoop-2.7.3/libexec/hdfs-config.sh: not engouth authority; /usr/hdp/2.6.0.3-8//hadoop-hdfs/bin/hdfs.distro: Lin 317 :exec: : not found
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
05-05-2017
10:09 AM
I put in ambari-metrics-collector-2.5.0.3-0.noarch.rpm into my local repository http://centos7-node3:9999/hdp.war/HDP/centos7/ambari/ and ambari.repo like following,but it doesn't work. :( #VERSION_NUMBER=2.5.0.3-7 [ambari-2.5.0.3] name=ambari Version - ambari-2.5.0.3 baseurl=http://centos7-node3:9999/hdp.war/HDP/centos7/ path=/ enabled=1 gpgcheck=0
... View more
05-05-2017
09:33 AM
Hi Jay SenSharma, I used the local repository of the ambari web ui to install hadoop cluster. There are only HDP and HDP-UTILS URL need to input. Do you mean I need add .repo file direct into yum manually? Thanks.
... View more
05-05-2017
09:00 AM
Help! Thank you! 2017-05-05 16:55:13,725 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-05-05 16:55:13,748 - Skipping installation of existing package hdp-select
2017-05-05 16:55:14,133 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-05-05 16:55:14,139 - checked_call['hostid'] {}
2017-05-05 16:55:14,145 - checked_call returned (0, 'a8c0807e')
2017-05-05 16:55:14,153 - Package['ambari-metrics-collector'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-05-05 16:55:14,346 - Installing package ambari-metrics-collector ('/usr/bin/yum -d 0 -e 0 -y install ambari-metrics-collector')
2017-05-05 16:55:20,848 - Execution of '/usr/bin/yum -d 0 -e 0 -y install ambari-metrics-collector' returned 1. Error: Nothing to do
2017-05-05 16:55:20,849 - Failed to install package ambari-metrics-collector. Executing '/usr/bin/yum clean metadata'
2017-05-05 16:55:21,378 - Retrying to install package ambari-metrics-collector after 30 seconds
... View more
Labels:
- Labels:
-
Apache Ambari
05-05-2017
07:19 AM
HI Artem Ervits, I know why not to download jar from hortonworks now ! I found the hortonworks would deny some ip request, after I change the IP, it is okay now. Thank you!
... View more
05-05-2017
07:18 AM
Failed to connect to https://centos7-node1:8440/ca due to [Errno 111] \xe6\x8b\x92\xe7\xbb\x9d\xe8\xbf\x9e\xe6\x8e\xa5 Help! Thank you! Creating target directory...
==========================
Command start time 2017-05-05 06:04:58
Connection to centos7-node1 closed.
SSH command execution finished
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:04:58
==========================
Copying ambari sudo script...
==========================
Command start time 2017-05-05 06:04:58
scp /var/lib/ambari-server/ambari-sudo.sh
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:04:59
==========================
Copying common functions script...
==========================
Command start time 2017-05-05 06:04:59
scp /usr/lib/python2.6/site-packages/ambari_commons
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:04:59
==========================
Copying create-python-wrap script...
==========================
Command start time 2017-05-05 06:04:59
scp /var/lib/ambari-server/create-python-wrap.sh
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:05:00
==========================
Copying OS type check script...
==========================
Command start time 2017-05-05 06:05:00
scp /usr/lib/python2.6/site-packages/ambari_server/os_check_type.py
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:05:01
==========================
Running create-python-wrap script...
==========================
Command start time 2017-05-05 06:05:01
Connection to centos7-node1 closed.
SSH command execution finished
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:05:01
==========================
Running OS type check...
==========================
Command start time 2017-05-05 06:05:01
Cluster primary/cluster OS family is redhat7 and local/current OS family is redhat7
Connection to centos7-node1 closed.
SSH command execution finished
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:05:02
==========================
Checking 'sudo' package on remote host...
==========================
Command start time 2017-05-05 06:05:02
Connection to centos7-node1 closed.
SSH command execution finished
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:05:02
==========================
Copying required files...
Ambari repo file not found: /etc/yum.repos.d/ambari.repo
==========================
Copying setup script file...
==========================
Command start time 2017-05-05 06:05:02
scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:05:03
==========================
Running setup agent script...
==========================
Command start time 2017-05-05 06:05:03
Repository base is listed more than once in the configuration
Repository updates is listed more than once in the configuration
Repository extras is listed more than once in the configuration
Repository centosplus is listed more than once in the configuration
('INFO 2017-05-05 13:45:19,163 Controller.py:495 - Finished heartbeating and registering cycle
INFO 2017-05-05 13:45:19,163 Controller.py:501 - Controller thread has successfully finished
INFO 2017-05-05 13:45:20,749 ExitHelper.py:56 - Performing cleanup before exiting...
INFO 2017-05-05 13:45:20,749 threadpool.py:111 - Shutting down thread pool
INFO 2017-05-05 13:45:20,750 scheduler.py:606 - Scheduler has been shut down
INFO 2017-05-05 13:45:20,750 threadpool.py:52 - Started thread pool with 3 core threads and 20 maximum threads
INFO 2017-05-05 13:45:20,750 AlertSchedulerHandler.py:168 - [AlertScheduler] Stopped the alert scheduler.
INFO 2017-05-05 13:45:20,750 threadpool.py:111 - Shutting down thread pool
INFO 2017-05-05 13:45:20,750 ExitHelper.py:70 - Cleanup finished, exiting with code:0
INFO 2017-05-05 14:05:11,105 main.py:143 - loglevel=logging.INFO
INFO 2017-05-05 14:05:11,105 main.py:143 - loglevel=logging.INFO
INFO 2017-05-05 14:05:11,105 main.py:143 - loglevel=logging.INFO
INFO 2017-05-05 14:05:11,106 DataCleaner.py:39 - Data cleanup thread started
INFO 2017-05-05 14:05:11,107 DataCleaner.py:120 - Data cleanup started
INFO 2017-05-05 14:05:11,108 DataCleaner.py:122 - Data cleanup finished
INFO 2017-05-05 14:05:11,154 PingPortListener.py:50 - Ping port listener started on port: 8670
INFO 2017-05-05 14:05:11,156 main.py:430 - Connecting to Ambari server at https://centos7-node1:8440 (192.168.126.128)
INFO 2017-05-05 14:05:11,156 NetUtil.py:67 - Connecting to https://centos7-node1:8440/ca
WARNING 2017-05-05 14:05:11,157 NetUtil.py:98 - Failed to connect to https://centos7-node1:8440/ca due to [Errno 111] \xe6\x8b\x92\xe7\xbb\x9d\xe8\xbf\x9e\xe6\x8e\xa5
WARNING 2017-05-05 14:05:11,157 NetUtil.py:121 - Server at https://centos7-node1:8440 is not reachable, sleeping for 10 seconds...
', None)
('INFO 2017-05-05 13:45:19,163 Controller.py:495 - Finished heartbeating and registering cycle
INFO 2017-05-05 13:45:19,163 Controller.py:501 - Controller thread has successfully finished
INFO 2017-05-05 13:45:20,749 ExitHelper.py:56 - Performing cleanup before exiting...
INFO 2017-05-05 13:45:20,749 threadpool.py:111 - Shutting down thread pool
INFO 2017-05-05 13:45:20,750 scheduler.py:606 - Scheduler has been shut down
INFO 2017-05-05 13:45:20,750 threadpool.py:52 - Started thread pool with 3 core threads and 20 maximum threads
INFO 2017-05-05 13:45:20,750 AlertSchedulerHandler.py:168 - [AlertScheduler] Stopped the alert scheduler.
INFO 2017-05-05 13:45:20,750 threadpool.py:111 - Shutting down thread pool
INFO 2017-05-05 13:45:20,750 ExitHelper.py:70 - Cleanup finished, exiting with code:0
INFO 2017-05-05 14:05:11,105 main.py:143 - loglevel=logging.INFO
INFO 2017-05-05 14:05:11,105 main.py:143 - loglevel=logging.INFO
INFO 2017-05-05 14:05:11,105 main.py:143 - loglevel=logging.INFO
INFO 2017-05-05 14:05:11,106 DataCleaner.py:39 - Data cleanup thread started
INFO 2017-05-05 14:05:11,107 DataCleaner.py:120 - Data cleanup started
INFO 2017-05-05 14:05:11,108 DataCleaner.py:122 - Data cleanup finished
INFO 2017-05-05 14:05:11,154 PingPortListener.py:50 - Ping port listener started on port: 8670
INFO 2017-05-05 14:05:11,156 main.py:430 - Connecting to Ambari server at https://centos7-node1:8440 (192.168.126.128)
INFO 2017-05-05 14:05:11,156 NetUtil.py:67 - Connecting to https://centos7-node1:8440/ca
WARNING 2017-05-05 14:05:11,157 NetUtil.py:98 - Failed to connect to https://centos7-node1:8440/ca due to [Errno 111] \xe6\x8b\x92\xe7\xbb\x9d\xe8\xbf\x9e\xe6\x8e\xa5
WARNING 2017-05-05 14:05:11,157 NetUtil.py:121 - Server at https://centos7-node1:8440 is not reachable, sleeping for 10 seconds...
', None)
Connection to centos7-node1 closed.
SSH command execution finished
host=centos7-node1, exitcode=0
Command end time 2017-05-05 06:05:13
Registering with the server...
Registration with the server failed.
... View more
Labels:
- Labels:
-
Apache Ambari
05-02-2017
10:54 AM
I have try to download jars from http://nexus-private.hortonworks.com/nexus/content/groups/public, but it failed. Errors as following : ( 404 - Path /org/apache/hadoop/hadoop-auth/2.7.1.2.3.4.0-3347/hadoop-auth-2.7.1.2.3.4.0-3347.BLK not found in group repository "Public Repositories" [id=public]. Path /org/apache/hadoop/hadoop-auth/2.7.1.2.3.4.0-3347/hadoop-auth-2.7.1.2.3.4.0-3347.BLK not found in group repository "Public Repositories" [id=public].
... View more
Labels:
05-02-2017
10:32 AM
I have try to download jars from http://nexus-private.hortonworks.com/nexus/content/groups/public, but it failed. Errors as following : ( 404 - Path /org/apache/hadoop/hadoop-auth/2.7.1.2.3.4.0-3347/hadoop-auth-2.7.1.2.3.4.0-3347.BLK not found in group repository "Public Repositories" [id=public]. Path /org/apache/hadoop/hadoop-auth/2.7.1.2.3.4.0-3347/hadoop-auth-2.7.1.2.3.4.0-3347.BLK not found in group repository "Public Repositories" [id=public].
... View more
05-02-2017
10:23 AM
I have try to download jars from http://nexus-private.hortonworks.com/nexus/content/groups/public, but it failed. Errors as following : ( 404 - Path /org/apache/hadoop/hadoop-auth/2.7.1.2.3.4.0-3347/hadoop-auth-2.7.1.2.3.4.0-3347.BLK not found in group repository "Public Repositories" [id=public]. Path /org/apache/hadoop/hadoop-auth/2.7.1.2.3.4.0-3347/hadoop-auth-2.7.1.2.3.4.0-3347.BLK not found in group repository "Public Repositories" [id=public].
... View more
05-02-2017
09:50 AM
When I try to compile ambari2.5 from soucecode, it failed becasue the jar could not be downloaded. For example, in the pom.xml of ambari-metrics-timelineservice, it need jar as following, how to download them? <hadoop.version>2.7.1.2.3.4.0-3347</hadoop.version> <phoenix.version>4.4.0.2.3.4.0-3347</phoenix.version> <hbase.version>1.1.2.2.3.4.0-3347</hbase.version> Then, I try to change version, hadoop version to 2.7.1 phoenix.version to 4.4.0 hbase.version to 1.1.2, there are some new problems coming. Who can build from sourcecode? Help, please. Thank you for your time.
... View more
Labels:
- Labels:
-
Apache Ambari