Member since
07-21-2017
22
Posts
0
Kudos Received
0
Solutions
07-27-2017
10:41 AM
@Santhosh B Gowda thank you! the name works. but the command i didn't work through. does the url equals https:// or service host>:<ambari port or component port>??? if it is ambari:ambari i got "curl: (35) gnutls_handshake() failed: An unexpected TLS packet was received."
... View more
07-27-2017
10:13 AM
i am setting component recovery by curl -u admin:admin -H "X-Requested-By: ambari" -X PUT 'http://10.90.3.101:8080/api/v1/clusters/hdp_cluster/components?ServiceComponentInfo/component_name.in(APP_TIMELINE_SERVER,DATANODE,HBASE_MASTER,HBASE_REGIONSERVER,HISTORYSERVER,HIVE_METASTORE,HIVE_SERVER,MYSQL_SERVER,NAMENODE,NODEMANAGER,RESOURCEMANAGER,SECONDARY_NAMENODE,WEBHCAT_SERVER,ZOOKEEPER_SERVER)' -d '{"ServiceComponentInfo" : {"recovery_enabled":"true"}}' but it seems the spark history serve doesn't match SPARK_HISTORY_SERVER or SPARK_HISTORY or SPARK_SERVER what is its name? or how can i get all the COMPONENTS'NAME?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Spark
07-27-2017
08:32 AM
@Jay SenSharma thanks,but this doesn't work,i even create an account 'hive'@'localhost' which is not created by default,it still can't access.
... View more
07-27-2017
08:02 AM
when i start hive by https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_reference/content/starting_hdp_services.html using: su hive
nohup /usr/hdp/current/hive-metastore/bin/hive --service metastore>/var/log/hive/hive.out 2>/var/log/hive/hive.log
i got errorlog from /var/log/hive/hive.log java.sql.SQLExcption: Access denied for user 'hive'@'localhost' (using password: YES). SQL Error code: 1045" i am quite sure that i can access mysql by typing: mysql -u hive -h localhost -ppasswd and the user 'hive' have all privileges please help me,thanks!
... View more
Labels:
07-14-2017
08:41 AM
map.memory = 2G map.opt=2048M io.sort.mb=2047M will cause ERROR JAVA HEAP SIZE map.memory = 2G map.opt=3096M io.sort.mb=2047M is fine; why?
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache YARN
07-09-2017
03:37 AM
i create a new client host outside the cluster by copying directory hdp & current & /etc/<conf> of one of the cluster's host i can run hive but when i run hive through different users at the same time,there is only one can be running ,others will wait until the running one finish. how to change it?
... View more
- Tags:
- Data Processing
- Hive
Labels:
- Labels:
-
Apache Hive
06-26-2017
01:34 AM
@Jay SenSharmathanks.but i mean why i need to do this on all hosts while using default choice don't.And i still can't find jdk on hosts by using "find / -name '*jdk* -type d'"
... View more
06-24-2017
08:21 AM
i find out that if i setup ambari with "ambari-server setup -j /path/to/your/installed/jdk". when i come to the confirm hosts step, i get warning : there are JDK issues on the hosts but when i change to configurate jdk with downloading from hortonworks,there is no issues,but i still can't find jdk on the hosts.why? please tell me how it works.
... View more
Labels:
- Labels:
-
Apache Ambari
06-06-2017
06:10 AM
@nshelke ambari-metrics-collector.txt
... View more
06-06-2017
05:57 AM
@Jay SenSharma sorry i send you the ambari-metrics-collector.out before ambari-metrics-collector.txt # df -h Filesystem Size Used Avail Use% Mounted on tank/containers/xdata-0 1.6T 12G 1.6T 1% / none 492K 4.0K 488K 1% /dev udev 126G 0 126G 0% /dev/tty /dev/md0 92G 22G 66G 25% /dev/lxd none 4.0K 0 4.0K 0% /sys/fs/cgroup
none 26G 1.1M 26G 1% /run none 5.0M 0 5.0M 0% /run/lock none 126G 0 126G 0% /run/shm none 100M 0 100M 0% /run/user #du 3750 . by the way, my another cluster shows that message too,but it works well = =
... View more
06-06-2017
05:54 AM
@nshelke thank a lot! please check the message above
... View more
06-06-2017
04:05 AM
@Jay SenSharma
@Jay SenSharma ambari-metrics-collector.log: Exception in thread Thread-947:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 1082, in run
self.function(*self.args, **self.kwargs) File "/usr/lib/python2.6/site-packages/resource_monitoring/core/metric_collector.py", line 45, in process_event
self.process_host_collection_event(event) File "/usr/lib/python2.6/site-packages/resource_monitoring/core/metric_collector.py", line 79, in process_host_collection_event
metrics.update(self.host_info.get_disk_io_counters())
File "/usr/lib/python2.6/site-packages/resource_monitoring/core/host_info.py", line 265, in get_disk_io_counters
io_counters = psutil.disk_io_counters()
File "/usr/lib/python2.6/site-packages/resource_monitoring/psutil/build/lib.linux-x86_64-2.7/psutil/__init__.py", line 1726, in disk_io_counters
raise RuntimeError("couldn't find any physical disk") RuntimeError: couldn't find any physical disk thank you very much
... View more
06-06-2017
03:49 AM
Metrics Collector Process it shows nothing when i type 'netstat -a|grep 6188' restart ambari-server or reboot dosen't work either ambari-server log: MetricsRequestHelper:114 - Error getting timeline metrics : Connection refused by the way, although my OS time is right but my log time is wrong
... View more
Labels:
- Labels:
-
Apache Ambari
06-02-2017
02:04 AM
@Jay SenSharma ambari-serverlog.txt i restart the ambari-server this morning thanks for help!
... View more
06-01-2017
09:35 AM
i can start the service one by one, but when i use the 'start all' button,the browser shows: vendor.js:127 PUT http://host:8080/api/v1/clusters/<clusters name>/services? 500 (Internal Server Error)
and the ambari-server.log:
01 Jun 2017 14:41:49,171 ERROR [qtp-ambari-client-84] AbstractResourceProvider:338 - Caught AmbariException when modifying a resource
org.apache.ambari.server.AmbariException: Invalid transition for servicecomponenthost, clusterName=<mycluster>, clusterId=2, serviceName=RANGER_KMS, componentName=RANGER_KMS_SERVER, hostname=<myhostname> currentState=INSTALL_FAILED, newDesiredState=STARTED
... View more
Labels:
- Labels:
-
Apache Ambari
05-26-2017
09:57 AM
thank you very much ! it turns out that our company's network is running in a wrong way.and we can reach "169.254.****", and we get a public_host_name which is a strange html,this html is too long for the var "public_host_name". In the situation we speculate,this address could not be reached.and it throws an exception to make the var getting the local host.too strange to understand T T the file's location: /usr/lib/python2.6/site-packages/ambari_agent/hostname.py method name: public_name
... View more
05-26-2017
09:00 AM
i deployed the ambari i got this: ==========================
Creating target directory...
==========================
Command start time 2017-05-26 15:58:41
Connection to slave1.xdata-b4.com closed.
SSH command execution finished
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:41
==========================
Copying common functions script...
==========================
Command start time 2017-05-26 15:58:41
scp /usr/lib/python2.6/site-packages/ambari_commons
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:41
==========================
Copying OS type check script...
==========================
Command start time 2017-05-26 15:58:41
scp /usr/lib/python2.6/site-packages/ambari_server/os_check_type.py
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:41
==========================
Running OS type check...
==========================
Command start time 2017-05-26 15:58:41
Cluster primary/cluster OS family is ubuntu14 and local/current OS family is ubuntu14
Connection to slave1.xdata-b4.com closed.
SSH command execution finished
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:41
==========================
Checking 'sudo' package on remote host...
==========================
Command start time 2017-05-26 15:58:41
sudo install
Connection to slave1.xdata-b4.com closed.
SSH command execution finished
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:41
==========================
Copying repo file to 'tmp' folder...
==========================
Command start time 2017-05-26 15:58:41
scp /etc/apt/sources.list.d/ambari.list
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:41
==========================
Moving file to repo dir...
==========================
Command start time 2017-05-26 15:58:41
Connection to slave1.xdata-b4.com closed.
SSH command execution finished
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:41
==========================
Changing permissions for ambari.repo...
==========================
Command start time 2017-05-26 15:58:41
Connection to slave1.xdata-b4.com closed.
SSH command execution finished
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:41
==========================
Update apt cache of repository...
==========================
Command start time 2017-05-26 15:58:41
0% [Working]
Get:1 http://10.90.2.36 Ambari InRelease [3,187 B]
100% [1 InRelease 3,187 B/3,187 B 100%]
100% [Working]
100% [1 InRelease gpgv 3,187 B]
Ign http://10.90.2.36 Ambari InRelease
100% [Working]
Ign http://10.90.2.36 Ambari/main amd64 Packages/DiffIndex
100% [Working]
Hit http://10.90.2.36 Ambari/main amd64 Packages
100% [Working]
Ign http://10.90.2.36 Ambari/main Translation-en_US
100% [Working]
100% [Packages 1,927 B] [Waiting for headers]
Ign http://10.90.2.36 Ambari/main Translation-en
100% [Packages 1,927 B]
100% [Working]
Fetched 3,187 B in 0s (28.4 kB/s)
Reading package lists... 0%
Reading package lists... 0%
Reading package lists... 0%
Reading package lists... 0%
Reading package lists... 40%
Reading package lists... Done
W: GPG error: http://10.90.2.36 Ambari InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B9733A7A07513CAD
W: Duplicate sources.list entry http://10.90.2.36/ambari-2.2.0.0/ubuntu14/2.2.0.0-1310/ Ambari/main amd64 Packages (/var/lib/apt/lists/10.90.2.36_ambari-2.2.0.0_ubuntu14_2.2.0.0-1310_dists_Ambari_main_binary-amd64_Packages)
Connection to slave1.xdata-b4.com closed.
SSH command execution finished
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:42
==========================
Copying setup script file...
==========================
Command start time 2017-05-26 15:58:42
scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:42
==========================
Running setup agent script...
==========================
Command start time 2017-05-26 15:58:42
('
</body>
</html>
WARNING 2017-05-26 07:58:51,415 Controller.py:198 - Sleeping for 16 seconds and then trying again
', None)
('
</body>
</html>
WARNING 2017-05-26 07:58:51,415 Controller.py:198 - Sleeping for 16 seconds and then trying again
', None)
Connection to slave1.xdata-b4.com closed.
SSH command execution finished
host=slave1.xdata-b4.com, exitcode=0
Command end time 2017-05-26 15:58:53
Registering with the server...
and the ambari-server log shows: 26 May 2017 16:44:30,474 WARN [qtp-ambari-agent-94] ServletHandler:563 - /agent/v1/register/slave1.xdata-b4.com
javax.persistence.RollbackException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: org.postgresql.util.PSQLException: ERROR: value too long for type character varying(255)
Error Code: 0
Call: INSERT INTO hosts (host_id, cpu_count, cpu_info, discovery_status, host_attributes, host_name, ipv4, ipv6, last_registration_time, os_arch, os_info, os_type, ph_cpu_count, public_host_name, rack_info, total_mem) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
bind => [16 parameters bound]
Query: InsertObjectQuery(org.apache.ambari.server.orm.entities.HostStateEntity@f0d2dee5)
at org.eclipse.persistence.internal.jpa.transaction.EntityTransactionImpl.commit(EntityTransactionImpl.java:157)
at Caused by: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: org.postgresql.util.PSQLException: ERROR: value too long for type character varying(255)
Error Code: 0
Call: INSERT INTO hosts (host_id, cpu_count, cpu_info, discovery_status, host_attributes, host_name, ipv4, ipv6, last_registration_time, os_arch, os_info, os_type, ph_cpu_count, public_host_name, rack_info, total_mem) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
bind => [16 parameters bound]
Query: InsertObjectQuery(org.apache.ambari.server.orm.entities.HostStateEntity@f0d2dee5)
at \ Caused by: org.postgresql.util.PSQLException: ERROR: value too long for type character varying(255)
at \
... View more
Labels:
- Labels:
-
Apache Ambari