Member since
07-30-2019
53
Posts
136
Kudos Received
16
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
8695 | 01-30-2017 05:05 PM | |
4613 | 01-13-2017 03:46 PM | |
2285 | 01-09-2017 05:36 PM | |
1379 | 01-09-2017 05:29 PM | |
1063 | 10-07-2016 03:34 PM |
09-30-2024
07:40 AM
非安全集群被阻止rpc通信,使用webhdfs协议,hadoop distcp -D ipc.client.fallback-to-simple-auth-allowed=true webhdfs://nn1:50070/foo/bar hdfs://nn2:8020/bar/foo
... View more
05-04-2023
02:43 AM
Hi Team, i have added Hbase client and phoenix core jar which has hbase client jar within it. I have the hbase and core site xmls. i get the Hconnection established message. But then i get "MESSAGE":"Reading reply sessionid:0x200239e26e51663, packet:: clientPath:/hbase serverPath:/hbase finished:false header:: 16,8 replyHeader:: 16,313534022349,0 request:: '/hbase,F response:: v{'meta-region-server,'rs,'splitWAL,'backup-masters,'flush-table-proc,'master-maintenance,'online-snapshot,'switch,'master,'running,'tokenauth,'draining,'namespace,'hbaseid,'table What could be the issue
... View more
09-17-2019
11:02 AM
Hi @dstreev Thanks for your article, I was checking and correct me if I'm wrong, but the same could be done using Knox service, that comes by default with HDP, it's that correct? Or there is some extra feature with this service? Regards Gerard
... View more
01-30-2017
05:05 PM
Rahul, Are the logs making it to HDFS? It sounds like you might be combining the "spooling" directory with the "local audit archive directory". What properties did you use during the Ranger HDFS Plugin installation? Are you doing a manual install or using Ambari? If manual, then this reference might help: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/installing_ranger_plugins.html#installing_ranger_hdfs_plugin I wasn't able to locate your "...filespool.archive.dir" property on my cluster. I'm not sure the property is required. And may be responsible for keeping the files "locally" that you've already posted to HDFS. If the files are making it to HDFS, I would try removing this setting. What do you have set for the property below? And are the contents being flushed from that location on a regular basis? xasecure.audit.destination.hdfs.batch.filespool.dir Compression doesn't happen during this process. Once they're on HDFS, you're free to do with them as you see fit. If compression is a part of that, then write an MR job to do so. (WARNING: Could affect other systems that might want to use these files as is) Cheers, David
... View more
01-09-2017
05:41 PM
Thanks for your message. Ambari version : 2.2.0.0. I have removed the rpcbind-0.2.0-38.el7.x86_64 package and tried to upgrade the HDP and it worked for me.
... View more
07-16-2018
11:34 AM
There is challenge I am facing .. when I am running the snapshotdiff from a remote cluster it is failing with snapshot not found error even though it is available .. do we have any solution for this .. we built a DR cluster and running distcp from DR to utilize the DR resources instead of overloading the PROD .. any solution how this can be achived..
... View more
11-29-2017
04:15 PM
For those who configure a connection to Hive the first time the Database Connection URL is available in Ambari> Service Hive> Sammary
... View more
11-24-2015
06:20 AM
1 Kudo
Well, it seems 600 characters wasn't enough for to supply enough of the back story @Peter Coates, so I added some high-level details in my original answer. I'd be glad to share more fine-grained info via email if you'd like.
... View more
05-18-2018
01:26 PM
I have been trying your suggestion, added the host via the above API call and get the following: 18 May 2018 14:18:37,613 INFO [qtp-ambari-agent-326] TopologyManager:637 - TopologyManager.onHostRegistered: Entering
18 May 2018 14:18:37,613 INFO [qtp-ambari-agent-326] TopologyManager:698 - TopologyManager: Queueing available host node5
18 May 2018 14:19:37,959 WARN [alert-event-bus-1] AlertReceivedListener:497 - Unable to process alert ambari_agent_disk_usage for cluster idp and host node5 because the host is not a part of the cluster.
18 May 2018 14:20:06,779 INFO [ambari-client-thread-74] TopologyManager:485 - TopologyManager.scaleHosts: Entering
18 May 2018 14:20:06,779 INFO [ambari-client-thread-74] ClusterTopologyImpl:158 - ClusterTopologyImpl.addHostTopology: added host = node5 to host group = host_group_1
18 May 2018 14:20:06,780 INFO [ambari-client-thread-74] HostRequest:205 - Skipping Start task creation since provision action = INSTALL_ONLY
18 May 2018 14:20:06,782 INFO [ambari-client-thread-74] HostRequest:244 - Skipping create of START task for KAFKA_BROKER on PENDING HOST ASSIGNMENT : HOSTGROUP=host_group_1.
18 May 2018 14:20:06,783 INFO [ambari-client-thread-74] HostRequest:244 - Skipping create of START task for ZOOKEEPER_SERVER on PENDING HOST ASSIGNMENT : HOSTGROUP=host_group_1.
18 May 2018 14:20:06,784 INFO [ambari-client-thread-74] HostRequest:244 - Skipping create of START task for METRICS_MONITOR on PENDING HOST ASSIGNMENT : HOSTGROUP=host_group_1.
18 May 2018 14:20:06,784 INFO [ambari-client-thread-74] HostRequest:244 - Skipping create of START task for NIFI_MASTER on PENDING HOST ASSIGNMENT : HOSTGROUP=host_group_1.
18 May 2018 14:20:06,785 INFO [ambari-client-thread-74] HostRequest:244 - Skipping create of START task for LOGSEARCH_LOGFEEDER on PENDING HOST ASSIGNMENT : HOSTGROUP=host_group_1.
18 May 2018 14:20:06,786 INFO [ambari-client-thread-74] HostRequest:244 - Skipping create of START task for ZOOKEEPER_CLIENT on PENDING HOST ASSIGNMENT : HOSTGROUP=host_group_1.
18 May 2018 14:20:06,786 INFO [ambari-client-thread-74] HostRequest:99 - HostRequest: Created request for host: node5
18 May 2018 14:20:06,786 INFO [ambari-client-thread-74] LogicalRequest:437 - LogicalRequest.createHostRequests: all host requests size 1 , outstanding requests size = 0
18 May 2018 14:20:06,790 INFO [ambari-client-thread-74] TopologyManager:923 - TopologyManager.createLogicalRequest: created LogicalRequest with ID = 52 and completed persistence of this request.
18 May 2018 14:20:06,793 INFO [ambari-client-thread-74] TopologyManager:845 - TopologyManager.processRequest: Entering
18 May 2018 14:20:06,794 INFO [ambari-client-thread-74] TopologyManager:863 - TopologyManager.processRequest: host name = node5 is mapped to LogicalRequest ID = 52 and will be removed from the reserved hosts.
18 May 2018 14:20:06,794 INFO [ambari-client-thread-74] TopologyManager:876 - TopologyManager.processRequest: offering host name = node5 to LogicalRequest ID = 52
18 May 2018 14:20:06,794 INFO [ambari-client-thread-74] LogicalRequest:101 - LogicalRequest.offer: attempting to match a request to a request for a reserved host to hostname = node5
18 May 2018 14:20:06,794 INFO [ambari-client-thread-74] LogicalRequest:110 - LogicalRequest.offer: request mapping ACCEPTED for host = node5
18 May 2018 14:20:06,794 INFO [ambari-client-thread-74] LogicalRequest:113 - LogicalRequest.offer returning response, reservedHost list size = 0
18 May 2018 14:20:06,795 INFO [ambari-client-thread-74] TopologyManager:886 - TopologyManager.processRequest: host name = node5 was ACCEPTED by LogicalRequest ID = 52 , host has been removed from available hosts.
18 May 2018 14:20:06,795 INFO [ambari-client-thread-74] ClusterTopologyImpl:158 - ClusterTopologyImpl.addHostTopology: added host = node5 to host group = host_group_1
18 May 2018 14:20:06,797 INFO [ambari-client-thread-74] TopologyManager:963 - TopologyManager.processAcceptedHostOffer: queue tasks for host = node5 which responded ACCEPTED
18 May 2018 14:20:06,797 INFO [ambari-client-thread-74] TopologyManager:988 - TopologyManager.processAcceptedHostOffer: queueing tasks for host = node5
18 May 2018 14:20:06,797 INFO [ambari-client-thread-74] TopologyManager:904 - TopologyManager.processRequest: not all required hosts have been matched, so adding LogicalRequest ID = 52 to outstanding requests
What can I do to move the request from PENDING to actually started? Best
... View more
06-17-2016
01:15 PM
@Philippe Back... From all krb5.conf files on all nodes in the hadoop cluster.
... View more