Member since
01-14-2019
6
Posts
0
Kudos Received
0
Solutions
06-28-2019
09:51 AM
Thanks for your response @Jay Kumar SenSharma. When I started namenode from Ambari UI, it says 'started'; however, when I checked the logs, there are few errors. Looking into the issue/errors now. Meanwhile, I will attach the namenode log file (as seen on Ambari UI), just in case anybody can help me figure it out.Task_log_error.txt
... View more
06-28-2019
07:42 AM
Also attaching the logs for Yarn Resource manager Resource Manager_Yarn.txt The errors for all the services are same - "Your request could not be processed because an error occurred contacting the DNS server. The DNS server may be temporarily unavailable, or there could be a network problem."
... View more
06-28-2019
07:38 AM
Start Timeline Service V2_0 Reader.txt
... View more
06-28-2019
05:07 AM
Hi @Geoffrey Shelton Okot, thanks for your response. Highly appreciate it! I had seen this same solution in one of the posts from you, and hence I had solved the issue with RegistryDNS ie., I was able to start RegistryDNS service. However, I am still not able to start other services like - Yarn resource Manager and Timeline Service V2.0 Reader / YARN. Could you please help me resolving this issue? Thanks and regards, Spandan Mohanty
... View more
06-24-2019
06:43 PM
Background : We have a 3 node cluster namely nodeone, nodetwo, nodethree. We have successfully installed Ambari and services like HDFS, ZooKeeper, Ambari Metrics, SmartSense, Kafka. Later, we tried to add Yarn service which comes along with MapReduce ie., Yarn+MapReduce2. Services are added successfully, however we are facing problem in starting Yarn Services like ResourceManager, YARN Registry DNS, Timeline Service V2.0 Reader ie., We added Services already installed and working fine are : HDFS, ZooKeeper, Ambari Metrics, SmartSense, Kafka. Services failed to start: Resource Manager_Yarn.txt YARN Registry DNS / YARN Timeline Service V2.0 Reader / YARN I understand Namenode should be running prior to starting YARN and it is running as expected. As per my investigation of the logs, I am getting an error saying 'Your request could not be processed because an error occurred contacting the DNS server'. Could you please suggest on how to solve this issue? Could you please help me in starting YARN services? I will attach the logs for Resource Manager and Timeline Service V2.0 Reader. Please do let me know if any other information is required. Thanks and regards, Spandan
... View more
Labels:
- Labels:
-
Apache YARN
01-14-2019
08:28 AM
@Chintan Visani I believe it's possible. Let me explain my usecase first. My objective is to take 4 CSVs as input and joining all of them based on a unique column named 'CustomerID' available in all the CSVs. I did not directly join the CSVs rather I put each of them into database tables and later join them using ExecuteSQL command. 1. GetFile -> UpdateAttribute -> PutDatabaseRecord (For each of the CSVs i.e., for my case - 4 CSVs put into 4 different tables) 2. ExecuteSQL (you write SQL query to join all the required tables) -> ConvertRecord -> PutFile (This will give you the join of all the CSVs) 3. After that again, GetFile -> UpdateAttribute -> PutDatabaseRecord (If you again want to put the aggregated/joined CSV into the DB, then you can do it again) Hope it would help. Thanks and regards, Spandan.
... View more