Member since
12-10-2017
9
Posts
1
Kudos Received
0
Solutions
11-05-2018
10:35 AM
1 Kudo
I am planning to do an automation where i can do OS upgrade/patching (One node at a time) which needs node restart. How can i test the services are up and running on that node after patching ? Looking for something like api which can help to validate services on datanode,namenode and edge node.
... View more
Labels:
- Labels:
-
Apache Hadoop
07-20-2018
03:03 PM
Thanks for sharing the detailed information and will try to update the spark-env to use default mode as yarn.
... View more
07-19-2018
09:28 PM
Facing issue where users are starting spark session in local mode and not the yarn mode. So need to identify users and update them on the process how they can start using yarn mode to avoid load on local node. Is there any document available on best practice for spark, which can help to educate users on the best ways to work on spark and how to launch spark session ?
... View more
- Tags:
- Hadoop Core
- Spark
- YARN
Labels:
- Labels:
-
Apache Spark
-
Apache YARN
12-11-2017
03:50 PM
what should be the url/command when we need to access hadoop jobs for a specified time duration ?
... View more
12-11-2017
08:16 AM
I am able to list jobs using below command with different status as finished/failed/killed. http://hostname:8088/ws/v1/cluster/apps?states=FINISHED but what i need is, the report should list jobs for a week or month ? I need to list finished jobs for a month and then list jobs for a week? I tried using parameter startedTime=1505907111909 but not sure on how we can implement this ? please share the format how should i use this
... View more
- Tags:
- Hadoop Core
- YARN
Labels:
- Labels:
-
Apache YARN
12-10-2017
06:20 PM
c1.png How we can format the timestamp value. which format is it and how its converted ?
... View more
- Tags:
- Hadoop Core
- YARN
Labels:
- Labels:
-
Apache YARN