Member since
12-06-2016
54
Posts
5
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2758 | 12-21-2016 04:09 PM | |
2285 | 12-16-2016 02:42 PM | |
1911 | 12-07-2016 04:16 PM |
12-25-2016
08:26 PM
@Rajkumar Singh >see if there was resource issue at RM side. How can I check that? What exactly should I look at?
... View more
12-21-2016
08:55 PM
@Rajkumar Singh My /var/run/ directory is indeed on tmpfs. So what is the workaround then?
... View more
12-21-2016
08:52 PM
@ddharam Thank you. I however was not sure what "id -a zeppelin" means in your post? My best guess was that you suggested to find some zeppelin id. But how do I find it? The /configs.sh -u $ambari_user -p $password get localhost $cluster_name zeppelin-env command returned a pretty big output. And I was not sure where I look for zeppelin id?
... View more
12-21-2016
08:25 PM
@Nate This looked like a nice and simple solution. However property zeppelin_pid_dir is disabled in Ambari. I can't enter any value there. Please advise where else I can change this value?
... View more
12-21-2016
04:24 PM
@Rajkumar Singh I did what you suggested. Below is the output INFO : Tez session hasn't been created yet. Opening session
INFO : Dag name: insert into car(model) values (...('Toyota')(Stage-1)
INFO :
INFO : Status: Running (Executing on YARN cluster with App id application_1482331426058_0001)
INFO : Map 1: -/-
INFO : Map 1: 0/1
INFO : Map 1: 0/1
INFO : Map 1: 0/1
INFO : Map 1: 0/1
INFO : Map 1: 0/1
INFO : Map 1: 0/1
INFO : Map 1: 0/1
INFO : Map 1: 0(+1)/1
INFO : Map 1: 0(+1)/1
INFO : Map 1: 0(+1)/1
INFO : Map 1: 0(+1)/1
INFO : Map 1: 0(+1)/1
INFO : Map 1: 1/1
INFO : Status: DAG finished successfully in 34.31 seconds
INFO :
INFO : METHOD DURATION(ms)
INFO : parse 45
INFO : semanticAnalyze 3,573
INFO : TezBuildDag 1,482
INFO : TezSubmitToRunningDag 1,433
INFO : TotalPrepTime 51,046
INFO : VERTICES TOTAL_TASKS FAILED_ATTEMPTS KILLED_TASKS DURATION_SECONDS CPU_TIME_MILLIS GC_TIME_MILLIS INPUT_RECORDS OUTPUT_RECORDS
INFO : Map 1 1 0 0 14.26 9,290 226 2 0
INFO : org.apache.tez.common.counters.DAGCounter:
INFO : NUM_SUCCEEDED_TASKS: 1
INFO : TOTAL_LAUNCHED_TASKS: 1
INFO : DATA_LOCAL_TASKS: 1
INFO : AM_CPU_MILLISECONDS: 7040
INFO : AM_GC_TIME_MILLIS: 19
INFO : File System Counters:
INFO : HDFS_BYTES_READ: 13
INFO : HDFS_BYTES_WRITTEN: 80
INFO : HDFS_READ_OPS: 4
INFO : HDFS_WRITE_OPS: 3
INFO : HDFS_OP_CREATE: 2
INFO : HDFS_OP_GET_FILE_STATUS: 3
INFO : HDFS_OP_OPEN: 1
INFO : HDFS_OP_RENAME: 1
INFO : org.apache.tez.common.counters.TaskCounter:
INFO : GC_TIME_MILLIS: 226
INFO : CPU_MILLISECONDS: 9290
INFO : PHYSICAL_MEMORY_BYTES: 79691776
INFO : VIRTUAL_MEMORY_BYTES: 2038177792
INFO : COMMITTED_HEAP_BYTES: 79691776
INFO : INPUT_RECORDS_PROCESSED: 2
INFO : INPUT_SPLIT_LENGTH_BYTES: 13
INFO : OUTPUT_RECORDS: 0
INFO : HIVE:
INFO : CREATED_FILES: 1
INFO : DESERIALIZE_ERRORS: 0
INFO : RECORDS_IN_Map_1: 2
INFO : RECORDS_OUT_1_default.car: 2
INFO : TaskCounter_Map_1_INPUT_values__tmp__table__1:
INFO : INPUT_RECORDS_PROCESSED: 2
INFO : INPUT_SPLIT_LENGTH_BYTES: 13
INFO : TaskCounter_Map_1_OUTPUT_out_Map_1:
INFO : OUTPUT_RECORDS: 0
INFO : Loading data to table default.car from hdfs://lenu.dom.hdp:8020/apps/hive/warehouse/car/.hive-staging_hive_2016-12-21_11-19-49_470_4335548459844470170-1/-ext-10000
INFO : Table default.car stats: [numFiles=6, numRows=15, totalSize=103, rawDataSize=88]
No rows affected (89.956 seconds)
... View more
12-21-2016
04:09 PM
It turned out that problem was quite different. Actually Zeppelin service was working fine, Ambari simply did not report it properly. "Address is already in use" message was shown simply because I tried to start Zeppelin service again when another instance of it was already running (but nobody knew about it). So this particular problem (Address is already in use) is now solved. However new problem started. So I started a new thread regarding a different problem
... View more
12-21-2016
03:44 PM
Zeppelin service is running (I can use Zeppelin view) but Ambari reports it is down. Some investigation revealed this is probably due to the fact that when Zeppelin was starting it was not able to create a PID file. The exception was thrown mkdir: cannot create directory ‘/var/run/zeppelin’: Permission denied If I manually give all permissions to /var/run/ folder it starts to work properly. It looks like I am not only one facing this issue as I saw other users already reported it. It is still not clear however what is a workaround for the problem? Giving permissions to /var/run/ folder only works as one time solution. As this folder is recreated on reboot, once I restart computer the problem starts over again...
... View more
Labels:
12-20-2016
11:28 PM
2 Kudos
Very basic insert statement in Hive insert into car(model)
values ('Honda'), ('Toyota'); is taking 2-3 minutes to complete. Is it a normal speed for Hive or is it too slow? I tried both Tez and MapReduce as execution engines, results were almost the same. Should I expect much better performance (like 2-3 seconds instead of minutes) if increase computer memory? The example below was executed on a single node cluster where computer had 6 Gb.
... View more
Labels:
12-20-2016
04:56 PM
@Alexandru Anghel I tried the command you've suggested . It returned only 1 row unix 3 [ ] STREAM CONNECTED 49995 5239/tracker-store So, there is nothing on port 9995
... View more
12-20-2016
04:52 PM
@Santhosh B Gowda I no longer have access to previous log as I deleted Zeppelin service and tried to reinstall it again. During the installation it thrown an error. Below is the content of stderr output Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.6.0.2.5/package/scripts/master.py", line 330, in <module>
Master().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.6.0.2.5/package/scripts/master.py", line 174, in start
self.create_zeppelin_dir(params)
File "/var/lib/ambari-agent/cache/common-services/ZEPPELIN/0.6.0.2.5/package/scripts/master.py", line 70, in create_zeppelin_dir
recursive_chmod=True
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 459, in action_create_on_execute
self.action_delayed("create")
File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 456, in action_delayed
self.get_hdfs_resource_executor().action_delayed(action_name, self)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 247, in action_delayed
self._assert_valid()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 231, in _assert_valid
self.target_status = self._get_file_status(target)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 292, in _get_file_status
list_status = self.util.run_command(target, 'GETFILESTATUS', method='GET', ignore_status_codes=['404'], assertable_result=False)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 179, in run_command
_, out, err = get_user_call_output(cmd, user=self.run_user, logoutput=self.logoutput, quiet=False)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/get_user_call_output.py", line 61, in get_user_call_output
raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
resource_management.core.exceptions.ExecutionFailed: Execution of 'curl -sS -L -w '%{http_code}' -X GET 'http://lenu.dom.hdp:50070/webhdfs/v1/user/zeppelin?op=GETFILESTATUS&user.name=hdfs' 1>/tmp/tmpeaTzEm 2>/tmp/tmpwrNLnT' returned 7. curl: (7) Failed connect to lenu.dom.hdp:50070; Connection refused
000
... View more