Member since
05-09-2016
39
Posts
23
Kudos Received
12
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1778 | 06-29-2017 03:11 PM | |
1109 | 06-28-2017 12:06 PM | |
1048 | 06-28-2017 08:28 AM | |
3088 | 06-21-2017 06:19 AM | |
917 | 06-13-2017 01:12 PM |
03-27-2017
10:31 AM
@nyadav Setting the root.acl properties resolved the issue.
... View more
03-27-2017
09:58 AM
Yarn Web Interface reporting '0' for many metrics for successfully completed applications. {
"id": "application_1480114771287_15299",
"user": "xx",
"name": "usr",
"queue": "default",
"state": "FINISHED",
"finalStatus": "SUCCEEDED",
"progress": 100,
"trackingUI": "History",
"trackingUrl": "http://<HOST>:8088/proxy/application_1480114771287_15299/",
"diagnostics": "",
"clusterId": 1480114771287,
"applicationType": "MAPREDUCE",
"applicationTags": "",
"startedTime": 0,
"finishedTime": 0,
"elapsedTime": 0,
"allocatedMB": 0,
"allocatedVCores": 0,
"runningContainers": 0,
"memorySeconds": 172160,
"vcoreSeconds": 49,
"queueUsagePercentage": 0,
"clusterUsagePercentage": 0,
"preemptedResourceMB": 0,
"preemptedResourceVCores": 0,
"numNonAMContainerPreempted": 0,
"numAMContainerPreempted": 0
}
... View more
Labels:
- Labels:
-
Apache YARN
03-27-2017
08:26 AM
@nyadav It appears that block size is different in your two clusters . You can set flags -preserveBlockSize or -skipChecksum as below . 1. Suspend all Falcon jobs .
2. Modify template for falcon mirroring at /usr/hdp/current/falcon-server/data-mirroring/workflows/hdfs-replication-workflow.xml .Add the following argument at the end in argument list to preserve the block size .
<arg>-preserveBlockSize</arg>
<arg>true</arg>
3. Restart Falcon through Ambari.
4. Resubmit the job and verify if the HDFS mirror job is working fine now. This will set this property for all mirror jobs.
... View more
03-22-2017
12:17 PM
@nyadav Thanks for the information . I was able to insert after creating the dataframe.
... View more
03-22-2017
08:45 AM
1 Kudo
@nyadav The permission for /var/run/ambari/server should be setup correctly ll /var/run/ambari-server/
total 12
-rw-r--r-- 1 root root 6 Jan 4 05:10 ambari-server.pid
drwxr-xr-x 4 root root 4096 Jan 4 05:26 bootstrap
drwxr-xr-x 39 root root 4096 Jan 17 18:14 stack-recommendations
Check and correct your permissions and try again.
... View more
03-22-2017
06:21 AM
1 Kudo
Not able to insert data into hive table through spark scala> sqlContext.sql("insert into table results_test_hive values('XXXXXXXXXX', 'm:X', 0.0)") Failed with below error, org.apache.spark.sql.AnalysisException: Unsupported language features in query: insert into table results_test_hive values('XXXXXXXXXX', 'm:X', 0.0)
... View more
Labels:
- Labels:
-
Apache Spark
03-22-2017
06:19 AM
@nyadav I am getting below exception while running the below command, rmr /hbase-secure/table/hbase:acl Authentication is not valid : /hbase-secure/table/hbase:acl
... View more
03-21-2017
06:15 AM
@nyadav Yes, I'm able to create and list table from shell. Only issue is while granting permission. Also Ranger is not enabled.
... View more
03-21-2017
06:09 AM
3 Kudos
While granting user permission in HBase, it is failing with error. Recently we have de-kerberized and kerberized the Cluster. "ERROR ArgumentError: DISABLED: Security features are not available"
... View more
Labels:
- Labels:
-
Apache HBase
03-20-2017
07:24 AM
1 Kudo
@Kalim Julia You need to set up below properties to delete. These configuration parameters must be set appropriately to turn on transaction support in Hive: Client Side
hive.support.concurrency – true hive.enforce.bucketing – true (Not required as of Hive 2.0) hive.exec.dynamic.partition.mode – nonstrict hive.txn.manager – org.apache.hadoop.hive.ql.lockmgr.DbTxnManager Server Side (Metastore)
hive.compactor.initiator.on – true (See table below for more details) hive.compactor.worker.threads – a positive number on at least one instance of the Thrift metastore service For further information refer to below link https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Transaction/LockManager
... View more
- « Previous
-
- 1
- 2
- Next »