Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2724 | 05-03-2017 05:13 PM | |
2299 | 05-02-2017 08:38 AM | |
2434 | 05-02-2017 08:13 AM | |
2474 | 04-10-2017 10:51 PM | |
1120 | 03-28-2017 02:27 AM |
10-26-2015
06:26 PM
permissions are there and user dirs also exist
... View more
10-26-2015
06:22 PM
6 Kudos
DISCLAIMER: it was tested on HDP 2.3.2 only. There are two blocking JIRAs preventing usage of blob storage as primary filesystem on HDP 2.3.0. For HBase, you need to use page blob instead of block blob. First things first, install Azure CLI for Mac or use Azure portal. The steps below are for CLI. azure login enter username enter password azure storage account create storageaccountname --type LRS azure storage account keys list storageaccountname note the account keys, you will need them in the next step azure storage container create storagecontainername --account-name storageaccountname --account-key accountkeystring just to validate it was created azure storage blob list storagecontainernae --account-name storageaccountname --account-key Once the previous steps have been completed, go to Ambari UI and edit the core-site.xml In addition to these properties, you need to replace fs.defaultFS property with the wasb path. These properties and their descriptions are discussed in hadoop-azure documentation. If you choose to install HBase you also need to edit hbase-site.xml and modify hbase.rootDir property. Now restart the cluster for changes to take effect and start using the cluster. For HBase, there are some open JIRAs and your usage may vary. I encountered the following error when I tried to pre-split and drop/create the same table over and over. The fix is coming in Hadoop 2.8 so until then, beware of acquired lease messages on HBase.
... View more
10-26-2015
02:04 PM
1 Kudo
I see a lot of Jira activity on WASB and HBase, I guess I'm out of luck here https://issues.apache.org/jira/browse/HADOOP-12089
... View more
10-26-2015
01:35 PM
Has this been tested? I cannot see region info, pre-splitting a table occurs but I do not see whether it actually took effect. Deleting/disabling/pre-splitting a table takes a long time.
... View more
Labels:
- Labels:
-
Apache HBase
10-24-2015
02:09 AM
If the oozie.wf.workflow.notification.url property is present in the workflow job properties when submitting the job, Oozie will make a notification to the provided URL when the workflow job changes its status. If the URL contains any of the following tokens, they will be replaced with the actual values by Oozie before making the notification:
$jobId : The workflow job ID $status : the workflow current state
... View more
10-24-2015
01:54 AM
yes I'll check again, we're echoing whoami and hostname in the script.
... View more
10-24-2015
01:50 AM
If all else fails, login to ambari server, connect to the ambari database delete from hostcomponentstate where service_name = "ZEPPELIN";
... View more
10-24-2015
01:36 AM
you need to run the configuration utility against these nodes to account for memory, disk and cpu sizing. If you don't put node1 with no storage in its own group and specify not to look for whatever the hdfs or yarn directory you will run out of disk pretty quick because hdfs will try to write data to nonexisting directories in filesystem. So for node 1, I'd put it in it's own Ambari configuration group.
... View more
10-24-2015
01:23 AM
it's actually similar error to this https://issues.apache.org/jira/browse/MAPREDUCE-3056, I wonder if it reared its ugly head in Hadoop 2.7.1
... View more