Member since
08-23-2016
261
Posts
201
Kudos Received
106
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1762 | 01-26-2018 07:28 PM | |
1402 | 11-29-2017 04:02 PM | |
35342 | 11-29-2017 03:56 PM | |
3523 | 11-28-2017 01:01 AM | |
965 | 11-22-2017 04:08 PM |
08-10-2017
03:48 PM
1 Kudo
hi @nzr ytmn When you are creating a process group, you usually provide a name for it. In the API results that come back from the /process-groups/root/ call, you could look for your name, and that would provide you with the process group ID associated with it. I just created a process group in NiFi and named it "TestTemplate". I then uploaded a template from my hard drive into the process group, and made the API call. The API results show this snippet: {"id":"e6318a1e-015c-1000-ffff-ffffe7e2554b","name":"TestTemplate", .... } As extra validation, if I go to the NiFi UI, I can see my process group and validate that the ID matches. Therefore I think you can use the API call I suggested above if I've understood your scenario correctly. screen-shot-2017-08-10-at-94635-am.png
... View more
08-09-2017
11:26 PM
@Allan Ferguson what is the port you ssh'd on? I'm wondering if you are SSH'ing into the Sandbox or the docker container
... View more
08-09-2017
05:31 PM
1 Kudo
Hi @nzr ytmn Is it not in the information returned when you call the root? Something along the lines of: http://127.0.0.1:19090/nifi-api/flow/process-groups/root/status?recursive=true
... View more
08-09-2017
12:06 AM
1 Kudo
hi @JT Ng Hive supports functions to_utc_timestamp() and from_utc_timestamp() to make this easier. Please see the language manual here for these functions including examples of how to invoke them. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF
... View more
08-04-2017
02:08 PM
Not just by adding the dirs, you would need to add the datanode service in Ambari to the master hosts also, but this is not recommended. Instead, it would be better to just add another slave node to the cluster vs taking resources from the master nodes
... View more
08-03-2017
08:09 PM
@Sam Red Awesome. In /etc/fstab a best practice is to use 'noatime,nodiratime' to help improve performance.
... View more
08-03-2017
06:15 PM
@Sam Red If you are adding 500GB of new disk to the host, then in Linux, you would mount/format the new disk. In Hadoop, via Ambari, you would add the new mount point to the list of dirs in the dfs.datanote.data.dir property. It will need to be mounted/formatted prior to adding the mount point in Ambari.
... View more
08-03-2017
05:41 PM
Hi @Sam Red You can modify the dfs.datanode.data.dir property within Ambari to add the new mountpoint you are creating. https://community.hortonworks.com/questions/21687/how-to-increase-the-capacity-of-hdfs.html
... View more
08-03-2017
04:07 PM
1 Kudo
Hi @rahul gulati It sounds as if your hosts have different configurations. To manage this using Ambari, you should investigate the Ambari Config Groups for hosts. You can group together like-hosts and apply configuration to them, while not forcing those configs to the outlier host. Here is a link to the documentation and to some relevant HCC threads. https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.1.0/bk_ambari-operations/content/using_host_config_groups.html https://community.hortonworks.com/questions/58846/amabri-config-groups.html https://community.hortonworks.com/questions/73983/datanode-config-groups.html
... View more
08-03-2017
03:34 PM
1 Kudo
Hi @Allan Ferguson I just installed the Azure 2.5 Sandbox. You must make sure you are the root user (or a sudo user) to see within the /root dir. When you login using your regular account (in my case, my username is 'azure'), you can see in the screenshot that I sudo to the superuser account and then can list the directory and see the dir and scripts. screen-shot-2017-08-03-at-93123-am.png
... View more