Member since
05-30-2018
1322
Posts
715
Kudos Received
148
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4025 | 08-20-2018 08:26 PM | |
| 1930 | 08-15-2018 01:59 PM | |
| 2362 | 08-13-2018 02:20 PM | |
| 4078 | 07-23-2018 04:37 PM | |
| 4994 | 07-19-2018 12:52 PM |
07-20-2016
06:15 PM
4 Kudos
Assuming the read/write balance is going to continue on the future, and assuming performance on both of those actions is equally important, I would recommend global index.
... View more
07-20-2016
03:12 PM
1 Kudo
It is not available yet but the team is working hard on it and we hope to have it officially supported very soon!
... View more
07-14-2017
06:15 PM
1 Kudo
Any news on this? I am wondering about installing the whole of HDF3.0 including the Scheme Registry and SAM as well as NiFi.
... View more
07-21-2016
04:54 AM
@david serafini I can't answer about the impact of difference. However I can recommend being consistent with the versions supported. If it is not listed I would not do it. You will run into issues ie like the ones you are running into now. Just my .02
... View more
07-20-2016
02:44 AM
@sujitha sanku Here are some thought. Your right data in HDFS is immutable; however, with hive acid and phoenix/hbase you are able to update data. There are internal workings without those products which allow to update data. However at the core data exist in hdfs is not truly updated. It gives the perception. Hence why there is such thing as major/minor compaction. Not going to go into too much detail on that. So if data is updated in hbase, you can use NiFi to detect when a record is changed and based on that create a alert. As for hive/acid I am not aware of similar functionality. However products at attunity have functionality for CDC on hadoop. I would reach out to them. if that is not possible them you can build functionality to do some change tracking. It would be a custom solution. again that is for hive.
... View more
07-20-2016
09:49 PM
@Sunile Manjee - Thanks for the info, I'm aware that we can do this using API, as @John Martin wanted to do this while installing HDP cluster hence suggested to put in configs section of ambari blueprint.
... View more
07-20-2016
06:09 PM
@Kuldeep Kulkarni great stuff. I find myself getting this confused as well.
... View more
07-19-2016
02:23 AM
@Michael Sobelman That DNS is not detectable by the node you are trying to access from. You can be fancy on aws and configure through routing tables by setting up a proper vpn between the EMR and NiFi nodes. Another option I used is route53 which will give you DNS publicly available. Lastly you can put a ELB infront of your EMR HBase master node. You may have to script it up (via boot scripts) to configure your ELB to point to new internal IP.
... View more
02-06-2017
01:05 PM
@Laurent Edel what about the jobs are planified to be run? if every oozie server know that there are jobs that must be executed, how to decide which execute the job? If it is done by locking using zookeeper, it does the job submissionpasses trhoughtout the load balancer /dns round robin / VIP?
... View more