Member since
05-30-2018
1322
Posts
715
Kudos Received
148
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4030 | 08-20-2018 08:26 PM | |
| 1933 | 08-15-2018 01:59 PM | |
| 2365 | 08-13-2018 02:20 PM | |
| 4092 | 07-23-2018 04:37 PM | |
| 5001 | 07-19-2018 12:52 PM |
05-04-2016
07:11 PM
@Sami Ahmad you can change the owner of /user/hadoop folder by issuing this command hdfs dfs -chown -R hadoop /user/hadoop or hadoop fs -chown -R hadoop /user/hadoop Do the above command as user hdfs.
... View more
05-04-2016
07:08 PM
@Sami Ahmad you are inserting data using user hadoop into directory /user/hadoop. to fix this provide user hadoop permission to write to file directory /user/hadoop. You can also simple add user hadoop to linux group hdfs. then all permissions group hdfs has will be inheritried by users within the group. let me know if you need more details.
... View more
05-04-2016
03:12 AM
@Benjamin Leonhardi that is if the client is located on a specific data node. on a edge node (not associated with data node) NN will try and colocate the splits but I don't believe it can guarantee same node. I believe it will be at the very minimum same rack.
... View more
05-03-2016
07:39 PM
creating a new cluster and registering the host times out. I have setup passwordless ssh and updated all /etc/hosts file. Here is what I see in the log file: INFO:root:BootStrapping hosts ['xxxx.xxxxx.com'] using /usr/lib/python2.6/site-packages/a
mbari_server cluster primary OS: redhat6 with user 'root' sshKey File /var/run/ambari-server/bootstrap/6/
sshKey password File null using tmp dir /var/run/ambari-server/bootstrap/6 ambari: xxxx.xxxxx.com; server_port: 8080; ambari version: 2.2.1.0; user_run_as: root
INFO:root:Executing parallel bootstrap
WARNING:root:Bootstrap at host xxxx.xxxxx.com timed out and will be interrupted
INFO:root:Finished parallel bootstrap I sometimes get lucky during the registration and it works. I have 4 more host to do. i have to keep retrying.
... View more
Labels:
- Labels:
-
Apache Ambari
05-03-2016
07:21 PM
@rkovacs @rdoktorics I need to know all the repos cloudbreak fetches and where does it fetch it from for security reasons.
... View more
05-03-2016
07:18 PM
@rkovacs basically can cloudbreak use local repository instead of fetching them. Do I understand correctly that is not possible?
... View more
05-03-2016
05:22 PM
@michael klybor documentation available here. Falcon currently support following ELs:
1. now(hours,minutes): now refer to the instance start time. Hours and minutes given are in reference with the start time of instance. For example now(-2,40) corresponds to feed instance at -2 hr and +40 minutes i.e. feed instance 80 mins before the instance start time. Id user would have given now(0,-80) it would have correspond to the same. 2. today(hours,minutes): hours and minutes given in this EL corresponds to instance from the start day of instance start time. Ie. If instance start is at 2010-01-02T01:30Z then today(-3,-20) will mean instance created at 2010-01-01T20:40 and today(3,20) will correspond to 2010-01-02T3:20Z.
3. yesterday(hours,minutes): As the name suggest EL yesterday picks up feed instances with respect to start of day yesterday. Hours and minutes are added to the 00 hours starting yesterday, Example: yesterday(24,30) will actually correspond to 00:30 am of today, for 2010-01-02T01:30Z this would mean 2010-01-02:00:30 feed.
7. lastYear(month,day,hour,minute): This is exactly similarly to currentYear in usage> only difference being start reference is taken to start of previous year. For example: lastYear(4,2,2,20) will correspond to feed instance created at 2009-05-03T02:20Z and lastYear(12,2,2,20) will correspond to feed at 2010-01-03T02:20Z.
4. currentMonth(day,hour,minute): Current month takes the reference to start of the month with respect to instance start time. One thing to keep in mind is that day is added to the first day of the month. So the value of day is the number of days you want to add to the first day of the month. For example: for instance start time 2010-01-12T01:30Z and El as currentMonth(3,2,40) will correspond to feed created at 2010-01-04T02:40Z and currentMonth(0,0,0) will mean 2010-01-01T00:00Z.
5. lastMonth(day,hour,minute): Parameters for lastMonth is same as currentMonth, only difference being the reference is shifted to one month back. For instance start 2010-01-12T01:30Z lastMonth(2,3,30) will correspond to feed instance at 2009-12-03:T03:30Z
6. currentYear(month,day,hour,minute): The month,day,hour, minutes in the parameter are added with reference to the start of year of instance start time. For our example start time 2010-01-02:00:30 reference will go back to 2010-01-01:T00:00Z. Also similar to days, months are added to the 1st month that Jan. So currentYear(0,2,2,20) will mean 2010-01-03T02:20Z while currentYear(11,2,2,20) will mean 2010-12-03T02:20Z
7. lastYear(month,day,hour,minute): This is exactly similarly to currentYear in usage> only difference being start reference is taken to start of previous year. For example: lastYear(4,2,2,20) will corrospond to feed insatnce created at 2009-05-03T02:20Z and lastYear(12,2,2,20) will corrospond to feed at 2010-01-03T02:20Z.
8. latest(number of latest instance): This will simply make you input consider the number of latest available instance of the feed given as parameter. For example: latest(0) will consider the last available instance of feed, where as latest latest(-1) will consider second last available feed and latest(-3) will consider 4th last available feed.
9. currentWeek(weekDayName,hour,minute): This is similar to currentMonth in the sense that it returns a relative time with respect to the instance start time, considering the day name provided as input as the start of the week. The day names can be one of SUN, MON, TUE, WED, THU, FRI, SAT.
10. lastWeek(weekDayName,hour,minute): This is typically 7 days less than what the currentWeek returns for similar parameters.
... View more
05-03-2016
04:36 PM
@jeden NN may also put the next split on the same data node.
... View more
05-03-2016
04:35 PM
@jeden when a file exceeds a block size, NN will try and put the next split in another data node within the same rack. Please read replica placement here.
... View more