Member since
11-22-2019
7
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3192 | 12-10-2019 07:17 PM |
12-20-2019
09:08 PM
@Bindal
The "/user" directory permission and ownership is shows as "hdfs:hdfs:drwxr-xr-x" Which means it can be written only by superuser "hdfs". However in ambari you have logged in as "admin" user which is NOT superuser "hdfs". So you may have to change the ownership of this dir (Which is not recommended) so that 'admin' user can create a directory inside it ....
But if you want to perform the directory creation inside "/user" via file view only then you can try this:
1. In Ambari UI Navigate to
"admin" → "Manage Ambari" → Users → "Add Users" Button
2. Create a user with name "hdfs" (you can choose your own desired password for this user and specify in the UI form)
3. You can create this user as Cluster Admin ...etc based on the type needed in the "User Access" section. Similarly you can make that user as Ambari Admin if needed. (But this is up to your requirement)
4. Now give the View Access permission to this user "hdfs"
"admin" → "Manage Ambari" → Views → "AUTO_FILES_INSTANCE" (click on "edit" button)
5. At the end of the "AUTO_FILES_INSTANCE" view definition you will find section named as "Permissions" please add user "hdfs" there.
6. Now try to login to a freshly opened browser as "hdfs" user and then you should be able to create Folders inside "/user" directory using File View.
.
Later you can disable the "hdfs" user account anytime in the Ambari UI.
... View more
12-17-2019
05:48 AM
1 Kudo
@Bindal Do the following steps sandbox-hdp login: root root@sandbox-hdp.hortonworks.com's password: ..... [root@sandbox-hdp~] mkdir -p /tmp/data [root@sandbox-hdp~]cd /tmp/data Now here you should be in /tmp/data to validate that do [root@sandbox-hdp~]pwd copy your riskfactor1.csv to this directory using some tool win Winscp or Mobaxterm see my screenshot using winscp My question is where is riskfactor1.csv file located? If that's not clear you can upload using the ambari view first navigate to /bindal/data and then select the upload please see attached screenshot to upload the file from your laptop. After the successful upload, you can run your Zeppelin job and keep me posted
... View more
12-10-2019
07:17 PM
I restarted all the interpreters in settings section like :- spark2, angular jdbc livy2 md and saved it. Then re-run the code and it was successful. Thanks.
... View more
11-22-2019
10:56 PM
Hi @mqureshi , you have explained beautifully. But how the replication of blocks will impact this calculation? Please explain. Regards.
... View more