Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Does anyone have an internal/external document for setting up Archival Storage?

avatar

HDP: 2.3.2 and Ambari 2.1.2

Have been trying to follow http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_hdfs_admin_tools/content/configuring_arch... and https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html but having a few issues.

1) Ambari doesn't allow me to type "[SSD]file:///...."

2) By using "[DISK]/hadoop/hdfs/data,[SSD]/hadoop/hdfs/ssd", I can read the data but can't write

3) Command examples in both URL do not work (I'm guessing it shouldn't be "dfsadmin")

I'm getting tired of following docs.., so I was wondering if someone could share the note to set up Archival Storage.

1 ACCEPTED SOLUTION

avatar

After restarting all HDFS components a few times, (2) was resolved (can write now).

But I'm not sure if I'm doing right way because all docs say "file:///" and I couldn't use that.

View solution in original post

5 REPLIES 5

avatar

After restarting all HDFS components a few times, (2) was resolved (can write now).

But I'm not sure if I'm doing right way because all docs say "file:///" and I couldn't use that.

avatar
Master Mentor

avatar

This used to work in older versions of Ambari (see p. 201 onwards in white paper here where we had it working)

In Ambari 2.1.0 I know it was broken (see JIRA) but according to the bug details it was fixed in 2.1.1

+ @jeff@hortonworks.com in case he has more on this

avatar

The bug you advised me looks like for fixing "[XXX]" part but not "file://" part, i guess. So I assume this bug has been fixed.

avatar
Master Mentor

@Hajime has this been resolved? Can you post your solution or accept best answer?