I have an ORC table that I am updating daily with the contents of a CSV file. When I created the table, I specified a bloom filter column. Is there any maintenance I need to perform with subsequent inserts? The table is about 500MM records and gets 50MM new records daily. ... View more

I am running HDP Sandbox in an Azure VM. I can successfully add a disk to the VM and format / mount it. I would like to add it to HDFS to extend my storage. I am performing the following steps to get it recognized: Create directory on the volume: i.e. mkdir /data/hdfs/data Change perms: sudo chmod -R 755 /data/hdfs/data Change ownership: sudo chown -R hadoop:hdfs /data/hdfs/data Stop datanode through Ambari Change dfs.data.dir property in /etc/hadoop/conf/hdfs-site.xml, add directory comma delimited Restart datanode Unfortunately, everytime I restart the datanode, the dfs.data.dir property reverts back to default. What am I doing wrong? ... View more