@kishore sanchina Looking at your logs, you are running out of PermGen space. you need to increase PermGen and likely your java heap also. How much memory do you have? 2016-08-29 06:58:42,186 ERROR [NiFi Web Server-96] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[NiFi Web Server-96,5,main]: java.lang.OutOfMemoryError: PermGen space You need to increase the following in your conf/bootstrap.conf folder. I would double it for now to start with. #java.arg.11=-XX:PermSize=128M #java.arg.12=-XX:MaxPermSize=128M And then possibly update following also. # JVM memory settings java.arg.2=-Xms1024m java.arg.3=-Xmx1024m It would be very difficult for me or anyone else to optimize these for your specific load. You need to figure out based on your load how much memory you need to assign to permgen as well as java heap. this may be trial and error. ... View more

@ScipioTheYounger I would say only one type of authorization is available for metastore and it is the Storage based. The second one is pretty useless. It's the legacy one and it allows users to grant themselves whatever permissions they want. ... View more

@Johnny Fugers First find if your data is normally distributed. If not, what's the distribution? That's what will pretty much determine which test you should be using. If data is not normally distributed, you can convert data to its normal form. So, first know your distribution. Are you familiar with Grubb's test? You will have to write your own UDF to do that using Hive. But why do you want to limit yourself to Hive? You can read Hive data using Spark? Spark MLLib will provide you with several out of the box tools to do just that. Your data can still be read using Hive for all other things that you are doing with it but at the same time you can use Spark on same data. Check this link. ... View more