Hue sends queries to HiveServer2, so you would want to implement it in the CM configuration for HS2, which is this safety valve in the Hive service: HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xml ... View more

First, try to index only couple of records. If that doesn't work then recheck the data values and data types used. If it works then index the data in small batches ... I faced a similar issue if more than 200 records are indexed. ... View more

If you use CM you don't need to use the Hue safety valve. Make sure the Trift Server is added and started Make sure in the Hue configuration that the HBase service and the HBase thrift service are checked Restart Hue and that's it! Romain ... View more

I decided to do a quick check on the attempt processing one of oozie's hive actions:   org.apache.hadoop.mapred.YarnChild 10.0.0.9 33024 attempt_1431965085423_0015_m_000000_0 2   ...and collected a quick stack trace which shows the hive client does indeed run inproc with the JVM running the attempt:   "main" prio=10 tid=0x00007f4dbc027800 nid=0xac2c in Object.wait() [0x00007f4dc5c2b000]    java.lang.Thread.State: WAITING (on object monitor)     at java.lang.Object.wait(Native Method)     - waiting on <0x00000000fe43fa48> (a org.apache.hadoop.ipc.Client$Call)     at java.lang.Object.wait(Object.java:503)     at org.apache.hadoop.ipc.Client.call(Client.java:1454)     - locked <0x00000000fe43fa48> (a org.apache.hadoop.ipc.Client$Call)     at org.apache.hadoop.ipc.Client.call(Client.java:1399)     at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)     at com.sun.proxy.$Proxy32.getJobReport(Unknown Source)     at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getJobReport(MRClientProtocolPBClientImpl.java:133)     at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)     at java.lang.reflect.Method.invoke(Method.java:606)     at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:323)     - locked <0x00000000ff3bafd0> (a org.apache.hadoop.mapred.ClientServiceDelegate)     at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:422)     at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:575)     at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:183)     at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:603)     at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:601)     at java.security.AccessController.doPrivileged(Native Method)     at javax.security.auth.Subject.doAs(Subject.java:415)     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)     at org.apache.hadoop.mapred.JobClient.getJobUsingCluster(JobClient.java:601)     at org.apache.hadoop.mapred.JobClient.getJobInner(JobClient.java:611)     at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:636)     at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:288)     at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:547)     at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:435)     at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137)     at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)     at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)     at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1604)     at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1364)     at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1177)     at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1004)     at org.apache.hadoop.hive.ql.Driver.run(Driver.java:994)     at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:247)     at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:199)     at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:410)     at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:345)     at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:443)     at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:459)     at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:739)     at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677)     at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)     at org.apache.oozie.action.hadoop.HiveMain.runHive(HiveMain.java:323)     at org.apache.oozie.action.hadoop.HiveMain.run(HiveMain.java:284)     at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:39)     at org.apache.oozie.action.hadoop.HiveMain.main(HiveMain.java:66)     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)     at java.lang.reflect.Method.invoke(Method.java:606)     at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:226)     at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)     at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)     at java.security.AccessController.doPrivileged(Native Method)     at javax.security.auth.Subject.doAs(Subject.java:415)     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)   Thanks ... View more

Great. It works !!!   Many thanks for your suggestion. Alessio   ... View more

  I ended up going with option 2 which solved the immediate problem.  Thanks. ... View more

Great! And for information, look at the Hue configuration section and look at Sentry, you should just need to check it and it will configure Hue automatically (no need to use any safety valve or put the Sentry service on the same host as Hue) Romain ... View more

Hi,   to read data in avro format from Hive you have to use an Avro SerDe. Maybe a good starting point will be http://www.michael-noll.com/blog/2013/07/04/using-avro-in-mapreduce-jobs-with-hadoop-pig-hive/   But this is not related to this topic since the solr sink will put data into Solr. I'd suggest to use just a HDFS sink to put your data on HDFS and create an (external or not) Hive table afterwards. You do not need Solr and/or Morphlines for this.   best, Gerd ... View more

Hey   In Step 4 are we editing the file /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/etc/oozie/conf.dist/oozie-site.xml manually?   We are using CM.   I see changes in CM but not in the oozie-site.xml  or on Oozie admin UI .   Getting error    [JA020: Could not load credentials of type [hbase] with name [hbase_credentials]]; perhaps it was not defined in oozie-site.xml?]   Thanks   ... View more