question Re: hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error in Archives of Support Questions (Read Only)

hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

Carolyn — Tue, 16 Aug 2016 06:12:43 GMT

I am using beeline with the HDP 2.5 tech preview.

The first time I use the source command to execute a query in beeline, the query succeeds.

The second time I run the same exact source command, beeline exits. Below is the error shown when beeline is started with the --verbose command.

I tried the source with both a newline at the end of the sql file and with no newline but I still see the error.

0: jdbc:hive2://localhost:10500/tpcds_bin_par> source query55.sql;

16/08/15 23:09:49 [main]: WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns does not exist

16/08/15 23:09:49 [main]: WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value

java.lang.ArrayIndexOutOfBoundsException: 1

at org.apache.hive.beeline.Commands.addConf(Commands.java:826)

at org.apache.hive.beeline.Commands.getHiveConfHelper(Commands.java:772)

at org.apache.hive.beeline.Commands.getHiveConf(Commands.java:764)

at org.apache.hive.beeline.Commands.sourceFile(Commands.java:852)

at org.apache.hive.beeline.Commands.executeInternal(Commands.java:932)

at org.apache.hive.beeline.Commands.execute(Commands.java:1150)

at org.apache.hive.beeline.Commands.sql(Commands.java:1065)

at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1144)

at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:975)

at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:885)

at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:501)

at org.apache.hive.beeline.BeeLine.main(BeeLine.java:484)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:606)

at org.apache.hadoop.util.RunJar.run(RunJar.java:233)

at org.apache.hadoop.util.RunJar.main(RunJar.java:148)

Closing: 0: jdbc:hive2://localhost:10500/tpcds_bin_partitioned_orc_10

Re: hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

TimothySpann — Tue, 16 Aug 2016 06:25:32 GMT

The 2.5 TechPreview is a Tech Preview and you may experience a few bugs. An updated HDP 2.5 will be out soon. Can you post some configuration and hardware details. Is this a VM?

Re: hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

TimothySpann — Tue, 16 Aug 2016 06:25:48 GMT

Maybe related to those warnings:

16/08/15 23:09:49 [main]: WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns does not exist

16/08/15 23:09:49 [main]: WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value

That one may have changed to:

hive.llap.daemon.allow.permanent.fns tohive.llap.daemon.download.permanent.fns.

can you fix those two values, then restart hive services and ambari-server.

Re: hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

Carolyn — Wed, 17 Aug 2016 01:18:46 GMT

I used cloud break with the ETL-ANALYTICS template on AWS.

Re: hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

Carolyn — Wed, 17 Aug 2016 01:32:39 GMT

@Timothy Spann How do I change the property names in Ambari? I see how to add a new custom property but I need to remove the one that is incorrect.

Re: hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

TimothySpann — Wed, 17 Aug 2016 02:11:57 GMT

is it under custom? where does it show up?

Re: hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

TimothySpann — Wed, 17 Aug 2016 02:17:08 GMT

I think the main thing for you to do is to set an INT value for hive.llap.daemon.vcpus.per.instance the wrong name one may just be a warning

Re: hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

Carolyn — Sat, 20 Aug 2016 04:00:10 GMT

@Timothy Spann I was able to work around the problem by using the !run beeline command:

!run query55.sql

Another alternative is to use the -f option to beeline and avoid the interactive shell altogether:

beeline -i my.settings -u jdbc:hive2://host:10500/my_table -f query.sql