can you check the following property value either from amabri or in hive-site.xml, it should be configured in any of the following option NONE,KERBEROS,PAM,LDAP,CUSTOM
... View more
@Ravikumar Kumashi the documentation you followed looked far old and it is meant for odbc driver version 1.2.0.*, what authentication mechanism you are currently using with hiveserver2?
... View more
@Luis Valdeavellano after doing mvn package there should be a jar file with name of empirix-jar-with-dependencies.jar create inside the target folder, run this jar instead of mytestapp-1.0-SNAPSHOT.jar.
... View more
@Luis Valdeavellano seems required dependency is not available at runtime,can you try running this after building a fat jar. to build a fat jar you need to add build configuration in pom.xml and build using mvn package <build>
<finalName>mytestapp</finalName>
<plugins>
<!-- Set a compiler level -->
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-compiler-plugin</artifactId>
<version>2.3.2</version>
<configuration>
<source>1.7</source>
<target>1.7</target>
</configuration>
</plugin>
<!-- Maven Assembly Plugin -->
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-assembly-plugin</artifactId>
<version>2.4.1</version>
<configuration>
<!-- get all project dependencies -->
<descriptorRefs>
<descriptorRef>jar-with-dependencies</descriptorRef>
</descriptorRefs>
<!-- MainClass in mainfest make a executable jar -->
<archive>
<manifest>
<mainClass>HiveJdbcClient</mainClass>
</manifest>
</archive>
</configuration>
<executions>
<execution>
<id>make-assembly</id>
<!-- bind to the packaging phase -->
<phase>package</phase>
<goals>
<goal>single</goal>
</goals>
</execution>
</executions>
</plugin>
</plugins>
</build>
... View more
can you try adding this dependency in your pom.xml <dependency>
<groupId>org.apache.storm</groupId>
<artifactId>storm-kafka</artifactId>
<version>0.10.0.2.4.0.0-169</version>
</dependency>
... View more
@ARUNKUMAR RAMASAMY add a custom hive-site.xml properties with the name of hive.aux.jars.path if it is not available and add your jars file:///home/user/xyz.jar
... View more
I think you want to unit test this python script to do so, just lunch pyspark shell which will give you python repl where you can run each line one by one to test it.
... View more
@Simran Kaur looking at Error: java.io.IOException:Illegal partition for341223(-2) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1083) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:715) at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89) it seems when writing mapper output to output buffer the partitioner called in and it is returning a -ve value(-2 in this case) which is throwing illegal partition.
... View more
