Member since
04-02-2019
36
Posts
0
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9361 | 05-21-2019 10:54 PM | |
12859 | 05-15-2019 10:50 PM |
05-14-2019
10:34 AM
For apt list oracle-j2sdk1.8 I got tmah@masternode:~$ apt list oracle-j2sdk1.8
Listing... Done
oracle-j2sdk1.8/unknown,now 1.8.0+update181-1 amd64 [installed] And for dpkg-query -L oracle-j2sdk1.8 I got a lot! The following are the last 20 lines ....
....
....
/usr/lib/jvm/java-8-oracle-cloudera/include
/usr/lib/jvm/java-8-oracle-cloudera/include/jdwpTransport.h
/usr/lib/jvm/java-8-oracle-cloudera/include/linux
/usr/lib/jvm/java-8-oracle-cloudera/include/linux/jawt_md.h
/usr/lib/jvm/java-8-oracle-cloudera/include/linux/jni_md.h
/usr/lib/jvm/java-8-oracle-cloudera/include/classfile_constants.h
/usr/lib/jvm/java-8-oracle-cloudera/include/jni.h
/usr/lib/jvm/java-8-oracle-cloudera/include/jvmticmlr.h
/usr/lib/jvm/java-8-oracle-cloudera/include/jawt.h
/usr/lib/jvm/java-8-oracle-cloudera/include/jvmti.h
/usr/lib/jvm/java-8-oracle-cloudera/THIRDPARTYLICENSEREADME-JAVAFX.txt
/usr/lib/jvm/java-8-oracle-cloudera/LICENSE
/usr/lib/jvm/java-8-oracle-cloudera/release
/usr/share
/usr/share/doc
/usr/share/doc/oracle-j2sdk1.8
/usr/share/doc/oracle-j2sdk1.8/changelog.gz
/usr/lib/jvm/java-8-oracle-cloudera/jre/bin/ControlPanel
/usr/lib/jvm/java-8-oracle-cloudera/jre/lib/amd64/server/libjsig.so
/usr/lib/jvm/java-8-oracle-cloudera/bin/ControlPanel
/usr/lib/jvm/java-8-oracle-cloudera/man/ja Thanks
... View more
05-14-2019
05:31 AM
OK I have chosen to install Cloudera 6.2 from scratch. Now when I run sudo apt-get install oracle-j2sdk1.8 it completes successfully.... however after it finishes I can't find any java folder under /usr !! And when I move to the next step of enabling auto-TLS, and run sudo JAVA_HOME=/usr/java/jdk1.8.0_181-cloudera /opt/cloudera/cm-agent/bin/certmanager setup --configure-services I get the following exception Exception: Cannot identify a valid keytool: /usr/java/jdk1.8.0_181-cloudera/bin/keytool and when i "java --version" i get The program 'java' can be found in the following packages:
* default-jre
* gcj-5-jre-headless
* openjdk-8-jre-headless
* gcj-4.8-jre-headless
* gcj-4.9-jre-headless
* openjdk-9-jre-headless
Try: sudo apt install <selected package>
... View more
05-13-2019
06:55 AM
Great! Now why I am still seeing java 1.7 in the Cloudera Manager and when “Java -version”. By the way I am using the Cloudera quickstart vm. And I am doubting that there is something that forces java 1.7 and even reset JAVA_HOME to the 1.7 folder on every restart ... am I right? What to do next?
... View more
05-13-2019
05:03 AM
"yum install java-1.8.0-openjdk-devel" [root@quickstart cloudera]# yum install java-1.8.0-openjdk-devel
Loaded plugins: fastestmirror, security
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: centos.activecloud.co.il
* epel: epel.scopesky.iq
* extras: centos.interhost.net.il
* updates: centos.activecloud.co.il
Resolving Dependencies
--> Running transaction check
---> Package java-1.8.0-openjdk-devel.x86_64 1:1.8.0.212.b04-0.el6_10 will be installed
--> Processing Dependency: java-1.8.0-openjdk = 1:1.8.0.212.b04-0.el6_10 for package: 1:java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: libawt_xawt.so(SUNWprivate_1.1)(64bit) for package: 1:java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: libjvm.so()(64bit) for package: 1:java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: libjava.so()(64bit) for package: 1:java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: libawt_xawt.so()(64bit) for package: 1:java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: libawt.so()(64bit) for package: 1:java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64
--> Running transaction check
---> Package java-1.8.0-openjdk.x86_64 1:1.8.0.212.b04-0.el6_10 will be installed
--> Processing Dependency: xorg-x11-fonts-Type1 for package: 1:java-1.8.0-openjdk-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: libgif.so.4()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.212.b04-0.el6_10.x86_64
---> Package java-1.8.0-openjdk-headless.x86_64 1:1.8.0.212.b04-0.el6_10 will be installed
--> Processing Dependency: tzdata-java >= 2014f-1 for package: 1:java-1.8.0-openjdk-headless-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: pcsc-lite-libs(x86-64) for package: 1:java-1.8.0-openjdk-headless-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: lksctp-tools(x86-64) for package: 1:java-1.8.0-openjdk-headless-1.8.0.212.b04-0.el6_10.x86_64
--> Processing Dependency: jpackage-utils for package: 1:java-1.8.0-openjdk-headless-1.8.0.212.b04-0.el6_10.x86_64
--> Running transaction check
---> Package giflib.x86_64 0:4.1.6-3.1.el6 will be installed
---> Package jpackage-utils.noarch 0:1.7.5-3.16.el6 will be installed
---> Package lksctp-tools.x86_64 0:1.0.10-7.el6 will be installed
---> Package pcsc-lite-libs.x86_64 0:1.5.2-16.el6 will be installed
---> Package tzdata-java.noarch 0:2019a-1.el6 will be installed
---> Package xorg-x11-fonts-Type1.noarch 0:7.2-11.el6 will be installed
--> Processing Dependency: ttmkfdir for package: xorg-x11-fonts-Type1-7.2-11.el6.noarch
--> Processing Dependency: ttmkfdir for package: xorg-x11-fonts-Type1-7.2-11.el6.noarch
--> Running transaction check
---> Package ttmkfdir.x86_64 0:3.0.9-32.1.el6 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
==================================================================================================================
Package Arch Version Repository Size
==================================================================================================================
Installing:
java-1.8.0-openjdk-devel x86_64 1:1.8.0.212.b04-0.el6_10 updates 10 M
Installing for dependencies:
giflib x86_64 4.1.6-3.1.el6 base 37 k
java-1.8.0-openjdk x86_64 1:1.8.0.212.b04-0.el6_10 updates 228 k
java-1.8.0-openjdk-headless x86_64 1:1.8.0.212.b04-0.el6_10 updates 32 M
jpackage-utils noarch 1.7.5-3.16.el6 base 60 k
lksctp-tools x86_64 1.0.10-7.el6 base 79 k
pcsc-lite-libs x86_64 1.5.2-16.el6 base 28 k
ttmkfdir x86_64 3.0.9-32.1.el6 base 43 k
tzdata-java noarch 2019a-1.el6 updates 188 k
xorg-x11-fonts-Type1 noarch 7.2-11.el6 base 520 k
Transaction Summary
==================================================================================================================
Install 10 Package(s)
Total download size: 43 M
Installed size: 146 M
Is this ok [y/N]: y
Downloading Packages:
http://centos.activecloud.co.il/6.10/os/x86_64/Packages/giflib-4.1.6-3.1.el6.x86_64.rpm: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 502 Bad Gateway"
Trying other mirror.
(1/10): giflib-4.1.6-3.1.el6.x86_64.rpm | 37 kB 00:00
(2/10): java-1.8.0-openjdk-1.8.0.212.b04-0.el6_10.x86_64.rpm | 228 kB 00:00
(3/10): java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64.rpm | 10 MB 00:03
(4/10): java-1.8.0-openjdk-headless-1.8.0.212.b04-0.el6_10.x86_64.rpm | 32 MB 00:11
(5/10): jpackage-utils-1.7.5-3.16.el6.noarch.rpm | 60 kB 00:00
(6/10): lksctp-tools-1.0.10-7.el6.x86_64.rpm | 79 kB 00:00
(7/10): pcsc-lite-libs-1.5.2-16.el6.x86_64.rpm | 28 kB 00:00
(8/10): ttmkfdir-3.0.9-32.1.el6.x86_64.rpm | 43 kB 00:00
(9/10): tzdata-java-2019a-1.el6.noarch.rpm | 188 kB 00:00
(10/10): xorg-x11-fonts-Type1-7.2-11.el6.noarch.rpm | 520 kB 00:00
------------------------------------------------------------------------------------------------------------------
Total 1.9 MB/s | 43 MB 00:22
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : jpackage-utils-1.7.5-3.16.el6.noarch 1/10
Installing : giflib-4.1.6-3.1.el6.x86_64 2/10
Installing : lksctp-tools-1.0.10-7.el6.x86_64 3/10
Installing : pcsc-lite-libs-1.5.2-16.el6.x86_64 4/10
Installing : tzdata-java-2019a-1.el6.noarch 5/10
Installing : 1:java-1.8.0-openjdk-headless-1.8.0.212.b04-0.el6_10.x86_64 6/10
Installing : ttmkfdir-3.0.9-32.1.el6.x86_64 7/10
Installing : xorg-x11-fonts-Type1-7.2-11.el6.noarch 8/10
Installing : 1:java-1.8.0-openjdk-1.8.0.212.b04-0.el6_10.x86_64 9/10
Installing : 1:java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64 10/10
Verifying : ttmkfdir-3.0.9-32.1.el6.x86_64 1/10
Verifying : 1:java-1.8.0-openjdk-headless-1.8.0.212.b04-0.el6_10.x86_64 2/10
Verifying : tzdata-java-2019a-1.el6.noarch 3/10
Verifying : 1:java-1.8.0-openjdk-devel-1.8.0.212.b04-0.el6_10.x86_64 4/10
Verifying : 1:java-1.8.0-openjdk-1.8.0.212.b04-0.el6_10.x86_64 5/10
Verifying : pcsc-lite-libs-1.5.2-16.el6.x86_64 6/10
Verifying : xorg-x11-fonts-Type1-7.2-11.el6.noarch 7/10
Verifying : lksctp-tools-1.0.10-7.el6.x86_64 8/10
Verifying : giflib-4.1.6-3.1.el6.x86_64 9/10
Verifying : jpackage-utils-1.7.5-3.16.el6.noarch 10/10
Installed:
java-1.8.0-openjdk-devel.x86_64 1:1.8.0.212.b04-0.el6_10
Dependency Installed:
giflib.x86_64 0:4.1.6-3.1.el6 java-1.8.0-openjdk.x86_64 1:1.8.0.212.b04-0.el6_10
java-1.8.0-openjdk-headless.x86_64 1:1.8.0.212.b04-0.el6_10 jpackage-utils.noarch 0:1.7.5-3.16.el6
lksctp-tools.x86_64 0:1.0.10-7.el6 pcsc-lite-libs.x86_64 0:1.5.2-16.el6
ttmkfdir.x86_64 0:3.0.9-32.1.el6 tzdata-java.noarch 0:2019a-1.el6
xorg-x11-fonts-Type1.noarch 0:7.2-11.el6
Complete!
... View more
05-13-2019
04:16 AM
by mistake I have deleted "cloudera-cdh5.repo". did I do a catastrophe ?! 😞 Can this be fixed? and still I am getting the same error. even after: wget https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/cloudera-manager.repo -P /etc/yum.repos.d/ then rpm --import https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera then Install Java Development Kit. And if you ask, when I do "cat /etc/yum.repos.d/cloudera-manager.repo", I get
... View more
05-13-2019
03:12 AM
I want to upgrade from 5.16 to 6.2 and based on this https://www.cloudera.com/documentation/enterprise/upgrade/topics/ug_cm_upgrade_server.html#cm_install_jdk I need to upgrade to Oracle-j2sdk1.8 from 1.7 first before I can start the major upgrade. Now, do I have to change anything or just follow your instructions: "As first step please add the CM repository file as shown in documentation chapter. Then install Oracle JDK as shown here." thanks 🙂
... View more
05-13-2019
02:59 AM
this is the result of cat /etc/yum.repos.d/cloudera-cdh5.repo Please help ... I need to upgrade to CHD6 Thanks
... View more
05-13-2019
01:16 AM
I have CHD 5.16 and I don't have this '/etc/yum.repos.d/cloudera.repo' if I 'ls /etc/yum.repos.d/cloudera-cdh5.repo' I get '/etc/yum.repos.d/cloudera-cdh5.repo' I am getting the same error 'No package oracle-j2sdk1.8.x86_64 available.' although I did 'yum clean all' I can run yum with no connectivity problem ... I mean I can upgrade other things on the centos What to do! '
... View more
05-09-2019
03:07 AM
I run the following sqoop merge import
sudo sqoop import \
--connect 'jdbc:sqlserver://1.1.1.1\test_server;database=Training' \
--username Training_user --password Training_user \
--table BigDataTest -m 1 \
--check-column lastmodified \
--merge-key id \
--incremental lastmodified \
--compression-codec=snappy \
--as-parquetfile \
--target-dir /user/hive/warehouse \
--hive-table bigDataTest \
--last-value '2019-05-06 15:07:49.917'
I get this
. . . 19/05/09 11:00:50 INFO tool.ImportTool: Final destination exists, will run merge job.
19/05/09 11:00:50 ERROR tool.ImportTool: Import failed: java.io.IOException: Could not load jar /tmp/sqoop-root/compile/e913f7c459cf4e1cdb8a8d5802f1dac2/codegen_BigDataTest.jar into JVM. (Cou ld not find class BigDataTest.)
at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:92)
at com.cloudera.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:36)
at org.apache.sqoop.tool.ImportTool.loadJars(ImportTool.java:120)
at org.apache.sqoop.tool.ImportTool.lastModifiedMerge(ImportTool.java:456)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:522)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:621)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
Caused by: java.lang.ClassNotFoundException: BigDataTest
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:789)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:88)
... 11 more
why? and how I can fix it ?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Sqoop
05-05-2019
12:56 AM
I am running the following query on the same data (same tables, and the same number of records on those tables), but it gives a different result on Impala than what I get on SQL Server. The following on Impala: and this is on SQL Server: I am very sure that the data is the same in everything ... actually, I have imported the data from SQL Server through Sqoop and after that made sure that the number of records is the same in the source and destination .... yet I don't know why I'm getting a defferent result here and there ?!!!
... View more
Labels:
- Labels:
-
Apache Impala
- « Previous
- Next »