Member since
05-24-2019
314
Posts
11
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
114 | 12-13-2024 08:17 AM | |
1016 | 07-22-2024 01:41 PM | |
1856 | 09-21-2023 06:52 AM | |
4335 | 02-17-2023 10:46 AM | |
2228 | 06-08-2022 08:39 AM |
01-03-2025
08:19 AM
1 Kudo
Hello, Please gather the PID of HiveServer2 and run this command: lsof -Pn -p <PID> | egrep TCP It should return something like this: [root@ccycloud apache]# lsof -Pn -p 426744 | egrep TCP java 426744 hive 680u IPv6 1426885630 0t0 TCP 127.0.0.1:46404->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 682u IPv6 1426605725 0t0 TCP 127.0.0.1:46420->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 683u IPv6 1426958951 0t0 TCP 127.0.0.1:46422->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 684u IPv6 1427031052 0t0 TCP 127.0.0.1:46426->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 685u IPv6 1427031053 0t0 TCP 127.0.0.1:46436->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 686u IPv6 1426956920 0t0 TCP 127.0.0.1:46444->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 687u IPv6 1426956921 0t0 TCP 127.0.0.1:46452->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 688u IPv6 1426847703 0t0 TCP 127.0.0.1:46466->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 692u IPv6 1426847704 0t0 TCP *:10000 (LISTEN) java 426744 hive 693u IPv6 1427016047 0t0 TCP *:10002 (LISTEN) java 426744 hive 704u IPv6 1427016054 0t0 TCP 127.0.0.1:46476->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 705u IPv6 1427037042 0t0 TCP 127.0.0.1:57868->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 706u IPv6 1427549483 0t0 TCP 127.0.0.1:10000->127.0.0.1:54610 (ESTABLISHED) Connections to Hive Metastore must be setup first before HS2 starts listening on port 10000 Hope this helps
... View more
12-11-2024
06:33 AM
Hello, These are NOT ERRORS: INFO conf.Configuration: resource-types.xml not found.
INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. As for this: INFO mapreduce.Job: map 0% reduce 0% How many mappers were specified for the IMPORT? Try locating the running containers in YARN and take a few JSTACKs to find out if the mapper is stuck waiting from your source database, if so make sure there are no firewall/network rules preventing the flow of data. Are you able to execute SQOOP EVAL on the source DB? If so, try using options: -jt local
-m 1
--verbose If the job completes, that would confirm a communication issue from your NodeManagers to the source DB
... View more
10-11-2024
08:32 AM
1 Kudo
Are you able to reproduce at will? If so, provide the Cloudera Runtime version and the associated DDL/DML
... View more
09-24-2024
06:59 AM
1 Kudo
@hanumanth Your Python code is throwing this: OSError: [Errno 2] No such file or directory The stack is not enough to determine what is happening Please look at the following items: * job.properties / workflow.xml Is this being setup as a Shell Action? Are all the necessary files being provided? The action needs to setup the Python environment within a YARN container * Oozie launcher log Is Python code starting to execute and then hit a snag or it does fail from the get-go?
... View more
08-16-2024
02:12 PM
1 Kudo
@zhaiziha Are you running this query on DataHub or Hive VW? Please try your SELECT statement on Beeline from DataHub as follows and let us know how it works for you SET hive.server2.logging.operation.level=VERBOSE; SET hive.input.format = org.apache.hadoop.hive.ql.io.HiveInputFormat; SET fs.s3a.experimental.input.fadvise=random; SET fs.s3a.readahead.range=1024K; SET parquet.enable.dictionary=false; SELECT * FROM small; Should that fail, can you provide the beeline output and simple repro steps? Seems like some form of HADOOP-16109
... View more
07-22-2024
01:41 PM
Hello @StefanSs This does not seem like a Cloudera CDP distro / Oozie Supported version We suggest to reach the Oozie Mailing list and provide simple repro steps for the community to review or contact Amazon Support Hope this helps -JMP
... View more
07-18-2024
06:48 AM
OK.... So, sqlplus works from the same host SQOOP is being tried? What is the output from SQOOP eval for "SELECT COUNT(*) FROM <YOUR TABLE>;" vs import on the same table?
... View more
07-17-2024
01:38 PM
Hello, This seems more of an Oracle TNS listener misconfiguration Oracle native sqlplus should be able to connect before using SQOOP: sqlplus <USER>/<PASSWD>@prxd10-scan.intranet.slt.com.lk:1521/<listener> Hope this helps, -JMP
... View more
09-21-2023
06:52 AM
@Lorenzo Hive is unaware of Spark and won't use it to execute commands On the other hand, Spark can access Hive data using the HiveWarehouseConnector Hope this helps, -JMP
... View more