Member since
04-08-2019
37
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4153 | 10-11-2020 11:53 PM |
10-08-2020
07:47 PM
Hello Team, We are planning to Impala UDFs and UDAs. To try things out we started by exploring the examples given in the cloudera github repo. After building the .so file using the make utility when I try to create the function using the following create function has_vowels (string) returns boolean location '/user/hive/udfs/libudfsample.so' symbol='HasVowels'; We are getting the following error ERROR: AnalysisException: Could not load binary: /<hdfs_path>/udfs/libudfsample.so
Unable to load /var/lib/impala/udfs/libudfsample.9909.1.so
dlerror: /opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/impala/lib/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /var/lib/impala/udfs/libudfsample.9909.1.so) Following are the error logs org.apache.impala.common.AnalysisException: Could not load binary: /user/parth.khatwani/udfs/libudfsample.so
Unable to load /var/lib/impala/udfs/libudfsample.9909.1.so
dlerror: /opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/impala/lib/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /var/lib/impala/udfs/libudfsample.9909.1.so)
at org.apache.impala.catalog.Function.lookupSymbol(Function.java:442)
at org.apache.impala.analysis.CreateUdfStmt.analyze(CreateUdfStmt.java:92)
at org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:451)
at org.apache.impala.analysis.AnalysisContext.analyzeAndAuthorize(AnalysisContext.java:421)
at org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:1285)
at org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:1252)
at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1222)
at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:167)
I1009 02:42:52.638576 15136 status.cc:124] 3c48433373076c77:30eff6ff00000000] AnalysisException: Could not load binary: /user/parth.khatwani/udfs/libudfsample.so
Unable to load /var/lib/impala/udfs/libudfsample.9909.1.so I am unable to figure out what's wrong here. Regards Parth
... View more
Labels:
- Labels:
-
Apache Impala
05-13-2020
04:53 AM
@Tim Armstrong thanks for detailed insights this will be very helpful.
... View more
04-30-2020
06:24 AM
1 Kudo
Hello Team, We are using Impala to query data stored as parquet on s3. This has been an awesome feature. Recently Amazon S3 has announced a new feature called S3 Select which helps in speeding up the column projection when querying data stored on S3. As of now Hive and Presto support S3 select push down. Is Impala going to support S3 select push downs? Parth
... View more
Labels:
- Labels:
-
Apache Impala
11-28-2019
07:19 AM
Hey @EricL Apologies for terribly delayed response. The reason why we don't want to install kerberos is that we are using a third party BI tool which connect to our DW Infrastucture(consisting of Kudu, Hive Metastore and Impala) and the tool does not support kerberos authentication. We are heavily dependent on the on the BI tool which we use and cannot do away with it. Sentry enforces to use kerberos for authentication while Ranger does not enforce this as it supports other authentication mechanisms as well. That's why we are waiting eagerly for cloudera to release a version of Impala(supported by 3.3 latest released by cloudera is 3.2) which supports Ranger. Also it will be great if you can suggest any other solution enforcing the Access controls which does not involve kerberos. Regards Parth
... View more
09-26-2019
08:20 AM
Hello Team,
We were planning to implement Role-Based-Access-Control(RBAC) for our impala tables we tried Sentry but there is a prerequisite of installing Kerberos which we don't want to use. So Apache Ranger is the other option we have but the latest CDH version 6.3 has Impala 3.2 which does not support Ranger. So just wanted to if there is going to be release of new CDH bundle which will have Impala 3.3.0 and support for ranger? What will be approximate release date of the new CDH bundle?
Regards
Parth
... View more
Labels:
09-25-2019
07:59 AM
Hello Team,
We are planning to use Sentry for implementing authorization for Impala Tables. In prerequisites for installing Sentry last point suggest to implement Kerberos authentication but point number 6 mentions that either Kerberos or LDAP is required. This is a bit confusing, can you help in clarifying if it is necessary to implement kerberos authentication for Configuring Sentry.
Regards
Parth
... View more
Labels:
- Labels:
-
Apache Impala
-
Apache Sentry
04-29-2019
08:58 AM
Thanks wdberkeley I will try out the options suggested by you. Can you suggest the best practices or the some options to do the following. My kudu cluster managed through Cloudera Manager and CDH is currently hosted in AWS I want to move it from AWS to Azure or someother cloud service provider. I will try options suggested by you for the above scenario but is there any other thing that you would like to suggest. Regards Parth
... View more
04-25-2019
06:38 AM
Hi Team, Greetings! There was a need to move the kudu installation from my current cluster of AWS machines to new cluster of AWS Machines. So I did the following steps. Took the back/sanpshot of disk haivng the kudu data Directory. Installed CDH and kudu on the new AWS cluster and attached the Disk from the older cluster to the newer one. After the installation I checked for kudu health in Cloudera Manager, kudu cluster was healthy and all new tablet servers were running fine along with master. when I ran the ksck command all except few the tables were in CONSENSUS_MISMATCH state Logs suggest the that master is still trying to refer to the tablet servers which is having IP of older machines. Can anybody help in pointing out why this is happening. Regards Parth
... View more
Labels:
- Labels:
-
Apache Kudu
04-08-2019
11:25 PM
Hi Team, Greetings, We are using Impala 2.12 along with cdh 5.16.x. We planning to upgrade to Impala 3.1.0. So will there be a need to upgrade to cdh 6.1.0 or higher inorder use Impala 3.1.0 or this can be handled using cdh 5.16.x. Regards Parth
... View more
Labels:
- Labels:
-
Apache Impala
-
Cloudera Manager
- « Previous
-
- 1
- 2
- Next »