Member since
03-29-2020
110
Posts
10
Kudos Received
16
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
850 | 01-08-2022 07:17 PM | |
2689 | 09-22-2021 09:39 AM | |
12347 | 09-14-2021 04:21 AM | |
2331 | 09-01-2021 10:28 PM | |
2860 | 08-31-2021 08:04 PM |
01-19-2022
02:01 AM
Hi, beeline -e "query_string". the query string can contain multiple queries. Those queries will be executed sequentially. In these case once loadTable1.hql completed after that loadTable2.hql will start. One Solution - Merge both the file as a single file and execute the target HQL by replacing hive variables like below, [hive@node~]$ cat loadTable1.hql loadTable2.hql
#HQL file 1
select * from sample1 where rownum between ${hivevar:FROM} and ${hivevar:TO};
#HQL file 2
select * from sample2 where rownum between ${hivevar:FROM} and ${hivevar:TO};
[hive@node~]$ cat loadTable1.hql loadTable2.hql > target.hql
[hive@node ~]$ beeline -u "${jdbc_url}" --hivevar FROM=10 --hivevar TO=30 -f target.hql
0: jdbc:hive2> #HQL file 1
0: jdbc:hive2> select * from sample1 where rownum between ${hivevar:FROM} and ${hivevar:TO};
DEBUG : Acquired the compile lock.
INFO : Compiling command(queryId=hive_20220119094048_055b8d53-a101-453f-902b-3b08b6ffd4d3): select * from sample1 where rownum between 10 and 30
.
.
.
0: jdbc:hive2> #HQL file 2
0: jdbc:hive2> select * from sample2 where rownum between ${hivevar:FROM} and ${hivevar:TO};
DEBUG : Acquired the compile lock.
INFO : Compiling command(queryId=hive_20220119094048_9271ad34-64d1-424b-ad09-f3ca8cf630f9): select * from sample2 where rownum between 10 and 30
.
.
.
... View more
01-08-2022
07:17 PM
Can you take a look at the below links for creating the ORC table with the Snappy compression question? https://community.cloudera.com/t5/Support-Questions/Data-Compression-Doesn-t-work-in-ORC-with-SNAPPY-Compression/td-p/172151 https://community.cloudera.com/t5/Support-Questions/Snappy-vs-Zlib-Pros-and-Cons-for-each-compression-in-Hive/m-p/97110 https://community.cloudera.com/t5/Community-Articles/Performance-Comparison-b-w-ORC-SNAPPY-and-ZLib-in-hive-ORC/ta-p/246948
... View more
12-01-2021
11:47 PM
add this to u yarn-site.xml good luck <property> <name>yarn.resourcemanager.webapp.address.rm1</name> <value>hadoop47:8088</value> </property> <property> <name>yarn.resourcemanager.webapp.address.rm2</name> <value>hadoop48:8088</value> </property>
... View more
11-14-2021
01:59 AM
@mhchethan Yes, you could mention multiple LDAP URLs separated by spaces. Hive will try the URLs in the mentioned order until a connection is successful. Ref: hive.server2.authentication.ldap.url
... View more
10-11-2021
02:13 AM
Hi @PawanUppala It would be really helpful if you could share with us the complete error stack before the HS2 goes down.
... View more
10-10-2021
10:48 PM
Hello , I applied below solution to do the fix. hdfs dfs -setfacl -R -m group:calapr01:r-x /tmp/logs/* hdfs dfs -setfacl -m default:group:calapr01:r-x /tmp/logs/hive/logs Seems I found this link helpful : https://my.cloudera.com/knowledge/ERROR-quotPermission-denied-userltusernamegt-accessREADEXECUTE?id=293648
... View more
10-01-2021
03:11 AM
@Sam2020 Logically this is a maintenance upgrade so no much trouble and extra steps needed. Your steps looks good till "c" i.e once you upgrade Cloudera Manager server to 7.4.4 there is a very simple steps you need, means just activate the Parcels or 7.1.7 that’s it. In layman’s term these steps will look like this. I am assuming you have the parcels for 7.1.7 available (credentials and repo details). Then follow below steps. 1.) Please stop the cluster services 2.) Navigate to CM -> hosts -> parcels -> Parcel Repository & Network Settings and include the 7.1.7 parcel "Remote Parcel Repository URLs" 3.) Take the back up of the required service databases following the steps below https://docs.cloudera.com/cdp-private-cloud/latest/upgrade-cdp/topics/ug_cdh_upgrade_backup.html 4.) Download, distribute and activate patch parcel 5.) Start the services. You are all set.
... View more
09-30-2021
12:27 AM
Thanks for the answer, but it is not the solution. See my reply above.
... View more
09-27-2021
10:32 PM
@nareshbattula, Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more