Member since
12-28-2018
30
Posts
1
Kudos Received
0
Solutions
11-07-2019
04:09 AM
pls elaborate the question, did you uoploading the file knox, if yes pls add the below properties in knox custom-gateway.xml gateway.httpserver.requestBuffer=xyzMB gateway.httpserver.requestHeaderBuffer=xyzMB gateway.httpserver.responseBuffer=xyzMB gateway.httpserver.responseHeaderBuffer=xyzMB Note: xyzMB is ,let us take 10mb file 10*1024*1024=10485760
... View more
09-23-2019
03:48 AM
Dear Team,
How to connect HDFS with standalone python by using API's
... View more
Labels:
09-10-2019
10:27 PM
Hi Team,
I am using HDP 3.1V and Zeppelin 0.8V, and trying to read PDF (file at HDFS location) into Zeppelin using python or livy2.pyspark interpreter, however i have done in Jupyter notebook but failed in Zeppelin notebook, is it will be possible in Zeppelin? i can able to read csv(file at HDFS location) into Zeppelin but not PDF format any help on this highly appreciable.
Regards,
Moka
... View more
06-21-2019
05:04 AM
Hai, Don't go for 3.0.1V this is incubator lot of bugs are there in this versions, better to upgrade 3.1V.
... View more
04-25-2019
12:42 PM
Hi Team, We are not able to transform Hive Data to Druid. Total records are 8L in Hive, only 2L records are transform to Druid and missing some 6 L records. Even after adding Cast to every column of hive. If i do count(*) on both tables some 6L records are missing in Druid tables. Count of Druid table - 200392 Count of Hive table - 794705 Below is my Hive external table. CREATE EXTERNAL TABLE afssales006 STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' AS select select current_timestamp() as `__time`, CAST(`transactiondate` as STRING) transactiondate, CAST(`airlinecode` AS STRING) airlinecode, CAST(`airlinename` AS STRING) airlinename, CAST(`billtocode` AS STRING) billtocode, CAST(`shiptocode` AS STRING) shiptocode, CAST(`shiptoname` AS STRING) shiptoname, CAST(`locationid` AS STRING) locationid, CAST(`customertype` AS STRING) customertype, CAST(`loc_name` AS STRING) loc_name, CAST(`loc_code` AS STRING) loc_code, CAST(`aircarfttype` AS STRING) aircarfttype from tab_sales where billtocode is not NULL; Please help me how to solve this issue.
... View more
Labels:
04-09-2019
10:28 AM
Hi, Thanks, This document is really helpful. I have enabled HDPSearch 4.0 in our kerberised cluster. Could you please help me to enable auto indexing in solr to index hive and hdfs data? Thanks, Shikha
... View more
04-08-2019
06:05 AM
Hai @asubramanian , can i expect any updates.
... View more
04-05-2019
06:35 AM
@asubramanian , with reference to trailing we are using HDP3.0.1V and Ambari 2.7V with MIT Kerberos is standalone Apache Metron tar is support with my environment?
... View more
04-05-2019
05:15 AM
Hau @asubramanian, Is it possible to install apache metron in kerberos environment from tar file.
... View more
04-04-2019
01:51 PM
Hai Team, Any updates
... View more
03-26-2019
10:29 AM
Hi Team, We are using Druid in our production cluster, Did we have any user( LDAP / AD ) based policy for druid. We what to restrict some Druid Datasources from other users. As of now every AD user is able to see Datasources in our HDP Cluster. We dont have any Ranger Plugin for Druid. If we have, how we can restrict Data datasources to users. Please update Thanks Mohammad Layeeq
... View more
Labels:
03-25-2019
02:29 PM
Hi, After success installation of Metron mpack, i Am unable to see Metron services in ambari. And i am getting below error while installing Repo. [root@devupgnew1 ~]# yum install createrepo ( at Ambari host) http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: public-repo-1.hortonworks.com; Unknown error" Trying other mirror. One of the configured repositories failed (HDP-UTILS-1.1.0.22-repo-101), and yum doesn't have enough cached data to continue. At this point the only safe thing yum can do is fail. There are a few ways to work "fix" this: 1. Contact the upstream for the repository and get them to fix the problem. 2. Reconfigure the baseurl/etc. for the repository, to point to a working upstream. This is most often useful if you are using a newer distribution release than is supported by the repository (and the packages for the previous distribution release still work). 3. Run the command with the repository temporarily disabled yum --disablerepo=HDP-UTILS-1.1.0.22-repo-101 ... 4. Disable the repository permanently, so yum won't use it by default. Yum will then just ignore the repository until you permanently enable it again or use --enablerepo for temporary usage: yum-config-manager --disable HDP-UTILS-1.1.0.22-repo-101 or subscription-manager repos --disable=HDP-UTILS-1.1.0.22-repo-101 5. Configure the failing repository to be skipped, if it is unavailable. Note that yum will try to contact the repo. when it runs most commands, so will have to try and fail each time (and thus. yum will be be much slower). If it is a very temporary problem though, this is often a nice compromise: yum-config-manager --save --setopt=HDP-UTILS-1.1.0.22-repo-101.skip_if_unavailable=true failure: repodata/repomd.xml from HDP-UTILS-1.1.0.22-repo-101: [Errno 256] No more mirrors to try. http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: public-repo-1.hortonworks.com; Unknown error" what is the issue here.
... View more
Labels:
02-27-2019
09:24 AM
Looking for good ELK installation related document also please suggest the best fit version of elastic search for our cluster. Ambari and HDP versions are as below :- Ambari 2.7.1 HDP 3.0.1
... View more
02-21-2019
10:33 AM
Hi, This is related to solr not infra solr. We are in process of installing HDP search 4.0 which includes the solr 7.4 service. we have done installation but not able to access the solr UI as it throws below error. Please suggest to disable spnego authentication for solr not infra solr. HTTP ERROR 403 Problem accessing /solr/. Reason: GSSException: Defective token detected (Mechanism level: GSSHeader did not find the right tag)
... View more
02-21-2019
08:17 AM
For your information we are using HDP 3.0.1V, Zeppelin 0.8V and Ambari 2.7.1V
... View more
02-21-2019
07:25 AM
Dear HWX Team, We are using zeppelin kerberos cluster,so when i login to zeppelin with kerberos REALM every time but i don't want to login with kerberos realm,if its possible to configure kerberos realm from zeppelin back-end. Regards, Rajendra
... View more
Labels:
02-21-2019
05:18 AM
I see this is very old post, can we have any property which can be set for solr 7.4 in HDP 3.0.1 to disable spnego authentication? Please help, we are stuck at this step and not able to access the solr URL getting below error. HTTP ERROR 403 Problem accessing /solr/. Reason: GSSException: Defective token detected (Mechanism level: GSSHeader did not find the right tag)
... View more
02-21-2019
04:59 AM
Hi, we are also facing the same issue with solr, Please let us know how you disabled spnego in solr for HDP 3.0.1 Thanks,
... View more
01-10-2019
02:22 PM
Is it possible to get total number of hive tables? If its yes, please suggest me how to do.
... View more
Labels:
01-04-2019
05:09 AM
@scharan I have deleted my notebook on 03-01-19 at 18:00 with respect to my cluster configuration fs.trash.interval is 360minutes i.e., 6hours even though after 15hours Trash still holds my deleted notebooks. Any help on this.
... View more
01-03-2019
07:45 AM
@scharan i have checked fs.trash.interval is 360 minutes so can we increase this time interval if yes what was the range.
... View more
01-02-2019
12:45 PM
Thank you @Akhil S Naik for supporting.
... View more
01-02-2019
12:41 PM
Hi Team, Is it possible to create n number of hive external tables are pointing to a single hdfs path,if its possible please help me on that how to do. Thanks in advance. Regards, Rajendra.
... View more
Labels:
01-02-2019
11:40 AM
Hi @scharan, Great Job! Its working fine for me, may i know how much time trash is holds the deleted notebooks.
... View more
12-28-2018
07:59 AM
@Felix Albani Hi Felix, could you please advise us on this.
... View more
12-28-2018
07:59 AM
Hi Team, Is it possible to retrieve deleted zeppelin notebooks in 0.8.0 version (HDP 3.0.1) ,if its possible please suggest how to do. Regards, Rajendra
... View more