Dear Team,   How to connect HDFS with standalone python by using API's ... View more

Hi Team,   I am using HDP 3.1V and Zeppelin 0.8V, and trying to read PDF (file at HDFS location) into Zeppelin using python or livy2.pyspark interpreter, however i have done in Jupyter notebook but failed in Zeppelin notebook, is it will be possible in Zeppelin? i can able to read csv(file at HDFS location) into Zeppelin but not PDF format any help on this highly appreciable.   Regards, Moka ... View more

Hi Team, We are not able to transform Hive Data to Druid. Total records are 8L in Hive, only 2L records are transform to Druid and missing some 6 L records. Even after adding Cast to every column of hive. If i do count(*) on both tables some 6L records are missing in Druid tables. Count of Druid table - 200392 Count of Hive table - 794705 Below is my Hive external table. CREATE EXTERNAL TABLE afssales006 STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' AS select select current_timestamp() as `__time`, CAST(`transactiondate` as STRING) transactiondate, CAST(`airlinecode` AS STRING) airlinecode, CAST(`airlinename` AS STRING) airlinename, CAST(`billtocode` AS STRING) billtocode, CAST(`shiptocode` AS STRING) shiptocode, CAST(`shiptoname` AS STRING) shiptoname, CAST(`locationid` AS STRING) locationid, CAST(`customertype` AS STRING) customertype, CAST(`loc_name` AS STRING) loc_name, CAST(`loc_code` AS STRING) loc_code, CAST(`aircarfttype` AS STRING) aircarfttype from tab_sales where billtocode is not NULL; Please help me how to solve this issue. ... View more

Hi Team, We are using Druid in our production cluster, Did we have any user( LDAP / AD ) based policy for druid. We what to restrict some Druid Datasources from other users. As of now every AD user is able to see Datasources in our HDP Cluster. We dont have any Ranger Plugin for Druid. If we have, how we can restrict Data datasources to users. Please update Thanks Mohammad Layeeq ... View more

Hi, After success installation of Metron mpack, i Am unable to see Metron services in ambari. And i am getting below error while installing Repo. [root@devupgnew1 ~]# yum install createrepo ( at Ambari host) http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: public-repo-1.hortonworks.com; Unknown error" Trying other mirror. One of the configured repositories failed (HDP-UTILS-1.1.0.22-repo-101), and yum doesn't have enough cached data to continue. At this point the only safe thing yum can do is fail. There are a few ways to work "fix" this: 1. Contact the upstream for the repository and get them to fix the problem. 2. Reconfigure the baseurl/etc. for the repository, to point to a working upstream. This is most often useful if you are using a newer distribution release than is supported by the repository (and the packages for the previous distribution release still work). 3. Run the command with the repository temporarily disabled yum --disablerepo=HDP-UTILS-1.1.0.22-repo-101 ... 4. Disable the repository permanently, so yum won't use it by default. Yum will then just ignore the repository until you permanently enable it again or use --enablerepo for temporary usage: yum-config-manager --disable HDP-UTILS-1.1.0.22-repo-101 or subscription-manager repos --disable=HDP-UTILS-1.1.0.22-repo-101 5. Configure the failing repository to be skipped, if it is unavailable. Note that yum will try to contact the repo. when it runs most commands, so will have to try and fail each time (and thus. yum will be be much slower). If it is a very temporary problem though, this is often a nice compromise: yum-config-manager --save --setopt=HDP-UTILS-1.1.0.22-repo-101.skip_if_unavailable=true failure: repodata/repomd.xml from HDP-UTILS-1.1.0.22-repo-101: [Errno 256] No more mirrors to try. http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: public-repo-1.hortonworks.com; Unknown error" what is the issue here. ... View more

Dear HWX Team, We are using zeppelin kerberos cluster,so when i login to zeppelin with kerberos REALM every time but i don't want to login with kerberos realm,if its possible to configure kerberos realm from zeppelin back-end. Regards, Rajendra ... View more

Is it possible to get total number of hive tables? If its yes, please suggest me how to do. ... View more

Hi Team, Is it possible to create n number of hive external tables are pointing to a single hdfs path,if its possible please help me on that how to do. Thanks in advance. Regards, Rajendra. ... View more