Try: SELECT ARRAY_LENGTH( REGEXP_SPLIT(line, ' ')) FROM twitter_feed; This is a common SQL challenge. Count will be incorrect if you have more than one spaces between words. ... View more

If you deployed Knox after enabling Kerberos, you will need to recreate keytabs from Ambari > Security Ranger will only sync from one provider at a time UNIX or LDAP/AD. When you switch to LDAP/AD, new users in UNIX will not be synced. So if you added Knox after sync, knox user will not be synced. The second part of your question, enabling kerberos does not, just, enable users to access cluster resources. This process actually creates principals and keytabs for all HDP service accounts. This is totally separate from user access. If you need just user access with no security you can do with just LDAP, no kerberos (not recommended on production systems). ... View more

As mentioned before, make sure your Hive Service is connected to the new location of MySQL. Removing MySQL without will result in losing all you metadata. You can use Ambari REST API to remove services manually: curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http: //AMBARI_SERVER_HOST:8080/api/v1/clusters/c1/services/SERVICENAME https://cwiki.apache.org/confluence/display/AMBARI/Using+APIs+to+delete+a+service+or+all+host+components+on+a+host ... View more

Pierre solution is correct. If you installed Atlas after Ranger UserSync has been configured to use LDAP, new local users will not get synced in ranger like atlas. This user is needed to setup hbase tables. To fix, revert UserSync to UNIX, restart only Ranger UserSync, Switch back to UserSync LDAP config. In Ranger add user atlas to HBase all policy. Restart Atlas. ... View more

Usually by default the ticket expires 24 hours and cache expires 7 days. Depends on your directory services policies. Within 7 days you can do kinit -R for users. klist will show ticket and cache expiry time. Or you can use keytabs to automate ticket renewal. You don't have to kinit for hadoop services (ever), ticket renewal is managed automatically. ... View more

Check your file-provider property in Nifi. Should be set to kerberos if you are using kerberos to authenticate user: https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#kerberos_login_identity_provider ... View more

Best place to start will be to check YARN tuning: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_command-line-installation/content/determine-hdp-memory-config.html There can be number of reasons why your jobs might be running slow like what is the current load on cluster, how is capacity scheduling set up like priority, queues, resources etc. You can check Hive execution plan to see bottlenecks. ... View more

Similar issue: https://community.hortonworks.com/questions/86429/cannot-connect-to-zookeeper-server-from-zookeeper.html Problem is your zookeeper address which is pointing to localhost:2181, the worker/slave node does not have a local zookeeper running hence the "Connection refused". Check link above for detailed solution. ... View more

Please provide more information like job you are trying to run, services you using for import and specific log messages. ... View more

I don't think it is your ConvertAvroToJSON processor failing it is Nifi itself. Check bootstrap logs and nifi-app.log for any suspicious messages. Maybe memory or disk issues. ... View more

Put a MonitorActivity processor after your GetFile processor. Set the threshold to your interval. If a file is not found in that interval MonitorActivity will be triggered. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.MonitorActivity/index.html ... View more

Please verify your source files for any new lines at the end. Best will be to open the queue and copy the content to a notepad, sometime using Nifi web reader is not ideal. Alternatively you can use a ReplaceText processor to strip out any new lines. ... View more

This is a bug in Ambari 2.5.1 [https://issues.apache.org/jira/browse/AMBARI-21473] Resolution: Remove /etc/zeppelin/conf/interpreter.json file and restart Zeppelin service ... View more

This is not a Hive issue rather a file system or file encoding issue. SELECT * in Hive actually does nothing except read the file from file system. So if you run a hadoop fs cat on your underlying file, you should see the same behavior. You can check file encoding on bash as $ file -i filename You can change the encoding using iconv. And convert to utf-8 which is printable encoding. iconv -f current_encoding -t new_encoding input.file -o out.file ... View more

Trying to give closure to this topic: This is a very misleading situation where it seems Nifi is not running but it actually is. And you get ERR_CONNECTION_CLOSED or 'can't display page' etc. error when you try to hit the secure url. Reason: Nifi is configured to authenticate client for connection and since there is not authentication provided the UI errors out. Resolution: Import client certificate in your browser. This certificate needs to be trusted by the same authority as Nifi. Once imported, close and re-open the browser (refreshing will not work). Given you have imported the certificates, you should be prompted to select a certificate to login. ... View more

Please provide information on how you are generating and defining your keytabs. try klist -k nifi-1-service-keytab If you principals have HOST (machine name or IP) as part of the definition like xxxx/HOST_NAME@domain you will not be able to use the keytab on any other machine. Renaming the keytab will not work as content of the file still point to a specific host. It is best practice to have separate keytab for separate machines. Reusing the same keytab is not the most secure option. Alternatively, if you define a principal in AD as headless that is without HOST attribute. And then create a keytab, that keytab can be used on any host typically this is your hdfs principal. But, not too secure. ... View more

Try something like: hadoop fs -cat /path_to_hdfs_file/test.csv | head -c 40000000 ... View more

Start by look into the container sizing and queues configuration. Seems the container serving JDBC is either not getting enough resource or is hanging. Check your yarn logs for the application id running JDBC (thrift) process. ... View more

I would strongly recommend you reconsider your usecase to import a table from SQL Server to HBase. HBase is not a relation database, and most of the practice applied on relational database will not work or degrade HBase performance. Consider Hive or similar technologies for SQL server or relation DB offload. Example, if you don't know your row key prefix in HBase you will end up doing a full table scan, which is an expensive operation in HBase. So designing rowkey is the most important step in HBase unlike relational DBs. More information here and why: https://hbase.apache.org/book.html#rowkey.design ... View more

You can use Multi-tenant tables to create user specific connections. More detail here: https://phoenix.apache.org/multi-tenancy.html ... View more

see fit Deem appropriate, as in He's entitled to divide up his property as he sees fit, or If we see fit to attend, we'll be there. This expression uses see in the sense of "view as," a usage dating from about 1325. http://idioms.thefreedictionary.com/see+fit ... View more

Before going into compatibility, from your logs it seems your /hadoop directory have different permissions than what you expect/ java.security.AccessControlException: Permission denied: user=hadoop, path="file:/hadoop":root:root:drwxr-xr-x /hadoop is owned by root:root with write permission only to root. No other user will be able to write to this directory. Change ownership to root:hadoop with permission 775. Hope it helps. ... View more

Please provide more information like: 1. Ranger version 2. Have you enabled audit logs in Ranger configuration 3 Where are you storing audit logs; Db, Solr, HDFS or log4j Depending on the version of Ranger please follow the documentation below to troubleshoot your configs: https://cwiki.apache.org/confluence/display/RANGER/Ranger+0.5+Audit+Configuration ... View more