I  know it's an old post but looks issue is unresolved yet.  I  came  to following  bash  version:   function hdfsMoveMerge() { src=$1 DEST=$2 if [[ "$SRC" == "$DEST" ]] then echo "source and dest is same " return 1 else echo "source and dest is not same " fi hadoop fs -find $SRC | xargs -n 10 hadoop fs -ls -d | grep -v '^d'| awk '{print $8}' | while read file ; do newFP=${file/$SRC/${DEST}}; if hadoop fs -mkdir -p $(dirname $newFP ) ; then cnt=0 if hadoop fs -test -f ${newFP} then ((cnt++)) while hadoop fs -test -f "${newFP}_copy($cnt)" do ((cnt++)) done hadoop fs -mv "${file}" "${newFP}_copy($cnt)"; else hadoop fs -mv "${file}" "${newFP}"; fi fi done } ... View more

@tcpip001to set hash key in your case you must create an EvaluateJsonPath and add a new attribute for each property that you're using, following your example: For Hash Key: Property: hashKey Value: $.k For Range Key I believe that is the same process: Property: rangeKey Value: $.v   And finally go to PutDynamoDb processor and put in the properties: Hash Key Value: ${hashKey} Range Key Value: ${rangeKey}   I hope this could help you. ... View more

Recently I have install sandbox in my laptop .. Everything is working expect amabri page...when Im giving localhost:8080 it not loading page its just blank page as attached ....its asking username and password ...after giving nothing poping up..all popup is enabled .. ... View more

@romits I have to do a similar docker image with more clients and with another version of HDP I would like to know if the dockerfile used to build this image is available somewhere thanks in advance ... View more

I killed two previous YARN applications in the queue and insertion was done. They were in the "Running" status but didn't make any progress (don't know why). ... View more

I know this is a bit late to post but i have a web app that scans the table and gets results based on the rowkey provided in the call so it needs to support multi threading, here's a snip of the scan:     try(ResultScanner scanner = myTable.getScanner(scan)) { for (Result result : scanner) { //logic of result.getValue() and result.getRow() } }     i just saw https://hbase.apache.org/1.2/devapidocs/org/apache/hadoop/hbase/client/Result.html is one of those classes that is not thread-safe among others mentioned in this article. Is there an example of a fully thread-safe hbase app that scans results based on the rowkey provided or anything similar? I'm looking for an efficient and good example i can use for reference. I am now concerned that this piece of code might not yield proper results when i get simultaneous requests. ... View more

Shubham_Ranjan   As this is an older post you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.  ... View more

This could be permission issue. you can see  the hive server2 log for the error. Log will be in /var/log/hive on the node to which you connect the hive  ... View more

Have you got solution, i'm getting same problem ... View more

You can try logging into the admin user and restart datanodes from the actions bar in Dashboard. That worked for me. May work for you too. ... View more

@bhara I just finished install of Hue 4.6.0 in HDP 2.6.5 using this repo:   https://github.com/steven-dfheinz/HDP2-Hue4-Service   If you have any issues please open a new question here and tag me in it. ... View more

The DSN-less connection string below FINALLY worked for me, in windows 10. I created a file DSN, then copy/pasted the string into the python code, as a template.   Three lessons that I learned from this struggle:   1) kerberos is CASE SENSITIVE. Your kerberos realm in the string MUST be uppercase. 2) The Cloudera driver doesn't like spaces in between the semicolons in the string. Avoid them. 3) If you don't need connection pooling, turn it off with a pyodbc.pooling = False statement. import pyodbc strFileDSNAsAstring = "DRIVER=Cloudera ODBC Driver for Apache Hive;USEUNICODESQLCHARACTERTYPES=1; \ SSL=0;SERVICEPRINCIPALCANONICALIZATION=0;SERVICEDISCOVERYMODE=0;SCHEMA=database;PORT=port; \ KRBSERVICENAME=hive;KRBREALM=uppercaserealm;KRBHOSTFQDN=hostfqdndomain;INVALIDSESSIONAUTORECOVER=1; \ HOST=host;HIVESERVERTYPE=2;GETTABLESWITHQUERY=0;ENABLETEMPTABLE=0;DESCRIPTION=Hive; \ DELEGATEKRBCREDS=0;AUTHMECH=1;ASYNCEXECPOLLINTERVAL=100;APPLYSSPWITHQUERIES=1;CAIssuedCertNamesMismatch=1;" try: pyodbc.pooling = False conn = pyodbc.connect(strFileDSNAsAstring, autocommit=True) except: print("failure.") else: conn.close() print("success.") ... View more

@Ham As this is an older post you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.  ... View more

--as-textfile Maps all the columns to their respective datatypes mentioned in –map-column-hive --as-parquet-file Does not change any datatype for the columns mentioned in –map-column-hive   Please reply on this, if you have got answer ... View more

What happens when we clear cookies from browser? ... View more

we just need to put phoenx-kafka-***-minimal jar file available in binary distribution of appropriate phoenix version which need to downloaded and extracted to hbase CLASSPATH. and then excute the command as it is. pointing to the jar file copied.  ... View more