Hi, I'm having trouble with Hive and Atlas. From what i understood, the hive error coms from atlas but i can't find anything to fix my atlas issue... I don't know which logs you need so please just tell me and i'll get them 🙂 Thank you in advance. ... View more

Hi, I would like to get rid of some duplicates in my Hive table. The duplicates differs by the variable DateExtraction. DateExtraction is a date formated as "yyyy/MM/dd". In case of duplicate i would like to keep the most recent observation. Any clues are most welcome 🙂 Here is the query i used to create my table: DROP TABLE IF EXISTS netodb.oneTable; CREATE EXTERNAL TABLE IF NOT EXISTS netodb.oneTable( Entreprise string,Industrie string,Source string,Type string,Auteur string, Id string,Texte string,DateCreation string,Likes bigint,Partages bigint, ObjetParent string,Users_mentionned string,Hashtags_uses string,View_count string, Dislike_count string,Comment_count string,DateExtraction date) ROW FORMAT DELIMITED FIELDS TERMINATED BY "|" LOCATION "/tmp/NetoDB/OneTable" TBLPROPERTIES("transactional"="true"); ... View more

Hi, I would like to create/update Hive tables let's say once per hour. Which tool should i use to schedule the execution of my hql script? Thank you in advance ... View more

Hi, It looks like i reached the memory limit for my sandbox. However i can't delete files since the Safemode is On. So i tried to turn it off manually with : hdfs dfsadmin -safemode leave but it makes nothing. From what i understood, it is because the memory is still full when i turn it off so the system immediatly goes back to safemode. How can i delete some files? ... View more

Hi, I'm having some permission issue with Hive. I wrote a file in HDFS using the PutHDFS nifi processor. When i try to create a table from this location in Hive Ambari view i get this error message : H110 Unable to submit statement. Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [admin] does not have [READ] privilege on [hdfs://sandbox.hortonworks.com:8020/tmp/fb_post_name2] [ERROR_STATUS] I can fix that by typing : sudo -u hdfs hadoop fs chown -R admin /tmp/fb_post_name2 sudo -u hdfs hadoop fs chmod 777 /tmp/fb_post_name2 But do i have a way to make it automatic (with the executeProcess processor for instance)? Thank you in advance. ... View more

Hi, I'm having trouble manipulating flow file content in nifi : i have a flow file which contains a json. I use one of the field of this json to make a http request, up to this point everything works fine. I would like to merge the answer of this request with my original json. The merge content processor doesn't seem appropriate so i'm kinda stuck. Thank you in advance. ... View more

Hi, I made a Nifi template with 3 processor : GetFile -->InvokeHttp-->PutHdfs. InvokeHttp makes a POST request to the facebook graph api and receives a JSON which is wrote in hdfs by PutHdfs. The issue i have is that the request i make doesn't seem to depend on the file read by GetFile. I read the Nifi documentation on InvokeHttp but i didn't find/understand the answer, hence my question. Thank you in advance. ... View more

Hi, I need to make a lot of request to the Facebook Graph API using Nifi. I looked at the documentation https://developers.facebook.com/docs/graph-api/making-multiple-requests which tells me that i need to POST a JSON which contains the request i want to make in a batch format to a specific endpoint. So i created a Nifi template with 3 processors : GetFile -->PostHTTP-->PutHDFS. GetFile reads a very simple JSON file i made to test. When i run the template, i have no error message. However, the HDFS file wrote is just a copy of my initial JSON file. Any explanation / solution? Thank you in advance. ... View more