Member since
08-08-2016
14
Posts
2
Kudos Received
0
Solutions
11-27-2017
11:32 AM
Hi Again @Aditya Sirna, Unfortunately, I realized that the problem is not about free memory for our environment. I changed yarn memory settings and restarted the servers. After 1 day the same problem occured again. The services are neither start nor stop. Is there any issue that reported like that? Kind Regards
... View more
11-23-2017
11:48 AM
"not enough free memory" gave me an idea. In ambari metrics view screen, yarn memory seen %100. As I know it only allocate that memory not actually use it. Anyway I changed memory settings for yarn and reboot servers. Now I can do some changes and can restart any service. It seems ok for now. Thank you so much
... View more
11-23-2017
07:26 AM
Hi Everyone,
While I try to restart/start/stop any ambari service, it hangs everytime. I don't know the reason because no error, no warning in logs. Generally some steps hang at %9. Here is the ss: Do you have any idea why it hangs?
... View more
Labels:
- Labels:
-
Apache Ambari
10-13-2016
01:52 PM
1 Kudo
Hi All, Briefly I can not create user or user group in NIFI. Because there are no 'create user' or something like this in users tab. Please see the screenshot. Do I have to change some of the configuration file to add new user? Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
08-26-2016
08:31 PM
I write the inner path in mounted directory. Then I start and this time it wrote xml's to the HDFS. So it seems that Recurse Subdirectories property is not working. Could ypu use recurse subdirectories property correctly? Still can't achieve to write all xml's in all sub directories automatically!
... View more
08-26-2016
08:26 PM
I made changes to run it every 5 sec and refresh page but nothing changed. Here is the error after 2-3 minutes later I stops the flow .
... View more
08-26-2016
07:58 PM
Hi @Chris Gambino, Thanks for sharing this article. I was working for one of our client but I couldn't achive this. They gave me a dfs path and I mounted it in linux using 'mount -t cifs
//mydfsdomain.lan/namespaceroot/sharedfolder /mnt -o username=windowsuser' Then I create a directory as you do in hdfs. Then I create processes in nifi. But when I start flow, nothing happens. After waits for 2-3 minutes, GetFile throw an error as 'gc overhead limit exceeded'. What shall I do to achive this? I found answer(https://community.hortonworks.com/questions/36416/how-to-getftp-file-and-putfile-in-to-linux-directo.html) for this question and it says that it is impossible. On the other hand you made it. I'm confused. Any suggestion?
... View more
08-08-2016
11:19 AM
Thanks for this valuable post @Brandon Wilson. I wonder if I can create a folder structure in hdfs as in my source folder structure. For example in my mounted directory there were store folders and there are day folders in this store folders: Store1 -> Day1, Store1 -> Day2, Store2 -> Day1 etc. I set Remote Path as my mounted directory. NIFI can read this folder and subfolders to get xml's and can write hdfs them. Can I write these xml's to the same directory as in file system? Is there any parametric property value for this aim? Or do I have to use another process in NIFI? Regards
... View more