Thanks Shelton for pointing this, now I see where I was making mistake. This resolved my issue. ... View more

Hello all  Please reply to this ASAP  I am trying to install vm on my pc but my screen is sticking at the same point  That Extracting and loading the hortonworks sandbox  I have assigned 8 gb of ram n my laptop configuration is 8gb also and i5 n 7th gen ... View more

username: root Password: hadoop ... View more

I want to create three custom nifi processors say B,C,D where the common functionality is extracted to an abstract class say A which extends nifi's abstract processor and B,C,D all child of A. What is the recommended way of doing that?  ... View more

I have opened page source code and downloaded HDP Sandbox with wget. ... View more

Nice thanks, I figured there had to be a way to tell it that it was a solo node but I just wasn't phrasing it right for google apparently. Though the problem ended up being solved with a simple delete/reinstall. ... View more

It was showing error mysql_secure_connection command not found ... View more

This is what I try to do , I have a deduplication appliance on the subnet 128.222.110.250 This appliance cannot talk directly to 172.17.0.2 which is a huge problem, means I could not test the backup. If this is pure vmware environment it would be easy, all I have to do is add an interface and configure that interface to use same subnet as 128.222.110.0 But with the docker thing, which I am fairly new, I am not sure how to proceed from there . this is the crux of my problem. ... View more

Hi @Sandeep Ranjan, did you ever get this resolved? If it still isn't going through, we can get you a sandbox through other means if you're still running into issues. ... View more

@Edgar Orendain - Are you actively updating this? I did a git pull and saw a lot of changes - setup.sh is no longer there. New scripts - deploy-prebuilt-topology (success), rebuild-and-deploy-topology (fails). New instructions coming? ... View more

@Jay Kumar SenSharma The problem was the cache. Thank you so much for the help! ... View more

@Touhid Alam For your HDP sandbox to boot up correctly you will need at least 8 GB of RAM that's the recommended but anything higher is better. Have your tried the Bridged adapter else please have a look at the tutorial using the Sandbox most erroors encountered have been documented in here link ... View more

@Julián Rodríguez Heya Julián, On boot, select the first kernel (3.10 non-rescue). The rescue option won't start the system with the appropriate resources/state to run the services that need to run. If I understood your original post correctly, booting with the default kernel won't get you to a login screen and you may not immediately be able to visit http://<ip-address>:8888 (also try port 8080 [ambari] and port 4200 [ssh in the browser]). You're probably seeing a loading bar that seems to hang for a really long time. That's an issue that the current sandbox has and will be fixed in a very near-future release. Underneath the covers, though, services are started/starting - even though the screen appears for a while. After a minute of booting up your VM, you should be able to navigate to <ip-add>:4200, :8080, and lastly :8888. ... However ... The thing about VMWare (at least in most cases) is that it's not obvious what ip address the VM is given, so you have to wait until that Centos "loading bar" actually goes away, which depending on the machine could be upwards of 10minutes. I see your screenshots have an IP at the top - that *seems* to be it, though I've never used ESXi so I can't say for certain. TL:DR; boot the first kernel, and give the VM a few minutes to do it's thing. It's getting fixed in an upcoming build. Also, if you're okay not using ESXi for a bit, the VirtualBox/Docker versions of the sandbox. Let me know how it goes or if I misunderstood and something else is also going wrong. ... View more

@Andres Urrego Regarding the VM failing, is it the services shutting down on their own and not staying up? One common cause of this is not enough memory - to reduce resource usage try turning off all services and starting only HDFS, Zookeeper, YARN and Spark. Also make sure that you give your VM at least 8GB of RAM (https://hortonworks.com/tutorial/sandbox-deployment-and-install-guide shows how). As far as documentation for Spark2/HDFS, here is a good Spark2 starter tutorial followed by a Spark2/HDFS project walkthrough. https://hortonworks.com/tutorial/hands-on-tour-of-apache-spark-in-5-minutes/#option-2-download-and-setup-hortonworks-data-platform-hdp-sandbox https://hortonworks.com/tutorial/sentiment-analysis-with-apache-spark/ ... View more

@Rafal Pronko The current version of the HDP sandbox may hang during boot, but underneath the covers services may be up and running. Try opening a browser and navigating to http://localhost:8080 - if Ambari shows up that you're good to go - the start script is just hanging a bit. That'll be fixed in a very near-future release. Another explanation is that your Docker wasn't allocated enough RAM. Did you do this step? https://hortonworks.com/tutorial/sandbox-deployment-and-install-guide/section/3/#for-mac ... View more

@Mihir Kothari Please try creating the following directory on your own to see if it helps? # ls -ld /var/run/ambari-server drwxr-xr-x. 4 root root 100 Jan 2 06:00 /var/run/ambari-server . ... View more

@Matt, Hope you were successful in copying your files to HDFS. For any other "Getting Started Questions" you might have please check out the Learning the Ropes Hortonworks Tutorial. ... View more

@Nikhil Jayaram Heya, this should answer your question: https://community.hortonworks.com/answers/158884/view.html ... View more

I'm facing the same issue: HDP 2.6.3 sandbox doesn't start on Ubuntu 16.04.03 LTS running Docker CE 17.12. The updated start script referenced by @Edgar Orendain still hangs while starting Ambari services. This is the line, within the script, having the issue: docker exec -t sandbox-hdp /bin/sh -c 'until /usr/bin/curl --silent --user raj_ops:raj_ops -H "X-Requested-By: ambari" "http://localhost:8080/api/v1/clusters/Sandbox/requests?to=end&page_size=10&fields=Requests" | tail -n 27 | grep COMPLETED | grep COMPLETED > /dev/null; do echo -n .; sleep 1; done;' Any suggestion? Regards, @Julián Rodríguez ... View more

@fintan guihen Heya, good question indeed. The recommended way to shut down the sandbox is to first stop all services via the Ambari UI, and then sending the shutdown signal to the VM (powering off, not killing it). The HDF sandbox is built in a such a way that signaling a VM shutdown should attempt to gracefully end running services, helping end mid-transaction data corruption. Though the same isn't yet true for the current HDP sandbox, it should be in a very near-future release! ... View more

@Ahshan MD, @Kyunam Kim Configure HTTP authentication for HDFS and restart. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_security/content/_configuring_http_authentication_for_HDFS_YARN_MapReduce2_HBase_Oozie_Falcon_and_Storm.html ... View more

@Chidambar Deshpande It's tough to say without knowing what all is running on your host machine, but the general recommendation is to give the VM as much RAM as possible without slowing your host machine down to the point that it becomes unusable. Stopping heavy host processes would also help. If you try the HDF sandbox instead of HDP, for data flow and streaming tasks, as long as you're not doing any heavy processing (running Druid jobs) 6-8GB would be more than enough in case you want to play around with that. ... View more

@Antonio Akiyama Have you gone through the official resource documentation it covers all the challenges so far met by members iând it's well documented. It has specific steps for Docker Virtualbox VMWare Please go through them first ... View more

@Lucjan Dudkiewicz Heya, my memory is a bit fuzzy on if the HDP 2.5 Sandbox comes with the option to install Hive View out of the box, but here's the process to follow to know for sure: In Ambari: Shortcut URL (http://localhost:8080/views/ADMIN_VIEW/2.6.0.0/INSTANCE/#/views) ... or ... to get there yourself, then from any Ambari page go to the top-right user menu -> "Manage Ambari" -> "Views" link on the left sidebar. There should be an entry under "View Name" named "HIVE". Expand this entry to expose the "Create Instance" button. Click on "Create Instance". The top two fields should say "HIVE", followed by a select box for "Version". If you have "2.0.0" as an option for "Version", this is the Hive 2.0 View. Fill out the top portion of the "Details" fieldset. You should be able to safely leave the defaults for the "Settings" fieldset. If you don't have "2.0.0", you likely only have "1.5.0", which is the non-2.0 Hive View that comes by default. Hope this helps! ... View more

@sandeep Jain I'd advise against changing the sandboxes' hostname if you can. The hostname is specified as part of an under-the-hood "docker run" command, which you'd have to change and would require trashing your current sandbox instance. The sandbox comes with Ambari already set up, which means you'll have to perform some database-crobatics in order to change the hostname the different services already resolve. You can definitely decide on your own hostname when setting up HDP or HDF from scratch, but the Sandbox is pre-configured in a way to get you going fast and we don't recommend you try altering hostnames. ... View more

@Eric Marquez @Kaliyug Antagonist Did you try out the solution I provided above"Enabling virtualization in the BIOS" if it did could you Accept the answer by Clicking on Accept button below, That would be a great help to Community users to find the solution quickly for these kinds of errors. ... View more

@Jay Kumar SenSharma The same issue I am facing with 64 bit VMplayer ... View more

Thanks! It works with 2.6.3. Didn't realize both script and sandbox were updated just a few days ago. ... View more

@Jack Oney In VirtualBox, right click on the existing virtual machine you want to remove and hit "Remove". I've attached a screengrab.43431.png ... View more

@Mustafa Hasanbulli Hmm, looks like it can be an SSH issue. Are you connecting to your sandbox via SSH tunneling? How are you connecting (using a config file, or SSH'ing with a -L option from a shell)? For reference ... View more