Member since
07-12-2013
435
Posts
117
Kudos Received
82
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2031 | 11-02-2016 11:02 AM | |
3143 | 10-05-2016 01:58 PM | |
7779 | 09-07-2016 08:32 AM | |
8249 | 09-07-2016 08:27 AM | |
2143 | 08-23-2016 08:35 AM |
01-13-2016
04:25 AM
2 Kudos
For me it was solved after login using hdfs user. You can typically then run the spark-shell command without errors
... View more
01-11-2016
07:27 PM
Thank you very much Sean. It helped a lot.
... View more
01-07-2016
02:04 PM
I'd need to take a look at a cluster and won't get a chance to for a little while, but that may not be a problem. Si I would just proceed as-is. Displaying shard replicas in the interface might no longer happen - I personally found it cluttered the interface for something I never used, so I wouldn't be surprised if that was removed recently and the screenshot in the tutorial simply needs to be updated. Also, I believe it's "step 1" that is not necessary since it's already done when installing the sample datasets (the command in #1 creates a blank configuration, we're providing the already-edited configuration). I think it's step #2 that you were missing, where that configuration gets uploaded to Zookeeper.
... View more
01-05-2016
08:57 AM
1) I don't know what the issue is with connecting to MySQL. Definitely ensure that MySQL is running (sudo service mysqld status; sudo service mysqld restart). The configuration is in /etc/cloudera-scm-server/db.properties. 2) We do not have a recommended solution for running Hadoop on Docker. Director currently supports cloud platforms like AWS but not Docker. Docker is somewhat counter-productive for production Hadoop clusters because even though Hadoop is designed to get a bunch of machines to work together, having the cluster split into fewer, bigger pieces is better. Docker essentially partiations a machine into smaller pieces. It can be handy for testing, etc. when performance doesn't matter, but it requires a lot of networking setup to make DNS and IP addresses, etc. work the way Cloudera Manager and Hadoop assume they do.
... View more
01-04-2016
07:04 AM
Thanks. Looks like I need a new access code.
... View more
12-26-2015
02:19 AM
In my Asus Bios i choosed the option "Intel Virtualisation Support" = activate and it worked....
... View more
12-17-2015
11:58 AM
Ah ha!! Problem solved!!! It's indeed because I don't use SSH connect to the manager node. (I connect to another instance that created by my own, I didn't notice that) So when I try to connect to the manager node, there is no public DNS, the way to solve it shown below: Go to console.aws.amazon.com Go To Services -> VPC Open Your VPCs select your VPC connected to your EC2 and Edit Summary ---> Change DNS hostnames: to YES Then you'll find all the instance have public DNS now! find the manager node one, then it works!
... View more
12-17-2015
07:38 AM
If you can send me your access code in a private message I can look up what's going on with your cluster.
... View more
12-09-2015
09:29 AM
Sorry, it's not - I'm trying to get that updated.
... View more
12-04-2015
05:11 PM
Sean It finally worked. After your inputs and reading several of your replies on other posts, I did the following: 1. On my Cloudera VM i reset the memory to 8GB. I had others I removed (2 other images). 2. I restarted the VM and deleted the files under hive with this command - sudo -u hdfs hadoop fs -rm -r /user/hive/warehouse/\* 3. I redid the sudo comand per tutorial 1 using sqoop import-all-tables \ -m 3 \ --connect jdbc:mysql://208.113.123.213:3306/retail_db \ --username=retail_dba \ --password=cloudera \ --compression-codec=snappy \ --as-avrofile \ --warehouse-dir=/user/hive/warehouse \ --hive-import Note - I used the avro format 4. After job finished, I went to Hive Editor and refreshed Database. After refresh, it showed the 6 tables I was expecting 5. I then went to Impala editor and did the same refresh (after Invalidate metadata; show tables:) 6. Next, I went to the tables and looked at table statistics. That ran a job and I found the table entries started showing up (statistics updated with row, byte size etc). Bottom line, the avro format worked. I have to work on the table right now so I did not use the parquet file format. I shall retry this once my immediate work is done. Without your assistance on ths particular posts and without reading your other posts this would not have been solved I thank you for that and appreciate your help.
... View more