@Ned Shawa please suggest if HIVE needs to be started with ACID and compactor on? or any other property. Thanks. While creating the table got this error, on HDP2.5 java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:default.OLYMPICS cannot be declared transactional because it's an external table) Also got errors with the inferred AVRO schema How does Infer schema works in the flow, does it keep inferring for every 10 records, is that a good approach? shoudn't we use convertCSVToAVRO by providing a avsc file created by Kite. Thanks. ... View more

Hi All, I was able to resolve this - by adding this line in in docker.service in /lib/systemd/system ExecStart=/usr/bin/dockerd --graph="/datadrive/docker-data" --storage-opt=dm.basesize=50G [root@docker datadrive]# docker load < HDP_2.5_docker.tar b1b065555b8a: Loading layer [==================================================>] 202.2 MB/202.2 MB 0b547722f59f: Loading layer [==================================================>] 13.84 GB/13.84 GB 99d7327952e0: Loading layer [==================================================>] 234.8 MB/234.8 MB 294b1c0e07bd: Loading layer [==================================================>] 207.5 MB/207.5 MB fd5c10f2f1a1: Loading layer [==================================================>] 387.6 kB/387.6 kB 6852ef70321d: Loading layer [==================================================>] 163 MB/163 MB 517f170bbf7f: Loading layer [==================================================>] 20.98 MB/20.98 MB 665edb80fc91: Loading layer [==================================================>] 337.4 kB/337.4 kB Loaded image: sandbox:latest Thanks, Avijeet ... View more

Hi, @Laurence Da Luz SparkR works using livy interpreter and sparkR shell. However is there a way to launch a sparkR job from command prompt something like spark-submit. Thanks, Avijeet ... View more

Hi @Michael Young I don't have any other images, this is the only image i was trying to load I have a azure centos vm, which root directory / has only 30GB I have another directory with has 500Gb but wondering how to tell docker to use that directory thanks, Avijeet ... View more

@Michael Young Hi Michel, while doing docker load, it ran out of space Is it possible to tell it load and use a specific location? Also how can I clean the half loaded image. Thanks Avijeet b1b065555b8a: Loading layer 202.2 MB/202.2 MB 0b547722f59f: Loading layer 10.36 GB/13.84 GB ApplyLayer exit status 1 stdout: stderr: write /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.101-3.b13.el6_8.x86_64/jre/lib/rt.jar: no space left on device ... View more

thanks @pankaj singh, how did you add the repository to zeppelin? ... View more

hi @pankaj singh I am trying to use the local repo @ /usr/hdp/current/zeppelin-server/local-repo/2BXQ86S9Q Which has the jar files Also isn't StreamContext part of Spark core libraries? Why does it complain StremContext cont found. Thanks, Avijeet ... View more