Member since
03-23-2018
28
Posts
0
Kudos Received
0
Solutions
06-06-2018
07:47 AM
@Geoffrey Shelton Okot Thank you for your reply. what is fundamental difference between Azure MSSQL and Azure Mysql DB?
... View more
06-06-2018
07:19 AM
@Geoffrey Shelton Okot what about existing data and how do i access the existing data ?
... View more
06-06-2018
06:34 AM
I would like to migrate the mysql database from HDP cluster to Azure mssql database what is advantages and disadvantages for this activity If it is advantage, how i have to migrate ..kindly provide the process What about existing data, how to migrate the existing data to azure mssql.
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
04-16-2018
08:31 AM
Apache Ambari Version2.6.0.0 While executing the hive query with limit 5 also. Giving the error shown below: {"trace":"java.util.concurrent.TimeoutException: deadline passed\n\njava.util.concurrent.TimeoutException: deadline passed\n\tat akka.actor.dsl.Inbox$InboxActor$$anonfun$receive$1.applyOrElse(Inbox.scala:117)\n\tat scala.PartialFunction$AndThen.applyOrElse(PartialFunction.scala:189)\n\tat akka.actor.Actor$class.aroundReceive(Actor.scala:467)\n\tat akka.actor.dsl.Inbox$InboxActor.aroundReceive(Inbox.scala:62)\n\tat akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)\n\tat akka.actor.ActorCell.invoke(ActorCell.scala:487)\n\tat akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)\n\tat akka.dispatch.Mailbox.run(Mailbox.scala:220)\n\tat akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)\n\tat scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)\n\tat scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)\n\tat scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)\n\tat scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)\n","message":"Result fetch timed out","status":500} For this I have increased the time in following properties in "/etc/ambari-server/conf/ambari.properties" views.request.read.timeout.millis=450000 Still facing the same error
... View more
Labels:
- Labels:
-
Apache Ambari
04-03-2018
07:34 AM
skiptrash is fine, However why .trash is not working even i set the fs.trash.interval=360 min Kindly let me know is there any way to configure the trash in wasb(Azure blob storage)
... View more
04-02-2018
12:11 PM
Issue with Trash. Configured the trash value fs.trash.interval is 360 min ... However trash is not happening as per configuration that is 6hr, I have deleted one file in 22/feb and one more file deleted on 23/march and one more deleted on 2/april , as per configuration in our trash it should contain only 2/April file, but in my case trash path contains all the old files. Kindly let me know, how to configure the correct trash in wasb space. Thanks, Praveen
... View more
04-02-2018
09:50 AM
$ hdfs dfs -D "fs.default.name=wasb://containername@storage_name.blob.core.windows.net//"-mkdir /test Done $ hdfs dfs -D "fs.default.name=wasb://containername@storage_name.blob.core.windows.net/"-ls / Result: drwxr-xr-x - paplcloudadmin supergroup 0 2018-04-02 09:33 /test hdfs dfsadmin -D "fs.default.name=wasb://containername@storage_name.blob.core.windows.net/" -report 18/04/02 09:40:56 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 18/04/02 09:40:56 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 18/04/02 09:40:56 INFO impl.MetricsSystemImpl: azure-file-system metrics system started report: FileSystem wasb://containername@storage_name.blob.core.windows.net is not an HDFS file system Usage: hdfs dfsadmin [-report] [-live] [-dead] [-decommissioning] 18/04/02 09:40:56 INFO impl.MetricsSystemImpl: Stopping azure-file-system metrics system... 18/04/02 09:40:56 INFO impl.MetricsSystemImpl: azure-file-system metrics system stopped. 18/04/02 09:40:56 INFO impl.MetricsSystemImpl: azure-file-system metrics system shutdown complete.
... View more
04-02-2018
08:40 AM
fidn the output of the command:
hadoop fs -ls wasb://mycontainer@youraccount.blob.core.windows.net/ 18/04/02 08:31:26 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 18/04/02 08:31:26 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 18/04/02 08:31:26 INFO impl.MetricsSystemImpl: azure-file-system metrics system started Found 3 items drwxr-xr-x - paplcloudadmin supergroup 0 2017-12-29 09:53 wasb://containername@account.blob.core.windows.net/user/paplcloudadmin/.hiveJars drwx------ - paplcloudadmin supergroup 0 2018-01-11 13:18 wasb://containername@account.blob.core.windows.net/user/paplcloudadmin/.staging drwxr-xr-x - paplcloudadmin supergroup 0 2018-01-11 13:28 wasb://containername@account.blob.core.windows.net/user/paplcloudadmin/prod.db 18/04/02 08:31:26 INFO impl.MetricsSystemImpl: Stopping azure-file-system metrics system... 18/04/02 08:31:26 INFO impl.MetricsSystemImpl: azure-file-system metrics system stopped. 18/04/02 08:31:26 INFO impl.MetricsSystemImpl: azure-file-system metrics system shutdown complete.
The following is a list of configurations that should be modified to configure WASB: I assume you have done the below
Correct, All configurations has been done properly and verified again...Result all are same.
... View more
04-02-2018
07:12 AM
@Geoffrey Shelton Okot....Getting the same error. "blob.core.windows.net is not an HDFS file system"
... View more