Member since
05-20-2016
155
Posts
220
Kudos Received
30
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4929 | 03-23-2018 04:54 AM | |
1785 | 10-05-2017 02:34 PM | |
914 | 10-03-2017 02:02 PM | |
7107 | 08-23-2017 06:33 AM | |
1914 | 07-27-2017 10:20 AM |
12-23-2016
04:58 PM
2 Kudos
I think I found it, it is cluster create command cloudbreak-shell>help cluster create
Keyword: cluster create
Description: Create a new cluster based on a blueprint and optionally a recipe
Keyword: userName
Help: Username of the Ambari server
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: 'admin'
Keyword: password
Help: Password of the Ambari server
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: 'admin'
Keyword: description
Help: Description of the blueprint
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: ambariVersion
Help: Ambari version: 2.4.0.0-748
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: ambariRepoBaseURL
Help: Ambari repo base url: http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: ambariRepoGpgKey
Help: Ambari repo GPG key url
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: stack
Help: Stack definition name, like HDP
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: version
Help: Stack definition version
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: os
Help: Stack OS to select package manager, default is RedHat
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: stackRepoId
Help: Stack repository id
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: stackBaseURL
Help: Stack url
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: utilsRepoId
Help: Stack utils repoId
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
Keyword: utilsBaseURL
Help: Stack utils URL
Mandatory: false
Default if specified: '__NULL__'
Default if unspecified: '__NULL__'
... View more
12-23-2016
04:34 PM
1 Kudo
Currently cloudbreak UI provides below screen to configure HDP repo. Does the cloudbreak-shell provide the same mechanism ? if so what would be the command ? Thanks Santhosh
... View more
Labels:
- Labels:
-
Apache Ambari
-
Hortonworks Cloudbreak
12-23-2016
07:11 AM
@ARUN Looks like there is an issue with zookeeper. Can you please share zookeeper logs and look for any errors
... View more
12-22-2016
01:42 PM
3 Kudos
@gvenkataramanan Please try the blueprint. small-default-hdp-corrected.txt . Issue was the NameNode default heapsize of 1024 is causing issue. Overriding it to 2048 resolves the issue. Regarding HDFS datanode configured to /hadoopfs by default ? that is how cloudbreak is designed i believe so that datanode have seperate dedicated disks.
... View more
12-22-2016
10:59 AM
2 Kudos
Ever come across below error while starting HDFS datanode in unsecure cluster ? 016-12-22 09:00:41,045 INFO mortbay.log (Slf4jLog.java:info(67)) - Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
2016-12-22 09:00:41,152 INFO datanode.DataNode (DataNode.java:shutdown(1915)) - Shutdown complete.
2016-12-22 09:00:41,153 ERROR datanode.DataNode (DataNode.java:secureMain(2630)) - Exception in secureMain
java.net.SocketException: Permission denied
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:463)
at sun.nio.ch.Net.bind(Net.java:455)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125)
at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:475)
at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1021)
at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:455)
at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:440)
at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:844)
at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:194)
at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:340)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:380)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)
2016-12-22 09:00:41,157 INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 1
2016-12-22 09:00:41,159 INFO datanode.DataNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG:
This error means DataNode is unable to bind to provided socket. Reason ? This is most like because the http port or other port of DataNode are listening on port < 1024. For e.x http port property is set to as below. dfs.datanode.http.address=1022 Solution: Change the port something as 50075 which is greater than 1024. DataNode should be able to start with this solution.
... View more
Labels:
12-22-2016
09:45 AM
I am also facing the same issue -- I see cloudbreak creates config group for HDFS and YARN service while the same in not mentioned in blueprint definition. How do I say cloudbreak to not create config group ?
... View more
12-22-2016
06:32 AM
2 Kudos
@Yukti Agrawal
On accessing the RM UI and click on the applicationId and corresponding logs link. It will take you to a screen something as below. Here you would see a file dag_*.dot, this should give you the query/MR graph that is being executed. Other option would be if the execution engine is TEZ, then you can leverage TEZ UI to view the actual query as well.
... View more
12-22-2016
06:25 AM
2 Kudos
I am being thrown below error while doing cbd start. I am running the command as cloudbreak user [cloudbreak@rv-cb-1 cloudbreak-deployment]$ cbd start /tmp/bashenv.304333115: line 1055: /var/lib/cloudbreak-deployment/.deps/tmp/docker-compose-delme.yml: Permission denied generating docker-compose.yml /tmp/bashenv.304333115: line 1055: docker-compose.yml: Permission denied
... View more
Labels:
- Labels:
-
Docker
-
Hortonworks Cloudbreak
12-20-2016
08:37 AM
3 Kudos
@Narasimma varman 1] From the attached ldap-setup.tx, looks like the port configured is 389 however the logs say's 33389, please make sure ldap server is installed on localhost. 2] BaseDN is a "valid" path in LDAP server from where users who login/sync to ambari server are search for. Below link gives a reference value however this will change per your setup. https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.1.0/bk_Ambari_Security_Guide/content/_setting_up_ldap_user_authentication.html 3] manager DN can any valid user/path in LDAP server, again the link shared above is for reference only, value will change as per your setup.
... View more