Created 02-25-2016 05:37 PM
I´m trying CloudBreak on Amazon AWS t2.micro instance to launch new clusters within EC2 (r2 instances) e I´m getting the following error after cbd start. I´m following the instructions on http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_cldbrk_install/bk_CLBK_IAG/bk_CLBK_IAG-20....
[root@ip-172-31-17-119 cloudbreak]# cbd start generating docker-compose.yml generating uaa.yml Creating cbreak_cbdb_1... Pulling image sequenceiq/cbdb:1.1.0-rc.28... 1.1.0-rc.28: Pulling from sequenceiq/cbdb 193224d99eda: Already exists a3ed95caeb02: Pull complete e17b9bab0b51: Already exists cebac4ac10ae: Already exists d2cf979f7728: Already exists ed097438f485: Already exists 887fe6d60a09: Already exists 0a29f8781259: Already exists 966ac5df714c: Already exists f5f8a69cf357: Already exists 21986ed0c2a0: Already exists b69dc2bc622c: Already exists 58f25ac44eea: Pull complete 9684816e42d9: Pull complete Digest: sha256:120d468fe085873f6848435aa39aa40de64f3136406829092e254c0d59b1ea5e Status: Downloaded newer image for sequenceiq/cbdb:1.1.0-rc.28 Creating cbreak_pcdb_1... Pulling image sequenceiq/pcdb:1.0.0-rc.3... 1.0.0-rc.3: Pulling from sequenceiq/pcdb 193224d99eda: Already exists a3ed95caeb02: Pull complete e17b9bab0b51: Already exists cebac4ac10ae: Already exists d2cf979f7728: Already exists ed097438f485: Already exists 887fe6d60a09: Already exists 0a29f8781259: Already exists 966ac5df714c: Already exists f5f8a69cf357: Already exists 21986ed0c2a0: Already exists b69dc2bc622c: Already exists 1d1622f430a4: Pull complete 9a960fd777c6: Pull complete Digest: sha256:02e8782f9c7ba00d62e7223291b29621bd5b040e1bb0eb9fa7a101351fbd7f3d Status: Downloaded newer image for sequenceiq/pcdb:1.0.0-rc.3 Creating cbreak_uaadb_1... Pulling image sequenceiq/uaadb:v2.7.1... v2.7.1: Pulling from sequenceiq/uaadb f8efbffe7b95: Pull complete a3ed95caeb02: Pull complete 64bb2775d20d: Pull complete 112aae0540bb: Pull complete 96d2a7a4fcb3: Pull complete 8d43a1a2d52b: Pull complete 1eba7ded6f54: Pull complete 72377f1d0630: Pull complete 5b95ba5f224f: Pull complete b91c5ed5aea8: Pull complete 1c9d3fc5a296: Pull complete 793d7d756766: Pull complete c357a7b255ac: Pull complete 0db0a73a83ca: Pull complete Digest: sha256:270e87a90add32c69d8cb848c7455256f4c0a73e14a9ba2c9335b11853f688a6 Status: Downloaded newer image for sequenceiq/uaadb:v2.7.1 Migration SUCCESS: cbdb up Migration SUCCESS: cbdb pending Migration SUCCESS: pcdb up Migration SUCCESS: pcdb pending [ERROR] Migration failed: uaadb up [ERROR] See logs in: db_migration.log [ERROR] Migration failed: uaadb pending [ERROR] See logs in: db_migration.log -- MyBatis Migrations FAILURE -- MyBatis Migrations FAILURE [ERROR] Migration is failed, please check the log: db_migration.log [root@ip-172-31-17-119 cloudbreak]# cat db_migration.log [MIGRATE] Script location: container [MIGRATE] Docker image name: sequenceiq/cloudbreak:1.1.0-rc.47 [MIGRATE] Migration command on cbdb with params: 'container up' will be executed on container: da0171af836c430c45a96b3ea2658a7f64c50c7a6e50ba1f602b38861ed40410 [MIGRATE] Scripts location: container [MIGRATE] Schema will be extracted from image: sequenceiq/cloudbreak:1.1.0-rc.47 [MIGRATE] Scripts location: /home/ec2-user/cloudbreak/.schema/cbdb ------------------------------------------------------------------------ -- MyBatis Migrations - up ------------------------------------------------------------------------ ------------------------------------------------------------------------ -- MyBatis Migrations SUCCESS -- Total time: 0s -- Finished at: Thu Feb 25 12:23:40 UTC 2016 -- Final Memory: 10M/483M ------------------------------------------------------------------------ [MIGRATE] Script location: container [MIGRATE] Docker image name: sequenceiq/cloudbreak:1.1.0-rc.47 [MIGRATE] Migration command on cbdb with params: 'container pending' will be executed on container: da0171af836c430c45a96b3ea2658a7f64c50c7a6e50ba1f602b38861ed40410 [MIGRATE] Scripts location: container [MIGRATE] Schema will be extracted from image: sequenceiq/cloudbreak:1.1.0-rc.47 [MIGRATE] Scripts location: /home/ec2-user/cloudbreak/.schema/cbdb ------------------------------------------------------------------------ -- MyBatis Migrations - pending ------------------------------------------------------------------------ WARNING: Running pending migrations out of order can create unexpected results. ------------------------------------------------------------------------ -- MyBatis Migrations SUCCESS -- Total time: 0s -- Finished at: Thu Feb 25 12:23:42 UTC 2016 -- Final Memory: 10M/483M ------------------------------------------------------------------------ [MIGRATE] Script location: container [MIGRATE] Docker image name: sequenceiq/periscope:1.0.0-rc.3 [MIGRATE] Migration command on pcdb with params: 'container up' will be executed on container: 4fd1f384f534ea6ff9a2b1178e9c1c240c491b87261844195235fd96a18a8719 [MIGRATE] Scripts location: container [MIGRATE] Schema will be extracted from image: sequenceiq/periscope:1.0.0-rc.3 [MIGRATE] Scripts location: /home/ec2-user/cloudbreak/.schema/pcdb ------------------------------------------------------------------------ -- MyBatis Migrations - up ------------------------------------------------------------------------ ------------------------------------------------------------------------ -- MyBatis Migrations SUCCESS -- Total time: 0s -- Finished at: Thu Feb 25 12:23:44 UTC 2016 -- Final Memory: 10M/483M ------------------------------------------------------------------------ [MIGRATE] Script location: container [MIGRATE] Docker image name: sequenceiq/periscope:1.0.0-rc.3 [MIGRATE] Migration command on pcdb with params: 'container pending' will be executed on container: 4fd1f384f534ea6ff9a2b1178e9c1c240c491b87261844195235fd96a18a8719 [MIGRATE] Scripts location: container [MIGRATE] Schema will be extracted from image: sequenceiq/periscope:1.0.0-rc.3 [MIGRATE] Scripts location: /home/ec2-user/cloudbreak/.schema/pcdb ------------------------------------------------------------------------ -- MyBatis Migrations - pending ------------------------------------------------------------------------ WARNING: Running pending migrations out of order can create unexpected results. ------------------------------------------------------------------------ -- MyBatis Migrations SUCCESS -- Total time: 0s -- Finished at: Thu Feb 25 12:23:46 UTC 2016 -- Final Memory: 10M/483M ------------------------------------------------------------------------ [MIGRATE] Script location: container [MIGRATE] Docker image name: sequenceiq/sultans-bin:1.1.0-rc.5 [MIGRATE] Migration command on uaadb with params: 'container up' will be executed on container: 6399ceb17cf3217b9a2cd7bbe84dbd08e61bcd7bc6b17d16996d7c8ba6c5366e [MIGRATE] Scripts location: container [MIGRATE] Schema will be extracted from image: sequenceiq/sultans-bin:1.1.0-rc.5 [MIGRATE] Scripts location: /home/ec2-user/cloudbreak/.schema/uaadb ------------------------------------------------------------------------ -- MyBatis Migrations - up ------------------------------------------------------------------------ ========== Applying: 20150918124357_add_new_read_scopes.sql ==================== Error executing: -- add new read scopes -- Migration SQL that makes the change goes here. INSERT INTO groups (id, displayname) VALUES ('2a4f837e-2ab0-4663-8644-de23047d040d', 'cloudbreak.blueprints.read'); INSERT into groups (id, displayname) VALUES ('9fc82f95-0318-4dda-af65-ea32e2f00497', 'cloudbreak.templates.read'); INSERT into groups (id, displayname) VALUES ('8cbffdab-560d-4e14-9d1e-d5ff3f43bec6', 'cloudbreak.credentials.read'); INSERT into groups (id, displayname) VALUES ('7f85eaad-4dac-4f74-9238-aef0e585df07', 'cloudbreak.recipes.read'); INSERT into groups (id, displayname) VALUES ('aac2dad1-6a7b-4ae2-9c58-e71d367d0e2d', 'cloudbreak.networks.read'); INSERT into groups (id, displayname) VALUES ('6674545b-295c-4f23-b1b4-953447dc5f40', 'cloudbreak.securitygroups.read'); INSERT into groups (id, displayname) VALUES ('f07b098a-2700-471a-9f0d-f7dd730db95d', 'cloudbreak.stacks.read'); INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.blueprints.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.templates.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.credentials.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.recipes.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.networks.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.securitygroups.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.stacks.read'; . Cause: org.postgresql.util.PSQLException: ERROR: relation "groups" does not exist Position: 88 ------------------------------------------------------------------------ -- MyBatis Migrations FAILURE -- Total time: 0s -- Finished at: Thu Feb 25 12:23:48 UTC 2016 -- Final Memory: 10M/483M ------------------------------------------------------------------------ ERROR: Error executing command. Cause: org.apache.ibatis.jdbc.RuntimeSqlException: Error executing: -- add new read scopes -- Migration SQL that makes the change goes here. INSERT INTO groups (id, displayname) VALUES ('2a4f837e-2ab0-4663-8644-de23047d040d', 'cloudbreak.blueprints.read'); INSERT into groups (id, displayname) VALUES ('9fc82f95-0318-4dda-af65-ea32e2f00497', 'cloudbreak.templates.read'); INSERT into groups (id, displayname) VALUES ('8cbffdab-560d-4e14-9d1e-d5ff3f43bec6', 'cloudbreak.credentials.read'); INSERT into groups (id, displayname) VALUES ('7f85eaad-4dac-4f74-9238-aef0e585df07', 'cloudbreak.recipes.read'); INSERT into groups (id, displayname) VALUES ('aac2dad1-6a7b-4ae2-9c58-e71d367d0e2d', 'cloudbreak.networks.read'); INSERT into groups (id, displayname) VALUES ('6674545b-295c-4f23-b1b4-953447dc5f40', 'cloudbreak.securitygroups.read'); INSERT into groups (id, displayname) VALUES ('f07b098a-2700-471a-9f0d-f7dd730db95d', 'cloudbreak.stacks.read'); INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.blueprints.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.templates.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.credentials.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.recipes.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.networks.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.securitygroups.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.stacks.read'; . Cause: org.postgresql.util.PSQLException: ERROR: relation "groups" does not exist Position: 88[MIGRATE] Script location: container [MIGRATE] Docker image name: sequenceiq/sultans-bin:1.1.0-rc.5 [MIGRATE] Migration command on uaadb with params: 'container pending' will be executed on container: 6399ceb17cf3217b9a2cd7bbe84dbd08e61bcd7bc6b17d16996d7c8ba6c5366e [MIGRATE] Scripts location: container [MIGRATE] Schema will be extracted from image: sequenceiq/sultans-bin:1.1.0-rc.5 [MIGRATE] Scripts location: /home/ec2-user/cloudbreak/.schema/uaadb ------------------------------------------------------------------------ -- MyBatis Migrations - pending ------------------------------------------------------------------------ WARNING: Running pending migrations out of order can create unexpected results. ========== Applying: 20150918124357_add_new_read_scopes.sql ==================== Error executing: -- add new read scopes -- Migration SQL that makes the change goes here. INSERT INTO groups (id, displayname) VALUES ('2a4f837e-2ab0-4663-8644-de23047d040d', 'cloudbreak.blueprints.read'); INSERT into groups (id, displayname) VALUES ('9fc82f95-0318-4dda-af65-ea32e2f00497', 'cloudbreak.templates.read'); INSERT into groups (id, displayname) VALUES ('8cbffdab-560d-4e14-9d1e-d5ff3f43bec6', 'cloudbreak.credentials.read'); INSERT into groups (id, displayname) VALUES ('7f85eaad-4dac-4f74-9238-aef0e585df07', 'cloudbreak.recipes.read'); INSERT into groups (id, displayname) VALUES ('aac2dad1-6a7b-4ae2-9c58-e71d367d0e2d', 'cloudbreak.networks.read'); INSERT into groups (id, displayname) VALUES ('6674545b-295c-4f23-b1b4-953447dc5f40', 'cloudbreak.securitygroups.read'); INSERT into groups (id, displayname) VALUES ('f07b098a-2700-471a-9f0d-f7dd730db95d', 'cloudbreak.stacks.read'); INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.blueprints.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.templates.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.credentials.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.recipes.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.networks.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.securitygroups.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.stacks.read'; . Cause: org.postgresql.util.PSQLException: ERROR: relation "groups" does not exist Position: 88 ------------------------------------------------------------------------ -- MyBatis Migrations FAILURE -- Total time: 0s -- Finished at: Thu Feb 25 12:23:49 UTC 2016 -- Final Memory: 10M/483M ------------------------------------------------------------------------ ERROR: Error executing command. Cause: org.apache.ibatis.jdbc.RuntimeSqlException: Error executing: -- add new read scopes -- Migration SQL that makes the change goes here. INSERT INTO groups (id, displayname) VALUES ('2a4f837e-2ab0-4663-8644-de23047d040d', 'cloudbreak.blueprints.read'); INSERT into groups (id, displayname) VALUES ('9fc82f95-0318-4dda-af65-ea32e2f00497', 'cloudbreak.templates.read'); INSERT into groups (id, displayname) VALUES ('8cbffdab-560d-4e14-9d1e-d5ff3f43bec6', 'cloudbreak.credentials.read'); INSERT into groups (id, displayname) VALUES ('7f85eaad-4dac-4f74-9238-aef0e585df07', 'cloudbreak.recipes.read'); INSERT into groups (id, displayname) VALUES ('aac2dad1-6a7b-4ae2-9c58-e71d367d0e2d', 'cloudbreak.networks.read'); INSERT into groups (id, displayname) VALUES ('6674545b-295c-4f23-b1b4-953447dc5f40', 'cloudbreak.securitygroups.read'); INSERT into groups (id, displayname) VALUES ('f07b098a-2700-471a-9f0d-f7dd730db95d', 'cloudbreak.stacks.read'); INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.blueprints.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.templates.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.credentials.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.recipes.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.networks.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.securitygroups.read'; INSERT into group_membership SELECT gr.id AS group_id, usr.id AS member_id, 'USER', 'MEMBER' FROM users usr, groups gr WHERE gr.displayname='cloudbreak.stacks.read'; . Cause: org.postgresql.util.PSQLException: ERROR: relation "groups" does not exist Position: 88[root@ip-172-31-17-119 cloudbreak]# [root@ip-172-31-17-119 cloudbreak]#
Created 02-25-2016 05:51 PM
@Gilsomar N Resende If you trying to run cloudbreak on t2micro then that will be too small please use minimum m2.medium.
Created 02-25-2016 05:51 PM
@Gilsomar N Resende If you trying to run cloudbreak on t2micro then that will be too small please use minimum m2.medium.
Created 02-25-2016 06:24 PM
Ok. I will try that and let you know the results.
Created 02-25-2016 06:32 PM
Just to check, you said m2.medium but Amazon have t2.medium, that´s it? Thanks.
Created 02-25-2016 07:33 PM
Sorry I wanted to mention m3.medium. If you want to use cloudbreak I suggest to use the prebuild images which already contains cloudbreak-deployer. You can find more here: http://sequenceiq.com/cloudbreak-docs/latest/aws-image/
Created 02-26-2016 05:06 PM
Ok rdoktorics. Thank you! I try it with t2.medium and it´s running fine. I´ll look at prebuild images. Regards.
Created 02-26-2016 05:07 PM
Don´t you think that is important to mention minimum requirements on install guide?
Created 02-27-2016 01:09 PM