Quantcast

Why is it so difficult to setup clustering ?

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Why is it so difficult to setup clustering ?

John Smith-2
Well, it seems my newly installed rabbit is misbehaving. 

Both RabbitMQ and Erlang are current versions off their relative APT feeds (http://packages.erlang-solutions.com/debian, http://www.rabbitmq.com/debian/).   One node is running Ubuntu 12.04LTS, the other 14.04LTS but I can't see that making a difference as long as Rabbit and Erlang match ?

For the purposes of this email, we'll call the Ubuntu 12 node U12 and the Ubuntu 14 node U14.

I have synched the Rabbit cookie file.

I can ping between both nodes, they are on the same subnet, no firewalls.

If I try clustering from U12 to U14, I get :

Error: {'EXIT',
           {function_clause,
               [{rabbit_control,action,
                    [join_cluster,'rabbit@U12',
                     ["rabbit@U14"],
                     [{"-p","/"},{"-n","rabbit@U14"},{"-q",false}],
                     #Fun<rabbit_control.1.115240681>],
                    []},
                {rabbit_control,start,0,[]},
                {init,start_it,1,[]},
                {init,start_em,1,[]}]}}


If I try from U14 to U12, I get :

Clustering node 'rabbit@U14' with 'rabbit@U12' ...
Error: unable to connect to nodes ['rabbit@U12]: {'EXIT',{undef,[{rabbit_mnesia,cluster_status_from_mnesia,[],[]},{rpc,'-handle_call_call/6-fun-0-',5,[{file,[114,112,99,46,101,114,108]},{line,205}]}]}}

DIAGNOSTICS
===========

attempted to contact: ['rabbit@U12']

rabbit@U12:
  * connected to epmd (port 4369) on U12
  * node rabbit@U12 up, 'rabbit' application running

current node details:
- node name: 'rabbitmqctl9529@U14'
- home dir: /var/lib/rabbitmq
- cookie hash: YhcBiH/OYzC0Gqx1id7VZg==


_______________________________________________
rabbitmq-discuss mailing list
[hidden email]
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Why is it so difficult to setup clustering ?

Simon MacMullen-2
On 30/05/2014 2:08PM, John Smith wrote:

> If I try clustering from U12 to U14, I get :
>
> Error: {'EXIT',
>             {function_clause,
>                 [{rabbit_control,action,
>                      [join_cluster,'rabbit@U12',
>                       ["rabbit@U14"],
>                       [{"-p","/"},{"-n","rabbit@U14"},{"-q",false}],
>                       #Fun<rabbit_control.1.115240681>],
>                      []},
>                  {rabbit_control,start,0,[]},
>                  {init,start_it,1,[]},
>                  {init,start_em,1,[]}]}}

That is a very odd looking error. The rabbit_control module was renamed
to rabbit_control_main in 3.0.0, the same release in which cluster was
changed to join_cluster.

So that looks like somehow you have a modern rabbitmqctl mixed in with
an old (2.x) RabbitMQ server.

> If I try from U14 to U12, I get :
>
> Clustering node 'rabbit@U14' with 'rabbit@U12' ...
> Error: unable to connect to nodes ['rabbit@U12]:
> {'EXIT',{undef,[{rabbit_mnesia,cluster_status_from_mnesia,[],[]},{rpc,'-handle_call_call/6-fun-0-',5,[{file,[114,112,99,46,101,114,108]},{line,205}]}]}}

That's also consistent with U12 running an old rabbit.

So I don't know how your installation on U12 has progressed but it has
definitely become mixed up somehow. That should be impossible if just
using .debs, so have you installed via some other mechanism as well?

Cheers, Simon

--
Simon MacMullen
RabbitMQ, Pivotal
_______________________________________________
rabbitmq-discuss mailing list
[hidden email]
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Why is it so difficult to setup clustering ?

John Smith-2
Afraid you have to point the finger straight at what's on the apt repository... neither RabbitMQ or Erlang were on either server prior to today.  So whatever got on there came straight from the repositories.


On Friday, 30 May 2014, 14:35, Simon MacMullen <[hidden email]> wrote:


On 30/05/2014 2:08PM, John Smith wrote:

> If I try clustering from U12 to U14, I get :
>
> Error: {'EXIT',
>            {function_clause,
>                [{rabbit_control,action,
>                      [join_cluster,'[hidden email]',
>                      ["[hidden email]"],
>                      [{"-p","/"},{"-n","[hidden email]"},{"-q",false}],
>                      #Fun<rabbit_control.1.115240681>],
>                      []},
>                  {rabbit_control,start,0,[]},
>                  {init,start_it,1,[]},
>                  {init,start_em,1,[]}]}}

That is a very odd looking error. The rabbit_control module was renamed
to rabbit_control_main in 3.0.0, the same release in which cluster was
changed to join_cluster.

So that looks like somehow you have a modern rabbitmqctl mixed in with
an old (2.x) RabbitMQ server.


> If I try from U14 to U12, I get :
>
> Clustering node '[hidden email]' with '[hidden email]' ...
> Error: unable to connect to nodes ['[hidden email]]:
> {'EXIT',{undef,[{rabbit_mnesia,cluster_status_from_mnesia,[],[]},{rpc,'-handle_call_call/6-fun-0-',5,[{file,[114,112,99,46,101,114,108]},{line,205}]}]}}


That's also consistent with U12 running an old rabbit.

So I don't know how your installation on U12 has progressed but it has
definitely become mixed up somehow. That should be impossible if just
using .debs, so have you installed via some other mechanism as well?

Cheers, Simon

--
Simon MacMullen
RabbitMQ, Pivotal




_______________________________________________
rabbitmq-discuss mailing list
[hidden email]
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Why is it so difficult to setup clustering ?

John Smith-2
In reply to this post by Simon MacMullen-2
Just to follow up, definitley reckon something is messed up with your apt repository.   Uninstalled the repo version, installed the deb file from the MQ site and it works fine !


On Friday, 30 May 2014, 14:35, Simon MacMullen <[hidden email]> wrote:


On 30/05/2014 2:08PM, John Smith wrote:

> If I try clustering from U12 to U14, I get :
>
> Error: {'EXIT',
>            {function_clause,
>                [{rabbit_control,action,
>                      [join_cluster,'[hidden email]',
>                      ["[hidden email]"],
>                      [{"-p","/"},{"-n","[hidden email]"},{"-q",false}],
>                      #Fun<rabbit_control.1.115240681>],
>                      []},
>                  {rabbit_control,start,0,[]},
>                  {init,start_it,1,[]},
>                  {init,start_em,1,[]}]}}

That is a very odd looking error. The rabbit_control module was renamed
to rabbit_control_main in 3.0.0, the same release in which cluster was
changed to join_cluster.

So that looks like somehow you have a modern rabbitmqctl mixed in with
an old (2.x) RabbitMQ server.


> If I try from U14 to U12, I get :
>
> Clustering node '[hidden email]' with '[hidden email]' ...
> Error: unable to connect to nodes ['[hidden email]]:
> {'EXIT',{undef,[{rabbit_mnesia,cluster_status_from_mnesia,[],[]},{rpc,'-handle_call_call/6-fun-0-',5,[{file,[114,112,99,46,101,114,108]},{line,205}]}]}}


That's also consistent with U12 running an old rabbit.

So I don't know how your installation on U12 has progressed but it has
definitely become mixed up somehow. That should be impossible if just
using .debs, so have you installed via some other mechanism as well?

Cheers, Simon

--
Simon MacMullen
RabbitMQ, Pivotal




_______________________________________________
rabbitmq-discuss mailing list
[hidden email]
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Why is it so difficult to setup clustering ?

Ceri Storey
(30/05/14 16:59), John Smith wrote:
Just to follow up, definitley reckon something is messed up with your apt repository.   Uninstalled the repo version, installed the deb file from the MQ site and it works fine !

When I've done things like this myself, I've usually forgotten to install the sources.list entry, or forgotten to run `apt-get update`; and subsequently been very confused for a short period of time. Next time, it might be worth double-checking with `dpkg -l` on both boxes as a sanity check.



On Friday, 30 May 2014, 14:35, Simon MacMullen [hidden email] wrote:


On 30/05/2014 2:08PM, John Smith wrote:
> If I try clustering from U12 to U14, I get :
>
> Error: {'EXIT',
>            {function_clause,
>                [{rabbit_control,action,
>                      [join_cluster,'[hidden email]',
>                      ["[hidden email]"],
>                      [{"-p","/"},{"-n","[hidden email]"},{"-q",false}],
>                      #Fun<rabbit_control.1.115240681>],
>                      []},
>                  {rabbit_control,start,0,[]},
>                  {init,start_it,1,[]},
>                  {init,start_em,1,[]}]}}

That is a very odd looking error. The rabbit_control module was renamed
to rabbit_control_main in 3.0.0, the same release in which cluster was
changed to join_cluster.

So that looks like somehow you have a modern rabbitmqctl mixed in with
an old (2.x) RabbitMQ server.


> If I try from U14 to U12, I get :
>
> Clustering node '[hidden email]' with '[hidden email]' ...
> Error: unable to connect to nodes ['[hidden email]]:
> {'EXIT',{undef,[{rabbit_mnesia,cluster_status_from_mnesia,[],[]},{rpc,'-handle_call_call/6-fun-0-',5,[{file,[114,112,99,46,101,114,108]},{line,205}]}]}}


That's also consistent with U12 running an old rabbit.

So I don't know how your installation on U12 has progressed but it has
definitely become mixed up somehow. That should be impossible if just
using .debs, so have you installed via some other mechanism as well?

Cheers, Simon

--
Simon MacMullen
RabbitMQ, Pivotal





_______________________________________________
rabbitmq-discuss mailing list
[hidden email]
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss


_______________________________________________
rabbitmq-discuss mailing list
[hidden email]
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Why is it so difficult to setup clustering ?

John Smith-2
In reply to this post by Simon MacMullen-2
>When I've done things like this myself, I've usually forgotten to install the sources.list entry, or forgotten to run `apt-get update`;

Definitley not the case here (have checked my bash history, and have also just gone in and deleted the config file from sources.list.d/ ).




On Friday, 30 May 2014, 14:35, Simon MacMullen <[hidden email]> wrote:


On 30/05/2014 2:08PM, John Smith wrote:

> If I try clustering from U12 to U14, I get :
>
> Error: {'EXIT',
>            {function_clause,
>                [{rabbit_control,action,
>                      [join_cluster,'[hidden email]',
>                      ["[hidden email]"],
>                      [{"-p","/"},{"-n","[hidden email]"},{"-q",false}],
>                      #Fun<rabbit_control.1.115240681>],
>                      []},
>                  {rabbit_control,start,0,[]},
>                  {init,start_it,1,[]},
>                  {init,start_em,1,[]}]}}

That is a very odd looking error. The rabbit_control module was renamed
to rabbit_control_main in 3.0.0, the same release in which cluster was
changed to join_cluster.

So that looks like somehow you have a modern rabbitmqctl mixed in with
an old (2.x) RabbitMQ server.


> If I try from U14 to U12, I get :
>
> Clustering node '[hidden email]' with '[hidden email]' ...
> Error: unable to connect to nodes ['[hidden email]]:
> {'EXIT',{undef,[{rabbit_mnesia,cluster_status_from_mnesia,[],[]},{rpc,'-handle_call_call/6-fun-0-',5,[{file,[114,112,99,46,101,114,108]},{line,205}]}]}}


That's also consistent with U12 running an old rabbit.

So I don't know how your installation on U12 has progressed but it has
definitely become mixed up somehow. That should be impossible if just
using .debs, so have you installed via some other mechanism as well?

Cheers, Simon

--
Simon MacMullen
RabbitMQ, Pivotal




_______________________________________________
rabbitmq-discuss mailing list
[hidden email]
https://lists.rabbitmq.com/cgi-bin/mailman/listinfo/rabbitmq-discuss
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Why is it so difficult to setup clustering ?

slayer201
This post has NOT been accepted by the mailing list yet.
In reply to this post by Simon MacMullen-2
Hey Simon ,

I am also getting the same error , with the [{rabbit_control_main,action, and even the clustering is getting failed. with the error

Error: {'EXIT',
           {function_clause,
               [{rabbit_control_main,action,
                    [join_cluster,rabbit@rabbit2,
                     ["rabbit@rabbit1","rabbit@rabbit2"],
                     [{"-q",false},{"-n",rabbit@rabbit2},{"--ram",false}],
                     #Fun<rabbit_control_main.9.121822165>],
                    []},
                {rabbit_cli,main,3,[]},
                {init,start_it,1,[]},
                {init,start_em,1,[]}]}}
Please see if , this is also the issue of rabbitmq verison mismatch ?

Loading...