Node is not running!

classic Classic list List threaded Threaded
12 messages Options
Reply | Threaded
Open this post in threaded view
|

Node is not running!

Jurgen Ramaliu
Hello RIAK,

I have one problem with riak node configuration. I have install RIAK KV and everything is ok.
I run riak start on my CentOS 6.5 and it starts ok.
I have configure file /etc/hosts :

127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.10          riak1.mydomain.com        riak1

and this file /etc/sysconfig/network :

NETWORKING=yes


to configure first node, when I change nodename form :
nodename = [hidden email] to nodename = [hidden email] , riak doesn't start, I take back this error messages :

[root@riak1 ~]# riak start
Node '[hidden email]' not responding to pings.
Node '[hidden email]' not responding to pings.
Node is not running!



or nodename = [hidden email], riak doesn't start, I take back this error messages :

[root@riak1 ~]# riak start

Node '[hidden email]' not responding to pings.
Node '[hidden email]' not responding to pings.
Node is not running!

Can you please tell me how can I resolve this problem?

Thank you in advance,

Jurgen

_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Paul Henrich
Hi Jurgen,

This rings a bell from a recent exchange on the list. Try this:
Hi David, I vaguely remember the same problem from a previous setup I did, a while ago now. IIRC, the original configured IP gets written to disk on the initial start and then the next start fails due to the mis-match. Try deleting your data directory and restarting, so this will be like the initial startup again. //Sean.
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2017-February/019061.html


On Feb 22, 2017, at 5:34 AM, Jurgen Ramaliu <[hidden email]> wrote:

Hello RIAK,

I have one problem with riak node configuration. I have install RIAK KV and everything is ok.
I run riak start on my CentOS 6.5 and it starts ok.
I have configure file /etc/hosts :

127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.10          riak1.mydomain.com        riak1

and this file /etc/sysconfig/network :

NETWORKING=yes


to configure first node, when I change nodename form :
nodename = [hidden email] to nodename = [hidden email] , riak doesn't start, I take back this error messages :

[root@riak1 ~]# riak start
Node '[hidden email]' not responding to pings.
Node '[hidden email]' not responding to pings.
Node is not running!



or nodename = [hidden email], riak doesn't start, I take back this error messages :

[root@riak1 ~]# riak start

Node '[hidden email]' not responding to pings.
Node '[hidden email]' not responding to pings.
Node is not running!

Can you please tell me how can I resolve this problem?

Thank you in advance,

Jurgen
_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Magnus Kessler
In reply to this post by Jurgen Ramaliu
On 22 February 2017 at 10:34, Jurgen Ramaliu <[hidden email]> wrote:
Hello RIAK,

I have one problem with riak node configuration. I have install RIAK KV and everything is ok.
I run riak start on my CentOS 6.5 and it starts ok.
I have configure file /etc/hosts :

127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.10          riak1.mydomain.com        riak1

and this file /etc/sysconfig/network :

NETWORKING=yes


to configure first node, when I change nodename form :
nodename = [hidden email] to nodename = [hidden email] , riak doesn't start, I take back this error messages :

[root@riak1 ~]# riak start
Node '[hidden email]' not responding to pings.
Node '[hidden email]' not responding to pings.
Node is not running!



or nodename = [hidden email], riak doesn't start, I take back this error messages :

[root@riak1 ~]# riak start

Node '[hidden email]' not responding to pings.
Node '[hidden email]' not responding to pings.
Node is not running!

Can you please tell me how can I resolve this problem?

Thank you in advance,

Jurgen


Hi Jurgen,

When a node is started for the first time, its name is recorded in the ring file (a file under /var/lib/riak/ring by default on CentOS). For a single node that hasn't joined a cluster, yet, the easiest way to start the node with a new node name is to simply remove the ring directory and then start the node. Please note that any changes to bucket properties for buckets under the default bucket type get lost in this process. If any such changes have been made, re-apply them once the node has been restarted.

Kind Regards,

Magnus

--
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431

_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Jurgen Ramaliu
Hi Paul and Magnus,
I have resolve it by using command : 

  • riak stop
But I have another problem, riak starts with this IP but shut down after about 15 seconds.


Can you tell me how can I resolve this?

Regards,
Jurgen


On Wed, Feb 22, 2017 at 4:43 PM, Magnus Kessler <[hidden email]> wrote:
On 22 February 2017 at 10:34, Jurgen Ramaliu <[hidden email]> wrote:
Hello RIAK,

I have one problem with riak node configuration. I have install RIAK KV and everything is ok.
I run riak start on my CentOS 6.5 and it starts ok.
I have configure file /etc/hosts :

127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.10          riak1.mydomain.com        riak1

and this file /etc/sysconfig/network :

NETWORKING=yes


to configure first node, when I change nodename form :
nodename = [hidden email] to nodename = [hidden email] , riak doesn't start, I take back this error messages :

[root@riak1 ~]# riak start
Node '[hidden email]' not responding to pings.
Node '[hidden email]' not responding to pings.
Node is not running!



or nodename = [hidden email], riak doesn't start, I take back this error messages :

[root@riak1 ~]# riak start

Node '[hidden email]' not responding to pings.
Node '[hidden email]' not responding to pings.
Node is not running!

Can you please tell me how can I resolve this problem?

Thank you in advance,

Jurgen


Hi Jurgen,

When a node is started for the first time, its name is recorded in the ring file (a file under /var/lib/riak/ring by default on CentOS). For a single node that hasn't joined a cluster, yet, the easiest way to start the node with a new node name is to simply remove the ring directory and then start the node. Please note that any changes to bucket properties for buckets under the default bucket type get lost in this process. If any such changes have been made, re-apply them once the node has been restarted.

Kind Regards,

Magnus

--
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Magnus Kessler
On 23 February 2017 at 07:19, Jurgen Ramaliu <[hidden email]> wrote:
Hi Paul and Magnus,
I have resolve it by using command : 

  • riak stop
But I have another problem, riak starts with this IP but shut down after about 15 seconds.


Can you tell me how can I resolve this?

Regards,
Jurgen

Hi Jurgen,

Can post the portion of the console.log since the last restart of Riak, please? Without further information it's hard to guess what may have gone wrong.

Kind Regards,

Magnus


--
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431

_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Jurgen Ramaliu
Hello Magnus,

Attached is console.log.


On Thu, Feb 23, 2017 at 2:32 PM, Magnus Kessler <[hidden email]> wrote:
On 23 February 2017 at 07:19, Jurgen Ramaliu <[hidden email]> wrote:
Hi Paul and Magnus,
I have resolve it by using command : 

  • riak stop
But I have another problem, riak starts with this IP but shut down after about 15 seconds.


Can you tell me how can I resolve this?

Regards,
Jurgen

Hi Jurgen,

Can post the portion of the console.log since the last restart of Riak, please? Without further information it's hard to guess what may have gone wrong.

Kind Regards,

Magnus


--
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

console.log (22K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Magnus Kessler
On 23 February 2017 at 13:38, Jurgen Ramaliu <[hidden email]> wrote:
Hello Magnus,

Attached is console.log.


Hi Jurgen,

The log contains these lines:

2017-02-23 14:36:17.949 [error] <0.707.0>@riak_kv_vnode:init:512 Failed to start riak_kv_eleveldb_backend backend for index 91343852333181432387730302044767688728495783936 error: {db_open,"Corruption: bad record length"}
2017-02-23 14:36:17.950 [error] <0.718.0>@riak_kv_vnode:init:512 Failed to start riak_kv_eleveldb_backend backend for index 251195593916248939066258330623111144003363405824 error: {db_open,"Corruption: bad record length"}
2017-02-23 14:36:17.970 [notice] <0.707.0>@riak:stop:43 "backend module failed to start."
2017-02-23 14:36:17.970 [notice] <0.718.0>@riak:stop:43 "backend module failed to start."

This suggests that a previous unclean shutdown of Riak left some leveldb data files damaged, specifically in partitions 91343852333181432387730302044767688728495783936 and 251195593916248939066258330623111144003363405824. Please follow the instructions in the documentation[0] to repair the affected partitions. If this is still a single test node without any valuable data, you can also simply delete the leveldb backend directory.

Kind Regards,

Magnus

 
--
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431

_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Magnus Kessler
On 23 February 2017 at 13:58, Magnus Kessler <[hidden email]> wrote:
On 23 February 2017 at 13:38, Jurgen Ramaliu <[hidden email]> wrote:
Hello Magnus,

Attached is console.log.




Hi Jurgen,

If you haven't deleted any older logs since, could you please also run 'riak-debug' and post the resulting archive file? A Basho engineer would like to see if there were similarities to another issue he's investigating.

Kind Regards,

Magnus
 
--
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431

_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Jurgen Ramaliu
Hello Magnus,

I have attached logs directory in this e-mail.


Best Regards,
Jurgen

On Fri, Feb 24, 2017 at 9:56 AM, Magnus Kessler <[hidden email]> wrote:
On 23 February 2017 at 13:58, Magnus Kessler <[hidden email]> wrote:
On 23 February 2017 at 13:38, Jurgen Ramaliu <[hidden email]> wrote:
Hello Magnus,

Attached is console.log.




Hi Jurgen,

If you haven't deleted any older logs since, could you please also run 'riak-debug' and post the resulting archive file? A Basho engineer would like to see if there were similarities to another issue he's investigating.

Kind Regards,

Magnus
 
--
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

logs.rar (113K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Jurgen Ramaliu
Hello,

I have two questions :

1.

Problem with Riak KV installation Bitcask. I try this link to install Bitcask on Riak KV:


And when I go on step 

Bitcask Database Files


I try to do this command : 
-H "Content-Type: text/plain" \ -d "hello

I receive this error :

curl: (6) Couldn't resolve host ' -H'
curl: (6) Couldn't resolve host 'Content-Type: text'
curl: (6) Couldn't resolve host ' -d'
curl: (6) Couldn't resolve host 'hello'
<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request:<br><pre>{error,function_clause}</pre><P><HR><ADDRESS>mochiweb+webmachine web server</ADDRESS></body></html>


2.

Activation bucket type problem.
I have create bucket-type hello and i can't activte it. 
When I try to activate it with command : riak-admin bucket-type activate hello , I receive this message : 'hello has been created but cannot be activated yet'



Attached are screen shots. 
Can you please give to me one solution to resolve those problems?


Thank you in advance,
Jurgen

On Fri, Feb 24, 2017 at 10:10 AM, Jurgen Ramaliu <[hidden email]> wrote:
Hello Magnus,

I have attached logs directory in this e-mail.


Best Regards,
Jurgen

On Fri, Feb 24, 2017 at 9:56 AM, Magnus Kessler <[hidden email]> wrote:
On 23 February 2017 at 13:58, Magnus Kessler <[hidden email]> wrote:
On 23 February 2017 at 13:38, Jurgen Ramaliu <[hidden email]> wrote:
Hello Magnus,

Attached is console.log.




Hi Jurgen,

If you haven't deleted any older logs since, could you please also run 'riak-debug' and post the resulting archive file? A Basho engineer would like to see if there were similarities to another issue he's investigating.

Kind Regards,

Magnus
 
--
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431



_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

riak.conf.png (52K) Download Attachment
bitcask.png (64K) Download Attachment
bucket type.png (15K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Magnus Kessler


On 8 March 2017 at 08:40, Jurgen Ramaliu <[hidden email]> wrote:
Hello,

I have two questions :

1.

Problem with Riak KV installation Bitcask. I try this link to install Bitcask on Riak KV:


And when I go on step 

Bitcask Database Files


I try to do this command : 
-H "Content-Type: text/plain" \ -d "hello

I receive this error :

curl: (6) Couldn't resolve host ' -H'
curl: (6) Couldn't resolve host 'Content-Type: text'
curl: (6) Couldn't resolve host ' -d'
curl: (6) Couldn't resolve host 'hello'
<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request:<br><pre>{error,function_clause}</pre><P><HR><ADDRESS>mochiweb+webmachine web server</ADDRESS></body></html>


Hi Jurgen,

I am not sure what causes this issue on your machine, but it may be due to a copy and paste error. Please try putting the entire command onto one line in the shell, like this: 

curl -XPUT http://localhost:8098/types/default/buckets/test/keys/test -H "Content-Type: text/plain" -d "hello"

 


2.

Activation bucket type problem.
I have create bucket-type hello and i can't activte it. 
When I try to activate it with command : riak-admin bucket-type activate hello , I receive this message : 'hello has been created but cannot be activated yet'



Attached are screen shots. 
Can you please give to me one solution to resolve those problems?

Please ensure that all nodes in the cluster are up. Before a bucket type can be activated, it must have been distributed to all nodes.

Kind Regards,

Magnus


-- 
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431

_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|

Re: Node is not running!

Jurgen Ramaliu
Hello Magnus and Riak Users,

Thanks for your help.
I have another question :

I run command:
 
curl -XPUT http://192...:8098/types/default/buckets/test/keys/test -H "Content-Type: text/plain" -d "hello"

Looks everything is ok , but when I list with command : 

ll /var/lib/riak/bitcask/ , I don't see vnode partitions like this :


|-- 1118962191081472546749696200048404186924073353216-1316787078245894 | |-- 1316787252.bitcask.data | |-- 1316787252.bitcask.hint | `-- bitcask.write.lock



I see only like this :
drwxrwxr-x. 2 riak riak 4096 Mar 13 09:58 1004782375664995756265033322492444576013453623296 drwxrwxr-x. 2 riak riak 4096 Mar 13 09:58 1027618338748291114361965898003636498195577569280 drwxrwxr-x. 2 riak riak 4096 Mar 13 09:58 1050454301831586472458898473514828420377701515264 drwxrwxr-x. 2 riak riak 4096 Mar 13 09:58 1073290264914881830555831049026020342559825461248

Attached is print screen.

Please give me on solution.

Thank you!

Regards,
Jurgen


On Sat, Mar 11, 2017 at 11:51 AM, Magnus Kessler <[hidden email]> wrote:


On 8 March 2017 at 08:40, Jurgen Ramaliu <[hidden email]> wrote:
Hello,

I have two questions :

1.

Problem with Riak KV installation Bitcask. I try this link to install Bitcask on Riak KV:


And when I go on step 

Bitcask Database Files


I try to do this command : 
-H "Content-Type: text/plain" \ -d "hello

I receive this error :

curl: (6) Couldn't resolve host ' -H'
curl: (6) Couldn't resolve host 'Content-Type: text'
curl: (6) Couldn't resolve host ' -d'
curl: (6) Couldn't resolve host 'hello'
<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request:<br><pre>{error,function_clause}</pre><P><HR><ADDRESS>mochiweb+webmachine web server</ADDRESS></body></html>


Hi Jurgen,

I am not sure what causes this issue on your machine, but it may be due to a copy and paste error. Please try putting the entire command onto one line in the shell, like this: 

curl -XPUT http://localhost:8098/types/default/buckets/test/keys/test -H "Content-Type: text/plain" -d "hello"

 


2.

Activation bucket type problem.
I have create bucket-type hello and i can't activte it. 
When I try to activate it with command : riak-admin bucket-type activate hello , I receive this message : 'hello has been created but cannot be activated yet'



Attached are screen shots. 
Can you please give to me one solution to resolve those problems?

Please ensure that all nodes in the cluster are up. Before a bucket type can be activated, it must have been distributed to all nodes.

Kind Regards,

Magnus


-- 
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

riak bitcask.png (153K) Download Attachment