memory usage of Riak.

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

memory usage of Riak.

Alex Feng
Hi Riak Users,

One of my riak nodes, it has 4G memory, when I check the memory usage with "free -m", I can see there are only around 150M left.  Then I check the command "riak-admin status", it shows around 415M(415594432) consumed by Erlang.  But with "top" command, it shows Erlang takes 52.1% memory, it is about 2G.
So, my question is where is the other ~1.6G (2G - 415M) memory ?


dropped_vnode_requests_total : 0
executing_mappers : 0
gossip_received : 6
handoff_timeouts : 0
ignored_gossip_total : 0
index_fsm_active : 0
index_fsm_create : 0
index_fsm_create_error : 0
late_put_fsm_coordinator_ack : 0
leveldb_read_block_error : 0
list_fsm_active : 0
list_fsm_create : 0
list_fsm_create_error : 0
list_fsm_create_error_total : 0
list_fsm_create_total : 0
map_actor_counts_100 : 0
map_actor_counts_95 : 0
map_actor_counts_99 : 0
map_actor_counts_mean : 0
map_actor_counts_median : 0
mem_allocated : 3859660800
mem_total : 3975495680
memory_atom : 703377
memory_atom_used : 677686
memory_binary : 92813136
memory_code : 16511098
memory_ets : 6823184
memory_processes : 287157280
memory_processes_used : 287149824
memory_system : 128437152
memory_total : 415594432



KiB Swap:  4063228 total,   106496 used,  3956732 free.   296560 cached Mem

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND                                      
    1 riak      20   0 4844692 1.929g   1772 S   5.3 52.1   4539:13 beam.smp                                     
23510 riak      20   0 10.152g 1.131g  32292 S   4.3 30.6   2:07.28 java                                         
   72 riak      20   0    7492     92      0 S   0.0  0.0   0:15.22 epmd                                         
  190 riak      20   0    4440    224    172 S   0.0  0.0   0:00.67 sh                                           
  191 riak      20   0    4324    252    192 S   0.0  0.0   0:08.97 memsup                                       
  193 riak      20   0    4324      0      0 S   0.0  0.0   0:00.00 cpu_sup                                      
  285 riak      20   0    7460     28      0 S   0.0  0.0   0:29.51 inet_gethost                                 
  286 riak      20   0   13780    316    236 S   0.0  0.0   0:55.30 inet_gethost                                 
  287 riak      20   0   13780      8      0 S   0.0  0.0   0:00.00 inet_gethost                                 
22534 root      20   0   22320   1248    756 S   0.0  0.0   0:00.07 bash                                         
24714 root      20   0   23992   1456   1052 R   0.0  0.0   0:00.00 top       


Br,
Alex

_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: memory usage of Riak.

Matthew Von-Maszewski
Alex,

Which backend are you using?  Leveldb's memory usage does not show up within Erlang.  Maybe that is what you are experiencing?

Matthew

Sent from my iPad

> On Jan 26, 2017, at 5:47 AM, Alex Feng <[hidden email]> wrote:
>
> Hi Riak Users,
>
> One of my riak nodes, it has 4G memory, when I check the memory usage with "free -m", I can see there are only around 150M left.  Then I check the command "riak-admin status", it shows around 415M(415594432) consumed by Erlang.  But with "top" command, it shows Erlang takes 52.1% memory, it is about 2G.
> So, my question is where is the other ~1.6G (2G - 415M) memory ?
>
>
> dropped_vnode_requests_total : 0
> executing_mappers : 0
> gossip_received : 6
> handoff_timeouts : 0
> ignored_gossip_total : 0
> index_fsm_active : 0
> index_fsm_create : 0
> index_fsm_create_error : 0
> late_put_fsm_coordinator_ack : 0
> leveldb_read_block_error : 0
> list_fsm_active : 0
> list_fsm_create : 0
> list_fsm_create_error : 0
> list_fsm_create_error_total : 0
> list_fsm_create_total : 0
> map_actor_counts_100 : 0
> map_actor_counts_95 : 0
> map_actor_counts_99 : 0
> map_actor_counts_mean : 0
> map_actor_counts_median : 0
> mem_allocated : 3859660800
> mem_total : 3975495680
> memory_atom : 703377
> memory_atom_used : 677686
> memory_binary : 92813136
> memory_code : 16511098
> memory_ets : 6823184
> memory_processes : 287157280
> memory_processes_used : 287149824
> memory_system : 128437152
> memory_total : 415594432
>
>
>
> KiB Swap:  4063228 total,   106496 used,  3956732 free.   296560 cached Mem
>
>   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND                                    
>     1 riak      20   0 4844692 1.929g   1772 S   5.3 52.1   4539:13 beam.smp                                    
> 23510 riak      20   0 10.152g 1.131g  32292 S   4.3 30.6   2:07.28 java                                        
>    72 riak      20   0    7492     92      0 S   0.0  0.0   0:15.22 epmd                                        
>   190 riak      20   0    4440    224    172 S   0.0  0.0   0:00.67 sh                                          
>   191 riak      20   0    4324    252    192 S   0.0  0.0   0:08.97 memsup                                      
>   193 riak      20   0    4324      0      0 S   0.0  0.0   0:00.00 cpu_sup                                      
>   285 riak      20   0    7460     28      0 S   0.0  0.0   0:29.51 inet_gethost                                
>   286 riak      20   0   13780    316    236 S   0.0  0.0   0:55.30 inet_gethost                                
>   287 riak      20   0   13780      8      0 S   0.0  0.0   0:00.00 inet_gethost                                
> 22534 root      20   0   22320   1248    756 S   0.0  0.0   0:00.07 bash                                        
> 24714 root      20   0   23992   1456   1052 R   0.0  0.0   0:00.00 top      
>
>
> Br,
> Alex
> _______________________________________________
> riak-users mailing list
> [hidden email]
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: memory usage of Riak.

Alex Feng
HI Mattew,

Thank you for the help.
I got answer from Shaun already, seems LevelDB and Bitcask, they are same, memory usage does not show up in Erlang.

Br,
Alex

2017-01-26 14:47 GMT+01:00 Matthew Von-Maszewski <[hidden email]>:
Alex,

Which backend are you using?  Leveldb's memory usage does not show up within Erlang.  Maybe that is what you are experiencing?

Matthew

Sent from my iPad

> On Jan 26, 2017, at 5:47 AM, Alex Feng <[hidden email]> wrote:
>
> Hi Riak Users,
>
> One of my riak nodes, it has 4G memory, when I check the memory usage with "free -m", I can see there are only around 150M left.  Then I check the command "riak-admin status", it shows around 415M(415594432) consumed by Erlang.  But with "top" command, it shows Erlang takes 52.1% memory, it is about 2G.
> So, my question is where is the other ~1.6G (2G - 415M) memory ?
>
>
> dropped_vnode_requests_total : 0
> executing_mappers : 0
> gossip_received : 6
> handoff_timeouts : 0
> ignored_gossip_total : 0
> index_fsm_active : 0
> index_fsm_create : 0
> index_fsm_create_error : 0
> late_put_fsm_coordinator_ack : 0
> leveldb_read_block_error : 0
> list_fsm_active : 0
> list_fsm_create : 0
> list_fsm_create_error : 0
> list_fsm_create_error_total : 0
> list_fsm_create_total : 0
> map_actor_counts_100 : 0
> map_actor_counts_95 : 0
> map_actor_counts_99 : 0
> map_actor_counts_mean : 0
> map_actor_counts_median : 0
> mem_allocated : 3859660800
> mem_total : 3975495680
> memory_atom : 703377
> memory_atom_used : 677686
> memory_binary : 92813136
> memory_code : 16511098
> memory_ets : 6823184
> memory_processes : 287157280
> memory_processes_used : 287149824
> memory_system : 128437152
> memory_total : 415594432
>
>
>
> KiB Swap:  4063228 total,   106496 used,  3956732 free.   296560 cached Mem
>
>   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
>     1 riak      20   0 4844692 1.929g   1772 S   5.3 52.1   4539:13 beam.smp
> 23510 riak      20   0 10.152g 1.131g  32292 S   4.3 30.6   2:07.28 java
>    72 riak      20   0    7492     92      0 S   0.0  0.0   0:15.22 epmd
>   190 riak      20   0    4440    224    172 S   0.0  0.0   0:00.67 sh
>   191 riak      20   0    4324    252    192 S   0.0  0.0   0:08.97 memsup
>   193 riak      20   0    4324      0      0 S   0.0  0.0   0:00.00 cpu_sup
>   285 riak      20   0    7460     28      0 S   0.0  0.0   0:29.51 inet_gethost
>   286 riak      20   0   13780    316    236 S   0.0  0.0   0:55.30 inet_gethost
>   287 riak      20   0   13780      8      0 S   0.0  0.0   0:00.00 inet_gethost
> 22534 root      20   0   22320   1248    756 S   0.0  0.0   0:00.07 bash
> 24714 root      20   0   23992   1456   1052 R   0.0  0.0   0:00.00 top
>
>
> Br,
> Alex
> _______________________________________________
> riak-users mailing list
> [hidden email]
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com


_______________________________________________
riak-users mailing list
[hidden email]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Loading...