co mi zere kernel pamet

Radim Kolar hsn at filez.com
Mon Jul 9 01:27:21 CEST 2012


>> Asi bude memory leak v ZFS. bsd je to 8.3
> To se samozrejme vyloucit neda - poznas to snadno - kdyz po restartu 
> (a nejake dobe na pocatecni ustaleni) bude to cislo mensi - a postupem 
> casu bude pomalu a vytrvale rust, pak je tve podezreni nejspis spravne.
vytrvale to neroste povetsinou se to flaka mezi 5 - 5,5 GB z 8.

> A kdyz uz to budes stejne restartovat, tak nejdriv postrilej vsechno 
> co tam bezi (kroem toho, co ti zajistuje prstup pres ktery to 
> strilis). Potvrdis nebo vyloucis moznost, ze tu pamet zere nejaka jina 
> aplikace a ne ZFS.
po restartu je tam hodne malo wired < 1 GB a pomalu to roste. Na netu 
podeziraji ZFS z memory leaku casto. Zajimavy je tohle:
zfs-stats -M jen nevim co je ta kernel memory map. Prece ty gigabajty 
nekde naalokovany byt musi pokud to neni overhead zpusobeny fragmentaci 
pameti.

------------------------------------------------------------------------
ZFS Subsystem Report                            Mon Jul  9 01:13:29 2012
------------------------------------------------------------------------

System Memory:

         18.21%  1.40    GiB Active,     6.24%   492.36  MiB Inact
         71.78%  5.53    GiB Wired,      2.84%   224.23  MiB Cache
         0.91%   71.56   MiB Free,       0.03%   2.59    MiB Gap

         Real Installed:                         8.00    GiB
         Real Available:                 99.68%  7.97    GiB
         Real Managed:                   96.68%  7.71    GiB

         Logical Total:                          8.00    GiB
         Logical Used:                   90.38%  7.23    GiB
         Logical Free:                   9.62%   788.14  MiB

Kernel Memory:                                  172.44  MiB
         Data:                           90.64%  156.30  MiB
         Text:                           9.36%   16.14   MiB

Kernel Memory Map:                              7.30    GiB
         Size:                           61.32%  4.48    GiB
         Free:                           38.68%  2.82    GiB


>
> Taky se muze spodivat co najdes v
>
> vmstat -m | grep solaris
>
> Mam dojem, ze to prvni cislo je ve ctyrkilovejch strankach a jestli ti 
> po vynasobeni vyjde zhruba to, co vidis ve Wired, tak vis, kde ta 
> pamet je. Teda, z hlediska systemu. Stale nebudes vedet, kde se toula 
> v ramci ZFS, ale alespon neco.
vmstat -m vraci samy maly cistla, rozhodne ne neco co sezere 3 GB.

          Type InUse MemUse HighUse Requests  Size(s)
       ithread   100    16K       -      100  32,128,256
      pci_link    16     2K       -       16  64,128
        KTRACE   100    13K       -      100  128
        linker   166    15K       -      181  16,32,64,128,512
         lockf   119    11K       - 124556822  64,128,256,512
        ip6ndp     7     1K       -        7  64,128
        ip6opt     1     1K       -    44641  256
          temp    65   570K       - 15345188 
16,32,64,128,256,512,1024,2048,4096
        devbuf 18156 39858K       -    18424 
16,32,64,128,256,512,1024,2048,4096
         cache     1     1K       -        1  32
          UART     3     2K       -        3  16,512,1024
        module   431    54K       -      431  128
     acpi_perf     8     2K       -        8  256
      mtx_pool     2    16K       -        2
        acpica  3431   348K       -    98917 16,32,64,128,256,512,1024,2048
           osd    15     1K       -    13427  16,64
      acpitask     1     2K       -        1  2048
       subproc  1911  1526K       -  4919043  512,4096
          proc     2    16K       -        2
       session    55     7K       -   393666  128
          pgrp    57     8K       -   406789  128
          cred   200    32K       - 142936292  64,256
       uidinfo    17     4K       -    50736  128,2048
        plimit    43    11K       -   521421  256
     CAM queue    13     1K       -       29  16,256
       acpisem    19     3K       -       19  128
     sysctltmp     0     0K       -   799123  16,32,64,128,256,4096
     sysctloid  5219   259K       -     5334  16,32,64,128
        sysctl     0     0K       -  6869726  16,32,64
       callout     7  3584K       -        7
          umtx  3918   490K       -     7869  128
      p1003.1b     1     1K       -        1  16
          SWAP     2  1097K       -        2  64
       CAM SIM     3     1K       -        3  256
        bus-sc    92   166K       -     2615 
16,32,64,128,256,512,1024,2048,4096
           bus  1182   110K       -     6674 16,32,64,128,256,512,1024
       devstat    12    25K       -       12  32,4096
  eventhandler    79     7K       -       79  64,128
    CAM periph     6     2K       -       18  16,32,64,128,256
          kobj   288  1152K       -      389  4096
       Per-cpu     1     1K       -        1  32
        USBdev    26    11K       -       26  64,128,512,1024,4096
          rman   178    22K       -      653  16,32,128
           USB    42    46K       -       48 16,32,64,128,256,2048,4096
          sbuf     0     0K       -     1412 
16,32,64,128,256,512,1024,2048,4096
       CAM XPT    69    82K       -      101  32,64,128,1024,2048
        kbdmux     7    10K       -        7  16,512,1024,2048,4096
           LED    12     1K       -       12  16,128
         stack     0     0K       -        4  256
     taskqueue    99     9K       -      129  16,32,64,128,1024
        Unitno    32     2K       -  7972561  32,64
           iov     0     0K       - 10845158 
16,32,64,128,256,512,1024,2048,4096
        select  3423   428K       -     5853  128
      ioctlops     0     0K       - 14020838 16,32,64,128,256,512,1024
           msg     4    30K       -        4  2048,4096
           sem     4  6938K       -        4  512,1024
           shm    42   102K       -   404419  2048
           tty    27    27K       -      163  1024,2048
           pts     7     2K       -      139  256
          accf     2     1K       -        2  64
      mbuf_tag     0     0K       -  9435098  32,64,128
          ksem     1     8K       -        7  64,128,1024
         shmfd     1     8K       -        1
           pcb   183   162K       - 42003908 16,32,128,1024,2048,4096
        soname    44     5K       - 145006763  16,32,128
           acl     0     0K       -  8178587  4096
      vfscache     1  2048K       -        1
      vfs_hash     1  1024K       -        1
        vnodes     3     1K       -       98  64,256
   vnodemarker     0     0K       -  4665700  512
         mount   261     9K       -      589  16,32,64,128,256
       fadvise   555    18K       -      555  32
           BPF    10    66K       -      176  16,128,256,512,4096
   ether_multi    25     2K       -       88  16,32,64
        ifaddr    75    22K       -       75  32,64,128,256,512,4096
         ifnet     7    13K       -        7  128,2048
         clone     6    24K       -        6  4096
        arpcom     3     1K       -        3  16
       lltable    29    11K       -      343  256,512
CAM dev queue     3     1K       -        3  128
      routetbl   175  2126K       -    25427  32,64,128,256,512
          igmp     6     2K       -        6  256
        DEVFS1   113    57K       -      247  512
        DEVFS3   267    67K       -      540  256
        DEVFS2   109     2K       -      110  16
   ip_moptions     4     1K       -       24  64,256
      in_multi     4     1K       -       14  256
    in_mfilter     2     2K       -       12  1024
      dummynet     3     3K       -        3  512,1024
    DEVFS_RULE    54    26K       -      105  64,512
   IpFw/IpAcct    33     5K       -       67  16,32,64,128,256
      ipfw_tbl     4     1K       -        4  256
     sctp_iter     0     0K       -       10  256
      sctp_ifn     2     1K       -        2  128
      sctp_ifa    15     2K       -       15  128
      sctp_vrf     1     1K       -        1  64
     sctp_a_it     0     0K       -       10  16
     hostcache     1    28K       -        1
      syncache     1    96K       -        1
         DEVFS    29     1K       -       44  16,128
        DEVFSP     2     1K       -       43  64
   fdesc_mount     1     1K       -        1  16
     in6_multi    12     2K       -       12  32,256
           mld     6     1K       -        6  128
       NFS FHA     1     2K       -        1  2048
           rpc     2     9K       -        2  256
audit_evclass   172     6K       -      211  32
        newblk     1     1K       -        1  512
      inodedep     1  1024K       -        1
       pagedep     1   256K       -        1
     ufs_quota     1  1024K       -        1
       UMAHash    80  4048K       -      480  512,1024,2048,4096
     pfs_nodes    21     6K       -       21  256
   pfs_vncache     2     1K       -     8652  64
     vm_pgdata     2   129K       -        2  128
          GEOM   107    19K       -      664 16,32,64,128,256,512,1024
       acpidev    87     6K       -       87  64
       io_apic     1     2K       -        1  2048
       memdesc     1     4K       -        1  4096
      atkbddev     2     1K       -        2  64
        isadev     7     1K       -        7  128
       entropy  1024    64K       -     1024  64
          cdev     9     3K       -        9  256
         sigio     1     1K       -        1  64
      filedesc   281   282K       -  6931930 16,32,64,128,512,1024,2048,4096
          kenv    83    11K       -       90  16,32,64,128
        kqueue   161   199K       -  4781116  256,512,2048,4096
     proc-args   126    63K       - 697680623 
16,32,64,128,256,512,1024,2048,4096
         hhook     2     1K       -        2  128
           MCA     9     2K       -        9  64,128
           msi     5     1K       -        5  128
      nexusdev     3     1K       -        3  16
    kstat_data     4     1K       -        4  64
   stripe_data     2     1K       -        2  16,64
       solaris 511842 87042K       - 10761412489 
16,32,64,128,256,512,1024,2048,4096

vmstat -z
ITEM                     SIZE     LIMIT      USED      FREE REQUESTS  
FAILURES

UMA Kegs:                 208,        0,      190,       14, 190,        0
UMA Zones:                448,        0,      190,        2, 190,        0
UMA Slabs:                568,        0,   146203,    12501, 
46047045,        0
UMA RCntSlabs:            568,        0,     1925,      175, 
166615,        0
UMA Hash:                 256,        0,        2,       28, 82,        0
16 Bucket:                152,        0,       60,      365, 1542,        0
32 Bucket:                280,        0,       70,      182, 1352,        0
64 Bucket:                536,        0,      225,       76, 2551,      123
128 Bucket:              1048,        0,     3238,        2, 4243780,  
2073488
VM OBJECT:                216,        0,    62856,    30348, 
149414903,        0
MAP:                      232,        0,        7,       25, 7,        0
KMAP ENTRY:               120,   277295,    19587,    34136, 
118897672,        0
MAP ENTRY:                120,        0,    13167,     8967, 
707651227,        0
DP fakepg:                120,        0,        0,        0, 0,        0
SG fakepg:                120,        0,        0,        0, 0,        0
mt_zone:                 2056,        0,      271,        8, 271,        0
16:                        16,        0,   110730,    86838, 
1881263779,        0
32:                        32,        0,    55284,    31273, 
718766067,        0
64:                        64,        0,   253112,   111560, 
4767942299,        0
128:                      128,        0,    57303,    35468, 
2746334055,        0
256:                      256,        0,    58976,    88354, 
1204999564,        0
512:                      512,        0,     2330,     1275, 
658039854,        0
1024:                    1024,        0,      244,     1388, 
10337302,        0
2048:                    2048,        0,      355,     1235, 
3526488,        0
4096:                    4096,        0,     9163,     1470, 
45674075,        0
Files:                     80,        0,     2995,     3440, 
202191541,        0
TURNSTILE:                136,        0,     3919,     1081, 7870,        0
umtx pi:                   96,        0,        0,        0, 0,        0
MAC labels:                40,        0,        0,        0, 0,        0
PROC:                    1136,        0,      128,     1618, 
4932189,        0
THREAD:                  1120,        0,     2838,     1080, 
3990347,        0
SLEEPQUEUE:                80,        0,     3919,     1098, 7870,        0
VMSPACE:                  392,        0,      109,     1691, 
4932144,        0
cpuset:                    72,        0,        6,       94, 6,        0
audit_record:             952,        0,        0,        0, 0,        0
mbuf_packet:              256,        0,     1023,     1576, 
604125183,        0
mbuf:                     256,        0,        4,     1417, 
1850465210,        0
mbuf_cluster:            2048,    32768,     2599,     1251, 
435804935,        0
mbuf_jumbo_page:         4096,    16384,        0,        0, 0,        0
mbuf_jumbo_9k:           9216,     8192,        0,        0, 0,        0
mbuf_jumbo_16k:         16384,     4096,        0,        0, 0,        0
mbuf_ext_refcnt:            4,        0,        0,     1344, 
47025888,        0
g_bio:                    232,        0,        8,     1608, 
900204003,        0
ttyinq:                   160,        0,       75,      549, 2790,        0
ttyoutq:                  256,        0,       40,      320, 1488,        0
ata_request:              320,        0,        0,        0, 0,        0
ata_composite:            336,        0,        0,        0, 0,        0
taskq_zone:                48,        0,        0,     1584, 
21519594,        0
VNODE:                    472,        0,    73655,    14801, 
44901504,        0
VNODEPOLL:                112,        0,       30,      531, 2444,        0
NAMEI:                   1024,        0,        0,     1300, 
503789404,        0
S VFS Cache:              108,        0,    71871,    18615, 
46769250,        0
L VFS Cache:              328,        0,     4997,     3619, 
10791779,        0
NFSMOUNT:                 632,        0,        0,        0, 0,        0
NFSNODE:                  688,        0,        0,        0, 0,        0
DIRHASH:                 1024,        0,        0,        0, 0,        0
AIO:                      208,        0,        0,        0, 0,        0
AIOP:                      32,        0,        0,        0, 0,        0
AIOCB:                    480,        0,        0,        0, 0,        0
AIOL:                     128,        0,        0,        0, 0,        0
AIOLIO:                   272,        0,        0,        0, 0,        0
pipe:                     728,        0,      107,     1428, 
6474875,        0
zio_cache:                880,        0,        8,     4708, 
3259536554,        0
zio_link_cache:            48,        0,        5,    10147, 
1638920210,        0
zio_buf_512:              512,        0,   152051,    57578, 
70317355,        0
zio_data_buf_512:         512,        0,     2398,     1207, 
2258453,        0
zio_buf_1024:            1024,        0,        9,     1379, 
14044427,        0
zio_data_buf_1024:       1024,        0,     1635,      913, 
1178817,        0
zio_buf_1536:            1536,        0,        5,     1269, 
3747961,        0
zio_data_buf_1536:       1536,        0,     1893,      721, 
1691457,        0
zio_buf_2048:            2048,        0,      182,     1124, 
12352798,        0
zio_data_buf_2048:       2048,        0,     1425,      723, 
708337,        0
zio_buf_2560:            2560,        0,       38,      803, 
1892188,        0
zio_data_buf_2560:       2560,        0,     1024,      703, 
1278533,        0
zio_buf_3072:            3072,        0,        2,      799, 
1963086,        0
zio_data_buf_3072:       3072,        0,      859,      649, 
450236,        0
zio_buf_3584:            3584,        0,        0,      809, 
2387749,        0
zio_data_buf_3584:       3584,        0,      655,      635, 
1128228,        0
zio_buf_4096:            4096,        0,      466,      991, 
11114228,        0
zio_data_buf_4096:       4096,        0,      545,      768, 
389198,        0
zio_buf_5120:            5120,        0,       38,     1219, 
2735515,        0
zio_data_buf_5120:       5120,        0,     1029,      886, 
1348103,        0
zio_buf_6144:            6144,        0,        0,      953, 
3842742,        0
zio_data_buf_6144:       6144,        0,      615,      824, 
1148900,        0
zio_buf_7168:            7168,        0,        0,      890, 
2712546,        0
zio_data_buf_7168:       7168,        0,      457,      574, 
1078358,        0
zio_buf_8192:            8192,        0,       19,      939, 
4781903,        0
zio_data_buf_8192:       8192,        0,    45584,     1920, 
53420158,        0
zio_buf_10240:          10240,        0,        0,     1000, 
5046243,        0
zio_data_buf_10240:     10240,        0,      658,      709, 
1780846,        0
zio_buf_12288:          12288,        0,        4,      689, 
7305859,        0
zio_data_buf_12288:     12288,        0,      584,      801, 
1579311,        0
zio_buf_14336:          14336,        0,        0,      798, 
4286282,        0
zio_data_buf_14336:     14336,        0,      409,      567, 
1460387,        0
zio_buf_16384:          16384,        0,    12492,     1614, 
71643846,        0
zio_data_buf_16384:     16384,        0,      312,      938, 
1521549,        0
zio_buf_20480:          20480,        0,        1,      735, 
3588245,        0
zio_data_buf_20480:     20480,        0,      330,      746, 
2710747,        0
zio_buf_24576:          24576,        0,        0,      888, 
2911067,        0
zio_data_buf_24576:     24576,        0,      214,      799, 
2168001,        0
zio_buf_28672:          28672,        0,        0,      854, 
1829310,        0
zio_data_buf_28672:     28672,        0,      181,      754, 
882471,        0
zio_buf_32768:          32768,        0,        0,     1126, 
3928279,        0
zio_data_buf_32768:     32768,        0,      122,      767, 
656933,        0
zio_buf_36864:          36864,        0,        1,     1093, 
1308479,        0
zio_data_buf_36864:     36864,        0,      110,      859, 
565902,        0
zio_buf_40960:          40960,        0,        0,      832, 
1427751,        0
zio_data_buf_40960:     40960,        0,       46,     1133, 
574230,        0
zio_buf_45056:          45056,        0,        0,      822, 
707243,        0
zio_data_buf_45056:     45056,        0,       50,     1026, 
531618,        0
zio_buf_49152:          49152,        0,        0,     1003, 
1560090,        0
zio_data_buf_49152:     49152,        0,       64,      810, 
536192,        0
zio_buf_53248:          53248,        0,        0,      943, 
332412,        0
zio_data_buf_53248:     53248,        0,       37,      802, 
501349,        0
zio_buf_57344:          57344,        0,        0,     1080, 
537008,        0
zio_data_buf_57344:     57344,        0,       15,      679, 
493402,        0
zio_buf_61440:          61440,        0,        0,      835, 
279750,        0
zio_data_buf_61440:     61440,        0,       37,      697, 
478630,        0
zio_buf_65536:          65536,        0,        0,      978, 
1359608,        0
zio_data_buf_65536:     65536,        0,       18,      961, 
481430,        0
zio_buf_69632:          69632,        0,        0,     1048, 
232333,        0
zio_data_buf_69632:     69632,        0,       24,      689, 
429735,        0
zio_buf_73728:          73728,        0,        0,      954, 
384361,        0
zio_data_buf_73728:     73728,        0,       19,      519, 
425705,        0
zio_buf_77824:          77824,        0,        0,      878, 
167300,        0
zio_data_buf_77824:     77824,        0,       21,      431, 
405402,        0
zio_buf_81920:          81920,        0,        0,     1141, 
644853,        0
zio_data_buf_81920:     81920,        0,       21,      477, 
408439,        0
zio_buf_86016:          86016,        0,        0,      836, 
147652,        0
zio_data_buf_86016:     86016,        0,        7,      387, 
384483,        0
zio_buf_90112:          90112,        0,        0,      813, 
228597,        0
zio_data_buf_90112:     90112,        0,       10,      393, 
385268,        0
zio_buf_94208:          94208,        0,        0,      833, 
117834,        0
zio_data_buf_94208:     94208,        0,        5,      289, 
365125,        0
zio_buf_98304:          98304,        0,        0,     1168, 
467375,        0
zio_data_buf_98304:     98304,        0,        7,      326, 
364153,        0
zio_buf_102400:        102400,        0,        0,      666, 
108347,        0
zio_data_buf_102400:   102400,        0,        7,      299, 
347344,        0
zio_buf_106496:        106496,        0,        0,      917, 
182871,        0
zio_data_buf_106496:   106496,        0,       12,      346, 
346854,        0
zio_buf_110592:        110592,        0,        0,      755, 95497,        0
zio_data_buf_110592:   110592,        0,       12,      390, 
329452,        0
zio_buf_114688:        114688,        0,        0,     1017, 
380932,        0
zio_data_buf_114688:   114688,        0,        5,      446, 
328462,        0
zio_buf_118784:        118784,        0,        0,      766, 
194014,        0
zio_data_buf_118784:   118784,        0,        9,      356, 
309025,        0
zio_buf_122880:        122880,        0,        0,      782, 
246405,        0
zio_data_buf_122880:   122880,        0,        4,      253, 
304541,        0
zio_buf_126976:        126976,        0,        0,     1116, 
721666,        0
zio_data_buf_126976:   126976,        0,        4,      210, 
288141,        0
zio_buf_131072:        131072,        0,      318,     1189, 
7240249,        0
zio_data_buf_131072:   131072,        0,     6090,      830, 
5210475,        0
sa_cache:                  80,        0,    73576,    23669, 
44891205,        0
dnode_t:                  856,        0,   178799,    31881, 
53744638,        0
dmu_buf_impl_t:           224,        0,   230088,    67395, 
161607775,        0
arc_buf_hdr_t:            216,        0,   127710,    43794, 
118346722,        0
arc_buf_t:                104,        0,    81163,     9341, 
141480007,        0
zil_lwb_cache:            192,        0,       18,     1182, 
947898,        0
zfs_znode_cache:          400,        0,    73576,    14984, 
44891205,        0
ksiginfo:                 112,        0,     1734,     1731, 
2782802,        0
itimer:                   344,        0,        1,       32, 2,        0
KNOTE:                    128,        0,      342,     1253, 
138457409,        0
socket:                   680,   131034,      366,     1602, 
52954355,        0
ipq:                       56,     1071,        0,      189, 
184312,        0
udp_inpcb:                336,   131032,       31,     1300, 
12087431,        0
udpcb:                     16,   131040,       31,     1313, 
12087431,        0
tcp_inpcb:                336,   131032,      293,     2699, 
40791646,        0
tcpcb:                    944,   131032,      210,     1230, 
40791646,        0
tcptw:                     72,    16400,       75,     2325, 
4823286,        0
syncache:                 144,    15366,        0,      390, 
5410808,        0
hostcache:                136,    15372,      350,      798, 
237994,        0
tcpreass:                  40,     2100,        0,      336, 72924,        0
sackhole:                  32,        0,        0,      303, 
229821,        0
sctp_ep:                 1304,    32769,        0,        0, 0,        0
sctp_asoc:               2288,    40000,        0,        0, 0,        0
sctp_laddr:                48,    80064,        0,      432, 14,        0
sctp_raddr:               696,    80000,        0,        0, 0,        0
sctp_chunk:               136,   400008,        0,        0, 0,        0
sctp_readq:               104,   400032,        0,        0, 0,        0
sctp_stream_msg_out:      112,   400026,        0,        0, 0,        0
sctp_asconf:               40,   400008,        0,        0, 0,        0
sctp_asconf_ack:           48,   400032,        0,        0, 0,        0
ripcb:                    336,   131032,        0,      110, 179,        0
unpcb:                    240,   131040,       96,     1488, 75086,        0
rtentry:                  200,        0,       23,       91, 23,        0
IPFW dynamic rule:        120,        0,        0,        0, 0,        0
g_stripe_zone:         131072,      100,        0,        0, 0,        0
selfd:                     56,        0,     5214,     1338, 
470978497,        0
SWAPMETA:                 288,   116519,    25358,     5842, 
13000379,        0
ip4flow:                   56,   197694,      494,     1837, 
12511201,        0
ip6flow:                   80,   197640,        0,        0, 0,        0
Mountpoints:              752,        0,       25,       15, 26,        0



More information about the Users-l mailing list