[208156.752017] courier-pop3d[7847]: segfault at 0000000000000000 rip 0000000000000000 rsp 00007fffffa02070 error 14
[208156.752118] ----------- [cut here ] --------- [please bite here ] ---------
[208156.844868] Kernel BUG at "mm/rmap.c":493
[208156.898664] invalid operand: 0000 [1] SMP 
[208156.953644] CPU 1 
[208156.981193] Modules linked in:
[208157.022468] Pid: 7847, comm: courier-pop3d Not tainted 2.6.13.2
[208157.101506] RIP: 0010:[<ffffffff8016b5eb>] <ffffffff8016b5eb>{page_remove_rmap+43}
[208157.199947] RSP: 0018:ffff81005a6d9c60  EFLAGS: 00010286
[208157.273358] RAX: 00000000ffffffff RBX: ffff810043e51030 RCX: ffff81000000d000
[208157.368422] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff81000100e000
[208157.463441] RBP: 0000000000406000 R08: 0000000000000000 R09: 0000000000400000
[208157.558464] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000400bf9
[208157.653490] R13: ffff810040e133c0 R14: ffff81000100e000 R15: 0000000000000000
[208157.748518] FS:  00002aaaaba5e310(0000) GS:ffffffff803af880(0000) knlGS:0000000000000000
[208157.856120] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[208157.932803] CR2: 0000000000000000 CR3: 000000005ca9a000 CR4: 00000000000006e0
[208158.027870] Process courier-pop3d (pid: 7847, threadinfo ffff81005a6d8000, task ffff81007820ef70)
[208158.145768] Stack: ffffffff80163034 000000000040a000 ffff81005bb3a010 000000000040a000 
[208158.249870]        000000000040a000 0000000000409fff ffff81005a4a6000 000000000040a000 
[208158.356431]        ffffffff801632eb 0000000000000000 
[208158.424077] Call Trace:<ffffffff80163034>{zap_pte_range+436} <ffffffff801632eb>{unmap_page_range+507}
[208158.546587]        <ffffffff8016346f>{unmap_vmas+319} <ffffffff80169102>{exit_mmap+162}
[208158.653151]        <ffffffff80130161>{mmput+49} <ffffffff8013553a>{do_exit+442}
[208158.750558]        <ffffffff801358c0>{sys_exit_group+0} <ffffffff8013ee5b>{get_signal_to_deliver+939}
[208158.873130]        <ffffffff8010d500>{do_signal+112} <ffffffff801e8dc2>{__up_write+34}
[208158.978548]        <ffffffff8010de04>{retint_signal+61} 
[208159.051929] 
[208159.051930] Code: 0f 0b a3 c2 1f 2e 80 ff ff ff ff c2 ed 01 66 66 66 90 66 66 
[208159.168882] RIP <ffffffff8016b5eb>{page_remove_rmap+43} RSP <ffff81005a6d9c60>
[208159.265551]  <1>Fixing recursive fault but reboot is needed!
[212263.397884] ----------- [cut here ] --------- [please bite here ] ---------
[212263.490641] Kernel BUG at "mm/rmap.c":493
[212263.544472] invalid operand: 0000 [2] SMP 
[212263.599447] CPU 1 
[212263.626995] Modules linked in:
[212263.668269] Pid: 28130, comm: apache Not tainted 2.6.13.2
[212263.740439] RIP: 0010:[<ffffffff8016b5eb>] <ffffffff8016b5eb>{page_remove_rmap+43}
[212263.838875] RSP: 0018:ffff81005aba7da0  EFLAGS: 00010286
[212263.912281] RAX: 00000000ffffffff RBX: ffff81007784b610 RCX: ffff810040000000
[212264.007341] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff8100400bc758
[212264.102358] RBP: 00000000008c2000 R08: 0000000000000000 R09: 0000000000800000
[212264.197378] R10: 00002aaaaba5aea8 R11: 0000000000000246 R12: 80000000432fd065
[212264.292391] R13: ffff810040e133c0 R14: ffff8100400bc758 R15: 0000000000000000
[212264.387418] FS:  00002aaaaba5e310(0000) GS:ffffffff803af880(0000) knlGS:0000000000000000
[212264.495011] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[212264.571690] CR2: 000000000062f008 CR3: 0000000000101000 CR4: 00000000000006e0
[212264.666752] Process apache (pid: 28130, threadinfo ffff81005aba6000, task ffff81003db91790)
[212264.777794] Stack: ffffffff80163034 0000000000900000 ffff810079777020 0000000000900000 
[212264.881891]        0000000000900000 00000000008fffff ffff810075a78000 0000000000900000 
[212264.988446]        ffffffff801632eb ffff810040078f28 
[212265.056089] Call Trace:<ffffffff80163034>{zap_pte_range+436} <ffffffff801632eb>{unmap_page_range+507}
[212265.178600]        <ffffffff8016346f>{unmap_vmas+319} <ffffffff80169102>{exit_mmap+162}
[212265.285151]        <ffffffff80130161>{mmput+49} <ffffffff8013553a>{do_exit+442}
[212265.382565]        <ffffffff801358c0>{sys_exit_group+0} <ffffffff8010d79a>{system_call+126}
[212265.493698]        
[212265.524773] 
[212265.524774] Code: 0f 0b a3 c2 1f 2e 80 ff ff ff ff c2 ed 01 66 66 66 90 66 66 
[212265.641728] RIP <ffffffff8016b5eb>{page_remove_rmap+43} RSP <ffff81005aba7da0>
[212265.738398]  <1>Fixing recursive fault but reboot is needed!
[233148.958581] Bad page state at prep_new_page (in process 'updatedb', page ffff81000100e000)
[233149.068522] flags:0x0000000000000014 mapping:0000000000000000 mapcount:-1 count:0
[233149.168183] Backtrace:
[233149.200248] 
[233149.200249] Call Trace:<ffffffff801577e4>{bad_page+116} <ffffffff80157d02>{prep_new_page+82}
[233149.330838]        <ffffffff80158285>{buffered_rmqueue+309} <ffffffff801584e5>{__alloc_pages+261}
[233149.448929]        <ffffffff8015b67e>{kmem_getpages+46} <ffffffff8015c5c1>{cache_grow+193}
[233149.559009]        <ffffffff8015c818>{cache_alloc_refill+424} <ffffffff8015caf6>{kmem_cache_alloc+54}
[233149.681596]        <ffffffff801bfc05>{ext3_alloc_inode+21} <ffffffff801915d2>{alloc_inode+18}
[233149.795204]        <ffffffff801922ca>{get_new_inode_fast+42} <ffffffff801bc9a5>{ext3_lookup+101}
[233149.912049]        <ffffffff801857b4>{real_lookup+132} <ffffffff80185b6d>{do_lookup+109}
[233150.019765]        <ffffffff801865d0>{__link_path_walk+2576} <ffffffff80186b5c>{link_path_walk+188}
[233150.140038]        <ffffffff801870b2>{path_lookup+450} <ffffffff8018727e>{__user_walk+62}
[233150.248899]        <ffffffff80181076>{vfs_lstat+38} <ffffffff801814bf>{sys_newlstat+31}
[233150.355451]        <ffffffff8010d79a>{system_call+126} 
[233150.427799] Trying to fix it up, but a reboot is needed
[489587.651205] Hangcheck: hangcheck value past margin!
[498506.831792] courier-pop3d[31456]: segfault at 0000000000000000 rip 0000000000000000 rsp 0000000000000000 error 14
[498506.968154] swap_free: Bad swap offset entry 2aaaaaac05
[498507.038028] swap_free: Bad swap file entry 400000000300118f
[498507.112473] ----------- [cut here ] --------- [please bite here ] ---------
[498507.205198] Kernel BUG at "mm/rmap.c":493
[498507.259042] invalid operand: 0000 [3] SMP 
[498507.314018] CPU 0 
[498507.341561] Modules linked in:
[498507.382833] Pid: 31456, comm: courier-pop3d Tainted: G    B 2.6.13.2
[498507.467588] RIP: 0010:[<ffffffff8016b5eb>] <ffffffff8016b5eb>{page_remove_rmap+43}
[498507.566025] RSP: 0018:ffff8100076c7c60  EFLAGS: 00010286
[498507.641614] RAX: 00000000ffffffff RBX: ffff810009019018 RCX: ffff81000000d000
[498507.736675] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff81000100e000
[498507.831691] RBP: 0000000000403000 R08: 0000000000000000 R09: 0000000000000004
[498507.926710] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000400bf9
[498508.021738] R13: ffff810001e082c0 R14: ffff81000100e000 R15: 0000000000000000
[498508.116757] FS:  00002aaaab00e6d0(0000) GS:ffffffff803af800(0000) knlGS:0000000000000000
[498508.224354] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[498508.301027] CR2: 0000000000000000 CR3: 0000000007e01000 CR4: 00000000000006e0
[498508.396092] Process courier-pop3d (pid: 31456, threadinfo ffff8100076c6000, task ffff81003db902f0)
[498508.515124] Stack: ffffffff80163034 000000000040a000 ffff8100385b2010 000000000040a000 
[498508.619216]        000000000040a000 0000000000409fff ffff81003895a000 000000000040a000 
[498508.725778]        ffffffff801632eb 0000000000000000 
[498508.793420] Call Trace:<ffffffff80163034>{zap_pte_range+436} <ffffffff801632eb>{unmap_page_range+507}
[498508.915926]        <ffffffff8016346f>{unmap_vmas+319} <ffffffff80169102>{exit_mmap+162}
[498509.022480]        <ffffffff80130161>{mmput+49} <ffffffff8013553a>{do_exit+442}
[498509.119892]        <ffffffff801358c0>{sys_exit_group+0} <ffffffff8013ee5b>{get_signal_to_deliver+939}
[498509.242462]        <ffffffff8010d500>{do_signal+112} <ffffffff801e8dc2>{__up_write+34}
[498509.347873]        <ffffffff8010de04>{retint_signal+61} 
[498509.421260] 
[498509.421261] Code: 0f 0b a3 c2 1f 2e 80 ff ff ff ff c2 ed 01 66 66 66 90 66 66 
[498509.538216] RIP <ffffffff8016b5eb>{page_remove_rmap+43} RSP <ffff8100076c7c60>
[498509.634867]  <1>Fixing recursive fault but reboot is needed!
[557491.991696] fo_view[30651]: segfault at 0000000000000000 rip 0000000000000000 rsp 00007fffff802100 error 14
[603175.325890] Bad page state at free_hot_cold_page (in process 'kswapd0', page ffff81000100e000)
[603175.440421] flags:0x0000000000000014 mapping:0000000000000000 mapcount:-1 count:0
[603175.539997] Backtrace:
[603175.572066] 
[603175.572067] Call Trace:<ffffffff801577e4>{bad_page+116} <ffffffff801580b7>{free_hot_cold_page+119}
[603175.709482]        <ffffffff8015b88c>{kmem_freepages+300} <ffffffff8015b9a4>{slab_destroy+148}
[603175.824036]        <ffffffff8015c9a9>{free_block+313} <ffffffff8015ca77>{cache_flusharray+135}
[603175.938586]        <ffffffff8015d087>{kmem_cache_free+55} <ffffffff80191754>{destroy_inode+52}
[603176.053135]        <ffffffff80191ae7>{dispose_list+215} <ffffffff80191eaa>{prune_icache+410}
[603176.165403]        <ffffffff80191f17>{shrink_icache_memory+23} <ffffffff8015f0a5>{shrink_slab+229}
[603176.284532]        <ffffffff801605fd>{balance_pgdat+589} <ffffffff80160867>{kswapd+295}
[603176.391079]        <ffffffff80148270>{autoremove_wake_function+0} <ffffffff80148270>{autoremove_wake_function+0}
[603176.526225]        <ffffffff8012c8e0>{schedule_tail+64} <ffffffff8010e34a>{child_rip+8}
[603176.632762]        <ffffffff80160740>{kswapd+0} <ffffffff8010e342>{child_rip+0}
[603176.730168]        
[603176.761239] Trying to fix it up, but a reboot is needed