Sorun tam olarak nerede çözemedim.
log dosyası şu şekilde.
Apr 17 13:18:34 server clamd[1641]: SelfCheck: Database status OK. Apr 17 13:28:34 server clamd[1641]: SelfCheck: Database status OK. Apr 17 13:38:42 server clamd[1641]: SelfCheck: Database status OK. Apr 17 13:44:27 server kernel: INFO: task httpd:28965 blocked for more than 120 seconds. Apr 17 13:44:27 server kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 17 13:44:27 server kernel: httpd D 0043050C 2292 28965 6785 28966 28964 (NOTLB) Apr 17 13:44:27 server kernel: dc8b3f4c 00000282 50f03609 0043050c 00000015 00000008 c3dc7350 50f126c3 Apr 17 13:44:27 server kernel: 0043050c 0000f0ba c3dc745c c1412b60 df4ab840 dc8b3f3c 00000005 01594bd0 Apr 17 13:44:27 server kernel: c04733ad c38a5bc0 00000000 c7b06a6c df4ab878 df4ab840 dfecdcd4 dfecdcd0 Apr 17 13:44:27 server kernel: Call Trace: Apr 17 13:44:27 server kernel: [<c04733ad>] nameidata_to_filp+0x19/0x28 Apr 17 13:44:27 server kernel: [<c06277fd>] __mutex_lock_slowpath+0x4d/0x7c Apr 17 13:44:27 server kernel: [<c062783b>] .text.lock.mutex+0xf/0x14 Apr 17 13:44:27 server kernel: [<c0486949>] vfs_readdir+0x4b/0x8d Apr 17 13:44:27 server kernel: [<c0486845>] filldir+0x0/0xb9 Apr 17 13:57:16 server kernel: [<c0486baf>] sys_getdents+0x5f/0x9c Apr 17 14:07:25 server kernel: [<c040546b>] syscall_call+0x7/0xb Apr 17 14:10:23 server clamd[1641]: SelfCheck: Database status OK. Apr 17 14:10:30 server kernel: ======================= Apr 17 14:10:30 server kernel: INFO: task httpd:29029 blocked for more than 120 seconds. Apr 17 14:10:30 server kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 17 14:10:30 server kernel: httpd D 0043050E 2292 29029 6785 29030 29028 (NOTLB) Apr 17 14:10:30 server kernel: cc170f4c 00000282 11810323 0043050e 00000015 00000007 d7854170 1182d77f Apr 17 14:10:30 server kernel: 0043050e 0001d45c d785427c c1412b60 c7705480 cc170f3c 00000005 015dcd03 Apr 17 14:10:31 server kernel: c04733ad c0972680 00000000 c8d1422c c77054b8 c7705480 dfecdcd4 dfecdcd0 Apr 17 14:10:31 server kernel: Call Trace: Apr 17 14:10:31 server kernel: [<c04733ad>] nameidata_to_filp+0x19/0x28 Apr 17 14:10:31 server kernel: [<c06277fd>] __mutex_lock_slowpath+0x4d/0x7c Apr 17 14:10:31 server kernel: [<c062783b>] .text.lock.mutex+0xf/0x14 Apr 17 14:10:31 server kernel: [<c0486949>] vfs_readdir+0x4b/0x8d Apr 17 14:10:31 server kernel: [<c0486845>] filldir+0x0/0xb9 Apr 17 14:10:31 server kernel: [<c0486baf>] sys_getdents+0x5f/0x9c Apr 17 14:10:31 server kernel: [<c040546b>] syscall_call+0x7/0xb Apr 17 14:10:31 server kernel: ======================= Apr 17 14:10:31 server kernel: INFO: task httpd:29039 blocked for more than 120 seconds. Apr 17 14:10:31 server kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 17 14:10:31 server kernel: httpd D 0043050E 2244 29039 6785 29040 29037 (NOTLB) Apr 17 14:10:31 server kernel: d88dcf4c 00000286 292c2784 0043050e 00000015 00000007 cd096750 29db27ca Apr 17 14:10:31 server kernel: 0043050e 00af0046 cd09685c c1412b60 c433ab00 d88dcf3c 00000005 015d8471 Apr 17 14:10:37 server kernel: [<c062783b>] .text.lock.mutex+0xf/0x14 Apr 17 14:10:37 server kernel: [<c0486949>] vfs_readdir+0x4b/0x8d Apr 17 14:10:37 server kernel: [<c0486845>] filldir+0x0/0xb9 Apr 17 14:10:37 server kernel: [<c0486baf>] sys_getdents+0x5f/0x9c Apr 17 14:10:37 server kernel: [<c040546b>] syscall_call+0x7/0xb Apr 17 14:10:37 server kernel: ======================= Apr 17 14:10:37 server kernel: INFO: task httpd:29052 blocked for more than 120 seconds. Apr 17 14:10:37 server kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 17 14:10:37 server kernel: httpd D 0043050D 2292 29052 6785 29053 29050 (NOTLB) Apr 17 14:10:37 server kernel: cdd51f4c 00000282 d1fdb8b8 0043050d 00000015 00000007 c0a7f2d0 d201c135 Apr 17 14:10:37 server kernel: 0043050d 0004087d c0a7f3dc c1412b60 c462b540 cdd51f3c 00000005 0140ddc4 Apr 17 14:10:37 server kernel: c04733ad df71af00 00000000 c84fa334 c462b578 c462b540 dfecdcd4 dfecdcd0 Apr 17 14:10:37 server kernel: Call Trace: Apr 17 14:10:37 server kernel: [<c04733ad>] nameidata_to_filp+0x19/0x28 Apr 17 14:10:37 server kernel: [<c06277fd>] __mutex_lock_slowpath+0x4d/0x7c Apr 17 14:10:37 server kernel: [<c062783b>] .text.lock.mutex+0xf/0x14 Apr 17 14:10:37 server kernel: [<c0486949>] vfs_readdir+0x4b/0x8d Apr 17 14:10:37 server kernel: [<c0486845>] filldir+0x0/0xb9 Apr 17 14:10:37 server kernel: [<c0486baf>] sys_getdents+0x5f/0x9c Apr 17 14:10:37 server kernel: [<c040546b>] syscall_call+0x7/0xb Apr 17 14:10:37 server kernel: ======================= Apr 17 14:10:37 server kernel: httpd invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0 Apr 17 14:10:37 server kernel: [<c0456e93>] out_of_memory+0x72/0x1a3 Apr 17 14:10:37 server kernel: [<c04584d4>] __alloc_pages+0x24e/0x2cf Apr 17 14:10:37 server kernel: [<c04598d4>] __do_page_cache_readahead+0xc1/0x180 Apr 17 14:10:37 server kernel: [<c0456412>] filemap_nopage+0x157/0x349 Apr 17 14:10:38 server kernel: [<c0462110>] __handle_mm_fault+0x32b/0x14b8 Apr 17 14:10:38 server kernel: [<c0629b11>] do_page_fault+0x6c4/0xc29 Apr 17 14:10:38 server kernel: [<c062944d>] do_page_fault+0x0/0xc29 Apr 17 14:10:38 server kernel: [<c04055ef>] error_code+0x2b/0x30 Apr 17 14:10:38 server kernel: ======================= Apr 17 14:10:38 server kernel: Mem-info: Apr 17 14:10:38 server kernel: DMA per-cpu: Apr 17 14:10:40 server kernel: cpu 0 hot: high 0, batch 1 used:0 Apr 17 14:10:40 server kernel: cpu 0 cold: high 0, batch 1 used:0 Apr 17 14:10:40 server kernel: DMA32 per-cpu: empty Apr 17 14:10:40 server kernel: Normal per-cpu: Apr 17 14:10:40 server kernel: cpu 0 hot: high 186, batch 31 used:10 Apr 17 14:10:40 server kernel: cpu 0 cold: high 62, batch 15 used:14 Apr 17 14:10:42 server kernel: Total swap = 1048568kB Apr 17 14:10:42 server kernel: Free swap: 0kB Apr 17 14:10:42 server kernel: 133120 pages of RAM Apr 17 14:10:42 server kernel: 0 pages of HIGHMEM Apr 17 14:10:42 server kernel: 2756 reserved pages Apr 17 14:10:42 server kernel: 45581 pages shared Apr 17 14:10:42 server kernel: 5722 pages swap cached Apr 17 14:10:42 server kernel: 1 pages dirty Apr 17 14:10:42 server kernel: 0 pages writeback Apr 17 14:10:42 server kernel: 1097 pages mapped Apr 17 14:10:42 server kernel: 4654 pages slab Apr 17 14:10:42 server kernel: 5628 pages pagetables Apr 17 14:10:42 server kernel: Out of memory: Killed process 28955, UID 27, (mysqld). Apr 17 14:10:42 server kernel: httpd invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0 Apr 17 14:10:44 server kernel: [<c0456e93>] out_of_memory+0x72/0x1a3 Apr 17 14:10:44 server kernel: [<c04584d4>] __alloc_pages+0x24e/0x2cf Apr 17 14:10:44 server kernel: [<c04598d4>] __do_page_cache_readahead+0xc1/0x180 Apr 17 14:10:44 server kernel: [<c0456412>] filemap_nopage+0x157/0x349 Apr 17 14:10:44 server kernel: [<c0462110>] __handle_mm_fault+0x32b/0x14b8 Apr 17 14:10:44 server kernel: [<c05c5742>] __alloc_skb+0x49/0xfe Apr 17 14:10:44 server kernel: [<c05c3a48>] sock_def_readable+0xf/0x60 Apr 17 14:10:44 server kernel: [<c0620b9d>] unix_stream_connect+0x308/0x36f Apr 17 14:10:44 server kernel: [<c0425984>] local_bh_enable+0x5/0x7b Apr 17 14:10:44 server kernel: [<c05c2389>] lock_sock+0x8e/0x96 Apr 17 14:10:44 server kernel: [<c05c29c1>] sock_set_timeout+0x1e/0x6f Apr 17 14:10:44 server kernel: [<c0628528>] _spin_lock_bh+0x8/0x18 Apr 17 14:10:45 server kernel: [<c05c34d1>] sock_setsockopt+0x491/0x49b Apr 17 14:10:45 server kernel: [<c0629b11>] do_page_fault+0x6c4/0xc29 Apr 17 14:10:45 server kernel: [<c0446585>] audit_syscall_entry+0x193/0x1bd Apr 17 14:10:45 server kernel: [<c062944d>] do_page_fault+0x0/0xc29 Apr 17 14:10:45 server kernel: [<c04055ef>] error_code+0x2b/0x30 Apr 17 14:10:45 server kernel: ======================= Apr 17 14:10:45 server kernel: Mem-info: Apr 17 14:10:45 server kernel: DMA per-cpu: Apr 17 14:10:45 server kernel: cpu 0 hot: high 0, batch 1 used:0 Apr 17 14:10:45 server kernel: cpu 0 cold: high 0, batch 1 used:0 Apr 17 14:10:45 server kernel: DMA32 per-cpu: empty Apr 17 14:10:45 server kernel: Normal per-cpu: Apr 17 14:10:45 server kernel: cpu 0 hot: high 186, batch 31 used:7 Apr 17 14:10:46 server kernel: HighMem per-cpu: empty Apr 17 14:10:46 server kernel: Free pages: 4876kB (0kB HighMem) Apr 17 14:10:46 server kernel: Active:57315 inactive:55681 dirty:0 writeback:0 unstable:0 free:1219 slab:4574 mapped-file:1085 mapped-anon:113188 pagetables:5628 Apr 17 14:10:46 server kernel: DMA free:2104kB min:88kB low:108kB high:132kB active:3544kB inactive:3112kB present:16384kB pages_scanned:10483 all_unreclaimable? yes Apr 17 14:10:46 server kernel: lowmem_reserve[]: 0 0 504 504 Apr 17 14:10:46 server kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no Apr 17 14:10:46 server kernel: lowmem_reserve[]: 0 0 504 504 Apr 17 14:10:46 server kernel: Normal free:2772kB min:2824kB low:3528kB high:4236kB active:225716kB inactive:219612kB present:516096kB pages_scanned:894500 all_unrecla$ Apr 17 14:10:46 server kernel: lowmem_reserve[]: 0 0 0 0 Apr 17 14:10:46 server kernel: HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no Apr 17 14:10:47 server kernel: lowmem_reserve[]: 0 0 0 0 Apr 17 14:10:47 server kernel: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 2104kB Apr 17 14:10:47 server kernel: DMA32: empty Apr 17 14:10:48 server kernel: Normal: 1*4kB 8*8kB 1*16kB 6*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 2772kB Apr 17 14:10:48 server kernel: HighMem: empty Apr 17 14:10:48 server kernel: 7043 pagecache pages Apr 17 14:10:48 server kernel: Swap cache: add 6352509, delete 6346820, find 26672325/27302434, race 2+18 Apr 17 14:10:48 server kernel: Free swap = 0kB Apr 17 14:10:48 server kernel: Total swap = 1048568kB Apr 17 14:10:48 server kernel: Free swap: 0kB Apr 17 14:10:48 server kernel: 133120 pages of RAM Apr 17 14:10:48 server kernel: 0 pages of HIGHMEM Apr 17 14:10:48 server kernel: 2756 reserved pages Apr 17 14:10:48 server kernel: 45533 pages shared Apr 17 14:10:48 server kernel: 5689 pages swap cached Apr 17 14:10:48 server kernel: 0 pages dirty Apr 17 14:10:48 server kernel: 0 pages writeback Apr 17 14:10:48 server kernel: 1085 pages mapped Apr 17 14:10:48 server kernel: 4574 pages slab Apr 17 14:10:48 server kernel: 5628 pages pagetables Apr 17 14:10:48 server kernel: httpd invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0 Apr 17 14:10:49 server kernel: [<c0456e93>] out_of_memory+0x72/0x1a3 Apr 17 14:10:49 server kernel: [<c04584d4>] __alloc_pages+0x24e/0x2cf Apr 17 14:10:50 server kernel: [<c04598d4>] __do_page_cache_readahead+0xc1/0x180 Apr 17 14:10:51 server kernel: [<c0456412>] filemap_nopage+0x157/0x349 Apr 17 14:10:51 server kernel: [<c0462110>] __handle_mm_fault+0x32b/0x14b8 Apr 17 14:10:51 server kernel: [<c05bf871>] sock_aio_write+0x53/0x61 Apr 17 14:10:56 server kernel: Active:58996 inactive:53502 dirty:0 writeback:0 unstable:0 free:1218 slab:4569 mapped-file:1092 mapped-anon:113204 pagetables:5630 Apr 17 14:10:56 server kernel: DMA free:2104kB min:88kB low:108kB high:132kB active:3708kB inactive:3216kB present:16384kB pages_scanned:11051 all_unreclaimable? yes Apr 17 14:10:56 server kernel: lowmem_reserve[]: 0 0 504 504 Apr 17 14:10:56 server kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no Apr 17 14:10:56 server kernel: lowmem_reserve[]: 0 0 504 504 Apr 17 14:10:56 server kernel: Normal free:2768kB min:2824kB low:3528kB high:4236kB active:232276kB inactive:210792kB present:516096kB pages_scanned:881594 all_unrecla$ Apr 17 14:10:56 server kernel: lowmem_reserve[]: 0 0 0 0 Apr 17 14:10:56 server kernel: HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no Apr 17 14:10:56 server kernel: lowmem_reserve[]: 0 0 0 0 Apr 17 14:10:56 server kernel: DMA: 0*4kB 1*8kB 1*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 2104kB Apr 17 14:10:56 server kernel: DMA32: empty Apr 17 14:10:56 server kernel: Normal: 12*4kB 2*8kB 1*16kB 6*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 2768kB Apr 17 14:10:56 server kernel: HighMem: empty Apr 17 14:10:57 server kernel: 7006 pagecache pages Apr 17 14:10:59 server kernel: Swap cache: add 6354494, delete 6348789, find 26672637/27302996, race 2+23 Apr 17 14:10:59 server kernel: Free swap = 0kB Apr 17 14:10:59 server kernel: Total swap = 1048568kB Apr 17 14:10:59 server kernel: Free swap: 0kB Apr 17 14:10:59 server kernel: 133120 pages of RAM Apr 17 14:10:59 server kernel: 0 pages of HIGHMEM Apr 17 14:10:59 server kernel: 2756 reserved pages Apr 17 14:10:59 server kernel: 46007 pages shared Apr 17 14:10:59 server kernel: 5705 pages swap cached Apr 17 14:10:59 server kernel: 0 pages dirty Apr 17 14:10:59 server kernel: 0 pages writeback Apr 17 14:10:59 server kernel: 1092 pages mapped Apr 17 14:10:59 server kernel: 4569 pages slab Apr 17 14:10:59 server kernel: 5630 pages pagetables Apr 17 14:11:01 server kernel: Out of memory: Killed process 29013, UID 27, (mysqld). Apr 17 14:11:01 server kernel: httpd invoked oom-killer: gfp_mask=0x200d2, order=0, oomkilladj=0 Apr 17 14:11:01 server kernel: [<c0456e93>] out_of_memory+0x72/0x1a3 Apr 17 19:48:41 server syslogd 1.4.1: restart. Apr 17 19:48:41 server kernel: klogd 1.4.1, log source = /proc/kmsg started. Apr 17 19:48:41 server kernel: Linux version 2.6.18-371.4.1.el5xen (mockbuild@builder17.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-54)) #1 SMP Thu Jan 30 0$ Apr 17 19:48:41 server kernel: BIOS-provided physical RAM map: Apr 17 19:48:41 server kernel: Xen: 0000000000000000 - 0000000020800000 (usable) Apr 17 19:48:41 server kernel: 0MB HIGHMEM available. Apr 17 19:48:41 server kernel: 520MB LOWMEM available. Apr 17 19:48:41 server kernel: NX (Execute Disable) protection: active
