2006年1月11日

Xen panic

MLog上でMovableTypeのrebuild allを実行すると、cgiの時間がかかりすぎてInternal Server Errorになることは頻繁に発生していたけど、とうとうPanicで落ちた(^^;

ちなみに本BlogもMLogXen 3.0.0上のDebian/Sargeで動いている。

xm console で仮想マシンを除くと、Panic Messageを見ることが出来たので、貼り付けておこう。

hobby:/home/shibata# xm list
Name                              ID Mem(MiB) VCPUs State  Time(s)
Domain-0                           0     1058     2 r----- 137148.1
hixen                              5      768     1 r----- 93908.4
hobby:/home/shibata# xm console 5
Linux version 2.6.12.6-xenU (xenod@freefall.cl.cam.ac.uk) (gcc version 3.3.3 20040412 (Red Hat Linux 3.3.3-7)) #1 SMP Sun Dec 4 22:29:04 GMT 2005
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 0000000030000000 (usable)
0MB HIGHMEM available.
776MB LOWMEM available.
IRQ lockup detection disabled
Built 1 zonelists
Kernel command line:  ip=192.168.0.113:1.2.3.4:192.168.0.250:255.255.255.0:hixen:eth0:off root=/dev/hdc2 rw 2
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 65536 bytes)
Xen reported: 2394.150 MHz processor.
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
vmalloc area: f1000000-fb7fe000, maxmem 34000000
Memory: 774528k/794624k available (1733k kernel code, 11532k reserved, 538k data, 136k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Mount-cache hash table entries: 512
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... disabled
Brought up 1 CPUs
NET: Registered protocol family 16
Brought up 1 CPUs
xen_mem: Initialising balloon driver.
Grant table initialized
Initializing Cryptographic API
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered
RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize
Xen virtual console successfully installed as tty1
Event-channel device installed.
netfront: Initialising virtual ethernet driver.
NET: Registered protocol family 2
Registering block device major 22
IP: routing cache hash table of 8192 buckets, 64Kbytes
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
NET: Registered protocol family 1
NET: Registered protocol family 17
IP-Config: Complete:
      device=eth0, addr=192.168.0.113, mask=255.255.255.0, gw=192.168.0.250,
     host=hixen, domain=, nis-domain=(none),
     bootserver=1.2.3.4, rootserver=1.2.3.4, rootpath=
kjournald starting.  Commit interval 5 seconds
EXT3 FS on hdc2, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
VFS: Mounted root (ext3 filesystem).
Freeing unused kernel memory: 136k freed
INIT: version 2.86 booting
Activating swap.
Adding 1004020k swap on /dev/hdc1.  Priority:-1 extents:1
Checking root file system...
fsck 1.37 (21-Mar-2005)
/dev/hdc2: clean, 35420/3662848 files, 1123406/7325640 blocks
EXT3 FS on hdc2, internal journal
System time was Fri Dec 23 18:21:43 UTC 2005.
Setting the System Clock using the Hardware Clock as reference...
System Clock set. System local time is now Fri Dec 23 18:21:48 UTC 2005.
Cleaning up ifupdown...done.
Checking all file systems...
fsck 1.37 (21-Mar-2005)
Setting kernel variables ...
... done.
Mounting local filesystems...
Cleaning /tmp /var/run /var/lock.
Running 0dns-down to make sure resolv.conf is ok...done.
Setting up networking...done.
Setting up IP spoofing protection: rp_filter.
Configuring network interfaces...SIOCADDRT: File exists
Failed to bring up eth0.
done.
Starting portmap daemon: portmap.

Setting the System Clock using the Hardware Clock as reference...
System Clock set. Local time: Fri Dec 23 18:21:53 UTC 2005

Initializing random number generator...done.
Recovering nvi editor sessions... done.
Setting up X server socket directory /tmp/.X11-unix...done.
Setting up ICE socket directory /tmp/.ICE-unix...done.
INIT: Entering runlevel: 2
Starting system log daemon: syslogd.
Starting kernel log daemon: klogd.
Starting portmap daemon: portmap.
Starting internet superserver: inetd.
Starting MySQL database server: mysqld.
Checking for crashed MySQL tables in the background.
Exporting directories for NFS kernel daemon...done.
Starting NFS kernel daemon: nfsdStarting mail transport agent: Postfix.
Starting OpenBSD Secure Shell server: sshd.
Starting NFS common utilities: statd.
Starting ProFTPD ftp daemon: proftpd.
Starting deferred execution scheduler: atd.
Starting periodic command scheduler: cron.
Starting web server: Apache2.
INIT: no more processes left in this runlevel
nfs warning: mount version older than kernel
nfs warning: mount version older than kernel
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
nfs warning: mount version older than kernel
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
lockd_up: makesock failed, error=-5
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
printk: 3 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 712 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 848 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 272 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 166 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 705 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 615 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 517 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 341 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 643 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 284 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 345 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 338 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 860 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 189 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 803 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 172 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 291 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 265 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 178 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 471 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 627 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 626 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 59 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 266 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 10 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 48 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 38 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 61 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 27 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 44609 messages suppressed.
Received packet needs 8 bytes more headroom.
printk: 37594 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 490 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 538 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 659 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 106 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
lockd_down: no lockd running.
nfs warning: mount version older than kernel
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
nfs warning: mount version older than kernel
lockd_up: no pid, 2 users??
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
nfs warning: mount version older than kernel
lockd_up: no pid, 2 users??
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
nfs warning: mount version older than kernel
lockd_up: no pid, 2 users??
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
portmap: server localhost not responding, timed out
RPC: failed to contact portmap (errno -5).
Unable to handle kernel paging request at virtual address d2644000
 printing eip:
c0144dac
*pde = ma 6207b067 pa 00047067
*pte = ma 66530000 pa 11104000
Oops: 0002 [#1]
SMP
Modules linked in:
CPU:    0
EIP:    0061:[]    Not tainted VLI
EFLAGS: 00010296   (2.6.12.6-xenU)
EIP is at buffered_rmqueue+0x16c/0x260
eax: 00000000   ebx: 00000001   ecx: 00000400   edx: d2644000
esi: c124c880   edi: d2644000   ebp: 00000000   esp: c5051b88
ds: 007b   es: 007b   ss: 0069
Process mt.cgi (pid: 25743, threadinfo=c5050000 task=c9f88a20)
Stack: c124c880 00000003 00000000 00000000 000080d2 c5050000 c124c880 c0305400
       00000000 00000000 000080d2 c0145357 c0305400 00000000 00000012 00000000
       00000000 00000000 00000000 00000000 c9f88a20 00000010 c0306020 00000000
Call Trace:
 [] __alloc_pages+0x407/0x430
 [] do_anonymous_page+0xd3/0x230
 [] do_no_page+0x64/0x410
 [] do_no_page+0x64/0x410
 [] pte_alloc_map+0x49/0x1f0
 [] handle_mm_fault+0xf6/0x1e0
 [] do_page_fault+0x1dc/0x68f
 [] try_to_wake_up+0x2a2/0x2f0
 [] activate_task+0x90/0xb0
 [] autoremove_wake_function+0x2f/0x60
 [] __do_page_cache_readahead+0xb1/0x1a0
 [] do_page_fault+0x0/0x68f
 [] error_code+0x2b/0x30
 [] file_read_actor+0x20/0xf0
 [] do_generic_mapping_read+0x409/0x620
 [] __generic_file_aio_read+0x202/0x240
 [] file_read_actor+0x0/0xf0
 [] link_path_walk+0x5c/0x110
 [] generic_file_aio_read+0x5b/0xb0
 [] do_sync_read+0xb7/0xf0
 [] vma_link+0x60/0xf0
 [] autoremove_wake_function+0x0/0x60
 [] old_mmap+0xd7/0x110
 [] vfs_read+0xae/0x130
 [] sys_read+0x51/0x80
 [] syscall_call+0x7/0xb
Code: 5a 85 db 7e 4a 8b 74 24 18 31 ed 8d 74 26 00 89 34 24 b8 03 00 00 00 89 44 24 04 e8 4f 1c fd ff 89 c2 89 c7 b9 00 04 00 00 89 e8  ab 89 14 24 b8 03 00 00 00 83 c6 20 89 44 24 04 e8 8e 1c fd
 <6>note: mt.cgi[25743] exited with preempt_count 1
printk: 33 messages suppressed.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
Received packet needs 8 bytes more headroom.
printk: 86 messages suppressed.
Received packet needs 8 bytes more headroom.
Unable to handle kernel paging request at virtual address 98393bc0
 printing eip:
c01e3bab
*pde = ma 00000000 pa 55555000
Oops: 0002 [#2]
SMP
Modules linked in:
CPU:    0
EIP:    0061:[]    Not tainted VLI
EFLAGS: 00010282   (2.6.12.6-xenU)
EIP is at journal_put_journal_head+0xb/0x110
eax: 00000000   ebx: 98393bc0   ecx: daac0000   edx: daac0000
esi: daac0000   edi: c066ba00   ebp: c066bac0   esp: d2463e08
ds: 007b   es: 007b   ss: 0069
Process mysqld (pid: 6945, threadinfo=d2462000 task=d866ea20)
Stack: e87179fc 00000004 cebfa598 cebfa62c 00000024 cfeecb0c c01dcf29 daac0000
       00000000 c016738b cfeecb3c d2463e40 c066ba14 00000001 cfeecb0c cfeecb0c
       00001000 cfeecb0c c01dd1df c066ba00 cfeecb0c d55b1764 c11c2880 d55b1764
Call Trace:
 [] journal_unmap_buffer+0xa9/0x2e0
 [] try_to_free_buffers+0x6b/0xe0
 [] journal_invalidatepage+0x7f/0x170
 [] ext3_invalidatepage+0x3b/0x40
 [] do_invalidatepage+0x27/0x30
 [] truncate_complete_page+0x76/0xb0
 [] truncate_inode_pages+0xdc/0x2f0
 [] ext3_mark_iloc_dirty+0x29/0x40
 [] generic_delete_inode+0xea/0x130
 [] _atomic_dec_and_lock+0x31/0x50
 [] iput+0x63/0xb0
 [] sys_unlink+0xd6/0x130
 [] sys_close+0x6d/0x90
 [] syscall_call+0x7/0xb
Code: 24 08 89 44 24 04 e8 35 b2 f3 ff e8 20 64 f2 ff c7 04 24 8d 84 2d c0 e8 c4 a8 f3 ff 8d 74 26 00 53 83 ec 14 8b 54 24 1c 8b 1a 90 <0f> ba 2b 14 19 c0 85 c0 74 24 8d 74 26 00 8d bc 27 00 00 00 00

誰か、解析して(^^;

投稿者 his : 2006年1月11日 02:55
このエントリーのトラックバックURL: http://hoop.euqset.org/blog/mt-tb2006.cgi/9250
コメント
コメントする









名前、アドレスを登録しますか?





画像の中に見える文字を入力してください。