[Simon Pelly]

Hi Folks,

Listed below is the console output from a Kernel Panic seen on an embedded linux device - GNU Linux 2.6.22.1

Can anybody provide any clues as to what this means?

Simon...

vma->vm_file->f_op->mmap = generic_file_mmap+0x0/0x40
------------[ cut here ]------------
kernel BUG at mm/rmap.c:628!
invalid opcode: 0000 [#2]
PREEMPT SMP
Modules linked in: qla2xxxt qla2400 qla2xxx recordcrc iscsi_trgt mod_dw nswitch vtbuffers
CPU: 2
EIP: 0060:[<c0155e63>] Not tainted VLI
EFLAGS: 00210282 (2.6.22.1 #1)
EIP is at page_remove_rmap+0x103/0x110
eax: 0000003b ebx: c1160000 ecx: ea046000 edx: 00000002
esi: ea633d84 edi: b8000000 ebp: ffffffff esp: ea047e64
ds: 007b es: 007b fs: 00d8 gs: 0000 ss: 0068
Process httpd (pid: 1349, ti=ea046000 task=ea02f560 task.ti=ea046000)
Stack: c04e6e14 dfe4ce7c ea637000 c1160000 c014eede 0800009c a6000000 b8001fff
00000000 ea633d84 ea047ef8 0800009c a6000000 00000000 00000001 b8002000
eaedb010 c6fafa00 c6e6d0c0 00000000 ffffffff c1749180 dffbae00 00001ff9
Call Trace:
[<c014eede>] unmap_vmas+0x37e/0x650
[<c0152b7d>] exit_mmap+0x7d/0x120
[<c011b032>] mmput+0x32/0x80
[<c0120155>] do_exit+0x105/0x7c0
[<c04698a4>] _spin_unlock_irqrestore+0x14/0x30
[<c01149f0>] do_page_fault+0x7a0/0x7f0
[<c011ffd7>] sys_waitpid+0x27/0x30
[<c0114250>] do_page_fault+0x0/0x7f0
[<c0469af2>] error_code+0x72/0x80
=======================
Code: c0 74 0d 8b 50 08 b8 1c 7a 4e c0 e8 88 8a fe ff 8b 46 4c 85 c0 74 14 8b 40 10 85 c0 74 0d 8b 50 2c b8 3c 7a 4e c0 e8 6d 8a fe ff <0f> 0b eb fe 8b 53 0c eb 95 8d 74 26 00 55 57 56 53 83 ec 10 89
EIP: [<c0155e63>] page_remove_rmap+0x103/0x110 SS:ESP 0068:ea047e64
Fixing recursive fault but reboot is needed!
BUG: scheduling while atomic: httpd/0x00000002/1349
[<c0467070>] __sched_text_start+0x530/0x9d0
[<c011d9af>] vprintk+0x29f/0x380
[<c0469097>] __down_failed_trylock+0x7/0x10
[<c011d9af>] vprintk+0x29f/0x380
[<c01207bd>] do_exit+0x76d/0x7c0
[<c0116002>] __wake_up+0x32/0x50
[<c0104733>] die+0x233/0x240
[<c0104af0>] do_invalid_op+0x0/0x90
[<c0104b71>] do_invalid_op+0x81/0x90
[<c0155e63>] page_remove_rmap+0x103/0x110
[<c0115adf>] __wake_up_locked+0x1f/0x30
[<c04698a4>] _spin_unlock_irqrestore+0x14/0x30
[<c046658b>] __down_trylock+0x3b/0x50
[<c0469097>] __down_failed_trylock+0x7/0x10
[<c011d9af>] vprintk+0x29f/0x380
[<c014701a>] free_hot_cold_page+0x12a/0x1a0
[<c01470ad>] __pagevec_free+0x1d/0x30
[<c01498da>] release_pages+0x12a/0x150
[<c0469af2>] error_code+0x72/0x80
[<c0155e63>] page_remove_rmap+0x103/0x110
[<c014eede>] unmap_vmas+0x37e/0x650
[<c0152b7d>] exit_mmap+0x7d/0x120
[<c011b032>] mmput+0x32/0x80
[<c0120155>] do_exit+0x105/0x7c0
[<c04698a4>] _spin_unlock_irqrestore+0x14/0x30
[<c01149f0>] do_page_fault+0x7a0/0x7f0
[<c011ffd7>] sys_waitpid+0x27/0x30
[<c0114250>] do_page_fault+0x0/0x7f0
[<c0469af2>] error_code+0x72/0x80
=======================
[<c0469af2>] error_code+0x72/0x80
[<c0194ea2>] do_task_stat+0x632/0x9d0
[<c016fbab>] dput+0x8b/0x120
[<c0167d26>] __link_path_walk+0xc36/0xcd0
[<c016fbab>] dput+0x8b/0x120
[<c0167d26>] __link_path_walk+0xc36/0xcd0
[<c0173d83>] mntput_no_expire+0x13/0x60
[<c0167e25>] link_path_walk+0x65/0xd0
[<c046980f>] _spin_unlock+0xf/0x30
[<c015d583>] get_unused_fd+0xa3/0xc0
[<c0168068>] do_path_lookup+0x78/0x1c0
[<c015d722>] __dentry_open+0x182/0x1f0
[<c014757f>] __alloc_pages+0x4f/0x330
[<c0192b47>] proc_info_read+0x77/0xb0
[<c015f499>] vfs_read+0x89/0x120
[<c0192ad0>] proc_info_read+0x0/0xb0
[<c015f941>] sys_read+0x41/0x70
[<c0102a66>] sysenter_past_esp+0x5f/0x89
=======================
BUG: scheduling while atomic: ps/0x10000002/1627
[<c0467070>] __sched_text_start+0x530/0x9d0
[<c0121ed3>] irq_exit+0x43/0x50
[<c010fb3a>] smp_apic_timer_interrupt+0x5a/0x90
[<c015d160>] quicklist_trim+0xf0/0x150
[<c0118911>] __cond_resched+0x21/0x40
[<c0467c1a>] cond_resched+0x2a/0x40
[<c014f17b>] unmap_vmas+0x61b/0x650
[<c0152b7d>] exit_mmap+0x7d/0x120
[<c011b032>] mmput+0x32/0x80
[<c0120155>] do_exit+0x105/0x7c0
[<c0116002>] __wake_up+0x32/0x50
[<c0104733>] die+0x233/0x240
[<c0114604>] do_page_fault+0x3b4/0x7f0
[<c0190fb8>] task_dumpable+0x28/0x50
[<c0114250>] do_page_fault+0x0/0x7f0
[<c0469af2>] error_code+0x72/0x80
[<c0194ea2>] do_task_stat+0x632/0x9d0
[<c016fbab>] dput+0x8b/0x120
[<c0167d26>] __link_path_walk+0xc36/0xcd0
[<c016fbab>] dput+0x8b/0x120
[<c0167d26>] __link_path_walk+0xc36/0xcd0
[<c0173d83>] mntput_no_expire+0x13/0x60
[<c0167e25>] link_path_walk+0x65/0xd0
[<c046980f>] _spin_unlock+0xf/0x30
[<c015d583>] get_unused_fd+0xa3/0xc0
[<c0168068>] do_path_lookup+0x78/0x1c0
[<c015d722>] __dentry_open+0x182/0x1f0
[<c014757f>] __alloc_pages+0x4f/0x330
[<c0192b47>] proc_info_read+0x77/0xb0
[<c015f499>] vfs_read+0x89/0x120
[<c0192ad0>] proc_info_read+0x0/0xb0
[<c015f941>] sys_read+0x41/0x70
[<c0102a66>] sysenter_past_esp+0x5f/0x89
=======================
BUG: scheduling while atomic: ps/0x10000002/1627
[<c0467070>] __sched_text_start+0x530/0x9d0
[<c0164ac2>] pipe_release+0x82/0xa0
[<c016fbab>] dput+0x8b/0x120
[<c015fdd4>] __fput+0x124/0x190
[<c0118911>] __cond_resched+0x21/0x40
[<c0467c1a>] cond_resched+0x2a/0x40
[<c011ef0b>] put_files_struct+0x9b/0xc0
[<c0120185>] do_exit+0x135/0x7c0
[<c0116002>] __wake_up+0x32/0x50
[<c0104733>] die+0x233/0x240
[<c0114604>] do_page_fault+0x3b4/0x7f0
[<c0190fb8>] task_dumpable+0x28/0x50
[<c0114250>] do_page_fault+0x0/0x7f0
[<c0469af2>] error_code+0x72/0x80
[<c0194ea2>] do_task_stat+0x632/0x9d0
[<c016fbab>] dput+0x8b/0x120
[<c0167d26>] __link_path_walk+0xc36/0xcd0
[<c016fbab>] dput+0x8b/0x120
[<c0167d26>] __link_path_walk+0xc36/0xcd0
[<c0173d83>] mntput_no_expire+0x13/0x60
[<c0167e25>] link_path_walk+0x65/0xd0
[<c046980f>] _spin_unlock+0xf/0x30
[<c015d583>] get_unused_fd+0xa3/0xc0
[<c0168068>] do_path_lookup+0x78/0x1c0
[<c015d722>] __dentry_open+0x182/0x1f0
[<c014757f>] __alloc_pages+0x4f/0x330
[<c0192b47>] proc_info_read+0x77/0xb0
[<c015f499>] vfs_read+0x89/0x120
[<c0192ad0>] proc_info_read+0x0/0xb0
[<c015f941>] sys_read+0x41/0x70
[<c0102a66>] sysenter_past_esp+0x5f/0x89
=======================
BUG: unable to handle kernel paging request at virtual address 080000a2
printing eip:
c015b4d1
*pdpt = 000000001ff9f001
*pde = 000000002a04e067
*pte = 0000000000000000
Oops: 0002 [#3]
PREEMPT SMP
Modules linked in: qla2xxxt qla2400 qla2xxx recordcrc iscsi_trgt mod_dw nswitch vtbuffers
CPU: 2
EIP: 0060:[<c015b4d1>] Not tainted VLI
EFLAGS: 00010082 (2.6.22.1 #1)
EIP is at free_block+0xa1/0x140
eax: a7000000 ebx: 00000001 ecx: ea630d24 edx: 0800009e
esi: ea630000 edi: dfee7940 ebp: dfed69e8 esp: dfeabf28
ds: 007b es: 007b fs: 00d8 gs: 0000 ss: 0068
Process events/2 (pid: 17, ti=dfeaa000 task=dfe8e560 task.ti=dfeaa000)
Stack: 00000005 00000000 00000002 c6f58ec0 00000001 dfed69e4 dfed69c0 00000002
00000000 c015b5cf 00000000 00000000 c6f58ec0 dfee7964 dfee7940 c6f58ec0
c6e6ea40 c015c5c0 c015c648 00000000 00000000 c6e6ea44 dfed92c0 c6e6ea40
Call Trace:
[<c015b5cf>] drain_array+0x5f/0xc0
[<c015c5c0>] cache_reap+0x0/0x120
[<c015c648>] cache_reap+0x88/0x120
[<c012b989>] run_workqueue+0x79/0x110
[<c04693b8>] _spin_lock_irqsave+0x18/0x70
[<c012c332>] worker_thread+0xa2/0x100
[<c012efb0>] autoremove_wake_function+0x0/0x40
[<c012c290>] worker_thread+0x0/0x100
[<c012ecf4>] kthread+0x34/0x60
[<c012ecc0>] kthread+0x0/0x60
[<c0103ca7>] kernel_thread_helper+0x7/0x10
=======================
Code: 02 00 3d 00 40 02 00 0f 84 a8 00 00 00 8b 02 84 c0 0f 89 ab 00 00 00 8b 72 28 8b 44 24 28 8b 54 24 0c 8b 7c 82 58 8b 16 8b 46 04 <89> 42 04 c7 46 04 00 02 20 00 89 10 c7 06 00 01 10 00 8b 46 0c
EIP: [<c015b4d1>] free_block+0xa1/0x140 SS:ESP 0068:dfeabf28
note: events/2[17] exited with preempt_count 1
BUG: sleeping function called from invalid context at fs/inode.c:244
in_atomic():1, irqs_disabled():0
[<c0171826>] clear_inode+0x16/0x110
[<c0190c5e>] proc_delete_inode+0x1e/0x50
[<c0190c40>] proc_delete_inode+0x0/0x50
[<c017198d>] generic_delete_inode+0x6d/0xe0
[<c0171036>] iput+0x56/0x70
[<c016ed32>] d_kill+0x32/0x50
[<c016fc90>] prune_one_dentry+0x30/0xe0
[<c016ffff>] prune_dcache+0x1af/0x1c0
[<c017011b>] shrink_dcache_parent+0xcb/0x100
[<c01924c7>] proc_flush_task+0x57/0x1f0
[<c04698a4>] _spin_unlock_irqrestore+0x14/0x30
[<c011f2ce>] release_task+0x23e/0x340
[<c01204f4>] do_exit+0x4a4/0x7c0
[<c0104733>] die+0x233/0x240
[<c0114604>] do_page_fault+0x3b4/0x7f0
[<c0114250>] do_page_fault+0x0/0x7f0
[<c0469af2>] error_code+0x72/0x80
[<c015b4d1>] free_block+0xa1/0x140
[<c015b5cf>] drain_array+0x5f/0xc0
[<c015c5c0>] cache_reap+0x0/0x120
[<c015c648>] cache_reap+0x88/0x120
[<c012b989>] run_workqueue+0x79/0x110
[<c04693b8>] _spin_lock_irqsave+0x18/0x70
[<c012c332>] worker_thread+0xa2/0x100
[<c012efb0>] autoremove_wake_function+0x0/0x40
[<c012c290>] worker_thread+0x0/0x100
[<c012ecf4>] kthread+0x34/0x60
[<c012ecc0>] kthread+0x0/0x60
[<c0103ca7>] kernel_thread_helper+0x7/0x10
=======================

[wildpossum]

Look like memory mapping and allocation errors.
Are you trying to run Linux (straight from a distro) without using the correct cross-compiling tool chain? If the system is supposedly a PC in embedded form, your probably got memory holes i.e.: memory is not contigous and linear for Linux to map.

Well that is the first pass.