panic while saving crash dump
Kallol Biswas
kallol at nucleodyne.com
Fri Jul 29 21:05:42 UTC 2016
Hi,
I have downloaded and compiled kernel source code for ubuntu 16.04
system. System boots up fine.
Then tried to test core dump functionality doing
echo 1> /proc/sys/kernel/sysrq
echo c > /proc/sysrq-trigger
The system started to save kernel core, but while saving core, it
crashed again. Below is the stack trace.
Is there a workaround?
Thanks,
Kallol
root at xlink-target:~# cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-4.4.13-kb
root=UUID=c6f326f6-7cc4-49f5-a3be-c511566165b4 ro intel_iommu=on
pci=realloc,nocrs,assign-busses pcie_ports=native
pciehp.pciehp_debug=1 pci=hpmemsize=0M console=ttyS1,115200n8 quiet
splash crashkernel=256M vt.handoff=7
root at xlink-target:~#
root at xlink-target:~#
2.288867] Trying to unpack rootfs image as initramfs...
[ 2.785837] swapper/0 invoked oom-killer: gfp_mask=0x24200c2,
order=0, oom_score_adj=0
[ 2.793749] swapper/0 cpuset=/ mems_allowed=0
[ 2.798143] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.4.13-kb #1
[ 2.804319] Hardware name: Supermicro Super Server/X10DRX, BIOS 2.0
12/17/2015
[ 2.811529] 0000000000000286 000000007fd56e93 ffff880037b637b0
ffffffff813eff33
[ 2.818982] ffff880037b63950 0000000000000000 ffff880037b63820
ffffffff8120801e
[ 2.826435] ffff880037f5e6c0 00000000a8815b75 ffff88002e616d00
ffff88002e616d00
[ 2.833888] Call Trace:
[ 2.836339] [<ffffffff813eff33>] dump_stack+0x63/0x90
[ 2.841474] [<ffffffff8120801e>] dump_header+0x5a/0x1c5
[ 2.846778] [<ffffffff81190685>] out_of_memory+0x445/0x460
[ 2.852342] [<ffffffff811964a0>] __alloc_pages_nodemask+0x9d0/0xb60
[ 2.858688] [<ffffffff8119cbab>] ? release_pages+0xdb/0x2b0
[ 2.864338] [<ffffffff811df41a>] alloc_page_interleave+0x3a/0x90
[ 2.870421] [<ffffffff811dfd4b>] alloc_pages_current+0xcb/0x110
[ 2.876420] [<ffffffff8118c8db>] __page_cache_alloc+0xab/0xc0
[ 2.882244] [<ffffffff8118d294>] pagecache_get_page+0x84/0x1c0
[ 2.888153] [<ffffffff8118d3f6>] grab_cache_page_write_begin+0x26/0x40
[ 2.894760] [<ffffffff812343d8>] simple_write_begin+0x28/0x1a0
[ 2.900668] [<ffffffff8118c73e>] generic_perform_write+0xce/0x1c0
[ 2.906841] [<ffffffff8118e5e2>] __generic_file_write_iter+0x1a2/0x1e0
[ 2.913446] [<ffffffff811bd234>] ? unmap_mapping_range+0x74/0x130
[ 2.919614] [<ffffffff8118e705>] generic_file_write_iter+0xe5/0x1e0
[ 2.925960] [<ffffffff81f5cacd>] ? md_run_setup+0x94/0x94
[ 2.931435] [<ffffffff8120b3db>] new_sync_write+0x9b/0xe0
[ 2.936912] [<ffffffff8120b446>] __vfs_write+0x26/0x40
[ 2.942130] [<ffffffff8120bdc9>] vfs_write+0xa9/0x1a0
[ 2.947262] [<ffffffff8140e84f>] ? zlib_updatewindow+0x7f/0xe0
[ 2.953173] [<ffffffff81f5cacd>] ? md_run_setup+0x94/0x94
[ 2.958650] [<ffffffff8120ca85>] SyS_write+0x55/0xc0
[ 2.963694] [<ffffffff8120e271>] ? __sb_end_write+0x21/0x30
[ 2.969343] [<ffffffff81f5cf3b>] xwrite+0x29/0x5c
[ 2.974128] [<ffffffff81f5cff8>] do_copy+0x8a/0xb8
[ 2.979000] [<ffffffff81f5cb6b>] write_buffer+0x23/0x34
[ 2.984303] [<ffffffff81f5cba7>] flush_buffer+0x2b/0x85
[ 2.989609] [<ffffffff81f9e5c8>] __gunzip+0x27e/0x322
[ 2.994738] [<ffffffff81f9e340>] ? bunzip2+0x399/0x399
[ 2.999955] [<ffffffff81f5cb7c>] ? write_buffer+0x34/0x34
[ 3.005433] [<ffffffff81f9e66c>] ? __gunzip+0x322/0x322
[ 3.010736] [<ffffffff81f9e67d>] gunzip+0x11/0x13
[ 3.015521] [<ffffffff81f5cacd>] ? md_run_setup+0x94/0x94
[ 3.020998] [<ffffffff81f5d409>] unpack_to_rootfs+0x17e/0x2b5
[ 3.026821] [<ffffffff81f5cacd>] ? md_run_setup+0x94/0x94
[ 3.032301] [<ffffffff81f5d7c3>] ? clean_rootfs+0x175/0x175
[ 3.037950] [<ffffffff81f5d81f>] populate_rootfs+0x5c/0xfc
[ 3.043516] [<ffffffff81002123>] do_one_initcall+0xb3/0x200
[ 3.049166] [<ffffffff8109edf5>] ? parse_args+0x295/0x4b0
[ 3.054645] [<ffffffff81f5b1a5>] kernel_init_freeable+0x173/0x212
[ 3.060815] [<ffffffff8181fe70>] ? rest_init+0x80/0x80
[ 3.066031] [<ffffffff8181fe7e>] kernel_init+0xe/0xe0
[ 3.071162] [<ffffffff8182c88f>] ret_from_fork+0x3f/0x70
[ 3.076552] [<ffffffff8181fe70>] ? rest_init+0x80/0x80
[ 3.081775] Mem-Info:
[ 3.084050] active_anon:0 inactive_anon:0 isolated_anon:0
[ 3.084050] active_file:2919 inactive_file:0 isolated_file:0
[ 3.084050] unevictable:20724 dirty:0 writeback:0 unstable:0
[ 3.084050] slab_reclaimable:1622 slab_unreclaimable:2545
[ 3.084050] mapped:0 shmem:0 pagetables:0 bounce:0
[ 3.084050] free:468 free_pcp:6 free_cma:0
[ 3.115356] Node 0 DMA free:480kB min:4kB low:4kB high:4kB
active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB
unevictable:0kB isolated(anon):0kB isolated(file):0kB present:612kB
managed:528kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB
slab_reclaimable:0kB slab_unreclaimable:48kB kernel_stack:0kB
pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB
free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[ 3.155959] lowmem_reserve[]: 0 119 119 119 119
[ 3.160586] Node 0 DMA32 free:1392kB min:1392kB low:1740kB
high:2088kB active_anon:0kB inactive_anon:0kB active_file:11676kB
inactive_file:0kB unevictable:82896kB isolated(anon):0kB
isolated(file):0kB present:261512kB managed:122208kB mlocked:0kB
dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:6488kB
slab_unreclaimable:10132kB kernel_stack:896kB pagetables:0kB
unstable:0kB bounce:0kB free_pcp:24kB local_pcp:24kB free_cma:0kB
writeback_tmp:0kB pages_scanned:82904 all_unreclaimable? yes
[ 3.204661] lowmem_reserve[]: 0 0 0 0 0
[ 3.208591] Node 0 DMA: 0*4kB 0*8kB 0*16kB 1*32kB (U) 1*64kB (U)
1*128kB (U) 1*256kB (U) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 480kB
[ 3.220690] Node 0 DMA32: 10*4kB (UM) 9*8kB (M) 10*16kB (ME) 9*32kB
(ME) 13*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB =
1392kB
[ 3.234025] Node 0 hugepages_total=0 hugepages_free=0
hugepages_surp=0 hugepages_size=1048576kB
[ 3.242715] 23644 total pagecache pages
[ 3.246548] 0 pages in swap cache
[ 3.249866] Swap cache stats: add 0, delete 0, find 0/0
[ 3.255083] Free swap = 0kB
[ 3.257962] Total swap = 0kB
[ 3.260835] 65531 pages RAM
[ 3.263628] 0 pages HighMem/MovableOnly
[ 3.267459] 34847 pages reserved
[ 3.270683] 0 pages cma reserved
[ 3.273908] 0 pages hwpoisoned
[ 3.276956] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds
swapents oom_score_adj name
[ 3.285469] Kernel panic - not syncing: Out of memory and no
killable processes...
[ 3.285469]
[ 3.294498] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.4.13-kb #1
[ 3.300667] Hardware name: Supermicro Super Server/X10DRX, BIOS 2.0
12/17/2015
[ 3.307877] 0000000000000086 000000007fd56e93 ffff880037b63798
ffffffff813eff33
[ 3.315332] ffffffff81cc7210 ffff880037b63830 ffff880037b63820
ffffffff8118ac67
[ 3.322786] 0000000000000008 ffff880037b63830 ffff880037b637c8
000000007fd56e93
[ 3.330239] Call Trace:
[ 3.332685] [<ffffffff813eff33>] dump_stack+0x63/0x90
[ 3.337814] [<ffffffff8118ac67>] panic+0xd3/0x215
[ 3.342599] [<ffffffff81190691>] out_of_memory+0x451/0x460
[ 3.348163] [<ffffffff811964a0>] __alloc_pages_nodemask+0x9d0/0xb60
[ 3.354506] [<ffffffff8119cbab>] ? release_pages+0xdb/0x2b0
[ 3.360159] [<ffffffff811df41a>] alloc_page_interleave+0x3a/0x90
[ 3.366241] [<ffffffff811dfd4b>] alloc_pages_current+0xcb/0x110
[ 3.372239] [<ffffffff8118c8db>] __page_cache_alloc+0xab/0xc0
[ 3.378063] [<ffffffff8118d294>] pagecache_get_page+0x84/0x1c0
[ 3.383975] [<ffffffff8118d3f6>] grab_cache_page_write_begin+0x26/0x40
[ 3.390579] [<ffffffff812343d8>] simple_write_begin+0x28/0x1a0
[ 3.396490] [<ffffffff8118c73e>] generic_perform_write+0xce/0x1c0
[ 3.402660] [<ffffffff8118e5e2>] __generic_file_write_iter+0x1a2/0x1e0
[ 3.409264] [<ffffffff811bd234>] ? unmap_mapping_range+0x74/0x130
[ 3.415434] [<ffffffff8118e705>] generic_file_write_iter+0xe5/0x1e0
[ 3.421778] [<ffffffff81f5cacd>] ? md_run_setup+0x94/0x94
[ 3.427256] [<ffffffff8120b3db>] new_sync_write+0x9b/0xe0
[ 3.432733] [<ffffffff8120b446>] __vfs_write+0x26/0x40
[ 3.437951] [<ffffffff8120bdc9>] vfs_write+0xa9/0x1a0
[ 3.443080] [<ffffffff8140e84f>] ? zlib_updatewindow+0x7f/0xe0
[ 3.448991] [<ffffffff81f5cacd>] ? md_run_setup+0x94/0x94
[ 3.454471] [<ffffffff8120ca85>] SyS_write+0x55/0xc0
[ 3.459514] [<ffffffff8120e271>] ? __sb_end_write+0x21/0x30
[ 3.465165] [<ffffffff81f5cf3b>] xwrite+0x29/0x5c
[ 3.469948] [<ffffffff81f5cff8>] do_copy+0x8a/0xb8
[ 3.474819] [<ffffffff81f5cb6b>] write_buffer+0x23/0x34
[ 3.480124] [<ffffffff81f5cba7>] flush_buffer+0x2b/0x85
[ 3.485427] [<ffffffff81f9e5c8>] __gunzip+0x27e/0x322
[ 3.490559] [<ffffffff81f9e340>] ? bunzip2+0x399/0x399
[ 3.495775] [<ffffffff81f5cb7c>] ? write_buffer+0x34/0x34
[ 3.501254] [<ffffffff81f9e66c>] ? __gunzip+0x322/0x322
[ 3.506556] [<ffffffff81f9e67d>] gunzip+0x11/0x13
[ 3.511341] [<ffffffff81f5cacd>] ? md_run_setup+0x94/0x94
[ 3.516819] [<ffffffff81f5d409>] unpack_to_rootfs+0x17e/0x2b5
[ 3.522642] [<ffffffff81f5cacd>] ? md_run_setup+0x94/0x94
[ 3.528119] [<ffffffff81f5d7c3>] ? clean_rootfs+0x175/0x175
[ 3.533771] [<ffffffff81f5d81f>] populate_rootfs+0x5c/0xfc
[ 3.539336] [<ffffffff81002123>] do_one_initcall+0xb3/0x200
[ 3.544986] [<ffffffff8109edf5>] ? parse_args+0x295/0x4b0
[ 3.550463] [<ffffffff81f5b1a5>] kernel_init_freeable+0x173/0x212
[ 3.556636] [<ffffffff8181fe70>] ? rest_init+0x80/0x80
[ 3.561852] [<ffffffff8181fe7e>] kernel_init+0xe/0xe0
[ 3.566984] [<ffffffff8182c88f>] ret_from_fork+0x3f/0x70
[ 3.572375] [<ffffffff8181fe70>] ? rest_init+0x80/0x80
[ 3.577594] ---[ end Kernel panic - not syncing: Out of memory and
no killable processes...
[ 3.577594]
~. [terminated ipmitool]
ipmitool> power reset
Chassis Power Control: Reset
ipmitool>
More information about the Ubuntu-devel-discuss
mailing list