discussions icon indicating copy to clipboard operation
discussions copied to clipboard

考虑给东图集群续命

Open Alkaid-Benetnash opened this issue 8 years ago • 12 comments

东图集群4台esxi都是16G,要不要加内存? 想法:

  • mirrors现在需要内存,但ddr3比较老,james想换机器。有一种办法是先给现在的mirrors加内存,换机器的话把内存拆下来给集群 —— 不兼容,集群机器太老了
  • mirrors的git服务考虑放到集群上
  • 日常使用内存是否紧张? --- 看来目前不紧张

需要掌握的信息:

  • 支持内存的型号,空余的内存条数

  • shinobu坏掉的时候还有几条内存条是好的,可以直接装(分不清了,要想办法查错

  • 集群在机架中摆放的方式不正确,很难拆开,需要办法

Alkaid-Benetnash avatar Nov 20 '16 08:11 Alkaid-Benetnash

比 mirrors 更老的内存 :joy:

zhsj avatar Nov 20 '16 08:11 zhsj

既然 nginx,vsftpd,rsync 这些服务需要的内存不太多,mirrors 的 oom 主要是由 git 引起,建议把 git 服务搬到东图集群的虚拟机上。

东图集群的三台 vcenter 现有 24G 左右的空闲内存。现东图集群的内存需求主要包括:

  • mirrors 的 git 服务搬过来(16G)
  • gitlab 增加内存(4G 增加到 16G)

淘宝上(二手?)DDR2 ECC 内存的价格很便宜(8G 100-150 元),也可以考虑买一些用来增加东图集群的内存。遗憾的是,根据 Alkaid 提供的主板信息,这批机器 6 个内存插槽,每槽最多支持 4G,现在已经插了 4 条 4G,所以最多每台机器加 8G 了。

On Nov 20, 2016 4:34 PM, "zhsj" [email protected] wrote:

比 mirrors 更老的内存 😂

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/ustclug/discussions/issues/59#issuecomment-261765812, or mute the thread https://github.com/notifications/unsubscribe-auth/ABWx4f2N0BUp6R7rCRsCfjeG4KIt_503ks5rAAX-gaJpZM4K3e8y .

bojieli avatar Nov 20 '16 10:11 bojieli

建议将这批机器淘汰掉,已经有故障的征兆了.....

3号节点已经失联了 #67

许多虚拟机内核日志中出现CPU stall:

[Fri Nov 18 01:37:08 2016] INFO: rcu_sched self-detected stall on CPU
[Fri Nov 18 01:37:08 2016] INFO: rcu_sched detected stalls on CPUs/tasks:
[Fri Nov 18 01:37:08 2016]  {
[Fri Nov 18 01:37:08 2016]  0
[Fri Nov 18 01:37:08 2016]  1
[Fri Nov 18 01:37:08 2016]  2
[Fri Nov 18 01:37:08 2016]  3
[Fri Nov 18 01:37:08 2016]  4
[Fri Nov 18 01:37:08 2016]  6
[Fri Nov 18 01:37:08 2016]  7
[Fri Nov 18 01:37:08 2016] }
[Fri Nov 18 01:37:08 2016] (detected by 5, t=10049 jiffies, g=35438838, c=35438837, q=207)
[Fri Nov 18 01:37:08 2016] sending NMI to all CPUs:
[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 5
[Fri Nov 18 01:37:08 2016] CPU: 5 PID: 15373 Comm: bundle Tainted: G         C    3.16.7-ckt11+deb8u6-ustclugsigned #1
[Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
[Fri Nov 18 01:37:08 2016] task: ffff880139a46010 ti: ffff88012248c000 task.ti: ffff88012248c000
[Fri Nov 18 01:37:08 2016] RIP: 0010:[<ffffffff81051b86>]
[Fri Nov 18 01:37:08 2016]  [<ffffffff81051b86>] native_write_msr_safe+0x6/0x10
[Fri Nov 18 01:37:08 2016] RSP: 0000:ffff88013fd43df8  EFLAGS: 00000046
[Fri Nov 18 01:37:08 2016] RAX: 0000000000000400 RBX: 0000000000000002 RCX: 0000000000000830
[Fri Nov 18 01:37:08 2016] RDX: 000000000000000a RSI: 0000000000000400 RDI: 0000000000000830
[Fri Nov 18 01:37:08 2016] RBP: 0000000000000005 R08: ffffffff818eff40 R09: 0000000000000018
[Fri Nov 18 01:37:08 2016] R10: 00124faecb387080 R11: 3a73555043206c6c R12: ffffffff818eff40
[Fri Nov 18 01:37:08 2016] R13: 0000000000000005 R14: 000000000000a10a R15: 0000000000080000
[Fri Nov 18 01:37:08 2016] FS:  00007fab46bc7740(0000) GS:ffff88013fd40000(0000) knlGS:0000000000000000
[Fri Nov 18 01:37:08 2016] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Nov 18 01:37:08 2016] CR2: 0000000001e01578 CR3: 0000000114da1000 CR4: 00000000000007e0
[Fri Nov 18 01:37:08 2016] Stack:
[Fri Nov 18 01:37:08 2016]  ffffffff8104a82b
[Fri Nov 18 01:37:08 2016]  0000000000000002
[Fri Nov 18 01:37:08 2016]  0000000000000086
[Fri Nov 18 01:37:08 2016]  ffff88013fd4d880

[Fri Nov 18 01:37:08 2016]  ffffffff81856a00
[Fri Nov 18 01:37:08 2016]  0000000000000005
[Fri Nov 18 01:37:08 2016]  ffffffff818f0500
[Fri Nov 18 01:37:08 2016]  00000000000000cf

[Fri Nov 18 01:37:08 2016]  ffffffff81856a00
[Fri Nov 18 01:37:08 2016]  ffffffff8104746e
[Fri Nov 18 01:37:08 2016]  ffff88013fd4d880
[Fri Nov 18 01:37:08 2016]  ffffffff810c7f65

[Fri Nov 18 01:37:08 2016] Call Trace:
[Fri Nov 18 01:37:08 2016]  <IRQ>

[Fri Nov 18 01:37:08 2016]  [<ffffffff8104a82b>] ? __x2apic_send_IPI_mask+0xab/0xd0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8104746e>] ? arch_trigger_all_cpu_backtrace+0x12e/0x140

[Fri Nov 18 01:37:08 2016]  [<ffffffff810c7f65>] ? rcu_check_callbacks+0x615/0x640

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d2980>] ? tick_sched_handle.isra.16+0x60/0x60

[Fri Nov 18 01:37:08 2016]  [<ffffffff81075f40>] ? update_process_times+0x40/0x70

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d2940>] ? tick_sched_handle.isra.16+0x20/0x60

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d29bc>] ? tick_sched_timer+0x3c/0x60

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108cef7>] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108d2b9>] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152c9ab>] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152aa3d>] ? apic_timer_interrupt+0x6d/0x80
[Fri Nov 18 01:37:08 2016]  <EOI>
[Fri Nov 18 01:37:08 2016] Code:
[Fri Nov 18 01:37:08 2016] d0
[Fri Nov 18 01:37:08 2016] c3
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] 1f
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] f9
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] 32
[Fri Nov 18 01:37:08 2016] 45
[Fri Nov 18 01:37:08 2016] 31
[Fri Nov 18 01:37:08 2016] c0
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] d7
[Fri Nov 18 01:37:08 2016] 44
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 06
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] c6
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] c1
[Fri Nov 18 01:37:08 2016] e7
[Fri Nov 18 01:37:08 2016] 20
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] f8
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 09
[Fri Nov 18 01:37:08 2016] f0
[Fri Nov 18 01:37:08 2016] c3
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] 1f
[Fri Nov 18 01:37:08 2016] 44
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] f0
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] f9
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] 30
[Fri Nov 18 01:37:08 2016] <31>
[Fri Nov 18 01:37:08 2016] c0
[Fri Nov 18 01:37:08 2016] c3
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] 1f
[Fri Nov 18 01:37:08 2016] 80
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] f9
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] 33
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] d7
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] c1
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] c1

[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 2
[Fri Nov 18 01:37:08 2016] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G         C    3.16.7-ckt11+deb8u6-ustclugsigned #1
[Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
[Fri Nov 18 01:37:08 2016] task: ffff880139fce0d0 ti: ffff880139fdc000 task.ti: ffff880139fdc000
[Fri Nov 18 01:37:08 2016] RIP: 0010:[<ffffffff8109e69d>]
[Fri Nov 18 01:37:08 2016]  [<ffffffff8109e69d>] update_curr+0xd/0x120
[Fri Nov 18 01:37:08 2016] RSP: 0018:ffff88013fc83e10  EFLAGS: 00010002
[Fri Nov 18 01:37:08 2016] RAX: ffff8800ba510b18 RBX: ffff880122526dc0 RCX: ffff8800ba510b08
[Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff8800b8a14c00
[Fri Nov 18 01:37:08 2016] RBP: ffff8800b8a14c00 R08: 0000000000000000 R09: 0000000000000001
[Fri Nov 18 01:37:08 2016] R10: 00124faecb387080 R11: 0000000000000010 R12: ffff88013fc93380
[Fri Nov 18 01:37:08 2016] R13: 0000000000000400 R14: 0000000000000001 R15: 0000000000000000
[Fri Nov 18 01:37:08 2016] FS:  0000000000000000(0000) GS:ffff88013fc80000(0000) knlGS:0000000000000000
[Fri Nov 18 01:37:08 2016] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[Fri Nov 18 01:37:08 2016] CR2: 00007f7de9005ef8 CR3: 00000000baf13000 CR4: 00000000000007e0
[Fri Nov 18 01:37:08 2016] Stack:
[Fri Nov 18 01:37:08 2016]  ffff880122526dc0
[Fri Nov 18 01:37:08 2016]  ffff8800b8a14c00
[Fri Nov 18 01:37:08 2016]  ffff88013fc93380
[Fri Nov 18 01:37:08 2016]  0000000000000400

[Fri Nov 18 01:37:08 2016]  0000000000000001
[Fri Nov 18 01:37:08 2016]  ffffffff810a001c
[Fri Nov 18 01:37:08 2016]  ffff88013fc93380
[Fri Nov 18 01:37:08 2016]  ffff88013fc93380

[Fri Nov 18 01:37:08 2016]  ffff88013fc93380
[Fri Nov 18 01:37:08 2016]  ffffffff8101c0b5
[Fri Nov 18 01:37:08 2016]  ffff8800ba510aa0
[Fri Nov 18 01:37:08 2016]  ffff88013fc93380

[Fri Nov 18 01:37:08 2016] Call Trace:
[Fri Nov 18 01:37:08 2016]  <IRQ>

[Fri Nov 18 01:37:08 2016]  [<ffffffff810a001c>] ? enqueue_task_fair+0x6c/0xf20

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101c0b5>] ? sched_clock+0x5/0x10

[Fri Nov 18 01:37:08 2016]  [<ffffffff8109633e>] ? ttwu_do_activate.constprop.97+0x2e/0x60

[Fri Nov 18 01:37:08 2016]  [<ffffffff81098aed>] ? try_to_wake_up+0x1ed/0x310

[Fri Nov 18 01:37:08 2016]  [<ffffffff812c1cbe>] ? timerqueue_del+0x1e/0x70

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108c850>] ? hrtimer_get_res+0x50/0x50

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108c86e>] ? hrtimer_wakeup+0x1e/0x30

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108cef7>] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108d2b9>] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152c9ab>] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152aa3d>] ? apic_timer_interrupt+0x6d/0x80
[Fri Nov 18 01:37:08 2016]  <EOI>

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfc0>] ? idle_notifier_unregister+0x20/0x20

[Fri Nov 18 01:37:08 2016]  [<ffffffff81051cc2>] ? native_safe_halt+0x2/0x10

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfd9>] ? default_idle+0x19/0xb0

[Fri Nov 18 01:37:08 2016]  [<ffffffff810aa88f>] ? cpu_startup_entry+0x38f/0x460

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d11c0>] ? tick_check_new_device+0xd0/0xf0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8104384f>] ? start_secondary+0x22f/0x2c0
[Fri Nov 18 01:37:08 2016] Code:
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 4e
[Fri Nov 18 01:37:08 2016] 28
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 56
[Fri Nov 18 01:37:08 2016] 30
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 51
[Fri Nov 18 01:37:08 2016] 08
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 0a
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 46
[Fri Nov 18 01:37:08 2016] 28
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 46
[Fri Nov 18 01:37:08 2016] 30
[Fri Nov 18 01:37:08 2016] 83
[Fri Nov 18 01:37:08 2016] 6f
[Fri Nov 18 01:37:08 2016] 10
[Fri Nov 18 01:37:08 2016] 01
[Fri Nov 18 01:37:08 2016] c3
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 90
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 90
[Fri Nov 18 01:37:08 2016] 41
[Fri Nov 18 01:37:08 2016] 56
[Fri Nov 18 01:37:08 2016] 41
[Fri Nov 18 01:37:08 2016] 55
[Fri Nov 18 01:37:08 2016] 41
[Fri Nov 18 01:37:08 2016] 54
[Fri Nov 18 01:37:08 2016] 55
[Fri Nov 18 01:37:08 2016] 53
[Fri Nov 18 01:37:08 2016] <48>
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 5f
[Fri Nov 18 01:37:08 2016] 38
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 87
[Fri Nov 18 01:37:08 2016] b0
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 85
[Fri Nov 18 01:37:08 2016] db
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 80
[Fri Nov 18 01:37:08 2016] a8
[Fri Nov 18 01:37:08 2016] 08
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00

[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 0
[Fri Nov 18 01:37:08 2016] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G         C    3.16.7-ckt11+deb8u6-ustclugsigned #1
[Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
[Fri Nov 18 01:37:08 2016] task: ffffffff81819500 ti: ffffffff81800000 task.ti: ffffffff81800000
[Fri Nov 18 01:37:08 2016] RIP: 0010:[<ffffffff8109e925>]
[Fri Nov 18 01:37:08 2016]  [<ffffffff8109e925>] update_cfs_shares+0x25/0xd0
[Fri Nov 18 01:37:08 2016] RSP: 0018:ffff88013fc03e20  EFLAGS: 00010002
[Fri Nov 18 01:37:08 2016] RAX: ffff8800b8c2f5c0 RBX: ffff88004985f940 RCX: ffff8800b8f5e600
[Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: ffff88004985f940 RDI: ffff8800ba7e1100
[Fri Nov 18 01:37:08 2016] RBP: ffff8800ba7e1100 R08: ffffffffffffffff R09: 0000000000000000
[Fri Nov 18 01:37:08 2016] R10: 00124faecb387080 R11: 0000000000000010 R12: ffff88013fc13380
[Fri Nov 18 01:37:08 2016] R13: 0000000000000400 R14: 0000000000000000 R15: ffff88007b196200
[Fri Nov 18 01:37:08 2016] FS:  0000000000000000(0000) GS:ffff88013fc00000(0000) knlGS:0000000000000000
[Fri Nov 18 01:37:08 2016] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[Fri Nov 18 01:37:08 2016] CR2: 00007f7deaf82bb0 CR3: 000000007b3e0000 CR4: 00000000000007f0
[Fri Nov 18 01:37:08 2016] Stack:
[Fri Nov 18 01:37:08 2016]  ffff88004985f940
[Fri Nov 18 01:37:08 2016]  ffff8800ba7e1100
[Fri Nov 18 01:37:08 2016]  ffff88013fc13380
[Fri Nov 18 01:37:08 2016]  ffffffff810a029b

[Fri Nov 18 01:37:08 2016]  000000000000010d
[Fri Nov 18 01:37:08 2016]  ffff88013fc13380
[Fri Nov 18 01:37:08 2016]  ffff88013fc13380
[Fri Nov 18 01:37:08 2016]  ffffffff8101c0b5

[Fri Nov 18 01:37:08 2016]  ffff8800571952b0
[Fri Nov 18 01:37:08 2016]  ffff88013fc13380
[Fri Nov 18 01:37:08 2016]  ffff88013fc13380
[Fri Nov 18 01:37:08 2016]  0000000000000046

[Fri Nov 18 01:37:08 2016] Call Trace:
[Fri Nov 18 01:37:08 2016]  <IRQ>

[Fri Nov 18 01:37:08 2016]  [<ffffffff810a029b>] ? enqueue_task_fair+0x2eb/0xf20

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101c0b5>] ? sched_clock+0x5/0x10

[Fri Nov 18 01:37:08 2016]  [<ffffffff8109633e>] ? ttwu_do_activate.constprop.97+0x2e/0x60

[Fri Nov 18 01:37:08 2016]  [<ffffffff81098aed>] ? try_to_wake_up+0x1ed/0x310

[Fri Nov 18 01:37:08 2016]  [<ffffffff812c1cbe>] ? timerqueue_del+0x1e/0x70

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108c850>] ? hrtimer_get_res+0x50/0x50

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108c86e>] ? hrtimer_wakeup+0x1e/0x30

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108cef7>] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108d2b9>] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152c9ab>] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152aa3d>] ? apic_timer_interrupt+0x6d/0x80
[Fri Nov 18 01:37:08 2016]  <EOI>

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfc0>] ? idle_notifier_unregister+0x20/0x20

[Fri Nov 18 01:37:08 2016]  [<ffffffff81051cc2>] ? native_safe_halt+0x2/0x10

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfd9>] ? default_idle+0x19/0xb0

[Fri Nov 18 01:37:08 2016]  [<ffffffff810aa88f>] ? cpu_startup_entry+0x38f/0x460

[Fri Nov 18 01:37:08 2016]  [<ffffffff81911f2f>] ? start_kernel+0x46e/0x476

[Fri Nov 18 01:37:08 2016]  [<ffffffff81911120>] ? early_idt_handlers+0x120/0x120

[Fri Nov 18 01:37:08 2016]  [<ffffffff81911608>] ? x86_64_start_kernel+0x14d/0x15c
[Fri Nov 18 01:37:08 2016] Code:
[Fri Nov 18 01:37:08 2016] 84
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 90
[Fri Nov 18 01:37:08 2016] 41
[Fri Nov 18 01:37:08 2016] 54
[Fri Nov 18 01:37:08 2016] 55
[Fri Nov 18 01:37:08 2016] 53
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 87
[Fri Nov 18 01:37:08 2016] b0
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 8f
[Fri Nov 18 01:37:08 2016] d0
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 63
[Fri Nov 18 01:37:08 2016] 90
[Fri Nov 18 01:37:08 2016] 08
[Fri Nov 18 01:37:08 2016] 09
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 81
[Fri Nov 18 01:37:08 2016] a8
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] <48>
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 2c
[Fri Nov 18 01:37:08 2016] d0
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 85
[Fri Nov 18 01:37:08 2016] ed
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] 84
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 07
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 91
[Fri Nov 18 01:37:08 2016] c0
[Fri Nov 18 01:37:08 2016] 00

[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 3
[Fri Nov 18 01:37:08 2016] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G         C    3.16.7-ckt11+deb8u6-ustclugsigned #1
[Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
[Fri Nov 18 01:37:08 2016] task: ffff880139fd73b0 ti: ffff880139fe0000 task.ti: ffff880139fe0000
[Fri Nov 18 01:37:08 2016] RIP: 0010:[<ffffffff8138ec6a>]
[Fri Nov 18 01:37:08 2016]  [<ffffffff8138ec6a>] vt_console_print+0x18a/0x400
[Fri Nov 18 01:37:08 2016] RSP: 0018:ffff88013fcc3cd0  EFLAGS: 00000006
[Fri Nov 18 01:37:08 2016] RAX: 0000000000000735 RBX: ffff88013f01e400 RCX: 0000000000000046
[Fri Nov 18 01:37:08 2016] RDX: ffff8800000b970c RSI: 0000000000000003 RDI: ffffffff81aeccb0
[Fri Nov 18 01:37:08 2016] RBP: 0000000000000035 R08: 0000000000000000 R09: ffff8800000b96f6
[Fri Nov 18 01:37:08 2016] R10: 6c6c617473206400 R11: 7463657465642064 R12: 000000000000000c
[Fri Nov 18 01:37:08 2016] R13: ffffffff81a7cc4c R14: ffffffff81a7cc7f R15: 0000000000000000
[Fri Nov 18 01:37:08 2016] FS:  0000000000000000(0000) GS:ffff88013fcc0000(0000) knlGS:0000000000000000
[Fri Nov 18 01:37:08 2016] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[Fri Nov 18 01:37:08 2016] CR2: 0000000000699050 CR3: 000000007e5c6000 CR4: 00000000000007e0
[Fri Nov 18 01:37:08 2016] Stack:
[Fri Nov 18 01:37:08 2016]  ffff8800000b96f6
[Fri Nov 18 01:37:08 2016]  000000460000002e
[Fri Nov 18 01:37:08 2016]  ffff88013f01e400
[Fri Nov 18 01:37:08 2016]  0000000000000038

[Fri Nov 18 01:37:08 2016]  ffffffff818afd80
[Fri Nov 18 01:37:08 2016]  000000000000003f
[Fri Nov 18 01:37:08 2016]  ffffffff818f04c0
[Fri Nov 18 01:37:08 2016]  ffffffff81a7fdb4

[Fri Nov 18 01:37:08 2016]  0000000000000000
[Fri Nov 18 01:37:08 2016]  0000000000000003
[Fri Nov 18 01:37:08 2016]  ffffffff810ba3ba
[Fri Nov 18 01:37:08 2016]  0000000000000046

[Fri Nov 18 01:37:08 2016] Call Trace:
[Fri Nov 18 01:37:08 2016]  <IRQ>

[Fri Nov 18 01:37:08 2016]  [<ffffffff810ba3ba>] ? call_console_drivers.constprop.24+0x9a/0xe0

[Fri Nov 18 01:37:08 2016]  [<ffffffff810bb271>] ? console_unlock+0x361/0x410

[Fri Nov 18 01:37:08 2016]  [<ffffffff810bb630>] ? vprintk_emit+0x310/0x580

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152243c>] ? printk+0x4f/0x57

[Fri Nov 18 01:37:08 2016]  [<ffffffff810c7c8f>] ? rcu_check_callbacks+0x33f/0x640

[Fri Nov 18 01:37:08 2016]  [<ffffffff81096226>] ? ttwu_do_wakeup+0x36/0xd0

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d2980>] ? tick_sched_handle.isra.16+0x60/0x60

[Fri Nov 18 01:37:08 2016]  [<ffffffff81075f40>] ? update_process_times+0x40/0x70

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d2940>] ? tick_sched_handle.isra.16+0x20/0x60

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d29bc>] ? tick_sched_timer+0x3c/0x60

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108cef7>] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108d2b9>] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152c9ab>] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152aa3d>] ? apic_timer_interrupt+0x6d/0x80
[Fri Nov 18 01:37:08 2016]  <EOI>

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfc0>] ? idle_notifier_unregister+0x20/0x20

[Fri Nov 18 01:37:08 2016]  [<ffffffff81051cc2>] ? native_safe_halt+0x2/0x10

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfd9>] ? default_idle+0x19/0xb0

[Fri Nov 18 01:37:08 2016]  [<ffffffff810aa88f>] ? cpu_startup_entry+0x38f/0x460

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d11c0>] ? tick_check_new_device+0xd0/0xf0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8104384f>] ? start_secondary+0x22f/0x2c0
[Fri Nov 18 01:37:08 2016] Code:
[Fri Nov 18 01:37:08 2016] 41
[Fri Nov 18 01:37:08 2016] 83
[Fri Nov 18 01:37:08 2016] c4
[Fri Nov 18 01:37:08 2016] 01
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] b6
[Fri Nov 18 01:37:08 2016] 83
[Fri Nov 18 01:37:08 2016] c5
[Fri Nov 18 01:37:08 2016] 01
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 40
[Fri Nov 18 01:37:08 2016] 0f
[Fri Nov 18 01:37:08 2016] b6
[Fri Nov 18 01:37:08 2016] f5
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] c7
[Fri Nov 18 01:37:08 2016] c7
[Fri Nov 18 01:37:08 2016] b0
[Fri Nov 18 01:37:08 2016] cc
[Fri Nov 18 01:37:08 2016] ae
[Fri Nov 18 01:37:08 2016] 81
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 4c
[Fri Nov 18 01:37:08 2016] 24
[Fri Nov 18 01:37:08 2016] 0c
[Fri Nov 18 01:37:08 2016] 4c
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 0c
[Fri Nov 18 01:37:08 2016] 24
[Fri Nov 18 01:37:08 2016] c1
[Fri Nov 18 01:37:08 2016] e0
[Fri Nov 18 01:37:08 2016] 08
[Fri Nov 18 01:37:08 2016] 01
[Fri Nov 18 01:37:08 2016] f0
[Fri Nov 18 01:37:08 2016] be
[Fri Nov 18 01:37:08 2016] 03
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 02
[Fri Nov 18 01:37:08 2016] <48>
[Fri Nov 18 01:37:08 2016] 8d
[Fri Nov 18 01:37:08 2016] 54
[Fri Nov 18 01:37:08 2016] 24
[Fri Nov 18 01:37:08 2016] 10
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 5c
[Fri Nov 18 01:37:08 2016] 24
[Fri Nov 18 01:37:08 2016] 10
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 6c
[Fri Nov 18 01:37:08 2016] 24
[Fri Nov 18 01:37:08 2016] 18
[Fri Nov 18 01:37:08 2016] e8
[Fri Nov 18 01:37:08 2016] 33
[Fri Nov 18 01:37:08 2016] f4
[Fri Nov 18 01:37:08 2016] cf
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 4c

[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 1
[Fri Nov 18 01:37:08 2016] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G         C    3.16.7-ckt11+deb8u6-ustclugsigned #1
[Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
[Fri Nov 18 01:37:08 2016] task: ffff880139fcea20 ti: ffff880139fd8000 task.ti: ffff880139fd8000
[Fri Nov 18 01:37:08 2016] RIP: 0010:[<ffffffff81098c16>]
[Fri Nov 18 01:37:08 2016]  [<ffffffff81098c16>] wake_up_process+0x6/0x50
[Fri Nov 18 01:37:08 2016] RSP: 0018:ffff88013fc43ee8  EFLAGS: 00010086
[Fri Nov 18 01:37:08 2016] RAX: ffff88010e88b968 RBX: ffff88010e88b968 RCX: ffff88012b47f968
[Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: ffff88013fc4d350 RDI: ffff880129cd93f0
[Fri Nov 18 01:37:08 2016] RBP: 0000000000000078 R08: 0000000000000000 R09: 0000000000000000
[Fri Nov 18 01:37:08 2016] R10: 00124faecb387080 R11: 0000000000000010 R12: ffff88013fc4d300
[Fri Nov 18 01:37:08 2016] R13: ffff88013fc4d340 R14: ffff88013fc43f68 R15: ffffffff8108c850
[Fri Nov 18 01:37:08 2016] FS:  0000000000000000(0000) GS:ffff88013fc40000(0000) knlGS:0000000000000000
[Fri Nov 18 01:37:08 2016] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[Fri Nov 18 01:37:08 2016] CR2: 00007f7df07ac708 CR3: 0000000083e0a000 CR4: 00000000000007e0
[Fri Nov 18 01:37:08 2016] Stack:
[Fri Nov 18 01:37:08 2016]  ffff88010e88b968
[Fri Nov 18 01:37:08 2016]  ffffffff8108c86e
[Fri Nov 18 01:37:08 2016]  ffffffff8108cef7
[Fri Nov 18 01:37:08 2016]  ffff88013fc4d300

[Fri Nov 18 01:37:08 2016]  0000000000000078
[Fri Nov 18 01:37:08 2016]  0000000000000000
[Fri Nov 18 01:37:08 2016]  ffff88013fc4d378
[Fri Nov 18 01:37:08 2016]  7fffffffffffffff

[Fri Nov 18 01:37:08 2016]  000757c9a1071a66
[Fri Nov 18 01:37:08 2016]  ffffffff8108d2b9
[Fri Nov 18 01:37:08 2016]  ffff88013fc4d378
[Fri Nov 18 01:37:08 2016]  00000003583498e8

[Fri Nov 18 01:37:08 2016] Call Trace:
[Fri Nov 18 01:37:08 2016]  <IRQ>

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108c86e>] ? hrtimer_wakeup+0x1e/0x30

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108cef7>] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8108d2b9>] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152c9ab>] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016]  [<ffffffff8152aa3d>] ? apic_timer_interrupt+0x6d/0x80
[Fri Nov 18 01:37:08 2016]  <EOI>

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfc0>] ? idle_notifier_unregister+0x20/0x20

[Fri Nov 18 01:37:08 2016]  [<ffffffff81051cc2>] ? native_safe_halt+0x2/0x10

[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfd9>] ? default_idle+0x19/0xb0

[Fri Nov 18 01:37:08 2016]  [<ffffffff810aa88f>] ? cpu_startup_entry+0x38f/0x460

[Fri Nov 18 01:37:08 2016]  [<ffffffff810d11c0>] ? tick_check_new_device+0xd0/0xf0

[Fri Nov 18 01:37:08 2016]  [<ffffffff8104384f>] ? start_secondary+0x22f/0x2c0
[Fri Nov 18 01:37:08 2016] Code:
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] d0
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 03
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 85
[Fri Nov 18 01:37:08 2016] c0
[Fri Nov 18 01:37:08 2016] 75
[Fri Nov 18 01:37:08 2016] eb
[Fri Nov 18 01:37:08 2016] e9
[Fri Nov 18 01:37:08 2016] f9
[Fri Nov 18 01:37:08 2016] fe
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] 4c
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] 0c
[Fri Nov 18 01:37:08 2016] 24
[Fri Nov 18 01:37:08 2016] e8
[Fri Nov 18 01:37:08 2016] ca
[Fri Nov 18 01:37:08 2016] 97
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 0c
[Fri Nov 18 01:37:08 2016] 24
[Fri Nov 18 01:37:08 2016] e9
[Fri Nov 18 01:37:08 2016] a5
[Fri Nov 18 01:37:08 2016] fd
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] ff
[Fri Nov 18 01:37:08 2016] 90
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 66
[Fri Nov 18 01:37:08 2016] 90
[Fri Nov 18 01:37:08 2016] 53
[Fri Nov 18 01:37:08 2016] <48>
[Fri Nov 18 01:37:08 2016] 8b
[Fri Nov 18 01:37:08 2016] 07
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] fb
[Fri Nov 18 01:37:08 2016] a8
[Fri Nov 18 01:37:08 2016] 0c
[Fri Nov 18 01:37:08 2016] 75
[Fri Nov 18 01:37:08 2016] 10
[Fri Nov 18 01:37:08 2016] 48
[Fri Nov 18 01:37:08 2016] 89
[Fri Nov 18 01:37:08 2016] df
[Fri Nov 18 01:37:08 2016] 31
[Fri Nov 18 01:37:08 2016] d2
[Fri Nov 18 01:37:08 2016] be
[Fri Nov 18 01:37:08 2016] 03
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 00
[Fri Nov 18 01:37:08 2016] 5b

[Fri Nov 18 01:37:08 2016]  {
[Fri Nov 18 01:37:08 2016]  3}  (t=10049 jiffies g=35438838 c=35438837 q=216)
[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 6
[Fri Nov 18 01:37:08 2016] CPU: 6 PID: 0 Comm: swapper/6 Tainted: G         C    3.16.7-ckt11+deb8u6-ustclugsigned #1
[Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
[Fri Nov 18 01:37:08 2016] task: ffff880139ff13f0 ti: ffff880139ff4000 task.ti: ffff880139ff4000
[Fri Nov 18 01:37:08 2016] RIP: 0010:[<ffffffff81051cc2>]  [<ffffffff81051cc2>] native_safe_halt+0x2/0x10
[Fri Nov 18 01:37:08 2016] RSP: 0018:ffff880139ff7ec8  EFLAGS: 00000246
[Fri Nov 18 01:37:08 2016] RAX: ffffffff8101cfc0 RBX: ffffffff818f04c0 RCX: ffffffff818584a0
[Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
[Fri Nov 18 01:37:08 2016] RBP: 0000000000000006 R08: 0000000000000000 R09: 0000000000000000
[Fri Nov 18 01:37:08 2016] R10: 00124f9778175ab8 R11: 0000000000000000 R12: ffff880139ff4000
[Fri Nov 18 01:37:08 2016] R13: 0000000000000000 R14: 00000000ffffffed R15: ffff880139ff7fd8
[Fri Nov 18 01:37:08 2016] FS:  0000000000000000(0000) GS:ffff88013fd80000(0000) knlGS:0000000000000000
[Fri Nov 18 01:37:08 2016] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[Fri Nov 18 01:37:08 2016] CR2: 0000000001de4538 CR3: 0000000001812000 CR4: 00000000000007e0
[Fri Nov 18 01:37:08 2016] Stack:
[Fri Nov 18 01:37:08 2016]  ffffffff8101cfd9 ffffffff818f04c0 0000000000000000 ffffffff810aa88f
[Fri Nov 18 01:37:08 2016]  ffff880139ff4000 ffff880139ff4000 ffff880139ff7fd8 ffffffff810d11c0
[Fri Nov 18 01:37:08 2016]  f5af525e37240ad8 0000000000000000 0000000000000000 0000000000000000
[Fri Nov 18 01:37:08 2016] Call Trace:
[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfd9>] ? default_idle+0x19/0xb0
[Fri Nov 18 01:37:08 2016]  [<ffffffff810aa88f>] ? cpu_startup_entry+0x38f/0x460
[Fri Nov 18 01:37:08 2016]  [<ffffffff810d11c0>] ? tick_check_new_device+0xd0/0xf0
[Fri Nov 18 01:37:08 2016]  [<ffffffff8104384f>] ? start_secondary+0x22f/0x2c0
[Fri Nov 18 01:37:08 2016] Code: 2e 0f 1f 84 00 00 00 00 00 fa c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fb c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fb f4 <c3> 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 f4 c3 66 66 66 66 66
[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 4
[Fri Nov 18 01:37:08 2016] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G         C    3.16.7-ckt11+deb8u6-ustclugsigned #1
[Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
[Fri Nov 18 01:37:08 2016] task: ffff880139fd6a60 ti: ffff880139fe8000 task.ti: ffff880139fe8000
[Fri Nov 18 01:37:08 2016] RIP: 0010:[<ffffffff81051cc2>]  [<ffffffff81051cc2>] native_safe_halt+0x2/0x10
[Fri Nov 18 01:37:08 2016] RSP: 0018:ffff880139febec8  EFLAGS: 00000246
[Fri Nov 18 01:37:08 2016] RAX: ffffffff8101cfc0 RBX: ffffffff818f04c0 RCX: ffffffff818584a0
[Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
[Fri Nov 18 01:37:08 2016] RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000000
[Fri Nov 18 01:37:08 2016] R10: 00124f9774861da8 R11: 0000000000000000 R12: ffff880139fe8000
[Fri Nov 18 01:37:08 2016] R13: 0000000000000000 R14: 00000000ffffffed R15: ffff880139febfd8
[Fri Nov 18 01:37:08 2016] FS:  0000000000000000(0000) GS:ffff88013fd00000(0000) knlGS:0000000000000000
[Fri Nov 18 01:37:08 2016] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[Fri Nov 18 01:37:08 2016] CR2: 00007f58bc285000 CR3: 00000000baf13000 CR4: 00000000000007e0
[Fri Nov 18 01:37:08 2016] Stack:
[Fri Nov 18 01:37:08 2016]  ffffffff8101cfd9 ffffffff818f04c0 0000000000000000 ffffffff810aa88f
[Fri Nov 18 01:37:08 2016]  ffff880139fe8000 ffff880139fe8000 ffff880139febfd8 ffffffff810d11c0
[Fri Nov 18 01:37:08 2016]  bc955c916e880c24 0000000000000000 0000000000000000 0000000000000000
[Fri Nov 18 01:37:08 2016] Call Trace:
[Fri Nov 18 01:37:08 2016]  [<ffffffff8101cfd9>] ? default_idle+0x19/0xb0
[Fri Nov 18 01:37:08 2016]  [<ffffffff810aa88f>] ? cpu_startup_entry+0x38f/0x460
[Fri Nov 18 01:37:08 2016]  [<ffffffff810d11c0>] ? tick_check_new_device+0xd0/0xf0
[Fri Nov 18 01:37:08 2016]  [<ffffffff8104384f>] ? start_secondary+0x22f/0x2c0
[Fri Nov 18 01:37:08 2016] Code: 2e 0f 1f 84 00 00 00 00 00 fa c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fb c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fb f4 <c3> 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 f4 c3 66 66 66 66 66
[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 7
[Fri Nov 18 01:37:08 2016] CPU: 7 PID: 578 Comm: vmtoolsd Tainted: G         C    3.16.7-ckt11+deb8u6-ustclugsigned #1
[Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
[Fri Nov 18 01:37:08 2016] task: ffff8800366f3370 ti: ffff8800b8a24000 task.ti: ffff8800b8a24000
[Fri Nov 18 01:37:08 2016] RIP: 0033:[<00007f691933b1ad>]  [<00007f691933b1ad>] 0x7f691933b1ad
[Fri Nov 18 01:37:08 2016] RSP: 002b:00007ffdcc3bfcc8  EFLAGS: 00000246
[Fri Nov 18 01:37:08 2016] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000001001e
[Fri Nov 18 01:37:08 2016] RDX: 00007ffd00005658 RSI: 00000000e550ff84 RDI: 00000000b04ea69d
[Fri Nov 18 01:37:08 2016] RBP: 000000000000000a R08: 0000000000000001 R09: 000000000000001e
[Fri Nov 18 01:37:08 2016] R10: 0000000000000020 R11: 0000000000000246 R12: 00007ffdcc3bfcf0
[Fri Nov 18 01:37:08 2016] R13: 0000000000000000 R14: 0000000000000000 R15: 00007f69193355b0
[Fri Nov 18 01:37:08 2016] FS:  00007f69197b4740(0000) GS:ffff88013fdc0000(0000) knlGS:0000000000000000
[Fri Nov 18 01:37:08 2016] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[Fri Nov 18 01:37:08 2016] CR2: 00007f69197c5000 CR3: 00000000bae1e000 CR4: 00000000000007e0

[Fri Nov 18 01:37:08 2016] systemd[1]: Starting Journal Service...
[Fri Nov 18 01:37:08 2016] systemd-journald[14500]: Received SIGTERM from PID 1 (systemd).
[Fri Nov 18 01:37:08 2016] systemd[1]: Unit systemd-journald.service entered failed state.
[Fri Nov 18 01:37:08 2016] systemd[1]: systemd-journald.service has no holdoff time, scheduling restart.
[Fri Nov 18 01:37:08 2016] systemd[1]: Stopping Journal Service...
[Fri Nov 18 01:37:08 2016] systemd[1]: Starting Journal Service...
[Fri Nov 18 01:37:08 2016] systemd[1]: Started Journal Service.
[Fri Nov 18 01:37:08 2016] systemd-journald[15379]: Received request to flush runtime journal from PID 1

gaoyifan avatar Nov 25 '16 13:11 gaoyifan

这么严重啊,确实应该淘汰掉了。如此看来之前 vcenter 频发的故障也可能是硬件问题所致,不一定是软件 bug。

现在少院 freeshell 集群是否有硬件故障发生?这批机器也挺老的(2009),不过当年少院是作为小超算买的,稳定性可能稍微好些。既然现在 freeshell 处于半死不活的状态,要不要把这批机器作为新的 vcenter 呢?

On Fri, Nov 25, 2016 at 9:28 PM, Yifan Gao [email protected] wrote:

建议将这批机器淘汰掉,已经有故障的征兆了.....

3号节点已经失联了 #67 https://github.com/ustclug/discussions/issues/67

许多虚拟机内核日志中出现CPU stall:

[Fri Nov 18 01:37:08 2016] INFO: rcu_sched self-detected stall on CPU [Fri Nov 18 01:37:08 2016] INFO: rcu_sched detected stalls on CPUs/tasks: [Fri Nov 18 01:37:08 2016] { [Fri Nov 18 01:37:08 2016] 0 [Fri Nov 18 01:37:08 2016] 1 [Fri Nov 18 01:37:08 2016] 2 [Fri Nov 18 01:37:08 2016] 3 [Fri Nov 18 01:37:08 2016] 4 [Fri Nov 18 01:37:08 2016] 6 [Fri Nov 18 01:37:08 2016] 7 [Fri Nov 18 01:37:08 2016] } [Fri Nov 18 01:37:08 2016] (detected by 5, t=10049 jiffies, g=35438838, c=35438837, q=207) [Fri Nov 18 01:37:08 2016] sending NMI to all CPUs: [Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 5 [Fri Nov 18 01:37:08 2016] CPU: 5 PID: 15373 Comm: bundle Tainted: G C 3.16.7-ckt11+deb8u6-ustclugsigned #1 [Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 [Fri Nov 18 01:37:08 2016] task: ffff880139a46010 ti: ffff88012248c000 task.ti: ffff88012248c000 [Fri Nov 18 01:37:08 2016] RIP: 0010:[] [Fri Nov 18 01:37:08 2016] [] native_write_msr_safe+0x6/0x10 [Fri Nov 18 01:37:08 2016] RSP: 0000:ffff88013fd43df8 EFLAGS: 00000046 [Fri Nov 18 01:37:08 2016] RAX: 0000000000000400 RBX: 0000000000000002 RCX: 0000000000000830 [Fri Nov 18 01:37:08 2016] RDX: 000000000000000a RSI: 0000000000000400 RDI: 0000000000000830 [Fri Nov 18 01:37:08 2016] RBP: 0000000000000005 R08: ffffffff818eff40 R09: 0000000000000018 [Fri Nov 18 01:37:08 2016] R10: 00124faecb387080 R11: 3a73555043206c6c R12: ffffffff818eff40 [Fri Nov 18 01:37:08 2016] R13: 0000000000000005 R14: 000000000000a10a R15: 0000000000080000 [Fri Nov 18 01:37:08 2016] FS: 00007fab46bc7740(0000) GS:ffff88013fd40000(0000) knlGS:0000000000000000 [Fri Nov 18 01:37:08 2016] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [Fri Nov 18 01:37:08 2016] CR2: 0000000001e01578 CR3: 0000000114da1000 CR4: 00000000000007e0 [Fri Nov 18 01:37:08 2016] Stack: [Fri Nov 18 01:37:08 2016] ffffffff8104a82b [Fri Nov 18 01:37:08 2016] 0000000000000002 [Fri Nov 18 01:37:08 2016] 0000000000000086 [Fri Nov 18 01:37:08 2016] ffff88013fd4d880

[Fri Nov 18 01:37:08 2016] ffffffff81856a00 [Fri Nov 18 01:37:08 2016] 0000000000000005 [Fri Nov 18 01:37:08 2016] ffffffff818f0500 [Fri Nov 18 01:37:08 2016] 00000000000000cf

[Fri Nov 18 01:37:08 2016] ffffffff81856a00 [Fri Nov 18 01:37:08 2016] ffffffff8104746e [Fri Nov 18 01:37:08 2016] ffff88013fd4d880 [Fri Nov 18 01:37:08 2016] ffffffff810c7f65

[Fri Nov 18 01:37:08 2016] Call Trace: [Fri Nov 18 01:37:08 2016] <IRQ>

[Fri Nov 18 01:37:08 2016] [] ? __x2apic_send_IPI_mask+0xab/0xd0

[Fri Nov 18 01:37:08 2016] [] ? arch_trigger_all_cpu_backtrace+0x12e/0x140

[Fri Nov 18 01:37:08 2016] [] ? rcu_check_callbacks+0x615/0x640

[Fri Nov 18 01:37:08 2016] [] ? tick_sched_handle.isra.16+0x60/0x60

[Fri Nov 18 01:37:08 2016] [] ? update_process_times+0x40/0x70

[Fri Nov 18 01:37:08 2016] [] ? tick_sched_handle.isra.16+0x20/0x60

[Fri Nov 18 01:37:08 2016] [] ? tick_sched_timer+0x3c/0x60

[Fri Nov 18 01:37:08 2016] [] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016] [] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016] [] ? apic_timer_interrupt+0x6d/0x80 [Fri Nov 18 01:37:08 2016] <EOI> [Fri Nov 18 01:37:08 2016] Code: [Fri Nov 18 01:37:08 2016] d0 [Fri Nov 18 01:37:08 2016] c3 [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] 1f [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] f9 [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] 32 [Fri Nov 18 01:37:08 2016] 45 [Fri Nov 18 01:37:08 2016] 31 [Fri Nov 18 01:37:08 2016] c0 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] d7 [Fri Nov 18 01:37:08 2016] 44 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 06 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] c6 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] c1 [Fri Nov 18 01:37:08 2016] e7 [Fri Nov 18 01:37:08 2016] 20 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] f8 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 09 [Fri Nov 18 01:37:08 2016] f0 [Fri Nov 18 01:37:08 2016] c3 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] 1f [Fri Nov 18 01:37:08 2016] 44 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] f0 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] f9 [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] 30 [Fri Nov 18 01:37:08 2016] <31> [Fri Nov 18 01:37:08 2016] c0 [Fri Nov 18 01:37:08 2016] c3 [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] 1f [Fri Nov 18 01:37:08 2016] 80 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] f9 [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] 33 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] d7 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] c1 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] c1

[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 2 [Fri Nov 18 01:37:08 2016] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G C 3.16.7-ckt11+deb8u6-ustclugsigned #1 [Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 [Fri Nov 18 01:37:08 2016] task: ffff880139fce0d0 ti: ffff880139fdc000 task.ti: ffff880139fdc000 [Fri Nov 18 01:37:08 2016] RIP: 0010:[] [Fri Nov 18 01:37:08 2016] [] update_curr+0xd/0x120 [Fri Nov 18 01:37:08 2016] RSP: 0018:ffff88013fc83e10 EFLAGS: 00010002 [Fri Nov 18 01:37:08 2016] RAX: ffff8800ba510b18 RBX: ffff880122526dc0 RCX: ffff8800ba510b08 [Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff8800b8a14c00 [Fri Nov 18 01:37:08 2016] RBP: ffff8800b8a14c00 R08: 0000000000000000 R09: 0000000000000001 [Fri Nov 18 01:37:08 2016] R10: 00124faecb387080 R11: 0000000000000010 R12: ffff88013fc93380 [Fri Nov 18 01:37:08 2016] R13: 0000000000000400 R14: 0000000000000001 R15: 0000000000000000 [Fri Nov 18 01:37:08 2016] FS: 0000000000000000(0000) GS:ffff88013fc80000(0000) knlGS:0000000000000000 [Fri Nov 18 01:37:08 2016] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [Fri Nov 18 01:37:08 2016] CR2: 00007f7de9005ef8 CR3: 00000000baf13000 CR4: 00000000000007e0 [Fri Nov 18 01:37:08 2016] Stack: [Fri Nov 18 01:37:08 2016] ffff880122526dc0 [Fri Nov 18 01:37:08 2016] ffff8800b8a14c00 [Fri Nov 18 01:37:08 2016] ffff88013fc93380 [Fri Nov 18 01:37:08 2016] 0000000000000400

[Fri Nov 18 01:37:08 2016] 0000000000000001 [Fri Nov 18 01:37:08 2016] ffffffff810a001c [Fri Nov 18 01:37:08 2016] ffff88013fc93380 [Fri Nov 18 01:37:08 2016] ffff88013fc93380

[Fri Nov 18 01:37:08 2016] ffff88013fc93380 [Fri Nov 18 01:37:08 2016] ffffffff8101c0b5 [Fri Nov 18 01:37:08 2016] ffff8800ba510aa0 [Fri Nov 18 01:37:08 2016] ffff88013fc93380

[Fri Nov 18 01:37:08 2016] Call Trace: [Fri Nov 18 01:37:08 2016] <IRQ>

[Fri Nov 18 01:37:08 2016] [] ? enqueue_task_fair+0x6c/0xf20

[Fri Nov 18 01:37:08 2016] [] ? sched_clock+0x5/0x10

[Fri Nov 18 01:37:08 2016] [] ? ttwu_do_activate.constprop.97+0x2e/0x60

[Fri Nov 18 01:37:08 2016] [] ? try_to_wake_up+0x1ed/0x310

[Fri Nov 18 01:37:08 2016] [] ? timerqueue_del+0x1e/0x70

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_get_res+0x50/0x50

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_wakeup+0x1e/0x30

[Fri Nov 18 01:37:08 2016] [] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016] [] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016] [] ? apic_timer_interrupt+0x6d/0x80 [Fri Nov 18 01:37:08 2016] <EOI>

[Fri Nov 18 01:37:08 2016] [] ? idle_notifier_unregister+0x20/0x20

[Fri Nov 18 01:37:08 2016] [] ? native_safe_halt+0x2/0x10

[Fri Nov 18 01:37:08 2016] [] ? default_idle+0x19/0xb0

[Fri Nov 18 01:37:08 2016] [] ? cpu_startup_entry+0x38f/0x460

[Fri Nov 18 01:37:08 2016] [] ? tick_check_new_device+0xd0/0xf0

[Fri Nov 18 01:37:08 2016] [] ? start_secondary+0x22f/0x2c0 [Fri Nov 18 01:37:08 2016] Code: [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 4e [Fri Nov 18 01:37:08 2016] 28 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 56 [Fri Nov 18 01:37:08 2016] 30 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 51 [Fri Nov 18 01:37:08 2016] 08 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 0a [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 46 [Fri Nov 18 01:37:08 2016] 28 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 46 [Fri Nov 18 01:37:08 2016] 30 [Fri Nov 18 01:37:08 2016] 83 [Fri Nov 18 01:37:08 2016] 6f [Fri Nov 18 01:37:08 2016] 10 [Fri Nov 18 01:37:08 2016] 01 [Fri Nov 18 01:37:08 2016] c3 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 90 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 90 [Fri Nov 18 01:37:08 2016] 41 [Fri Nov 18 01:37:08 2016] 56 [Fri Nov 18 01:37:08 2016] 41 [Fri Nov 18 01:37:08 2016] 55 [Fri Nov 18 01:37:08 2016] 41 [Fri Nov 18 01:37:08 2016] 54 [Fri Nov 18 01:37:08 2016] 55 [Fri Nov 18 01:37:08 2016] 53 [Fri Nov 18 01:37:08 2016] <48> [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 5f [Fri Nov 18 01:37:08 2016] 38 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 87 [Fri Nov 18 01:37:08 2016] b0 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 85 [Fri Nov 18 01:37:08 2016] db [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 80 [Fri Nov 18 01:37:08 2016] a8 [Fri Nov 18 01:37:08 2016] 08 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00

[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 0 [Fri Nov 18 01:37:08 2016] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G C 3.16.7-ckt11+deb8u6-ustclugsigned #1 [Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 [Fri Nov 18 01:37:08 2016] task: ffffffff81819500 ti: ffffffff81800000 task.ti: ffffffff81800000 [Fri Nov 18 01:37:08 2016] RIP: 0010:[] [Fri Nov 18 01:37:08 2016] [] update_cfs_shares+0x25/0xd0 [Fri Nov 18 01:37:08 2016] RSP: 0018:ffff88013fc03e20 EFLAGS: 00010002 [Fri Nov 18 01:37:08 2016] RAX: ffff8800b8c2f5c0 RBX: ffff88004985f940 RCX: ffff8800b8f5e600 [Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: ffff88004985f940 RDI: ffff8800ba7e1100 [Fri Nov 18 01:37:08 2016] RBP: ffff8800ba7e1100 R08: ffffffffffffffff R09: 0000000000000000 [Fri Nov 18 01:37:08 2016] R10: 00124faecb387080 R11: 0000000000000010 R12: ffff88013fc13380 [Fri Nov 18 01:37:08 2016] R13: 0000000000000400 R14: 0000000000000000 R15: ffff88007b196200 [Fri Nov 18 01:37:08 2016] FS: 0000000000000000(0000) GS:ffff88013fc00000(0000) knlGS:0000000000000000 [Fri Nov 18 01:37:08 2016] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [Fri Nov 18 01:37:08 2016] CR2: 00007f7deaf82bb0 CR3: 000000007b3e0000 CR4: 00000000000007f0 [Fri Nov 18 01:37:08 2016] Stack: [Fri Nov 18 01:37:08 2016] ffff88004985f940 [Fri Nov 18 01:37:08 2016] ffff8800ba7e1100 [Fri Nov 18 01:37:08 2016] ffff88013fc13380 [Fri Nov 18 01:37:08 2016] ffffffff810a029b

[Fri Nov 18 01:37:08 2016] 000000000000010d [Fri Nov 18 01:37:08 2016] ffff88013fc13380 [Fri Nov 18 01:37:08 2016] ffff88013fc13380 [Fri Nov 18 01:37:08 2016] ffffffff8101c0b5

[Fri Nov 18 01:37:08 2016] ffff8800571952b0 [Fri Nov 18 01:37:08 2016] ffff88013fc13380 [Fri Nov 18 01:37:08 2016] ffff88013fc13380 [Fri Nov 18 01:37:08 2016] 0000000000000046

[Fri Nov 18 01:37:08 2016] Call Trace: [Fri Nov 18 01:37:08 2016] <IRQ>

[Fri Nov 18 01:37:08 2016] [] ? enqueue_task_fair+0x2eb/0xf20

[Fri Nov 18 01:37:08 2016] [] ? sched_clock+0x5/0x10

[Fri Nov 18 01:37:08 2016] [] ? ttwu_do_activate.constprop.97+0x2e/0x60

[Fri Nov 18 01:37:08 2016] [] ? try_to_wake_up+0x1ed/0x310

[Fri Nov 18 01:37:08 2016] [] ? timerqueue_del+0x1e/0x70

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_get_res+0x50/0x50

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_wakeup+0x1e/0x30

[Fri Nov 18 01:37:08 2016] [] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016] [] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016] [] ? apic_timer_interrupt+0x6d/0x80 [Fri Nov 18 01:37:08 2016] <EOI>

[Fri Nov 18 01:37:08 2016] [] ? idle_notifier_unregister+0x20/0x20

[Fri Nov 18 01:37:08 2016] [] ? native_safe_halt+0x2/0x10

[Fri Nov 18 01:37:08 2016] [] ? default_idle+0x19/0xb0

[Fri Nov 18 01:37:08 2016] [] ? cpu_startup_entry+0x38f/0x460

[Fri Nov 18 01:37:08 2016] [] ? start_kernel+0x46e/0x476

[Fri Nov 18 01:37:08 2016] [] ? early_idt_handlers+0x120/0x120

[Fri Nov 18 01:37:08 2016] [] ? x86_64_start_kernel+0x14d/0x15c [Fri Nov 18 01:37:08 2016] Code: [Fri Nov 18 01:37:08 2016] 84 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 90 [Fri Nov 18 01:37:08 2016] 41 [Fri Nov 18 01:37:08 2016] 54 [Fri Nov 18 01:37:08 2016] 55 [Fri Nov 18 01:37:08 2016] 53 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 87 [Fri Nov 18 01:37:08 2016] b0 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 8f [Fri Nov 18 01:37:08 2016] d0 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 63 [Fri Nov 18 01:37:08 2016] 90 [Fri Nov 18 01:37:08 2016] 08 [Fri Nov 18 01:37:08 2016] 09 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 81 [Fri Nov 18 01:37:08 2016] a8 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] <48> [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 2c [Fri Nov 18 01:37:08 2016] d0 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 85 [Fri Nov 18 01:37:08 2016] ed [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] 84 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 07 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 91 [Fri Nov 18 01:37:08 2016] c0 [Fri Nov 18 01:37:08 2016] 00

[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 3 [Fri Nov 18 01:37:08 2016] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G C 3.16.7-ckt11+deb8u6-ustclugsigned #1 [Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 [Fri Nov 18 01:37:08 2016] task: ffff880139fd73b0 ti: ffff880139fe0000 task.ti: ffff880139fe0000 [Fri Nov 18 01:37:08 2016] RIP: 0010:[] [Fri Nov 18 01:37:08 2016] [] vt_console_print+0x18a/0x400 [Fri Nov 18 01:37:08 2016] RSP: 0018:ffff88013fcc3cd0 EFLAGS: 00000006 [Fri Nov 18 01:37:08 2016] RAX: 0000000000000735 RBX: ffff88013f01e400 RCX: 0000000000000046 [Fri Nov 18 01:37:08 2016] RDX: ffff8800000b970c RSI: 0000000000000003 RDI: ffffffff81aeccb0 [Fri Nov 18 01:37:08 2016] RBP: 0000000000000035 R08: 0000000000000000 R09: ffff8800000b96f6 [Fri Nov 18 01:37:08 2016] R10: 6c6c617473206400 R11: 7463657465642064 R12: 000000000000000c [Fri Nov 18 01:37:08 2016] R13: ffffffff81a7cc4c R14: ffffffff81a7cc7f R15: 0000000000000000 [Fri Nov 18 01:37:08 2016] FS: 0000000000000000(0000) GS:ffff88013fcc0000(0000) knlGS:0000000000000000 [Fri Nov 18 01:37:08 2016] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [Fri Nov 18 01:37:08 2016] CR2: 0000000000699050 CR3: 000000007e5c6000 CR4: 00000000000007e0 [Fri Nov 18 01:37:08 2016] Stack: [Fri Nov 18 01:37:08 2016] ffff8800000b96f6 [Fri Nov 18 01:37:08 2016] 000000460000002e [Fri Nov 18 01:37:08 2016] ffff88013f01e400 [Fri Nov 18 01:37:08 2016] 0000000000000038

[Fri Nov 18 01:37:08 2016] ffffffff818afd80 [Fri Nov 18 01:37:08 2016] 000000000000003f [Fri Nov 18 01:37:08 2016] ffffffff818f04c0 [Fri Nov 18 01:37:08 2016] ffffffff81a7fdb4

[Fri Nov 18 01:37:08 2016] 0000000000000000 [Fri Nov 18 01:37:08 2016] 0000000000000003 [Fri Nov 18 01:37:08 2016] ffffffff810ba3ba [Fri Nov 18 01:37:08 2016] 0000000000000046

[Fri Nov 18 01:37:08 2016] Call Trace: [Fri Nov 18 01:37:08 2016] <IRQ>

[Fri Nov 18 01:37:08 2016] [] ? call_console_drivers.constprop.24+0x9a/0xe0

[Fri Nov 18 01:37:08 2016] [] ? console_unlock+0x361/0x410

[Fri Nov 18 01:37:08 2016] [] ? vprintk_emit+0x310/0x580

[Fri Nov 18 01:37:08 2016] [] ? printk+0x4f/0x57

[Fri Nov 18 01:37:08 2016] [] ? rcu_check_callbacks+0x33f/0x640

[Fri Nov 18 01:37:08 2016] [] ? ttwu_do_wakeup+0x36/0xd0

[Fri Nov 18 01:37:08 2016] [] ? tick_sched_handle.isra.16+0x60/0x60

[Fri Nov 18 01:37:08 2016] [] ? update_process_times+0x40/0x70

[Fri Nov 18 01:37:08 2016] [] ? tick_sched_handle.isra.16+0x20/0x60

[Fri Nov 18 01:37:08 2016] [] ? tick_sched_timer+0x3c/0x60

[Fri Nov 18 01:37:08 2016] [] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016] [] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016] [] ? apic_timer_interrupt+0x6d/0x80 [Fri Nov 18 01:37:08 2016] <EOI>

[Fri Nov 18 01:37:08 2016] [] ? idle_notifier_unregister+0x20/0x20

[Fri Nov 18 01:37:08 2016] [] ? native_safe_halt+0x2/0x10

[Fri Nov 18 01:37:08 2016] [] ? default_idle+0x19/0xb0

[Fri Nov 18 01:37:08 2016] [] ? cpu_startup_entry+0x38f/0x460

[Fri Nov 18 01:37:08 2016] [] ? tick_check_new_device+0xd0/0xf0

[Fri Nov 18 01:37:08 2016] [] ? start_secondary+0x22f/0x2c0 [Fri Nov 18 01:37:08 2016] Code: [Fri Nov 18 01:37:08 2016] 41 [Fri Nov 18 01:37:08 2016] 83 [Fri Nov 18 01:37:08 2016] c4 [Fri Nov 18 01:37:08 2016] 01 [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] b6 [Fri Nov 18 01:37:08 2016] 83 [Fri Nov 18 01:37:08 2016] c5 [Fri Nov 18 01:37:08 2016] 01 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 40 [Fri Nov 18 01:37:08 2016] 0f [Fri Nov 18 01:37:08 2016] b6 [Fri Nov 18 01:37:08 2016] f5 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] c7 [Fri Nov 18 01:37:08 2016] c7 [Fri Nov 18 01:37:08 2016] b0 [Fri Nov 18 01:37:08 2016] cc [Fri Nov 18 01:37:08 2016] ae [Fri Nov 18 01:37:08 2016] 81 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 4c [Fri Nov 18 01:37:08 2016] 24 [Fri Nov 18 01:37:08 2016] 0c [Fri Nov 18 01:37:08 2016] 4c [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 0c [Fri Nov 18 01:37:08 2016] 24 [Fri Nov 18 01:37:08 2016] c1 [Fri Nov 18 01:37:08 2016] e0 [Fri Nov 18 01:37:08 2016] 08 [Fri Nov 18 01:37:08 2016] 01 [Fri Nov 18 01:37:08 2016] f0 [Fri Nov 18 01:37:08 2016] be [Fri Nov 18 01:37:08 2016] 03 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 02 [Fri Nov 18 01:37:08 2016] <48> [Fri Nov 18 01:37:08 2016] 8d [Fri Nov 18 01:37:08 2016] 54 [Fri Nov 18 01:37:08 2016] 24 [Fri Nov 18 01:37:08 2016] 10 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 5c [Fri Nov 18 01:37:08 2016] 24 [Fri Nov 18 01:37:08 2016] 10 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 6c [Fri Nov 18 01:37:08 2016] 24 [Fri Nov 18 01:37:08 2016] 18 [Fri Nov 18 01:37:08 2016] e8 [Fri Nov 18 01:37:08 2016] 33 [Fri Nov 18 01:37:08 2016] f4 [Fri Nov 18 01:37:08 2016] cf [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 4c

[Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 1 [Fri Nov 18 01:37:08 2016] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G C 3.16.7-ckt11+deb8u6-ustclugsigned #1 [Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 [Fri Nov 18 01:37:08 2016] task: ffff880139fcea20 ti: ffff880139fd8000 task.ti: ffff880139fd8000 [Fri Nov 18 01:37:08 2016] RIP: 0010:[] [Fri Nov 18 01:37:08 2016] [] wake_up_process+0x6/0x50 [Fri Nov 18 01:37:08 2016] RSP: 0018:ffff88013fc43ee8 EFLAGS: 00010086 [Fri Nov 18 01:37:08 2016] RAX: ffff88010e88b968 RBX: ffff88010e88b968 RCX: ffff88012b47f968 [Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: ffff88013fc4d350 RDI: ffff880129cd93f0 [Fri Nov 18 01:37:08 2016] RBP: 0000000000000078 R08: 0000000000000000 R09: 0000000000000000 [Fri Nov 18 01:37:08 2016] R10: 00124faecb387080 R11: 0000000000000010 R12: ffff88013fc4d300 [Fri Nov 18 01:37:08 2016] R13: ffff88013fc4d340 R14: ffff88013fc43f68 R15: ffffffff8108c850 [Fri Nov 18 01:37:08 2016] FS: 0000000000000000(0000) GS:ffff88013fc40000(0000) knlGS:0000000000000000 [Fri Nov 18 01:37:08 2016] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [Fri Nov 18 01:37:08 2016] CR2: 00007f7df07ac708 CR3: 0000000083e0a000 CR4: 00000000000007e0 [Fri Nov 18 01:37:08 2016] Stack: [Fri Nov 18 01:37:08 2016] ffff88010e88b968 [Fri Nov 18 01:37:08 2016] ffffffff8108c86e [Fri Nov 18 01:37:08 2016] ffffffff8108cef7 [Fri Nov 18 01:37:08 2016] ffff88013fc4d300

[Fri Nov 18 01:37:08 2016] 0000000000000078 [Fri Nov 18 01:37:08 2016] 0000000000000000 [Fri Nov 18 01:37:08 2016] ffff88013fc4d378 [Fri Nov 18 01:37:08 2016] 7fffffffffffffff

[Fri Nov 18 01:37:08 2016] 000757c9a1071a66 [Fri Nov 18 01:37:08 2016] ffffffff8108d2b9 [Fri Nov 18 01:37:08 2016] ffff88013fc4d378 [Fri Nov 18 01:37:08 2016] 00000003583498e8

[Fri Nov 18 01:37:08 2016] Call Trace: [Fri Nov 18 01:37:08 2016] <IRQ>

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_wakeup+0x1e/0x30

[Fri Nov 18 01:37:08 2016] [] ? __run_hrtimer+0x67/0x1c0

[Fri Nov 18 01:37:08 2016] [] ? hrtimer_interrupt+0xf9/0x230

[Fri Nov 18 01:37:08 2016] [] ? smp_apic_timer_interrupt+0x3b/0x50

[Fri Nov 18 01:37:08 2016] [] ? apic_timer_interrupt+0x6d/0x80 [Fri Nov 18 01:37:08 2016] <EOI>

[Fri Nov 18 01:37:08 2016] [] ? idle_notifier_unregister+0x20/0x20

[Fri Nov 18 01:37:08 2016] [] ? native_safe_halt+0x2/0x10

[Fri Nov 18 01:37:08 2016] [] ? default_idle+0x19/0xb0

[Fri Nov 18 01:37:08 2016] [] ? cpu_startup_entry+0x38f/0x460

[Fri Nov 18 01:37:08 2016] [] ? tick_check_new_device+0xd0/0xf0

[Fri Nov 18 01:37:08 2016] [] ? start_secondary+0x22f/0x2c0 [Fri Nov 18 01:37:08 2016] Code: [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] d0 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 03 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 85 [Fri Nov 18 01:37:08 2016] c0 [Fri Nov 18 01:37:08 2016] 75 [Fri Nov 18 01:37:08 2016] eb [Fri Nov 18 01:37:08 2016] e9 [Fri Nov 18 01:37:08 2016] f9 [Fri Nov 18 01:37:08 2016] fe [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] 4c [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] 0c [Fri Nov 18 01:37:08 2016] 24 [Fri Nov 18 01:37:08 2016] e8 [Fri Nov 18 01:37:08 2016] ca [Fri Nov 18 01:37:08 2016] 97 [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 0c [Fri Nov 18 01:37:08 2016] 24 [Fri Nov 18 01:37:08 2016] e9 [Fri Nov 18 01:37:08 2016] a5 [Fri Nov 18 01:37:08 2016] fd [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] ff [Fri Nov 18 01:37:08 2016] 90 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 66 [Fri Nov 18 01:37:08 2016] 90 [Fri Nov 18 01:37:08 2016] 53 [Fri Nov 18 01:37:08 2016] <48> [Fri Nov 18 01:37:08 2016] 8b [Fri Nov 18 01:37:08 2016] 07 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] fb [Fri Nov 18 01:37:08 2016] a8 [Fri Nov 18 01:37:08 2016] 0c [Fri Nov 18 01:37:08 2016] 75 [Fri Nov 18 01:37:08 2016] 10 [Fri Nov 18 01:37:08 2016] 48 [Fri Nov 18 01:37:08 2016] 89 [Fri Nov 18 01:37:08 2016] df [Fri Nov 18 01:37:08 2016] 31 [Fri Nov 18 01:37:08 2016] d2 [Fri Nov 18 01:37:08 2016] be [Fri Nov 18 01:37:08 2016] 03 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 00 [Fri Nov 18 01:37:08 2016] 5b

[Fri Nov 18 01:37:08 2016] { [Fri Nov 18 01:37:08 2016] 3} (t=10049 jiffies g=35438838 c=35438837 q=216) [Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 6 [Fri Nov 18 01:37:08 2016] CPU: 6 PID: 0 Comm: swapper/6 Tainted: G C 3.16.7-ckt11+deb8u6-ustclugsigned #1 [Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 [Fri Nov 18 01:37:08 2016] task: ffff880139ff13f0 ti: ffff880139ff4000 task.ti: ffff880139ff4000 [Fri Nov 18 01:37:08 2016] RIP: 0010:[] [] native_safe_halt+0x2/0x10 [Fri Nov 18 01:37:08 2016] RSP: 0018:ffff880139ff7ec8 EFLAGS: 00000246 [Fri Nov 18 01:37:08 2016] RAX: ffffffff8101cfc0 RBX: ffffffff818f04c0 RCX: ffffffff818584a0 [Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 [Fri Nov 18 01:37:08 2016] RBP: 0000000000000006 R08: 0000000000000000 R09: 0000000000000000 [Fri Nov 18 01:37:08 2016] R10: 00124f9778175ab8 R11: 0000000000000000 R12: ffff880139ff4000 [Fri Nov 18 01:37:08 2016] R13: 0000000000000000 R14: 00000000ffffffed R15: ffff880139ff7fd8 [Fri Nov 18 01:37:08 2016] FS: 0000000000000000(0000) GS:ffff88013fd80000(0000) knlGS:0000000000000000 [Fri Nov 18 01:37:08 2016] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [Fri Nov 18 01:37:08 2016] CR2: 0000000001de4538 CR3: 0000000001812000 CR4: 00000000000007e0 [Fri Nov 18 01:37:08 2016] Stack: [Fri Nov 18 01:37:08 2016] ffffffff8101cfd9 ffffffff818f04c0 0000000000000000 ffffffff810aa88f [Fri Nov 18 01:37:08 2016] ffff880139ff4000 ffff880139ff4000 ffff880139ff7fd8 ffffffff810d11c0 [Fri Nov 18 01:37:08 2016] f5af525e37240ad8 0000000000000000 0000000000000000 0000000000000000 [Fri Nov 18 01:37:08 2016] Call Trace: [Fri Nov 18 01:37:08 2016] [] ? default_idle+0x19/0xb0 [Fri Nov 18 01:37:08 2016] [] ? cpu_startup_entry+0x38f/0x460 [Fri Nov 18 01:37:08 2016] [] ? tick_check_new_device+0xd0/0xf0 [Fri Nov 18 01:37:08 2016] [] ? start_secondary+0x22f/0x2c0 [Fri Nov 18 01:37:08 2016] Code: 2e 0f 1f 84 00 00 00 00 00 fa c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fb c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fb f4 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 f4 c3 66 66 66 66 66 [Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 4 [Fri Nov 18 01:37:08 2016] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G C 3.16.7-ckt11+deb8u6-ustclugsigned #1 [Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 [Fri Nov 18 01:37:08 2016] task: ffff880139fd6a60 ti: ffff880139fe8000 task.ti: ffff880139fe8000 [Fri Nov 18 01:37:08 2016] RIP: 0010:[] [] native_safe_halt+0x2/0x10 [Fri Nov 18 01:37:08 2016] RSP: 0018:ffff880139febec8 EFLAGS: 00000246 [Fri Nov 18 01:37:08 2016] RAX: ffffffff8101cfc0 RBX: ffffffff818f04c0 RCX: ffffffff818584a0 [Fri Nov 18 01:37:08 2016] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 [Fri Nov 18 01:37:08 2016] RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000000 [Fri Nov 18 01:37:08 2016] R10: 00124f9774861da8 R11: 0000000000000000 R12: ffff880139fe8000 [Fri Nov 18 01:37:08 2016] R13: 0000000000000000 R14: 00000000ffffffed R15: ffff880139febfd8 [Fri Nov 18 01:37:08 2016] FS: 0000000000000000(0000) GS:ffff88013fd00000(0000) knlGS:0000000000000000 [Fri Nov 18 01:37:08 2016] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [Fri Nov 18 01:37:08 2016] CR2: 00007f58bc285000 CR3: 00000000baf13000 CR4: 00000000000007e0 [Fri Nov 18 01:37:08 2016] Stack: [Fri Nov 18 01:37:08 2016] ffffffff8101cfd9 ffffffff818f04c0 0000000000000000 ffffffff810aa88f [Fri Nov 18 01:37:08 2016] ffff880139fe8000 ffff880139fe8000 ffff880139febfd8 ffffffff810d11c0 [Fri Nov 18 01:37:08 2016] bc955c916e880c24 0000000000000000 0000000000000000 0000000000000000 [Fri Nov 18 01:37:08 2016] Call Trace: [Fri Nov 18 01:37:08 2016] [] ? default_idle+0x19/0xb0 [Fri Nov 18 01:37:08 2016] [] ? cpu_startup_entry+0x38f/0x460 [Fri Nov 18 01:37:08 2016] [] ? tick_check_new_device+0xd0/0xf0 [Fri Nov 18 01:37:08 2016] [] ? start_secondary+0x22f/0x2c0 [Fri Nov 18 01:37:08 2016] Code: 2e 0f 1f 84 00 00 00 00 00 fa c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fb c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fb f4 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 f4 c3 66 66 66 66 66 [Fri Nov 18 01:37:08 2016] NMI backtrace for cpu 7 [Fri Nov 18 01:37:08 2016] CPU: 7 PID: 578 Comm: vmtoolsd Tainted: G C 3.16.7-ckt11+deb8u6-ustclugsigned #1 [Fri Nov 18 01:37:08 2016] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 [Fri Nov 18 01:37:08 2016] task: ffff8800366f3370 ti: ffff8800b8a24000 task.ti: ffff8800b8a24000 [Fri Nov 18 01:37:08 2016] RIP: 0033:[<00007f691933b1ad>] [<00007f691933b1ad>] 0x7f691933b1ad [Fri Nov 18 01:37:08 2016] RSP: 002b:00007ffdcc3bfcc8 EFLAGS: 00000246 [Fri Nov 18 01:37:08 2016] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000001001e [Fri Nov 18 01:37:08 2016] RDX: 00007ffd00005658 RSI: 00000000e550ff84 RDI: 00000000b04ea69d [Fri Nov 18 01:37:08 2016] RBP: 000000000000000a R08: 0000000000000001 R09: 000000000000001e [Fri Nov 18 01:37:08 2016] R10: 0000000000000020 R11: 0000000000000246 R12: 00007ffdcc3bfcf0 [Fri Nov 18 01:37:08 2016] R13: 0000000000000000 R14: 0000000000000000 R15: 00007f69193355b0 [Fri Nov 18 01:37:08 2016] FS: 00007f69197b4740(0000) GS:ffff88013fdc0000(0000) knlGS:0000000000000000 [Fri Nov 18 01:37:08 2016] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [Fri Nov 18 01:37:08 2016] CR2: 00007f69197c5000 CR3: 00000000bae1e000 CR4: 00000000000007e0

[Fri Nov 18 01:37:08 2016] systemd[1]: Starting Journal Service... [Fri Nov 18 01:37:08 2016] systemd-journald[14500]: Received SIGTERM from PID 1 (systemd). [Fri Nov 18 01:37:08 2016] systemd[1]: Unit systemd-journald.service entered failed state. [Fri Nov 18 01:37:08 2016] systemd[1]: systemd-journald.service has no holdoff time, scheduling restart. [Fri Nov 18 01:37:08 2016] systemd[1]: Stopping Journal Service... [Fri Nov 18 01:37:08 2016] systemd[1]: Starting Journal Service... [Fri Nov 18 01:37:08 2016] systemd[1]: Started Journal Service. [Fri Nov 18 01:37:08 2016] systemd-journald[15379]: Received request to flush runtime journal from PID 1

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ustclug/discussions/issues/59#issuecomment-262957347, or mute the thread https://github.com/notifications/unsubscribe-auth/ABWx4bXBmdNWGXyAQGsJZRDHqii404b9ks5rBuKJgaJpZM4K3e8y .

bojieli avatar Nov 25 '16 15:11 bojieli

freeshell 处于半死不活的状态,要不要把这批机器作为新的 vcenter 呢?

ESXi不怎么挑硬件,应该是可行的。

gaoyifan avatar Nov 26 '16 04:11 gaoyifan

freeshell 处于半死不活的状态,要不要把这批机器作为新的 vcenter 呢?

可行,短时间内可以一续

现在少院 freeshell 集群是否有硬件故障发生?这批机器也挺老的(2009),不过当年少院是作为小超算买的,稳定性可能稍微好些。

一号结点报过BIOS firmware BUG其它结点还好

迁移vcenter很折腾的,还有一个问题是freeshell的硬盘位(一个机器两个)只认2T空间,多了不认 这个问题是上次想用freeshell拷贝tuna寄来的硬盘时发现的。此外,考虑服役时间、硬件年龄、机房条件,我不认为是个好方案,极有可能花大力气弄好结果撑不住多久。 此外,@gaoyifan 猜你不想踩这个坑了吧,派谁踩呢? 上次给james发邮件没有问出来有没有要/已经报废的机器,我觉得追问一下? 认为还是找那种刚退役的机器比较合适。不过想不到什么地方有而且愿意给。

PS:假期在许老师实验室听到他们要买一批新机器跑实验,不知道是本身不够用还是要淘汰旧的。 我们要不要在bbs上发消息(或者其他方式找这种实验室),再用vpn换报废机器?

Alkaid-Benetnash avatar Nov 26 '16 04:11 Alkaid-Benetnash

@Alkaid Freeshell 的硬盘位只支持 2T 啊,这也是太老了……我赞同你的提议,尽量去找一些稍微新一些的来,不要折腾这些老服务器了。

sonnie 很久之前说过图书馆有空闲的退役服务器,要不要去问问?还有科大云,两年前升级到新版的时候也应该退休了一批服务器。上次 james 没有提报废机器,可能是 james 认为买新机器更适合 mirrors 这种比较重要、负载又高的服务,可以再追问一下。我感觉做云计算、高性能计算相关的实验室淘汰下来的机器配置应该是不错的。

bojieli avatar Nov 26 '16 07:11 bojieli

那就分成三条线并行走吧

  • [ ] 向james追问
  • [ ] 问sonnie
  • [ ] 发bbs通知找找实验室

有人自告奋勇干一项吗😲

Alkaid-Benetnash avatar Nov 27 '16 05:11 Alkaid-Benetnash

Sonnie 上次还跟我闲置刀片、阵列的事情。还说到 Mirrors 机器太旧的话,用图书馆换机器也行。(虽然我说已经要换了,不过当备份或其他服务也好)

只是他忙别的事一直也没捣腾。机器应该是现成的,装系统之类的LUG自己来就好了吧。

cuihaoleo avatar Nov 28 '16 00:11 cuihaoleo

Sonnie似乎非常忙,虽然一直表示有设备,我每次过去也都会问一下,但每次都见不到设备......

gaoyifan avatar Nov 28 '16 01:11 gaoyifan

@Alkaid-Benetnash 之前去配置新mirrors时,james提到下学期可以给我们换一些新服务器。他说旧服务器太不节能了,网络信息中心缺电.......

gaoyifan avatar Jan 23 '17 17:01 gaoyifan

收到,再开学发邮件联系(现在都放假回家了吧)。 网络中心除了mirrors也没有我们其他物理机啊?是要换旧mirrors? 东图的机器也费电,希望sonnie下学期开学不忙。

Alkaid-Benetnash avatar Jan 24 '17 00:01 Alkaid-Benetnash

时过境迁,这批机器(E5420 CPU)已全部下架报废。(虽然目前~~还有 E5620 在服役~~,但是也差不多快要下架报废了)

iBug avatar Jun 18 '24 13:06 iBug

哈哈哈哈,这些机器还能开机?8 年前就已经接近淘汰了,都用了这么多年了竟然还没有坏。

bojieli avatar Jun 19 '24 09:06 bojieli

这些机器还能开机?

实际情况是,2019 年暑假我接手的时候已经坏了一个了,2021 年 3 月又坏了一个。这几年间 yifan 学长和 sonnie 老师陆续送了我们几台淘汰的机器(但都不算太旧),我们有了足够多和足够好的替代品,所以到了 2023 年 7 月,我们就把剩下两台没坏的机器也一起处理掉了(其实它们还能开机)。

iBug avatar Jun 19 '24 09:06 iBug

实际情况是,2019 年暑假我接手的时候已经坏了一个了,2021 年 3 月又坏了一个。这几年间 yifan 学长和 sonnie 老师陆续送了我们几台淘汰的机器(但都不算太旧),我们有了足够多和足够好的替代品,所以到了 2023 年 7 月,我们就把剩下两台没坏的机器也一起处理掉了(其实它们还能开机)。

看起来二手服务器的稳定性比想象的好,我们的 AI serving cluster 也是用一些二手服务器和 4090 搭的,虽然我们的几台二手服务器还没坏过,我还总是担心这些服务器不够稳定,毕竟比新机器便宜太多了。

bojieli avatar Jun 19 '24 10:06 bojieli