Hi Eddie,

For VM BSOD, seems host work well, but guest got something wrong. Can you also share the dump file in VM? BTW, which windows gfx version you used?

For host freeze issue, since demsg can’t get critical log information when got GPU/CPU hang, could you use serial port to capture the log? It may help to show more useful information.

 

 

BRs,

Weinan Li

 

 

From: Eddie Yen [mailto:missile0407@gmail.com]
Sent: Tuesday, September 20, 2016 3:18 PM
To: Li, Weinan Z
Cc: igvt-g@lists.01.org
Subject: Re: [iGVT-g] Host crash in stress test after 60~70 hrs

 

Hi Weinan,

 

I'm following the guide that written in 2016Q2 kernel, so I have to use ignore_loglevel?  The guide is write opposite.

 

And the VM crash, I believe the test crashed and triggered restart itself, because I got BSOD information after reboot into Windows (which is 0x50).

 

Then the "freeze" I mean is, the monitor which connect to computer is stuck at last message, and not response when using keyboard try it type anything.

For example, I'm using watch command to monitoring dmesg message, when host crash at 17:09 PM, the screen will still show the information at 17:09 PM, but I can't type the command anymore, this also means I can't dump the call trace by using command after crash.

 

Regards,

Eddie.

 

2016-09-20 15:00 GMT+08:00 Li, Weinan Z <weinan.z.li@intel.com>:

Hi Eddie:

                I saw your boot option, in KVMGT you should add ‘ignore_loglevel’ in grub if you want to get all the log info. ‘loglvl=all’ is for XenGT.

                In this log, I saw there is one restart of VM2, it’s auto restart? Or your test case trigger auto restart. Could you help to share the event log and dump file in VM2 when you got windows guest trigger reset?

                In your last email you mentioned:

After few days test, I found that the E3V5 host crashed after 60~70 hours, which crashing is "freeze".

Then I checked htop and dmesg watch monitor and found two things:

 

1. There is no error log when crash, only kernel trace about i915 driver when starting VM.

2. When testing, the memory usage is increasing.

I am not sure ‘freeze’ mean, you can still use htop and dmesg after you got ‘freeze’? so host still can response?

Could you help to share the memory utilization when you got ‘freeze’? if you still can run command in this scenario, could you also help to dump the call trace in all CPU cores?

 

 

Thanks.

Best Regards.

Weinan, LI

 

From: iGVT-g [mailto:igvt-g-bounces@lists.01.org] On Behalf Of Eddie Yen
Sent: Tuesday, September 20, 2016 2:39 PM
To: igvt-g@lists.01.org
Subject: Re: [iGVT-g] Host crash in stress test after 60~70 hrs

 

Hello again,

 

One of the VM crashed when running stress test few hours ago, and I got a log when VM restart.

It seems like this VM got GPU reset, and also got debug logging, hope this can help to find out the issue.

 

[67649.826999] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67650.124637] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67650.130541] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67650.132352] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67650.134308] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67650.135824] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67650.137289] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67650.139225] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67650.141005] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67650.142927] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67650.144936] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67684.674266] vGT warning:(vgt_emulate_read:383) vGT: untracked MMIO read: vm_id(2), offset=0x206c,len=4, val=0x0!!!

[67684.674425] ------------------------------------------

[67684.674607] VM(2) likely triggers a gfx reset at 669413051434

[67684.674768] Disable untracked MMIO warning for VM(2)

[67684.674921] ------------------------------------------

[67684.675047] ========vGT DEBUG INFO==========

[67684.675114] CPU[0]: out of vgt

[67684.675188] CPU[1]: out of vgt

[67684.675247] CPU[2]: in vgt

[67684.675321] CPU[3]: out of vgt

[67684.675380] CPU[4]: in vgt

[67684.675454] CPU[5]: out of vgt

[67684.675527] CPU[6]: out of vgt

[67684.675586] CPU[7]: in vgt

[67684.675657] DE_RRMR: 206769e9

[67684.675797] -----------ring-0 info-------------

[67684.675833] VM0   :

[67684.676041] stat(us): sche_in 0, sche_out 601718295346, last_vblank 0

[67684.676081] VM1   :

[67684.676328] stat(us): sche_in 669413030762, sche_out 669413031782, last_vblank 0

[67684.676357] VM2   :

[67684.676602] stat(us): sche_in 669377159364, sche_out 669377160384, last_vblank 0

[67684.676638] VM3(*):

[67684.676883] stat(us): sche_in 669413045486, sche_out 669413043284, last_vblank 0

[67684.676911] VM4   :

[67684.677156] stat(us): sche_in 669413043840, sche_out 669413044859, last_vblank 0

[67684.677384] debug registers,reg maked with <*> may not apply to every ring):

[67684.677465] ....RING_EIR: 00000000

[67684.677553] ....RING_EMR: ffffffff

[67684.677640] ....RING_ESR: 00000000

[67684.677734] ....00002068: 02800000

[67684.677866] ....ACTHD(active header): 2ae03d38

[67684.678000] ....UHPTR(pending header): 00000000

[67684.678086] ....00002078: 3e4f1d38

[67684.678230] ....INSTPS* (parser state): 00000001 :

[67684.678388] ....CSCMDOP* (instruction DWORD): 00000000

[67684.678560] ....CSCMDVLD* (command buffer valid): 00000000

[67684.678616] (informative)

[67684.678738] ....INSTDONE_1(FYI): fffffffe

[67684.678842] ....INSTDONE_2*: 00000000

[67684.678890] Execlist:

[67684.679020] ....Current execlist status: 301.

[67684.679197] ....Current element descriptor(low): 3e55811b.

[67684.679274] ....LRCA: 3e558000.

[67684.679554] ring buffer(0): head(0x2ae03d38) tail(0x3d38), start(0x3e4ee000), ctl(0x3001)

[67684.679681] ring xxx:(0), mi_mode idle:(512)

[67684.679804] p_contents(ffffc9007e4ee000)

[67684.679810]

[67684.679810] [00003cf8]: 7a000004 09104f3c 89515000 00000000 00848a09 00000000 10400002 89515010

[67684.679810] [00003d18]: 00000000 00848a09 11000001 0000b118 40600000 04000001 00400000 02800000

[67684.679810] [00003d38]: 00200041(*) 00000000 00000000 01a70041 00000001 00000000 00000000 00000000

[67684.679810] [00003d58]: 00000000 00200021 00000000 fffff001 00000000 00000001 fffff001 00000000

[67684.681146] -----------ring-1 info-------------

[67684.681179] VM0   :

[67684.681385] stat(us): sche_in 0, sche_out 601718295346, last_vblank 0

[67684.681423] VM1   :

[67684.681668] stat(us): sche_in 669413030762, sche_out 669413031782, last_vblank 0

[67684.681731] VM2   :

[67684.681976] stat(us): sche_in 669377159364, sche_out 669377160384, last_vblank 0

[67684.682004] VM3(*):

[67684.682249] stat(us): sche_in 669413045486, sche_out 669413043284, last_vblank 0

[67684.682277] VM4   :

[67684.682522] stat(us): sche_in 669413043840, sche_out 669413044859, last_vblank 0

[67684.682750] debug registers,reg maked with <*> may not apply to every ring):

[67684.682839] ....RING_EIR: 00000000

[67684.682927] ....RING_EMR: ffffffff

[67684.683015] ....RING_ESR: 00000000

[67684.683107] ....00012064*: 00000000

[67684.683192] ....00012068: 00000000

[67684.683321] ....ACTHD(active header): 00000018

[67684.683454] ....UHPTR(pending header): 00000000

[67684.683538] ....00012078: 00000000

[67684.683594] (informative)

[67684.683717] ....INSTDONE_1(FYI): fffffffe

[67684.683764] Execlist:

[67684.683887] ....Current execlist status: 1.

[67684.684056] ....Current element descriptor(low): 4001e10b.

[67684.684133] ....LRCA: 4001e000.

[67684.684389] vGT warning:(vgt_gma_to_va:1757) invalid gpa! gma 0x4001f000, mm type 0

[67684.684519] -----------ring-2 info-------------

[67684.684550] VM0   :

[67684.684757] stat(us): sche_in 0, sche_out 601718295346, last_vblank 0

[67684.684799] VM1   :

[67684.685045] stat(us): sche_in 669413030762, sche_out 669413031782, last_vblank 0

[67684.685076] VM2   :

[67684.685322] stat(us): sche_in 669377159364, sche_out 669377160384, last_vblank 0

[67684.685350] VM3(*):

[67684.685595] stat(us): sche_in 669413045486, sche_out 669413043284, last_vblank 0

[67684.685625] VM4   :

[67684.685872] stat(us): sche_in 669413043840, sche_out 669413044859, last_vblank 0

[67684.686101] debug registers,reg maked with <*> may not apply to every ring):

[67684.686182] ....RING_EIR: 00000000

[67684.686270] ....RING_EMR: ffffffff

[67684.686357] ....RING_ESR: 00000000

[67684.686448] ....00022064*: 00000000

[67684.686532] ....00022068: 02800000

[67684.686661] ....ACTHD(active header): 02c03d28

[67684.686801] ....UHPTR(pending header): 00000000

[67684.686887] ....00022078: 3e23bd28

[67684.686945] (informative)

[67684.687061] ....INSTDONE_1(FYI): fffffffe

[67684.687107] Execlist:

[67684.687240] ....Current execlist status: 301.

[67684.687417] ....Current element descriptor(low): 3e3c111b.

[67684.687494] ....LRCA: 3e3c1000.

[67684.687599] Invalid signature: 1100101b.

[67684.687734] -----------ring-3 info-------------

[67684.687770] VM0   :

[67684.687977] stat(us): sche_in 0, sche_out 601718295346, last_vblank 0

[67684.688016] VM1   :

[67684.688261] stat(us): sche_in 669413030762, sche_out 669413031782, last_vblank 0

[67684.688289] VM2   :

[67684.688534] stat(us): sche_in 669377159364, sche_out 669377160384, last_vblank 0

[67684.688563] VM3(*):

[67684.688808] stat(us): sche_in 669413045486, sche_out 669413043284, last_vblank 0

[67684.688846] VM4   :

[67684.689092] stat(us): sche_in 669413043840, sche_out 669413044859, last_vblank 0

[67684.689321] debug registers,reg maked with <*> may not apply to every ring):

[67684.689405] ....RING_EIR: 00000000

[67684.689496] ....RING_EMR: ffffffff

[67684.689585] ....RING_ESR: 00000000

[67684.689680] ....0001a064*: 00000000

[67684.689764] ....0001a068: 00000000

[67684.689894] ....ACTHD(active header): 00000018

[67684.690027] ....UHPTR(pending header): 00000000

[67684.690110] ....0001a078: 00000000

[67684.690167] (informative)

[67684.690282] ....INSTDONE_1(FYI): fffffffe

[67684.690328] Execlist:

[67684.690450] ....Current execlist status: 1.

[67684.690619] ....Current element descriptor(low): 4002c10b.

[67684.690699] ....LRCA: 4002c000.

[67684.690957] vGT warning:(vgt_gma_to_va:1757) invalid gpa! gma 0x4002d000, mm type 0

[67684.691090] -----------ring-4 info-------------

[67684.691126] VM0   :

[67684.691336] stat(us): sche_in 0, sche_out 601718295346, last_vblank 0

[67684.691378] VM1   :

[67684.691625] stat(us): sche_in 669413030762, sche_out 669413031782, last_vblank 0

[67684.691657] VM2   :

[67684.691902] stat(us): sche_in 669377159364, sche_out 669377160384, last_vblank 0

[67684.691930] VM3(*):

[67684.692175] stat(us): sche_in 669413045486, sche_out 669413043284, last_vblank 0

[67684.692202] VM4   :

[67684.692447] stat(us): sche_in 669413043840, sche_out 669413044859, last_vblank 0

[67684.692675] debug registers,reg maked with <*> may not apply to every ring):

[67684.692760] ....RING_EIR: 00000000

[67684.692849] ....RING_EMR: ffffffff

[67684.692938] ....RING_ESR: 00000000

[67684.693032] ....0001c064*: 00000000

[67684.693120] ....0001c068: 04000001

[67684.693252] ....ACTHD(active header): 00601650

[67684.693385] ....UHPTR(pending header): 00000000

[67684.693469] ....0001c078: 3e444650

[67684.693525] (informative)

[67684.693640] ....INSTDONE_1(FYI): fffffffe

[67684.693691] Execlist:

[67684.693822] ....Current execlist status: 302.

[67684.693999] ....Current element descriptor(low): 3e23611b.

[67684.694078] ....LRCA: 3e236000.

[67684.694185] Invalid signature: 1100101b.

[67684.694369] -------- Current EXECLIST status of ring-0 --------

[67684.694460] Current Context ID: 0x0

[67684.694502] LDW: 0x301

[67684.694589] EXECLIST queue full: 0

[67684.694693] Current EXECLIST index: 1

[67684.694790] EXECLIST write index: 0

[67684.694981]   EXECLIST 0 status: 0(1 for valid) 0(1 for active)

[67684.695182]   EXECLIST 1 status: 0(1 for valid) 0(1 for active)

[67684.695295] Active context information:

[67684.695386]     no context is active

[67684.695502] Last ctx switch reason: 0x18

[67684.695603] Arbitration is: disabled

[67684.695772] ---- Physical status Buffer of Ring 0 ----

[67684.695781] Context StatusBufPtr Value: 0x203. (write_ptr: 3; read_ptr: 2; mask: 0x0

[67684.696036]     ring-0 CSB[0]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.696323]     ring-0 CSB[1]: ctx(0x0008a727) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.696678]     ring-0 CSB[2]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.696960]     ring-0 CSB[3]: ctx(0x0008a727) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.697311]     ring-0 CSB[4]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.697537]     ring-0 CSB[5]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.697957] ---- Virtual status Buffer for VM-2 of Ring 0 ----

[67684.697968] Context StatusBufPtr Value: 0x0. (write_ptr: 0; read_ptr: 0; mask: 0x0

[67684.698223]     ring-0 CSB[0]: ctx(0x00071d13) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.698577]     ring-0 CSB[1]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.698860]     ring-0 CSB[2]: ctx(0x00071d13) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.699214]     ring-0 CSB[3]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.699493]     ring-0 CSB[4]: ctx(0x00071d13) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.699846]     ring-0 CSB[5]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.700128] ---- VM(2): ring-0 EL queue --- head: 4; tail: 4;

[67684.700360] [0]: status: 0

[67684.700374] |-ctx[0]: NULL

[67684.700432] |-ctx[1]: NULL

[67684.700536] [1]: status: 0

[67684.700548] |-ctx[0]: NULL

[67684.700610] |-ctx[1]: NULL

[67684.700718] [2]: status: 0

[67684.700731] |-ctx[0]: NULL

[67684.700787] |-ctx[1]: NULL

[67684.700891] [3]: status: 0

[67684.700903] |-ctx[0]: NULL

[67684.700959] |-ctx[1]: NULL

[67684.701064] [4]: status: 0

[67684.701075] |-ctx[0]: NULL

[67684.701130] |-ctx[1]: NULL

[67684.701235] [5]: status: 0

[67684.701246] |-ctx[0]: NULL

[67684.701302] |-ctx[1]: NULL

[67684.701537] -------- Current EXECLIST status of ring-1 --------

[67684.701628] Current Context ID: 0x0

[67684.701667] LDW: 0x1

[67684.701762] EXECLIST queue full: 0

[67684.701862] Current EXECLIST index: 1

[67684.701957] EXECLIST write index: 0

[67684.702147]   EXECLIST 0 status: 0(1 for valid) 0(1 for active)

[67684.702350]   EXECLIST 1 status: 0(1 for valid) 0(1 for active)

[67684.702465] Active context information:

[67684.702558]     no context is active

[67684.702675] Last ctx switch reason: 0x0

[67684.702769] Arbitration is: disabled

[67684.702936] ---- Physical status Buffer of Ring 1 ----

[67684.702949] Context StatusBufPtr Value: 0x101. (write_ptr: 1; read_ptr: 1; mask: 0x0

[67684.703203]     ring-1 CSB[0]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.703484]     ring-1 CSB[1]: ctx(0x0004001e) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.703843]     ring-1 CSB[2]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.704068]     ring-1 CSB[3]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.704292]     ring-1 CSB[4]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.704516]     ring-1 CSB[5]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.704921] ---- Virtual status Buffer for VM-2 of Ring 1 ----

[67684.704930] Context StatusBufPtr Value: 0x707. (write_ptr: 7; read_ptr: 7; mask: 0x0

[67684.705552] vGT error:(dump_ctx_status_buf:1280) No writes happened and no interesting data in status buffer to show.

[67684.707038] ---- VM(2): ring-1 EL queue --- head: 0; tail: 0;

[67684.707268] [0]: status: 0

[67684.707280] |-ctx[0]: NULL

[67684.707335] |-ctx[1]: NULL

[67684.707440] [1]: status: 0

[67684.707451] |-ctx[0]: NULL

[67684.707507] |-ctx[1]: NULL

[67684.707611] [2]: status: 0

[67684.707625] |-ctx[0]: NULL

[67684.707683] |-ctx[1]: NULL

[67684.707788] [3]: status: 0

[67684.707801] |-ctx[0]: NULL

[67684.707860] |-ctx[1]: NULL

[67684.707966] [4]: status: 0

[67684.707981] |-ctx[0]: NULL

[67684.708037] |-ctx[1]: NULL

[67684.708141] [5]: status: 0

[67684.708152] |-ctx[0]: NULL

[67684.708208] |-ctx[1]: NULL

[67684.708444] -------- Current EXECLIST status of ring-2 --------

[67684.708535] Current Context ID: 0x0

[67684.708577] LDW: 0x301

[67684.708670] EXECLIST queue full: 0

[67684.708769] Current EXECLIST index: 1

[67684.708866] EXECLIST write index: 0

[67684.709057]   EXECLIST 0 status: 0(1 for valid) 0(1 for active)

[67684.709260]   EXECLIST 1 status: 0(1 for valid) 0(1 for active)

[67684.709375] Active context information:

[67684.709466]     no context is active

[67684.709583] Last ctx switch reason: 0x18

[67684.709686] Arbitration is: disabled

[67684.709854] ---- Physical status Buffer of Ring 2 ----

[67684.709863] Context StatusBufPtr Value: 0x505. (write_ptr: 5; read_ptr: 5; mask: 0x0

[67684.710119]     ring-2 CSB[0]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.710400]     ring-2 CSB[1]: ctx(0x000895c9) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.710757]     ring-2 CSB[2]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.711040]     ring-2 CSB[3]: ctx(0x000895c9) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.711394]     ring-2 CSB[4]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.711680]     ring-2 CSB[5]: ctx(0x000895c9) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.712209] ---- Virtual status Buffer for VM-2 of Ring 2 ----

[67684.712220] Context StatusBufPtr Value: 0x101. (write_ptr: 1; read_ptr: 1; mask: 0x0

[67684.712474]     ring-2 CSB[0]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.712758]     ring-2 CSB[1]: ctx(0x000715c9) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.713112]     ring-2 CSB[2]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.713392]     ring-2 CSB[3]: ctx(0x000715c9) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.713745]     ring-2 CSB[4]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.714029]     ring-2 CSB[5]: ctx(0x000715c9) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.714379] ---- VM(2): ring-2 EL queue --- head: 4; tail: 4;

[67684.714610] [0]: status: 0

[67684.714627] |-ctx[0]: NULL

[67684.714686] |-ctx[1]: NULL

[67684.714790] [1]: status: 0

[67684.714802] |-ctx[0]: NULL

[67684.714857] |-ctx[1]: NULL

[67684.714962] [2]: status: 0

[67684.714973] |-ctx[0]: NULL

[67684.715029] |-ctx[1]: NULL

[67684.715133] [3]: status: 0

[67684.715145] |-ctx[0]: NULL

[67684.715200] |-ctx[1]: NULL

[67684.715305] [4]: status: 0

[67684.715316] |-ctx[0]: NULL

[67684.715371] |-ctx[1]: NULL

[67684.715476] [5]: status: 0

[67684.715487] |-ctx[0]: NULL

[67684.715543] |-ctx[1]: NULL

[67684.715797] -------- Current EXECLIST status of ring-3 --------

[67684.715890] Current Context ID: 0x0

[67684.715927] LDW: 0x1

[67684.716024] EXECLIST queue full: 0

[67684.716124] Current EXECLIST index: 1

[67684.716219] EXECLIST write index: 0

[67684.716410]   EXECLIST 0 status: 0(1 for valid) 0(1 for active)

[67684.716610]   EXECLIST 1 status: 0(1 for valid) 0(1 for active)

[67684.716727] Active context information:

[67684.716821]     no context is active

[67684.716935] Last ctx switch reason: 0x0

[67684.717027] Arbitration is: disabled

[67684.717192] ---- Physical status Buffer of Ring 3 ----

[67684.717200] Context StatusBufPtr Value: 0x101. (write_ptr: 1; read_ptr: 1; mask: 0x0

[67684.717454]     ring-3 CSB[0]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.717739]     ring-3 CSB[1]: ctx(0x0004002c) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.718092]     ring-3 CSB[2]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.718316]     ring-3 CSB[3]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.718541]     ring-3 CSB[4]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.718768]     ring-3 CSB[5]: ctx(0x00000000) val(0x00000000) <set bits: >

[67684.719172] ---- Virtual status Buffer for VM-2 of Ring 3 ----

[67684.719181] Context StatusBufPtr Value: 0x707. (write_ptr: 7; read_ptr: 7; mask: 0x0

[67684.719802] vGT error:(dump_ctx_status_buf:1280) No writes happened and no interesting data in status buffer to show.

[67684.721231] ---- VM(2): ring-3 EL queue --- head: 0; tail: 0;

[67684.721461] [0]: status: 0

[67684.721474] |-ctx[0]: NULL

[67684.721529] |-ctx[1]: NULL

[67684.721636] [1]: status: 0

[67684.721649] |-ctx[0]: NULL

[67684.721707] |-ctx[1]: NULL

[67684.721813] [2]: status: 0

[67684.721827] |-ctx[0]: NULL

[67684.721882] |-ctx[1]: NULL

[67684.721987] [3]: status: 0

[67684.721998] |-ctx[0]: NULL

[67684.722053] |-ctx[1]: NULL

[67684.722158] [4]: status: 0

[67684.722169] |-ctx[0]: NULL

[67684.722225] |-ctx[1]: NULL

[67684.722329] [5]: status: 0

[67684.722341] |-ctx[0]: NULL

[67684.722397] |-ctx[1]: NULL

[67684.722632] -------- Current EXECLIST status of ring-4 --------

[67684.722728] Current Context ID: 0x0

[67684.722770] LDW: 0x302

[67684.722859] EXECLIST queue full: 0

[67684.722958] Current EXECLIST index: 0

[67684.723054] EXECLIST write index: 1

[67684.723245]   EXECLIST 0 status: 0(1 for valid) 0(1 for active)

[67684.723447]   EXECLIST 1 status: 0(1 for valid) 0(1 for active)

[67684.723561] Active context information:

[67684.723655]     no context is active

[67684.723773] Last ctx switch reason: 0x18

[67684.723877] Arbitration is: disabled

[67684.724043] ---- Physical status Buffer of Ring 4 ----

[67684.724051] Context StatusBufPtr Value: 0x505. (write_ptr: 5; read_ptr: 5; mask: 0x0

[67684.724305]     ring-4 CSB[0]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.724594]     ring-4 CSB[1]: ctx(0x000a16fa) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.724945]     ring-4 CSB[2]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.725225]     ring-4 CSB[3]: ctx(0x000a16fa) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.725580]     ring-4 CSB[4]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.725863]     ring-4 CSB[5]: ctx(0x000a16fa) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.726391] ---- Virtual status Buffer for VM-2 of Ring 4 ----

[67684.726399] Context StatusBufPtr Value: 0x101. (write_ptr: 1; read_ptr: 1; mask: 0x0

[67684.726654]     ring-4 CSB[0]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.726938]     ring-4 CSB[1]: ctx(0x000716fa) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.727289]     ring-4 CSB[2]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.727571]     ring-4 CSB[3]: ctx(0x000716fa) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.727925]     ring-4 CSB[4]: ctx(0x00000000) val(0x00000001) <set bits: idle_to_active; >

[67684.728205]     ring-4 CSB[5]: ctx(0x000716fa) val(0x00000018) <set bits: active_to_idle; context_complete; >

[67684.728558] ---- VM(2): ring-4 EL queue --- head: 1; tail: 1;

[67684.728789] [0]: status: 0

[67684.728803] |-ctx[0]: NULL

[67684.728859] |-ctx[1]: NULL

[67684.728964] [1]: status: 0

[67684.728975] |-ctx[0]: NULL

[67684.729030] |-ctx[1]: NULL

[67684.729135] [2]: status: 0

[67684.729146] |-ctx[0]: NULL

[67684.729202] |-ctx[1]: NULL

[67684.729306] [3]: status: 0

[67684.729318] |-ctx[0]: NULL

[67684.729373] |-ctx[1]: NULL

[67684.729478] [4]: status: 0

[67684.729489] |-ctx[0]: NULL

[67684.729545] |-ctx[1]: NULL

[67684.729651] [5]: status: 0

[67684.729665] |-ctx[0]: NULL

[67684.729724] |-ctx[1]: NULL

[67684.732527] vGT error:(vgt_not_allowed_mmio_read:47) VM(2): MMIO reading of reg 0x2230 is not allowed. 0 will be returned!

[67684.737017] vGT error:(vgt_not_allowed_mmio_read:47) VM(2): MMIO reading of reg 0x22230 is not allowed. 0 will be returned!

[67684.739383] vGT error:(vgt_not_allowed_mmio_read:47) VM(2): MMIO reading of reg 0x12230 is not allowed. 0 will be returned!

[67684.741307] vGT error:(vgt_not_allowed_mmio_read:47) VM(2): MMIO reading of reg 0x1a230 is not allowed. 0 will be returned!

[67684.745097] vGT(2) , read fence register 100020, 4 out of assignment 4.

[67684.745318] vGT(2) , read fence register 100024, 4 out of assignment 4.

[67684.745535] vGT(2) , read fence register 100028, 5 out of assignment 4.

[67684.745757] vGT(2) , read fence register 10002c, 5 out of assignment 4.

[67684.745973] vGT(2) , read fence register 100030, 6 out of assignment 4.

[67684.746208] vGT(2) , read fence register 100034, 6 out of assignment 4.

[67684.746425] vGT(2) , read fence register 100038, 7 out of assignment 4.

[67684.746643] vGT(2) , read fence register 10003c, 7 out of assignment 4.

[67684.746863] vGT(2) , read fence register 100040, 8 out of assignment 4.

[67684.747080] vGT(2) , read fence register 100044, 8 out of assignment 4.

[67684.747298] vGT(2) , read fence register 100048, 9 out of assignment 4.

[67684.747518] vGT(2) , read fence register 10004c, 9 out of assignment 4.

[67684.747742] vGT(2) , read fence register 100050, a out of assignment 4.

[67684.747961] vGT(2) , read fence register 100054, a out of assignment 4.

[67684.748180] vGT(2) , read fence register 100058, b out of assignment 4.

[67684.748399] vGT(2) , read fence register 10005c, b out of assignment 4.

[67684.748638] vGT(2) , read fence register 100060, c out of assignment 4.

[67684.748885] vGT(2) , read fence register 100064, c out of assignment 4.

[67684.749105] vGT(2) , read fence register 100068, d out of assignment 4.

[67684.749322] vGT(2) , read fence register 10006c, d out of assignment 4.

[67684.749539] vGT(2) , read fence register 100070, e out of assignment 4.

[67684.749761] vGT(2) , read fence register 100074, e out of assignment 4.

[67684.749978] vGT(2) , read fence register 100078, f out of assignment 4.

[67684.750196] vGT(2) , read fence register 10007c, f out of assignment 4.

[67686.631878] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(10) base_gfn(0x100) npages(524030)

[67686.636207] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(07) base_gfn(0x7fffe) npages(2)

[67686.722482] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(07) base_gfn(0x100) npages(524032)

[67686.723592] prepare to destroy vgt (2)

[67686.723836] check render ownership...

[67686.723970] remove vgt(2) from runqueue safely

[67686.724120] vGT-2: disable render with enabled rings

[67686.724250] vGT-2: remove from render run queue!

[67686.724344] check display ownership...

[67686.724519] release display/render ownership... done

[67686.740434] vGT: vgt_release_instance done

[67686.748696] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(07) base_gfn(0x100) npages(524032)

[67686.832097] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(07) base_gfn(0x100) npages(524030)

[67686.832463] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(10) base_gfn(0x7fffe) npages(2)

[67686.833875] vGT info:(create_vgt_instance:120) vm_id=2, low_gm_sz=128MB, high_gm_sz=384MB, fence_sz=4, vgt_primary=1

[67686.835597] vGT info:(create_vgt_instance:208) aperture: [0x8e000000, 0x95ffffff] guest [0x8e000000, 0x95ffffff] va(0xffffc9004e000000)

[67686.836112] vGT info:(create_vgt_instance:219) GM: [0xe000000, 0x15ffffff], [0x70000000, 0x87ffffff], guest[0xe000000, 0x15ffffff], [0x70000000, 0x87ffffff]

[67686.837276] --- VM(2) ppat mapping table ---

[67686.837498] guest entry(0) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67686.837729] guest entry(1) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67686.837961] guest entry(2) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67686.838189] guest entry(3) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67686.838417] guest entry(4) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67686.838645] guest entry(5) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67686.838877] guest entry(6) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67686.839109] guest entry(7) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67686.839579] Linux host ppat register:

[67686.839579]     0x40e0: 000a0907, 0x40e4: 1013111b

[67686.839579] Guest VM(2) ppat register:

[67686.839579]     0x40e0: 03030303, 0x40e4: 03030303

[67686.840232] vGT info:(create_vgt_instance:256) filling VGT_PVINFO_PAGE for dom2:

[67686.840232]    visable_gm_base=0xe000000, size=0x8000000

[67686.840232]    hidden_gm_base=0x70000000, size=0x18000000

[67686.840232]    fence_base=8, num=4

[67686.841555] vGT info:(vgt_create_scratch_page:2117) VM2 create scratch page: mfn=0x20c9c7

[67686.842209] vGT info:(kvmgt_pin_slot:771) VM2: slot 1: reuse pinned pages

[67686.842440] vGT info:(kvmgt_pin_slot:771) VM2: slot 6: reuse pinned pages

[67686.842671] vGT info:(kvmgt_pin_slot:771) VM2: slot 10: reuse pinned pages

[67686.842902] vGT info:(kvmgt_pin_slot:771) VM2: slot 7: reuse pinned pages

[67686.843135] vGT info:(kvmgt_pin_slot:771) VM2: slot 9: reuse pinned pages

[67686.843364] vGT info:(kvmgt_pin_slot:771) VM2: slot 8: reuse pinned pages

[67686.843594] vGT info:(kvmgt_pin_slot:771) VM2: slot 5: reuse pinned pages

[67686.843824] vGT info:(kvmgt_pin_slot:771) VM2: slot 4: reuse pinned pages

[67686.844053] vGT info:(kvmgt_pin_slot:771) VM2: slot 3: reuse pinned pages

[67686.844281] vGT info:(kvmgt_pin_slot:771) VM2: slot 0: reuse pinned pages

[67686.844547] vGT info:(create_vgt_instance:301) writing virtual 0xfc opregion for VM2

[67686.844752] vGT info:(kvmgt_opregion_init:608) opregion initialized

[67686.844933] vGT(2): create debugfs node: virtual_mmio_space

[67686.845102] vGT(2): create debugfs node: shadow_mmio_space

[67686.845277] vGT(2): create debugfs node: virtual_mmio_space

[67686.845418] vGT(2): create debugfs node: hlistinfo

[67686.845582] vGT(2): create debugfs node: mmio_accounting

[67686.845757] vGT(2): create debugfs node: frame_buffer_format

[67686.845933] vGT(2): create debugfs node: frame_buffer_format

[67686.846299] vGT info:(vgt_init_sched_info:1299) VM-2 setup timebased schedule period 1 ms

[67686.865065] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(07) base_gfn(0x100) npages(524030)

[67686.865852] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(10) base_gfn(0x7fffe) npages(2)

[67686.950484] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(07) base_gfn(0x100) npages(524032)

[67686.951446] prepare to destroy vgt (2)

[67686.951710] check render ownership...

[67686.951879] vgt instance has been removed from run queue

[67686.951974] check display ownership...

[67686.952128] release display/render ownership... done

[67686.966795] vGT: vgt_release_instance done

[67686.974463] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(07) base_gfn(0x100) npages(524032)

[67687.061366] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(07) base_gfn(0x100) npages(524030)

[67687.061761] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(10) base_gfn(0x7fffe) npages(2)

[67687.063147] vGT info:(create_vgt_instance:120) vm_id=2, low_gm_sz=128MB, high_gm_sz=384MB, fence_sz=4, vgt_primary=1

[67687.064997] vGT info:(create_vgt_instance:208) aperture: [0x8e000000, 0x95ffffff] guest [0x8e000000, 0x95ffffff] va(0xffffc9004e000000)

[67687.065511] vGT info:(create_vgt_instance:219) GM: [0xe000000, 0x15ffffff], [0x70000000, 0x87ffffff], guest[0xe000000, 0x15ffffff], [0x70000000, 0x87ffffff]

[67687.067016] --- VM(2) ppat mapping table ---

[67687.067237] guest entry(0) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67687.067465] guest entry(1) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67687.067699] guest entry(2) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67687.067929] guest entry(3) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67687.068162] guest entry(4) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].


[67687.068391] guest entry(5) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67687.068627] guest entry(6) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67687.068855] guest entry(7) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67687.069322] Linux host ppat register:

[67687.069322]     0x40e0: 000a0907, 0x40e4: 1013111b

[67687.069322] Guest VM(2) ppat register:

[67687.069322]     0x40e0: 03030303, 0x40e4: 03030303

[67687.069984] vGT info:(create_vgt_instance:256) filling VGT_PVINFO_PAGE for dom2:

[67687.069984]    visable_gm_base=0xe000000, size=0x8000000

[67687.069984]    hidden_gm_base=0x70000000, size=0x18000000

[67687.069984]    fence_base=8, num=4

[67687.071618] vGT info:(vgt_create_scratch_page:2117) VM2 create scratch page: mfn=0x92cecc

[67687.072256] vGT info:(kvmgt_pin_slot:771) VM2: slot 1: reuse pinned pages

[67687.072493] vGT info:(kvmgt_pin_slot:771) VM2: slot 6: reuse pinned pages

[67687.072728] vGT info:(kvmgt_pin_slot:771) VM2: slot 10: reuse pinned pages

[67687.072955] vGT info:(kvmgt_pin_slot:771) VM2: slot 7: reuse pinned pages

[67687.073183] vGT info:(kvmgt_pin_slot:771) VM2: slot 9: reuse pinned pages

[67687.073410] vGT info:(kvmgt_pin_slot:771) VM2: slot 8: reuse pinned pages

[67687.073641] vGT info:(kvmgt_pin_slot:771) VM2: slot 5: reuse pinned pages

[67687.073871] vGT info:(kvmgt_pin_slot:771) VM2: slot 4: reuse pinned pages

[67687.074099] vGT info:(kvmgt_pin_slot:771) VM2: slot 3: reuse pinned pages

[67687.074330] vGT info:(kvmgt_pin_slot:771) VM2: slot 0: reuse pinned pages

[67687.074599] vGT info:(create_vgt_instance:301) writing virtual 0xfc opregion for VM2

[67687.074806] vGT info:(kvmgt_opregion_init:608) opregion initialized

[67687.074983] vGT(2): create debugfs node: virtual_mmio_space

[67687.075153] vGT(2): create debugfs node: shadow_mmio_space

[67687.075328] vGT(2): create debugfs node: virtual_mmio_space

[67687.075473] vGT(2): create debugfs node: hlistinfo

[67687.075642] vGT(2): create debugfs node: mmio_accounting

[67687.075818] vGT(2): create debugfs node: frame_buffer_format

[67687.075990] vGT(2): create debugfs node: frame_buffer_format

[67687.076354] vGT info:(vgt_init_sched_info:1299) VM-2 setup timebased schedule period 1 ms

[67687.126041] Programming bar 0x10 with 0xffffffff

[67687.126178] Programming bar 0x10 with 0xde000004

[67687.126314] Programming bar 0x14 with 0xffffffff

[67687.126442] Programming bar 0x14 with 0x0

[67687.126593] Programming bar 0x18 with 0xffffffff

[67687.126731] Programming bar 0x18 with 0x8000000c

[67687.126869] Programming bar 0x1c with 0xffffffff

[67687.126983] Programming bar 0x1c with 0x0

[67687.127132] Programming bar 0x20 with 0xffffffff

[67687.127257] Programming bar 0x20 with 0xf001

[67687.127403] Programming bar 0x24 with 0xffffffff

[67687.127517] Programming bar 0x24 with 0x0

[67687.128668] Programming bar 0x20 with 0xc000

[67687.129818] Programming bar 0x10 with 0xfd000000

[67687.129926] Programming bar 0x14 with 0x0

[67687.130815] Programming bar 0x18 with 0x80000000

[67687.130923] Programming bar 0x1c with 0x0

[67687.135849] add_map: domid=2 gfn_s=0x8e000 mfn_s=0x8e000 nr_mfns=0x8000

[67687.136151] vGT info:(__kvmgt_set_trap_area:322) VM2: registered iodev: 0xfd000000 - 0xfdffffff

[67687.294270] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xfe000) npages(64)

[67687.295612] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xfe000) npages(64)

[67687.300610] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(03) base_gfn(0xc0) npages(10)

[67687.300967] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(04) base_gfn(0xca) npages(3)

[67687.301291] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(05) base_gfn(0xcd) npages(31)

[67687.301653] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(03) base_gfn(0xc0) npages(44)

[67687.302559] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(03) base_gfn(0xc0) npages(44)

[67687.302911] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(03) base_gfn(0xc0) npages(10)

[67687.303208] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(04) base_gfn(0xca) npages(3)

[67687.303526] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(05) base_gfn(0xcd) npages(31)

[67688.113863] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67688.114782] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67688.115831] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67688.116740] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67688.117708] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67688.118632] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67688.119740] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67688.120691] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67688.121719] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.424996] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.428007] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.429060] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.430172] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.431210] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.432329] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.433420] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.434514] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.435618] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.436638] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.438109] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.439158] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.440170] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.441322] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.442397] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.443535] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.444563] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.445467] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.446387] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.447288] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.449029] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.450174] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.451078] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.451976] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.453052] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.454071] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67732.455071] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67732.456174] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.241384] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.246519] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.247683] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.248695] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.249666] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.250707] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.251730] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.252852] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.253910] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.255037] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.256386] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.257501] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.258648] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.259848] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.260938] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.262065] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.263108] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.264253] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.265276] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.266450] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.267947] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.269028] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.270070] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.271157] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.272193] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.273222] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.274077] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.275050] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67733.277484] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67733.278636] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67734.241512] Programming bar 0x10 with 0xffffffff

[67734.241652] Programming bar 0x14 with 0xffffffff

[67734.241790] Programming bar 0x18 with 0xffffffff

[67734.241934] Programming bar 0x1c with 0xffffffff

[67734.242081] Programming bar 0x20 with 0xffffffff

[67734.242221] Programming bar 0x24 with 0xffffffff

[67734.242393] Programming bar 0x10 with 0xfd000004

[67734.242504] Programming bar 0x14 with 0x0

[67734.242651] Programming bar 0x18 with 0x8000000c

[67734.242762] Programming bar 0x1c with 0x0

[67734.243071] Programming bar 0x20 with 0xc001

[67734.243180] Programming bar 0x24 with 0x0

[67734.243436] vGT: write to MSI capa(ae) with val (80000000)

[67755.360828] VM2 Read SCI Trigger Register, bytes=4 value=0x8000

[67755.361451] VM2 Read SCI Trigger Register, bytes=4 value=0x8000

[67759.028526] Programming bar 0x10 with 0xfd000000

[67759.028645] Programming bar 0x14 with 0x0

[67759.028792] Programming bar 0x18 with 0x80000000

[67759.028905] Programming bar 0x1c with 0x0

[67759.029038] Programming bar 0x20 with 0xc000

[67759.029149] Programming bar 0x24 with 0x0

[67759.029450] vGT: write to MSI capa(ae) with val (80000000)

[67759.029659] vGT: write to MSI capa(b0) with val (fee0300c)

[67759.029839] vGT: write to MSI capa(b4) with val (80004982)

[67759.030026] vGT: write to MSI capa(ae) with val (80000001)

[67759.082386] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.373587] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.375357] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.377070] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.378660] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.380357] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.382132] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.384132] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.411087] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.414310] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.416850] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.419091] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.421647] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.424146] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.426920] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.428849] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.430173] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.431910] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.434154] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.435923] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.437951] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.440054] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.441608] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.443328] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.445097] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.447026] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67759.448719] vGT info:(kvmgt_unpin_slot:823) VM2: unpinned slot id(11) base_gfn(0xa0) npages(16)

[67759.450487] vGT info:(kvmgt_pin_slot:798) VM2: pinned slot id(11) base_gfn(0xa0) npages(16)

[67761.179888] VM2 Read SCI Trigger Register, bytes=4 value=0x8000

[67761.180781] VM2 write register RC_STATE_CTRL_1 with 0x0

[67761.180965] VM2 write register RC_STATE_CTRL_1 with 0x8040000

[67761.185113] vGT info:(mailbox_write:2673) VM 2 write 80000006 to mailbox, return data0 1e1a1100

[67761.185577] vGT info:(mailbox_write:2673) VM 2 write 80000006 to mailbox, return data0 61514b3d

[67761.186399] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 61514b3d

[67761.186741] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 61514b3d

[67761.187089] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 61514b3d

[67761.187423] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 61514b3d

[67761.188471] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 61514b3d

[67761.188811] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 61514b3d

[67761.189146] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 61514b3d

[67761.189477] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 61514b3d

[67761.190241] VM2 Read SCI Trigger Register, bytes=2 value=0x8000

[67761.190456] VM2 Read SCI Trigger Register, bytes=2 value=0x8000

[67761.190666] VM2 Read SCI Trigger Register, bytes=2 value=0x8000

[67761.190874] VM2 Read SCI Trigger Register, bytes=2 value=0x8000

[67761.191071] VM2 Read SCI Trigger Register, bytes=2 value=0x8000

[67761.191280] VM2 Read SCI Trigger Register, bytes=2 value=0x8000

[67761.197868] --- VM(2) ppat mapping table ---

[67761.198090] guest entry(0) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67761.198317] guest entry(1) [tc: 0, ca: 1] -> host entry(5) [tc: 0, ca: 1].

[67761.198545] guest entry(2) [tc: 0, ca: 0] -> host entry(3) [tc: 0, ca: 0].

[67761.198780] guest entry(3) [tc: 0, ca: 0] -> host entry(3) [tc: 0, ca: 0].

[67761.199007] guest entry(4) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67761.199234] guest entry(5) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67761.199462] guest entry(6) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67761.199691] guest entry(7) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67761.200157] Linux host ppat register:

[67761.200157]     0x40e0: 000a0907, 0x40e4: 1013111b

[67761.200157] Guest VM(2) ppat register:

[67761.200157]     0x40e0: 10101113, 0x40e4: 03030303

[67761.200383] --- VM(2) ppat mapping table ---

[67761.200607] guest entry(0) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67761.200835] guest entry(1) [tc: 0, ca: 1] -> host entry(5) [tc: 0, ca: 1].

[67761.201062] guest entry(2) [tc: 0, ca: 0] -> host entry(3) [tc: 0, ca: 0].

[67761.201289] guest entry(3) [tc: 0, ca: 0] -> host entry(3) [tc: 0, ca: 0].

[67761.201517] guest entry(4) [tc: 0, ca: 3] -> host entry(6) [tc: 0, ca: 3].

[67761.201748] guest entry(5) [tc: 0, ca: 1] -> host entry(5) [tc: 0, ca: 1].

[67761.201975] guest entry(6) [tc: 0, ca: 0] -> host entry(3) [tc: 0, ca: 0].

[67761.202203] guest entry(7) [tc: 0, ca: 0] -> host entry(3) [tc: 0, ca: 0].

[67761.202668] Linux host ppat register:

[67761.202668]     0x40e0: 000a0907, 0x40e4: 1013111b

[67761.202668] Guest VM(2) ppat register:

[67761.202668]     0x40e0: 10101113, 0x40e4: 10101113

[67761.698345] PPGTT 64 bit VA enabling on ring 0

[67761.698539] PPGTT enabling on ring 0 page table level 4 type 10

[67761.698677] PPGTT 64 bit VA enabling on ring 2

[67761.698867] PPGTT enabling on ring 2 page table level 4 type 10

[67761.699038] PPGTT 64 bit VA enabling on ring 1

[67761.699228] PPGTT enabling on ring 1 page table level 4 type 10

[67761.699362] PPGTT 64 bit VA enabling on ring 3

[67761.699567] PPGTT enabling on ring 3 page table level 4 type 10

[67763.763993] vGT info:(ring_pp_mode_write:795) EXECLIST enabling on ring 0.

[67763.764119] vGT-2: add to render run queue!

[67763.764523] vGT info:(ring_pp_mode_write:795) EXECLIST enabling on ring 1.

[67763.765522] vGT info:(ring_pp_mode_write:795) EXECLIST enabling on ring 4.

[67763.765858] vGT info:(ring_pp_mode_write:795) EXECLIST enabling on ring 2.

[67763.766316] vGT info:(ring_pp_mode_write:795) EXECLIST enabling on ring 3.

[67763.767586] vGT warning:(vgt_emulate_read:383) vGT: untracked MMIO read: vm_id(2), offset=0x940c,len=4, val=0x0!!!

[67763.767978] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x940c,len=4, val=0x4000!!!

[67763.769677] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.782437] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.783641] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.784530] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.785050] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.785690] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.786184] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.786661] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.787161] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.788214] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.788712] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67763.789391] vGT warning:(vgt_emulate_write:498) vGT: untracked MMIO write: vm_id(2), offset=0x4274,len=4, val=0x1!!!

[67764.080329] vGT info:(mailbox_write:2673) VM 2 write 80000021 to mailbox, return data0 3

[67764.080755] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67764.081083] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67765.990478] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67765.990788] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67864.383823] vGT info:(mailbox_write:2673) VM 2 write 80000021 to mailbox, return data0 3

[67864.384370] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67864.384682] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67866.294206] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67866.294573] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67871.139011] vGT info:(mailbox_write:2673) VM 2 write 80000021 to mailbox, return data0 3

[67871.140428] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67871.140746] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67873.050212] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67873.050525] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67877.138854] vGT info:(mailbox_write:2673) VM 2 write 80000021 to mailbox, return data0 3

[67877.139409] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67877.139739] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67879.049835] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67879.050262] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67994.566600] vGT info:(mailbox_write:2673) VM 2 write 80000021 to mailbox, return data0 3

[67994.567117] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67994.567430] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67996.474720] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[67996.475024] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[68002.841612] vGT info:(mailbox_write:2673) VM 2 write 80000021 to mailbox, return data0 3

[68002.842098] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[68002.842934] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[68004.751729] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

[68004.752063] vGT info:(mailbox_write:2673) VM 2 write 80000005 to mailbox, return data0 3

 

2016-09-20 9:43 GMT+08:00 Eddie Yen <missile0407@gmail.com>:

Hi everyone,

 

I'm testing the stress test on my C236-WSI4-85L these days.

The test is simple, I created 4 VMs which are 2 cores / 14GB memory each.

And running Unigine Valley Benchmark each VM.

 

And another machine which is E3V4, created same 4 VMs, only difference between E3V5 is that the VM spec is 2 cores / 6GB memory each.

 

(P.S Every VM are running Windows 7.)

 

After few days test, I found that the E3V5 host crashed after 60~70 hours, which crashing is "freeze".

Then I checked htop and dmesg watch monitor and found two things:

 

1. There is no error log when crash, only kernel trace about i915 driver when starting VM.

2. When testing, the memory usage is increasing.

 

For example, I got 64189MB total memory when boot into Ubuntu, and used about 593XX MB memory after 4 VMs started.

After about 36 hours, the memory was already used 613XX MB memory.

Then After 48 hours, the memory was already used 624XX MB memory, and started using swap.

 

When host crashed, the htop shows that already used 634XX MB memory, and used about 2GB swap size.

 

I guess that memory overloaded cause the "freeze" crash.

But it seems like memory usage is not increase when testing on E3V4 platform.

And I'm sure that I didn't run any other program. Then the Ubuntu is running with server edition, which means didn't have any GUI.

 

Besides, I'm using kernel command line below:

BOOT_IMAGE=/vmlinuz-4.3.0 root=/dev/mapper/os-root ro console=tty0 net.ifnames=0 biosdevname=0 rootdelay=90 root=UUID=5d69db35-c6cb-4990-947f-9b562ea8908b nomdmonddf nomdmonisw intel_iommu=igfx_off i915.hvm_boot_foreground=0 i915.propagate_monitor_to_guest=0 i915.preemption_policy=3 i915.enable_cmd_parser=0 loglvl=all guest_loglvl=all conring_size=4M noreboot

 

Any suggestions?

 

Thanks,

Eddie.