October 2020 - LKP - Ml01.01.Org

[hugetlbfs] c0d0381ade: vm-scalability.throughput -33.4% regression

by kernel test robot

Greeting, FYI, we noticed a -33.4% regression of vm-scalability.throughput due to commit: commit: c0d0381ade79885c04a04c303284b040616b116e ("hugetlbfs: use i_mmap_rwsem for more pmd sharing synchronization") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: vm-scalability on test machine: 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory with following parameters: runtime: 300s size: 8T test: anon-cow-seq-hugetlb cpufreq_governor: performance ucode: 0x11 test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us. test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/rootfs/runtime/size/tbox_group/test/testcase/ucode: gcc-7/performance/x86_64-rhel-7.6/debian-x86_64-20191114.cgz/300s/8T/lkp-knm01/anon-cow-seq-hugetlb/vm-scalability/0x11 commit: 49aef7175c ("mm/memblock.c: remove redundant assignment to variable max_addr") c0d0381ade ("hugetlbfs: use i_mmap_rwsem for more pmd sharing synchronization") 49aef7175cc6eb70 c0d0381ade79885c04a04c30328 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x :4 25% 1:4 dmesg.WARNING:at_ip__mutex_lock/0x :4 25% 1:4 dmesg.WARNING:at_ip_perf_event_mmap_output/0x %stddev %change %stddev \ | \ 37643 -29.5% 26549 ± 4% vm-scalability.median 9.18 ± 16% +9.3 18.48 ± 21% vm-scalability.median_stddev% 12666048 -33.4% 8429873 ± 4% vm-scalability.throughput 1701516 -19.5% 1369683 ± 5% vm-scalability.time.minor_page_faults 13447 ± 3% -19.3% 10848 vm-scalability.time.percent_of_cpu_this_job_got 26620 ± 4% -10.5% 23830 vm-scalability.time.system_time 14297 ± 3% -35.3% 9255 ± 4% vm-scalability.time.user_time 125377 ± 2% +621.3% 904348 ± 4% vm-scalability.time.voluntary_context_switches 2.468e+09 -19.6% 1.984e+09 ± 5% vm-scalability.workload 3.807e+10 ± 4% +20.9% 4.605e+10 ± 2% cpuidle.C1.time 9524 ± 10% -17.3% 7873 ± 4% numa-vmstat.node0.nr_mapped 2494252 -12.4% 2184278 ± 3% numa-numastat.node0.local_node 2494194 -12.4% 2184223 ± 3% numa-numastat.node0.numa_hit 49.26 ± 3% +9.4 58.62 mpstat.cpu.all.idle% 32.89 ± 4% -3.2 29.70 mpstat.cpu.all.sys% 17.79 ± 3% -6.2 11.64 ± 4% mpstat.cpu.all.usr% 4856 +47.6% 7169 numa-meminfo.node0.HugePages_Surp 4856 +47.6% 7169 numa-meminfo.node0.HugePages_Total 37725 ± 10% -17.7% 31054 ± 4% numa-meminfo.node0.Mapped 12274212 +38.3% 16981169 numa-meminfo.node0.MemUsed 49.00 ± 3% +18.9% 58.25 vmstat.cpu.id 17.00 ± 4% -33.8% 11.25 ± 3% vmstat.cpu.us 138.25 ± 2% -19.5% 111.25 ± 2% vmstat.procs.r 5836 ± 2% +88.0% 10969 ± 3% vmstat.system.cs 4855 +48.0% 7186 meminfo.HugePages_Surp 4856 +48.0% 7186 meminfo.HugePages_Total 9946017 +48.0% 14718559 meminfo.Hugetlb 48593 ± 8% -13.9% 41859 ± 3% meminfo.Mapped 12877361 +36.8% 17619364 meminfo.Memused 81607 ± 2% +29.1% 105324 meminfo.max_used_kB 2890 ±100% +285.4% 11139 ± 3% perf-stat.i.context-switches 298.31 ±100% +243.7% 1025 ± 2% perf-stat.i.cpu-migrations 0.11 ±100% +119.3% 0.24 perf-stat.i.ipc 0.04 ±100% +129.7% 0.10 ± 4% perf-stat.i.metric.K/sec 0.11 ±100% +122.1% 0.24 perf-stat.overall.ipc 3107 ±100% +137.3% 7372 ± 3% perf-stat.overall.path-length 2836 ±100% +284.4% 10902 ± 3% perf-stat.ps.context-switches 275.01 ±100% +257.9% 984.31 ± 2% perf-stat.ps.cpu-migrations 111986 -11.7% 98924 ± 2% slabinfo.anon_vma.active_objs 2434 -11.7% 2150 ± 2% slabinfo.anon_vma.active_slabs 111986 -11.7% 98924 ± 2% slabinfo.anon_vma.num_objs 2434 -11.7% 2150 ± 2% slabinfo.anon_vma.num_slabs 258615 -9.1% 235038 ± 2% slabinfo.anon_vma_chain.active_objs 4041 -9.1% 3672 ± 2% slabinfo.anon_vma_chain.active_slabs 258670 -9.1% 235049 ± 2% slabinfo.anon_vma_chain.num_objs 4041 -9.1% 3672 ± 2% slabinfo.anon_vma_chain.num_slabs 1500 -17.8% 1232 ± 5% slabinfo.hugetlbfs_inode_cache.active_objs 1500 -17.8% 1232 ± 5% slabinfo.hugetlbfs_inode_cache.num_objs 682.00 ± 6% +15.9% 790.50 ± 6% slabinfo.numa_policy.active_objs 682.00 ± 6% +15.9% 790.50 ± 6% slabinfo.numa_policy.num_objs 1082230 -19.6% 869890 ± 5% proc-vmstat.htlb_buddy_alloc_success 1721553 -6.8% 1604364 proc-vmstat.nr_dirty_background_threshold 3447317 -6.8% 3212652 proc-vmstat.nr_dirty_threshold 17371789 -6.8% 16197198 proc-vmstat.nr_free_pages 351.00 +3.8% 364.25 proc-vmstat.nr_inactive_file 39705 +1.4% 40269 proc-vmstat.nr_kernel_stack 12252 ± 7% -13.7% 10570 ± 3% proc-vmstat.nr_mapped 2632 +8.8% 2863 proc-vmstat.nr_page_table_pages 98880 -1.6% 97341 proc-vmstat.nr_slab_unreclaimable 351.00 +3.8% 364.25 proc-vmstat.nr_zone_inactive_file 6285 ± 50% -90.8% 577.50 ± 47% proc-vmstat.numa_hint_faults 6285 ± 50% -90.8% 577.50 ± 47% proc-vmstat.numa_hint_faults_local 2514799 -12.3% 2205532 ± 3% proc-vmstat.numa_hit 2514798 -12.3% 2205531 ± 3% proc-vmstat.numa_local 5.557e+08 -19.6% 4.469e+08 ± 5% proc-vmstat.pgalloc_normal 2510883 -12.9% 2187221 ± 3% proc-vmstat.pgfault 5.553e+08 -19.5% 4.468e+08 ± 5% proc-vmstat.pgfree 60107 ± 2% -19.7% 48269 ± 17% sched_debug.cfs_rq:/.exec_clock.avg 71511 ± 2% -23.4% 54794 ± 16% sched_debug.cfs_rq:/.exec_clock.max 44464 ± 7% -16.9% 36954 ± 18% sched_debug.cfs_rq:/.exec_clock.min 4619 ± 4% -47.8% 2412 ± 11% sched_debug.cfs_rq:/.exec_clock.stddev 614.00 ± 10% +371.9% 2897 ±124% sched_debug.cfs_rq:/.load_avg.max 49.58 ± 11% +321.1% 208.79 ±123% sched_debug.cfs_rq:/.load_avg.stddev 11526482 ± 4% -37.6% 7189313 ± 17% sched_debug.cfs_rq:/.min_vruntime.avg 13399855 ± 4% -40.0% 8039878 ± 15% sched_debug.cfs_rq:/.min_vruntime.max 8425626 ± 8% -37.2% 5294770 ± 18% sched_debug.cfs_rq:/.min_vruntime.min 788640 ± 4% -56.4% 343805 ± 11% sched_debug.cfs_rq:/.min_vruntime.stddev 0.37 ± 8% -40.0% 0.22 ± 10% sched_debug.cfs_rq:/.nr_running.avg 21.17 ± 5% +134.9% 49.72 ± 21% sched_debug.cfs_rq:/.nr_spread_over.avg 56.15 ± 13% +60.7% 90.25 ± 19% sched_debug.cfs_rq:/.nr_spread_over.max 6.95 ± 7% +289.4% 27.06 ± 23% sched_debug.cfs_rq:/.nr_spread_over.min 7.32 ± 5% +39.4% 10.20 ± 19% sched_debug.cfs_rq:/.nr_spread_over.stddev 413.38 ± 11% -27.5% 299.85 ± 14% sched_debug.cfs_rq:/.runnable_avg.avg 834.44 ± 53% -65.7% 286.48 ± 5% sched_debug.cfs_rq:/.runnable_avg.stddev 2625208 ± 11% -29.7% 1845657 ± 13% sched_debug.cfs_rq:/.spread0.avg 4483653 ± 6% -39.8% 2699533 ± 11% sched_debug.cfs_rq:/.spread0.max -475138 -94.3% -26940 sched_debug.cfs_rq:/.spread0.min 801419 ± 4% -56.8% 345835 ± 11% sched_debug.cfs_rq:/.spread0.stddev 371.84 ± 8% -22.5% 288.10 ± 14% sched_debug.cfs_rq:/.util_avg.avg 382.64 ± 4% -32.5% 258.09 ± 4% sched_debug.cfs_rq:/.util_avg.stddev 330.75 ± 10% -54.8% 149.57 ± 7% sched_debug.cfs_rq:/.util_est_enqueued.avg 358.21 ± 6% -27.6% 259.25 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.stddev 4047967 ± 4% +17.6% 4760305 ± 4% sched_debug.cpu.avg_idle.avg 561715 ± 52% +116.4% 1215479 ± 7% sched_debug.cpu.avg_idle.min 731.80 ± 6% -38.6% 449.23 ± 8% sched_debug.cpu.clock.stddev 731.80 ± 6% -38.6% 449.23 ± 8% sched_debug.cpu.clock_task.stddev 4741 ± 13% -43.0% 2702 ± 18% sched_debug.cpu.curr->pid.avg 5519 ± 7% -15.8% 4650 ± 11% sched_debug.cpu.curr->pid.stddev 2119875 ± 5% +16.3% 2465873 ± 4% sched_debug.cpu.max_idle_balance_cost.avg 1107931 ± 2% +24.6% 1380330 ± 3% sched_debug.cpu.max_idle_balance_cost.min 581556 ± 5% +11.1% 646020 ± 5% sched_debug.cpu.max_idle_balance_cost.stddev 0.00 ± 4% -30.8% 0.00 ± 11% sched_debug.cpu.next_balance.stddev 0.31 ± 12% -32.6% 0.21 ± 10% sched_debug.cpu.nr_running.avg 5116 +46.1% 7477 ± 11% sched_debug.cpu.nr_switches.avg 2301 ± 5% +85.0% 4257 ± 22% sched_debug.cpu.nr_switches.min 0.09 ± 44% +300.2% 0.34 ± 17% sched_debug.cpu.nr_uninterruptible.avg 296.40 ± 3% +24.1% 367.95 ± 8% sched_debug.cpu.nr_uninterruptible.max -50.40 +38.8% -69.98 sched_debug.cpu.nr_uninterruptible.min 23.04 ± 3% +53.3% 35.32 ± 12% sched_debug.cpu.nr_uninterruptible.stddev 2343 +98.2% 4646 ± 18% sched_debug.cpu.sched_count.avg 1110 ± 2% +193.0% 3252 ± 23% sched_debug.cpu.sched_count.min 913.60 ± 2% +125.6% 2060 ± 18% sched_debug.cpu.sched_goidle.avg 356.95 +296.7% 1416 ± 25% sched_debug.cpu.sched_goidle.min 1148 +102.6% 2326 ± 18% sched_debug.cpu.ttwu_count.avg 510.15 ± 5% +80.8% 922.26 ± 21% sched_debug.cpu.ttwu_count.min 148.25 ± 6% -11.3% 131.52 ± 6% sched_debug.cpu.ttwu_local.stddev 21.96 ± 6% -10.0 11.99 ± 11% perf-profile.calltrace.cycles-pp.hugetlb_cow.hugetlb_fault.handle_mm_fault.do_page_fault.page_fault 19.05 ± 5% -8.1 10.96 ± 11% perf-profile.calltrace.cycles-pp.copy_user_huge_page.hugetlb_cow.hugetlb_fault.handle_mm_fault.do_page_fault 18.72 ± 5% -8.0 10.76 ± 11% perf-profile.calltrace.cycles-pp.copy_subpage.copy_user_huge_page.hugetlb_cow.hugetlb_fault.handle_mm_fault 17.82 ± 4% -7.6 10.17 ± 10% perf-profile.calltrace.cycles-pp.copy_page.copy_subpage.copy_user_huge_page.hugetlb_cow.hugetlb_fault 2.22 ± 44% -1.5 0.68 ± 23% perf-profile.calltrace.cycles-pp.alloc_huge_page.hugetlb_cow.hugetlb_fault.handle_mm_fault.do_page_fault 1.03 ± 22% -0.6 0.40 ±102% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.do_access 0.91 ± 23% -0.6 0.32 ±103% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.do_access 0.81 ± 19% -0.2 0.60 ± 14% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.do_exit.do_group_exit 0.81 ± 19% -0.2 0.60 ± 14% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput.do_exit 0.80 ± 19% -0.2 0.60 ± 14% perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput 0.79 ± 19% -0.2 0.59 ± 15% perf-profile.calltrace.cycles-pp.__free_huge_page.release_pages.tlb_flush_mmu.tlb_finish_mmu.exit_mmap 1.44 ± 22% +0.6 2.00 ± 28% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues 0.71 ± 80% +1.5 2.16 ± 33% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.osq_lock 1.03 ± 55% +1.6 2.67 ± 32% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.osq_lock.__mutex_lock 1.24 ± 57% +2.0 3.29 ± 26% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.osq_lock.__mutex_lock.hugetlb_fault 1.38 ± 55% +2.3 3.66 ± 25% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.osq_lock.__mutex_lock.hugetlb_fault.handle_mm_fault 29.76 ± 21% +20.1 49.83 ± 13% perf-profile.calltrace.cycles-pp.__mutex_lock.hugetlb_fault.handle_mm_fault.do_page_fault.page_fault 15.71 ± 27% +23.2 38.88 ± 18% perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.hugetlb_fault.handle_mm_fault.do_page_fault 21.96 ± 6% -10.0 12.00 ± 11% perf-profile.children.cycles-pp.hugetlb_cow 19.36 ± 5% -8.2 11.11 ± 11% perf-profile.children.cycles-pp.copy_user_huge_page 18.74 ± 5% -8.0 10.77 ± 11% perf-profile.children.cycles-pp.copy_subpage 18.31 ± 5% -7.8 10.54 ± 11% perf-profile.children.cycles-pp.copy_page 16.95 ± 20% -7.0 10.00 ± 53% perf-profile.children.cycles-pp.do_rw_once 2.46 ± 41% -1.7 0.80 ± 14% perf-profile.children.cycles-pp.alloc_huge_page 3.11 ± 36% -1.6 1.48 ± 4% perf-profile.children.cycles-pp._raw_spin_lock 2.64 ± 44% -1.5 1.10 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 1.60 ± 38% -1.0 0.57 ± 14% perf-profile.children.cycles-pp.alloc_surplus_huge_page 1.81 ± 12% -0.5 1.34 ± 4% perf-profile.children.cycles-pp.do_syscall_64 1.81 ± 12% -0.5 1.35 ± 4% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 0.76 ± 28% -0.4 0.38 ± 12% perf-profile.children.cycles-pp.alloc_fresh_huge_page 1.21 ± 10% -0.4 0.85 ± 11% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.40 ± 52% -0.3 0.09 ± 20% perf-profile.children.cycles-pp.prep_new_huge_page 0.81 ± 19% -0.2 0.60 ± 14% perf-profile.children.cycles-pp.tlb_finish_mmu 0.81 ± 19% -0.2 0.60 ± 14% perf-profile.children.cycles-pp.tlb_flush_mmu 0.80 ± 18% -0.2 0.60 ± 15% perf-profile.children.cycles-pp.release_pages 0.79 ± 19% -0.2 0.59 ± 15% perf-profile.children.cycles-pp.__free_huge_page 0.44 ± 13% -0.2 0.26 ± 14% perf-profile.children.cycles-pp.___might_sleep 0.20 ± 14% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.update_and_free_page 0.32 ± 12% -0.1 0.21 ± 6% perf-profile.children.cycles-pp.ksys_read 0.29 ± 13% -0.1 0.18 ± 10% perf-profile.children.cycles-pp.read 0.31 ± 11% -0.1 0.20 ± 8% perf-profile.children.cycles-pp.vfs_read 0.18 ± 17% -0.1 0.09 ± 8% perf-profile.children.cycles-pp._cond_resched 0.16 ± 9% -0.1 0.09 ± 17% perf-profile.children.cycles-pp.__libc_start_main 0.16 ± 11% -0.1 0.08 ± 17% perf-profile.children.cycles-pp.main 0.19 ± 14% -0.1 0.12 ± 17% perf-profile.children.cycles-pp.x86_pmu_disable 0.26 ± 8% -0.1 0.19 ± 6% perf-profile.children.cycles-pp.ksys_write 0.26 ± 9% -0.1 0.19 ± 8% perf-profile.children.cycles-pp.vfs_write 0.15 ± 12% -0.1 0.09 ± 20% perf-profile.children.cycles-pp.new_sync_read 0.15 ± 11% -0.1 0.09 ± 17% perf-profile.children.cycles-pp.pipe_read 0.24 ± 9% -0.1 0.18 ± 7% perf-profile.children.cycles-pp.new_sync_write 0.08 ± 6% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__perf_sw_event 0.11 ± 14% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.__wake_up_common 0.12 ± 3% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.schedule_timeout 0.12 ± 13% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.__wake_up_common_lock 0.10 ± 15% -0.0 0.06 ± 15% perf-profile.children.cycles-pp.autoremove_wake_function 0.11 ± 29% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.26 ± 6% -0.0 0.22 ± 5% perf-profile.children.cycles-pp.tick_program_event 0.09 ± 31% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.prepare_exit_to_usermode 0.09 ± 9% -0.0 0.06 ± 13% perf-profile.children.cycles-pp.rcu_gp_kthread 0.08 ± 10% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.cmd_stat 0.01 ±173% +0.0 0.06 ± 11% perf-profile.children.cycles-pp.select_task_rq_fair 0.11 ± 11% +0.0 0.16 ± 9% perf-profile.children.cycles-pp.finish_task_switch 0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.rwsem_wake 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.arch_stack_walk 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.dequeue_task_fair 0.00 +0.1 0.07 ± 13% perf-profile.children.cycles-pp.stack_trace_save_tsk 0.13 ± 6% +0.1 0.21 ± 10% perf-profile.children.cycles-pp.schedule_idle 0.06 ± 11% +0.1 0.14 ± 10% perf-profile.children.cycles-pp.enqueue_entity 0.03 ±100% +0.1 0.11 ± 7% perf-profile.children.cycles-pp.update_load_avg 0.00 +0.1 0.09 ± 12% perf-profile.children.cycles-pp.__account_scheduler_latency 0.07 ± 17% +0.1 0.16 ± 11% perf-profile.children.cycles-pp.activate_task 0.07 ± 17% +0.1 0.16 ± 11% perf-profile.children.cycles-pp.ttwu_do_activate 0.07 ± 17% +0.1 0.16 ± 11% perf-profile.children.cycles-pp.enqueue_task_fair 0.00 +0.1 0.09 ± 8% perf-profile.children.cycles-pp.wake_up_q 0.14 ± 24% +0.1 0.27 ± 13% perf-profile.children.cycles-pp.schedule_preempt_disabled 0.00 +0.1 0.14 ± 15% perf-profile.children.cycles-pp.sched_ttwu_pending 1.17 ± 13% +0.4 1.56 ± 8% perf-profile.children.cycles-pp.load_balance 0.99 ± 11% +0.4 1.41 ± 9% perf-profile.children.cycles-pp.find_busiest_group 0.96 ± 11% +0.4 1.38 ± 9% perf-profile.children.cycles-pp.update_sd_lb_stats 0.66 ± 9% +0.5 1.20 ± 11% perf-profile.children.cycles-pp.newidle_balance 0.53 ± 7% +0.6 1.11 ± 12% perf-profile.children.cycles-pp.pick_next_task_fair 0.71 ± 8% +0.6 1.35 ± 10% perf-profile.children.cycles-pp.schedule 0.00 +0.7 0.68 ± 17% perf-profile.children.cycles-pp.rwsem_down_read_slowpath 0.86 ± 7% +0.7 1.58 ± 9% perf-profile.children.cycles-pp.__schedule 52.14 ± 14% +10.7 62.86 ± 9% perf-profile.children.cycles-pp.page_fault 52.09 ± 14% +10.7 62.83 ± 9% perf-profile.children.cycles-pp.do_page_fault 51.96 ± 14% +10.8 62.74 ± 9% perf-profile.children.cycles-pp.handle_mm_fault 51.86 ± 14% +10.8 62.67 ± 9% perf-profile.children.cycles-pp.hugetlb_fault 29.77 ± 21% +20.1 49.84 ± 13% perf-profile.children.cycles-pp.__mutex_lock 15.83 ± 27% +23.4 39.18 ± 18% perf-profile.children.cycles-pp.osq_lock 16.53 ± 4% -7.1 9.48 ± 9% perf-profile.self.cycles-pp.copy_page 15.27 ± 22% -6.4 8.90 ± 53% perf-profile.self.cycles-pp.do_rw_once 2.38 ± 42% -1.4 1.02 ± 7% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.70 ± 9% -0.2 0.48 ± 14% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler 0.38 ± 2% -0.2 0.21 ± 11% perf-profile.self.cycles-pp.copy_subpage 0.33 ± 4% -0.2 0.17 ± 11% perf-profile.self.cycles-pp.copy_user_huge_page 0.18 ± 18% -0.1 0.05 ± 8% perf-profile.self.cycles-pp.update_and_free_page 0.19 ± 14% -0.1 0.11 ± 18% perf-profile.self.cycles-pp.x86_pmu_disable 0.19 ± 6% -0.1 0.12 ± 10% perf-profile.self.cycles-pp.___might_sleep 0.35 ± 14% -0.1 0.28 ± 8% perf-profile.self.cycles-pp.run_timer_softirq 0.18 ± 10% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.get_page_from_freelist 0.26 ± 6% -0.0 0.22 ± 5% perf-profile.self.cycles-pp.tick_program_event 0.07 -0.0 0.06 ± 7% perf-profile.self.cycles-pp.try_to_wake_up 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.update_load_avg 0.73 ± 12% +0.3 1.06 ± 8% perf-profile.self.cycles-pp.update_sd_lb_stats 14.37 ± 25% +21.2 35.60 ± 18% perf-profile.self.cycles-pp.osq_lock 22773 ± 3% +11.6% 25420 ± 2% softirqs.CPU0.SCHED 15462 ± 6% +24.5% 19248 ± 5% softirqs.CPU1.SCHED 8331 ± 11% +27.1% 10590 ± 11% softirqs.CPU10.RCU 14783 ± 4% +16.0% 17145 ± 4% softirqs.CPU10.SCHED 14236 ± 3% +15.6% 16462 ± 2% softirqs.CPU100.SCHED 14117 ± 3% +18.2% 16683 ± 3% softirqs.CPU101.SCHED 13918 ± 4% +18.4% 16472 ± 5% softirqs.CPU102.SCHED 14183 ± 6% +18.0% 16742 ± 3% softirqs.CPU103.SCHED 13795 ± 5% +19.8% 16528 softirqs.CPU104.SCHED 14326 ± 6% +17.7% 16859 softirqs.CPU105.SCHED 13842 ± 5% +19.4% 16530 ± 2% softirqs.CPU106.SCHED 14155 ± 4% +20.0% 16983 ± 2% softirqs.CPU107.SCHED 13907 ± 3% +18.6% 16492 ± 2% softirqs.CPU108.SCHED 14411 ± 7% +16.1% 16726 ± 2% softirqs.CPU109.SCHED 14354 +19.0% 17085 ± 2% softirqs.CPU11.SCHED 13689 ± 6% +21.8% 16667 ± 3% softirqs.CPU110.SCHED 13461 ± 6% +25.6% 16907 ± 3% softirqs.CPU111.SCHED 13738 ± 9% +23.2% 16925 softirqs.CPU112.SCHED 14135 ± 3% +20.5% 17032 softirqs.CPU113.SCHED 14477 ± 4% +20.8% 17491 ± 4% softirqs.CPU114.SCHED 123003 ± 2% -7.8% 113426 ± 2% softirqs.CPU114.TIMER 14014 ± 4% +23.4% 17299 softirqs.CPU115.SCHED 13528 ± 6% +24.4% 16824 ± 2% softirqs.CPU116.SCHED 13530 ± 6% +24.5% 16840 ± 2% softirqs.CPU117.SCHED 14263 ± 3% +16.1% 16557 ± 2% softirqs.CPU119.SCHED 7902 ± 2% +22.1% 9648 ± 6% softirqs.CPU12.RCU 14332 ± 3% +19.5% 17130 ± 4% softirqs.CPU12.SCHED 13476 ± 5% +26.5% 17047 softirqs.CPU120.SCHED 14240 ± 6% +20.7% 17183 softirqs.CPU121.SCHED 13161 ± 5% +27.0% 16708 ± 2% softirqs.CPU122.SCHED 13037 ± 7% +28.8% 16786 softirqs.CPU123.SCHED 14229 ± 5% +16.5% 16577 ± 3% softirqs.CPU124.SCHED 14427 ± 4% +15.4% 16652 softirqs.CPU125.SCHED 14426 ± 4% +16.3% 16771 softirqs.CPU126.SCHED 6680 +39.3% 9305 ± 22% softirqs.CPU127.RCU 13659 ± 3% +23.7% 16890 ± 3% softirqs.CPU128.SCHED 14396 ± 5% +17.9% 16979 ± 3% softirqs.CPU129.SCHED 14183 ± 7% +20.2% 17048 ± 2% softirqs.CPU13.SCHED 6700 ± 2% +35.8% 9097 ± 17% softirqs.CPU130.RCU 13949 ± 4% +22.2% 17051 ± 4% softirqs.CPU130.SCHED 14271 ± 4% +21.8% 17379 ± 2% softirqs.CPU131.SCHED 129315 ± 3% -7.0% 120290 softirqs.CPU131.TIMER 14135 ± 2% +16.0% 16396 ± 2% softirqs.CPU132.SCHED 13567 ± 4% +22.5% 16617 ± 3% softirqs.CPU133.SCHED 13912 ± 5% +20.1% 16712 ± 2% softirqs.CPU134.SCHED 14309 ± 5% +18.9% 17016 ± 2% softirqs.CPU135.SCHED 13637 ± 4% +20.3% 16402 ± 5% softirqs.CPU136.SCHED 13843 ± 4% +19.3% 16518 ± 2% softirqs.CPU137.SCHED 14049 ± 5% +19.2% 16750 ± 2% softirqs.CPU138.SCHED 14244 ± 7% +18.1% 16816 softirqs.CPU139.SCHED 14139 +22.1% 17271 ± 2% softirqs.CPU14.SCHED 13460 ± 8% +22.9% 16546 softirqs.CPU140.SCHED 13645 ± 6% +21.7% 16601 ± 2% softirqs.CPU141.SCHED 13278 ± 6% +25.5% 16661 ± 3% softirqs.CPU142.SCHED 12487 ± 5% +29.2% 16136 ± 2% softirqs.CPU143.SCHED 13440 ± 9% +22.8% 16502 softirqs.CPU144.SCHED 126064 ± 2% -8.1% 115836 softirqs.CPU144.TIMER 13995 ± 6% +21.2% 16966 ± 3% softirqs.CPU145.SCHED 13834 ± 3% +14.8% 15883 ± 6% softirqs.CPU146.SCHED 14297 ± 9% +17.1% 16735 softirqs.CPU147.SCHED 14500 ± 3% +15.2% 16711 softirqs.CPU148.SCHED 14419 ± 6% +17.5% 16945 softirqs.CPU149.SCHED 8018 ± 6% +24.4% 9977 ± 7% softirqs.CPU15.RCU 13832 ± 5% +28.2% 17737 ± 5% softirqs.CPU15.SCHED 14538 ± 5% +15.0% 16723 ± 2% softirqs.CPU150.SCHED 15092 +9.5% 16526 ± 4% softirqs.CPU152.SCHED 14533 ± 2% +15.6% 16804 softirqs.CPU153.SCHED 14415 ± 2% +14.8% 16554 ± 2% softirqs.CPU154.SCHED 14583 ± 2% +15.4% 16833 ± 2% softirqs.CPU155.SCHED 14851 ± 2% +11.8% 16598 ± 2% softirqs.CPU156.SCHED 6747 +35.2% 9124 ± 19% softirqs.CPU158.RCU 13839 ± 4% +25.9% 17429 ± 4% softirqs.CPU158.SCHED 15020 ± 5% +11.8% 16785 ± 2% softirqs.CPU159.SCHED 13468 ± 5% +25.8% 16945 ± 2% softirqs.CPU16.SCHED 128305 ± 3% -8.1% 117855 softirqs.CPU160.TIMER 15111 ± 2% +13.7% 17184 softirqs.CPU162.SCHED 14788 ± 2% +12.8% 16685 ± 3% softirqs.CPU163.SCHED 13903 ± 5% +21.5% 16889 softirqs.CPU164.SCHED 14547 ± 5% +13.5% 16510 ± 2% softirqs.CPU165.SCHED 14440 ± 4% +13.3% 16354 ± 3% softirqs.CPU166.SCHED 14450 ± 5% +14.1% 16494 ± 2% softirqs.CPU167.SCHED 131454 ± 3% -6.9% 122396 ± 2% softirqs.CPU167.TIMER 13683 ± 6% +23.0% 16824 ± 3% softirqs.CPU168.SCHED 14468 ± 5% +18.1% 17085 ± 3% softirqs.CPU169.SCHED 7703 +22.5% 9437 ± 4% softirqs.CPU17.RCU 14392 +19.8% 17237 softirqs.CPU17.SCHED 14570 ± 6% +16.9% 17038 ± 3% softirqs.CPU170.SCHED 14172 ± 5% +19.3% 16905 softirqs.CPU171.SCHED 14176 ± 3% +17.9% 16709 softirqs.CPU172.SCHED 127159 ± 2% -8.4% 116497 ± 2% softirqs.CPU172.TIMER 15034 ± 2% +11.1% 16698 ± 2% softirqs.CPU174.SCHED 14923 ± 8% +17.0% 17458 ± 5% softirqs.CPU175.SCHED 14164 ± 5% +18.8% 16833 ± 2% softirqs.CPU176.SCHED 127027 ± 2% -8.4% 116378 ± 2% softirqs.CPU176.TIMER 14359 ± 3% +16.9% 16788 ± 4% softirqs.CPU177.SCHED 14466 ± 3% +18.7% 17169 softirqs.CPU178.SCHED 14632 ± 2% +15.1% 16837 softirqs.CPU179.SCHED 123562 ± 3% -8.2% 113392 ± 2% softirqs.CPU179.TIMER 7677 +27.6% 9794 ± 2% softirqs.CPU18.RCU 14177 ± 2% +21.6% 17233 softirqs.CPU18.SCHED 14429 ± 7% +15.8% 16707 softirqs.CPU180.SCHED 15194 ± 5% +12.4% 17084 softirqs.CPU181.SCHED 13917 ± 3% +20.2% 16723 ± 3% softirqs.CPU182.SCHED 14587 ± 2% +15.1% 16786 ± 3% softirqs.CPU183.SCHED 14266 ± 3% +18.0% 16827 ± 2% softirqs.CPU184.SCHED 14661 ± 3% +16.3% 17053 softirqs.CPU185.SCHED 14222 ± 5% +21.0% 17202 ± 3% softirqs.CPU186.SCHED 15059 ± 2% +13.0% 17022 ± 3% softirqs.CPU187.SCHED 125388 ± 2% -7.6% 115887 ± 2% softirqs.CPU187.TIMER 13435 ± 4% +25.0% 16801 ± 3% softirqs.CPU188.SCHED 13434 ± 2% +28.8% 17297 ± 2% softirqs.CPU189.SCHED 7719 +27.0% 9806 ± 9% softirqs.CPU19.RCU 14075 ± 2% +20.7% 16986 softirqs.CPU19.SCHED 13735 ± 3% +20.4% 16536 ± 2% softirqs.CPU190.SCHED 13772 ± 3% +19.8% 16494 softirqs.CPU192.SCHED 13911 ± 2% +17.4% 16327 ± 2% softirqs.CPU193.SCHED 6417 +34.3% 8616 ± 17% softirqs.CPU194.RCU 14008 +17.6% 16468 ± 8% softirqs.CPU194.SCHED 14094 ± 4% +19.9% 16905 softirqs.CPU195.SCHED 14387 ± 7% +16.1% 16698 ± 5% softirqs.CPU196.SCHED 13704 ± 3% +23.7% 16952 softirqs.CPU198.SCHED 8214 ± 10% +23.7% 10157 ± 7% softirqs.CPU2.RCU 14431 +17.4% 16946 ± 4% softirqs.CPU2.SCHED 7770 +30.4% 10135 ± 8% softirqs.CPU20.RCU 13996 ± 2% +23.7% 17320 softirqs.CPU20.SCHED 14611 ± 5% +12.7% 16463 ± 3% softirqs.CPU200.SCHED 14897 ± 3% +15.5% 17199 softirqs.CPU201.SCHED 14105 ± 6% +21.7% 17167 ± 2% softirqs.CPU202.SCHED 127698 ± 3% -7.1% 118685 softirqs.CPU202.TIMER 14369 ± 6% +18.6% 17048 ± 2% softirqs.CPU203.SCHED 126668 ± 3% -8.8% 115539 softirqs.CPU203.TIMER 14461 ± 4% +13.1% 16356 ± 3% softirqs.CPU205.SCHED 13139 ± 10% +26.6% 16634 ± 3% softirqs.CPU206.SCHED 14808 ± 2% +11.8% 16550 ± 2% softirqs.CPU207.SCHED 13744 ± 5% +21.0% 16624 ± 4% softirqs.CPU208.SCHED 14039 ± 5% +18.7% 16661 ± 2% softirqs.CPU209.SCHED 127488 ± 2% -8.2% 116998 softirqs.CPU209.TIMER 7755 ± 2% +30.5% 10122 ± 12% softirqs.CPU21.RCU 13731 ± 5% +25.2% 17185 ± 2% softirqs.CPU21.SCHED 14755 ± 6% +16.1% 17123 ± 4% softirqs.CPU211.SCHED 13920 ± 3% +18.5% 16501 ± 2% softirqs.CPU212.SCHED 14435 ± 4% +16.1% 16765 ± 3% softirqs.CPU213.SCHED 13857 ± 6% +21.6% 16844 ± 2% softirqs.CPU214.SCHED 13417 ± 8% +16.5% 15635 ± 2% softirqs.CPU215.SCHED 127636 ± 3% -7.4% 118224 softirqs.CPU215.TIMER 13715 ± 3% +21.7% 16686 ± 3% softirqs.CPU216.SCHED 126421 ± 2% -7.8% 116544 softirqs.CPU216.TIMER 13885 ± 5% +18.2% 16416 softirqs.CPU217.SCHED 14003 ± 8% +20.5% 16875 softirqs.CPU218.SCHED 13891 ± 4% +23.9% 17210 ± 4% softirqs.CPU22.SCHED 14901 ± 2% +12.0% 16694 ± 2% softirqs.CPU220.SCHED 14623 ± 6% +17.3% 17153 softirqs.CPU221.SCHED 14613 ± 8% +13.9% 16643 ± 2% softirqs.CPU224.SCHED 14745 ± 4% +12.9% 16643 softirqs.CPU225.SCHED 126232 -8.3% 115717 softirqs.CPU225.TIMER 14290 ± 2% +17.2% 16753 softirqs.CPU226.SCHED 15229 ± 3% +10.3% 16800 ± 3% softirqs.CPU228.SCHED 14282 ± 6% +15.4% 16479 ± 3% softirqs.CPU23.SCHED 13785 ± 9% +24.2% 17126 ± 4% softirqs.CPU230.SCHED 126791 ± 4% -9.4% 114889 ± 3% softirqs.CPU231.TIMER 14749 ± 3% +15.0% 16958 ± 3% softirqs.CPU232.SCHED 15099 ± 5% +11.9% 16893 ± 2% softirqs.CPU233.SCHED 14825 ± 6% +12.9% 16738 softirqs.CPU234.SCHED 14272 ± 5% +18.7% 16945 ± 2% softirqs.CPU236.SCHED 15187 ± 2% +10.9% 16846 softirqs.CPU237.SCHED 15267 ± 7% +11.1% 16955 ± 3% softirqs.CPU239.SCHED 14156 ± 4% +16.3% 16466 ± 3% softirqs.CPU24.SCHED 14671 ± 3% +13.9% 16711 ± 3% softirqs.CPU240.SCHED 127318 ± 2% -7.6% 117651 ± 2% softirqs.CPU240.TIMER 14218 ± 5% +20.2% 17097 softirqs.CPU241.SCHED 14554 ± 3% +15.2% 16771 softirqs.CPU242.SCHED 14003 +19.9% 16785 softirqs.CPU243.SCHED 13761 ± 6% +21.5% 16724 ± 2% softirqs.CPU244.SCHED 14418 ± 6% +16.4% 16781 softirqs.CPU245.SCHED 14760 ± 7% +14.8% 16940 ± 4% softirqs.CPU246.SCHED 14891 ± 3% +12.3% 16722 ± 4% softirqs.CPU249.SCHED 13823 ± 4% +24.1% 17148 softirqs.CPU25.SCHED 14201 ± 4% +18.1% 16774 ± 3% softirqs.CPU250.SCHED 14620 ± 10% +18.5% 17331 softirqs.CPU251.SCHED 14877 ± 3% +11.3% 16564 ± 2% softirqs.CPU252.SCHED 14517 ± 6% +16.3% 16877 ± 3% softirqs.CPU254.SCHED 14284 ± 7% +18.0% 16858 ± 4% softirqs.CPU255.SCHED 121538 ± 3% -7.5% 112473 softirqs.CPU255.TIMER 14582 +14.8% 16736 softirqs.CPU256.SCHED 14057 ± 3% +22.8% 17259 softirqs.CPU257.SCHED 15076 ± 3% +13.4% 17097 ± 3% softirqs.CPU258.SCHED 14356 ± 3% +20.2% 17251 ± 3% softirqs.CPU259.SCHED 13998 ± 3% +20.1% 16806 ± 2% softirqs.CPU26.SCHED 13899 ± 4% +19.0% 16534 ± 5% softirqs.CPU260.SCHED 128277 ± 4% -7.4% 118758 softirqs.CPU260.TIMER 14288 ± 5% +20.7% 17251 softirqs.CPU261.SCHED 14456 ± 5% +15.1% 16644 softirqs.CPU262.SCHED 14114 ± 2% +17.8% 16624 ± 4% softirqs.CPU263.SCHED 13328 ± 4% +25.0% 16657 softirqs.CPU264.SCHED 13328 ± 4% +25.1% 16676 ± 4% softirqs.CPU266.SCHED 14367 ± 3% +19.5% 17165 ± 2% softirqs.CPU267.SCHED 122663 ± 3% -7.6% 113293 ± 2% softirqs.CPU268.TIMER 13527 ± 6% +25.2% 16940 softirqs.CPU27.SCHED 14341 ± 5% +19.8% 17187 softirqs.CPU270.SCHED 14345 ± 5% +14.3% 16403 ± 5% softirqs.CPU271.SCHED 14990 ± 3% +14.4% 17152 ± 4% softirqs.CPU272.SCHED 15007 ± 2% +13.4% 17012 softirqs.CPU273.SCHED 14668 ± 8% +17.0% 17157 ± 4% softirqs.CPU274.SCHED 14287 ± 6% +17.2% 16749 ± 4% softirqs.CPU277.SCHED 6301 +41.8% 8938 ± 16% softirqs.CPU278.RCU 13980 ± 10% +24.6% 17424 ± 2% softirqs.CPU278.SCHED 14763 ± 7% +16.0% 17119 softirqs.CPU279.SCHED 13682 ± 5% +23.9% 16950 softirqs.CPU28.SCHED 14204 ± 3% +17.0% 16617 ± 3% softirqs.CPU280.SCHED 14202 ± 3% +14.4% 16240 ± 2% softirqs.CPU281.SCHED 14629 ± 7% +16.3% 17013 ± 3% softirqs.CPU283.SCHED 13692 ± 6% +22.7% 16795 softirqs.CPU284.SCHED 14194 ± 7% +17.5% 16679 ± 3% softirqs.CPU285.SCHED 123721 ± 3% -8.1% 113741 ± 3% softirqs.CPU285.TIMER 14757 ± 7% +15.5% 17050 softirqs.CPU286.SCHED 13560 ± 6% +17.2% 15894 softirqs.CPU287.SCHED 14201 ± 4% +19.9% 17020 ± 2% softirqs.CPU29.SCHED 14345 ± 3% +20.5% 17292 softirqs.CPU3.SCHED 13910 ± 4% +20.9% 16814 ± 4% softirqs.CPU30.SCHED 7587 +41.8% 10759 ± 23% softirqs.CPU31.RCU 13401 ± 4% +26.6% 16967 ± 2% softirqs.CPU31.SCHED 13593 +24.6% 16937 softirqs.CPU32.SCHED 13175 ± 2% +29.0% 16989 softirqs.CPU33.SCHED 13491 ± 5% +25.8% 16974 ± 3% softirqs.CPU34.SCHED 13520 ± 7% +25.9% 17018 ± 2% softirqs.CPU35.SCHED 13723 ± 6% +22.1% 16763 ± 2% softirqs.CPU36.SCHED 13449 ± 3% +27.1% 17091 softirqs.CPU37.SCHED 7405 +40.0% 10368 ± 17% softirqs.CPU38.RCU 14299 ± 6% +22.4% 17509 ± 3% softirqs.CPU38.SCHED 14269 ± 3% +18.6% 16918 softirqs.CPU39.SCHED 7977 ± 2% +23.6% 9862 ± 5% softirqs.CPU4.RCU 14055 ± 2% +23.4% 17349 ± 3% softirqs.CPU4.SCHED 14257 ± 2% +19.4% 17030 ± 2% softirqs.CPU40.SCHED 13774 ± 2% +24.1% 17090 softirqs.CPU41.SCHED 14425 ± 8% +17.7% 16976 softirqs.CPU42.SCHED 14314 ± 2% +21.2% 17345 ± 2% softirqs.CPU43.SCHED 13274 ± 4% +27.7% 16954 softirqs.CPU44.SCHED 135612 ± 10% -15.7% 114264 ± 3% softirqs.CPU44.TIMER 13919 ± 2% +20.9% 16829 softirqs.CPU45.SCHED 13156 +27.9% 16834 ± 2% softirqs.CPU46.SCHED 13617 ± 2% +22.0% 16614 softirqs.CPU47.SCHED 13565 ± 3% +25.7% 17054 ± 2% softirqs.CPU48.SCHED 13791 ± 4% +21.6% 16769 softirqs.CPU49.SCHED 14260 ± 3% +20.1% 17126 ± 4% softirqs.CPU5.SCHED 13510 ± 7% +25.3% 16934 softirqs.CPU50.SCHED 12790 ± 10% +30.3% 16669 softirqs.CPU51.SCHED 13989 +19.9% 16774 ± 3% softirqs.CPU52.SCHED 14279 ± 3% +17.1% 16722 ± 2% softirqs.CPU53.SCHED 7263 +36.9% 9940 ± 21% softirqs.CPU54.RCU 14088 ± 2% +20.1% 16918 softirqs.CPU54.SCHED 13508 ± 6% +23.1% 16629 softirqs.CPU55.SCHED 130302 ± 6% -9.4% 118014 ± 7% softirqs.CPU55.TIMER 13313 ± 3% +27.9% 17030 ± 2% softirqs.CPU56.SCHED 7360 ± 2% +33.2% 9803 ± 12% softirqs.CPU57.RCU 13818 ± 2% +21.3% 16768 ± 2% softirqs.CPU57.SCHED 7296 +27.1% 9274 ± 7% softirqs.CPU58.RCU 13922 ± 3% +23.4% 17181 ± 2% softirqs.CPU58.SCHED 7271 +30.3% 9476 ± 11% softirqs.CPU59.RCU 14169 ± 5% +19.7% 16956 ± 2% softirqs.CPU59.SCHED 8176 ± 7% +16.5% 9524 ± 3% softirqs.CPU6.RCU 13689 ± 3% +25.2% 17132 ± 5% softirqs.CPU6.SCHED 13645 ± 2% +23.3% 16825 softirqs.CPU60.SCHED 13441 ± 6% +24.9% 16786 ± 2% softirqs.CPU61.SCHED 13497 ± 5% +25.7% 16959 softirqs.CPU62.SCHED 13682 ± 4% +25.5% 17170 softirqs.CPU63.SCHED 13656 ± 6% +22.3% 16695 ± 3% softirqs.CPU64.SCHED 13704 ± 7% +22.7% 16819 softirqs.CPU65.SCHED 13683 ± 3% +23.0% 16826 softirqs.CPU66.SCHED 14076 ± 2% +19.3% 16797 ± 2% softirqs.CPU67.SCHED 13713 ± 4% +18.2% 16215 ± 2% softirqs.CPU68.SCHED 13396 ± 3% +25.1% 16754 ± 2% softirqs.CPU69.SCHED 8042 ± 3% +21.0% 9730 ± 7% softirqs.CPU7.RCU 13604 ± 3% +27.3% 17320 ± 5% softirqs.CPU7.SCHED 13023 ± 2% +29.2% 16828 ± 2% softirqs.CPU70.SCHED 12307 ± 3% +32.1% 16255 softirqs.CPU71.SCHED 7727 ± 22% +37.3% 10612 ± 22% softirqs.CPU72.RCU 13320 ± 3% +28.0% 17050 ± 2% softirqs.CPU72.SCHED 13838 ± 3% +22.0% 16883 ± 3% softirqs.CPU73.SCHED 14604 ± 2% +14.4% 16707 ± 4% softirqs.CPU74.SCHED 14184 ± 4% +19.1% 16892 ± 2% softirqs.CPU75.SCHED 14138 ± 4% +19.0% 16830 softirqs.CPU76.SCHED 7098 +28.1% 9090 ± 12% softirqs.CPU77.RCU 13082 ± 4% +28.0% 16741 softirqs.CPU77.SCHED 126355 ± 4% -10.8% 112765 ± 2% softirqs.CPU78.TIMER 14718 ± 5% +12.6% 16576 ± 3% softirqs.CPU79.SCHED 7959 ± 2% +27.1% 10119 ± 10% softirqs.CPU8.RCU 13775 ± 4% +25.1% 17232 ± 5% softirqs.CPU8.SCHED 14397 +13.6% 16355 ± 2% softirqs.CPU80.SCHED 13999 ± 6% +20.7% 16896 ± 2% softirqs.CPU81.SCHED 14129 ± 7% +18.2% 16706 softirqs.CPU82.SCHED 13931 +17.6% 16385 ± 3% softirqs.CPU83.SCHED 14455 ± 5% +16.1% 16776 ± 2% softirqs.CPU84.SCHED 14426 ± 5% +16.4% 16799 softirqs.CPU86.SCHED 7049 +28.2% 9036 ± 10% softirqs.CPU88.RCU 13901 ± 3% +20.1% 16697 ± 2% softirqs.CPU88.SCHED 127258 ± 2% -7.3% 118017 softirqs.CPU88.TIMER 14353 ± 5% +17.4% 16855 ± 2% softirqs.CPU89.SCHED 14823 ± 4% +14.7% 17004 softirqs.CPU9.SCHED 14278 ± 4% +18.4% 16908 softirqs.CPU90.SCHED 14225 ± 2% +18.8% 16894 ± 2% softirqs.CPU91.SCHED 7091 +26.7% 8987 ± 10% softirqs.CPU92.RCU 13726 ± 3% +24.0% 17014 ± 3% softirqs.CPU92.SCHED 14051 ± 5% +20.6% 16939 softirqs.CPU93.SCHED 14123 ± 4% +17.9% 16649 ± 3% softirqs.CPU94.SCHED 130109 ± 5% -8.2% 119400 softirqs.CPU95.TIMER 13638 ± 4% +23.5% 16847 ± 2% softirqs.CPU96.SCHED 13134 ± 2% +29.4% 17001 ± 3% softirqs.CPU97.SCHED 13357 ± 3% +25.7% 16791 ± 2% softirqs.CPU98.SCHED 14112 ± 6% +20.0% 16938 softirqs.CPU99.SCHED 1991578 +21.8% 2426642 ± 3% softirqs.RCU 4100803 +18.4% 4855612 softirqs.SCHED 454.00 ± 27% +675.8% 3522 ±139% interrupts.30:IR-PCI-MSI.2097153-edge.eth0-TxRx-0 384622 -1.6% 378485 interrupts.CAL:Function_call_interrupts 930.25 ± 8% -46.7% 496.00 ± 10% interrupts.CPU0.TLB:TLB_shootdowns 758.50 ± 9% -44.8% 418.75 ± 11% interrupts.CPU1.TLB:TLB_shootdowns 454.00 ± 27% +675.8% 3522 ±139% interrupts.CPU10.30:IR-PCI-MSI.2097153-edge.eth0-TxRx-0 886.75 ± 5% -39.4% 537.00 ± 3% interrupts.CPU10.TLB:TLB_shootdowns 169.50 ± 11% +67.0% 283.00 ± 9% interrupts.CPU100.TLB:TLB_shootdowns 178.50 ± 20% +44.0% 257.00 ± 9% interrupts.CPU101.TLB:TLB_shootdowns 169.00 ± 23% +62.7% 275.00 ± 20% interrupts.CPU104.TLB:TLB_shootdowns 1463 ± 28% +88.1% 2753 ± 22% interrupts.CPU105.NMI:Non-maskable_interrupts 1463 ± 28% +88.1% 2753 ± 22% interrupts.CPU105.PMI:Performance_monitoring_interrupts 158.75 ± 21% +73.4% 275.25 ± 4% interrupts.CPU106.TLB:TLB_shootdowns 157.50 ± 24% +67.3% 263.50 ± 13% interrupts.CPU109.TLB:TLB_shootdowns 2884 ± 27% -43.7% 1625 ± 6% interrupts.CPU11.NMI:Non-maskable_interrupts 2884 ± 27% -43.7% 1625 ± 6% interrupts.CPU11.PMI:Performance_monitoring_interrupts 713.50 ± 5% -38.8% 436.50 ± 13% interrupts.CPU11.TLB:TLB_shootdowns 146.00 ± 38% +79.3% 261.75 ± 14% interrupts.CPU110.TLB:TLB_shootdowns 162.00 ± 14% +82.6% 295.75 ± 12% interrupts.CPU112.TLB:TLB_shootdowns 445.75 ± 52% +170.1% 1204 ± 91% interrupts.CPU114.RES:Rescheduling_interrupts 160.25 ± 37% +70.8% 273.75 ± 14% interrupts.CPU114.TLB:TLB_shootdowns 1417 ± 17% +66.0% 2352 ± 34% interrupts.CPU115.NMI:Non-maskable_interrupts 1417 ± 17% +66.0% 2352 ± 34% interrupts.CPU115.PMI:Performance_monitoring_interrupts 380.75 ± 9% +37.9% 525.00 ± 15% interrupts.CPU116.RES:Rescheduling_interrupts 183.00 ± 9% +48.2% 271.25 ± 14% interrupts.CPU116.TLB:TLB_shootdowns 170.50 ± 15% +74.5% 297.50 ± 5% interrupts.CPU118.TLB:TLB_shootdowns 454.25 ± 38% +251.3% 1596 ±103% interrupts.CPU12.RES:Rescheduling_interrupts 847.00 ± 12% -36.9% 534.25 ± 10% interrupts.CPU12.TLB:TLB_shootdowns 173.25 ± 20% +65.7% 287.00 ± 13% interrupts.CPU122.TLB:TLB_shootdowns 420.50 ± 32% +80.5% 759.00 ± 37% interrupts.CPU123.RES:Rescheduling_interrupts 247.75 ± 22% +75.9% 435.75 ± 14% interrupts.CPU124.RES:Rescheduling_interrupts 181.75 ± 33% +58.7% 288.50 ± 15% interrupts.CPU126.TLB:TLB_shootdowns 364.75 ± 21% +39.1% 507.50 ± 11% interrupts.CPU128.RES:Rescheduling_interrupts 337.75 ± 24% +248.5% 1177 ± 74% interrupts.CPU13.RES:Rescheduling_interrupts 783.25 ± 14% -47.8% 409.00 ± 3% interrupts.CPU13.TLB:TLB_shootdowns 277.00 ± 14% +84.9% 512.25 ± 10% interrupts.CPU131.RES:Rescheduling_interrupts 155.75 ± 24% +71.7% 267.50 ± 21% interrupts.CPU132.TLB:TLB_shootdowns 174.25 ± 24% +50.4% 262.00 ± 19% interrupts.CPU133.TLB:TLB_shootdowns 137.00 ± 7% +116.4% 296.50 ± 11% interrupts.CPU134.TLB:TLB_shootdowns 152.00 ± 24% +86.3% 283.25 ± 17% interrupts.CPU138.TLB:TLB_shootdowns 820.00 ± 10% -32.5% 553.75 ± 3% interrupts.CPU14.TLB:TLB_shootdowns 277.75 ± 19% +81.1% 503.00 ± 7% interrupts.CPU140.RES:Rescheduling_interrupts 298.25 ± 31% +59.3% 475.00 ± 15% interrupts.CPU142.RES:Rescheduling_interrupts 192.50 ± 22% +38.6% 266.75 ± 4% interrupts.CPU143.TLB:TLB_shootdowns 290.00 ± 38% +103.4% 590.00 ± 18% interrupts.CPU145.RES:Rescheduling_interrupts 104.50 ± 34% +90.4% 199.00 ± 16% interrupts.CPU145.TLB:TLB_shootdowns 226.50 ± 10% +96.9% 446.00 ± 15% interrupts.CPU146.RES:Rescheduling_interrupts 95.75 ± 8% +145.4% 235.00 ± 12% interrupts.CPU146.TLB:TLB_shootdowns 145.00 ± 22% +65.2% 239.50 ± 16% interrupts.CPU147.TLB:TLB_shootdowns 90.25 ± 23% +212.2% 281.75 ± 19% interrupts.CPU148.TLB:TLB_shootdowns 104.25 ± 22% +142.7% 253.00 ± 11% interrupts.CPU149.TLB:TLB_shootdowns 2888 ± 16% -35.6% 1860 ± 30% interrupts.CPU15.NMI:Non-maskable_interrupts 2888 ± 16% -35.6% 1860 ± 30% interrupts.CPU15.PMI:Performance_monitoring_interrupts 472.25 ± 31% +275.2% 1771 ±106% interrupts.CPU15.RES:Rescheduling_interrupts 816.50 ± 16% -50.0% 408.50 ± 11% interrupts.CPU15.TLB:TLB_shootdowns 84.75 ± 24% +207.4% 260.50 ± 10% interrupts.CPU150.TLB:TLB_shootdowns 133.50 ± 16% +108.6% 278.50 ± 17% interrupts.CPU151.TLB:TLB_shootdowns 103.75 ± 25% +132.0% 240.75 ± 8% interrupts.CPU152.TLB:TLB_shootdowns 105.00 ± 60% +155.0% 267.75 ± 7% interrupts.CPU153.TLB:TLB_shootdowns 100.50 ± 28% +133.1% 234.25 ± 8% interrupts.CPU154.TLB:TLB_shootdowns 73.50 ± 36% +220.4% 235.50 ± 11% interrupts.CPU155.TLB:TLB_shootdowns 229.50 ± 18% +182.1% 647.50 ± 8% interrupts.CPU156.RES:Rescheduling_interrupts 114.50 ± 20% +110.9% 241.50 ± 29% interrupts.CPU156.TLB:TLB_shootdowns 125.75 ± 27% +79.7% 226.00 ± 8% interrupts.CPU157.TLB:TLB_shootdowns 97.50 ± 21% +143.1% 237.00 ± 16% interrupts.CPU158.TLB:TLB_shootdowns 94.75 ± 49% +136.4% 224.00 ± 21% interrupts.CPU159.TLB:TLB_shootdowns 452.00 ± 36% +89.2% 855.25 ± 39% interrupts.CPU16.RES:Rescheduling_interrupts 959.00 ± 16% -54.3% 438.25 ± 8% interrupts.CPU16.TLB:TLB_shootdowns 96.75 ± 9% +145.0% 237.00 ± 9% interrupts.CPU161.TLB:TLB_shootdowns 94.25 ± 24% +169.5% 254.00 ± 10% interrupts.CPU162.TLB:TLB_shootdowns 100.50 ± 8% +141.8% 243.00 ± 14% interrupts.CPU163.TLB:TLB_shootdowns 87.00 ± 42% +186.5% 249.25 ± 8% interrupts.CPU164.TLB:TLB_shootdowns 93.50 ± 29% +145.7% 229.75 ± 9% interrupts.CPU165.TLB:TLB_shootdowns 110.50 ± 33% +165.4% 293.25 ± 15% interrupts.CPU166.TLB:TLB_shootdowns 323.25 ± 37% +105.7% 665.00 ± 39% interrupts.CPU167.RES:Rescheduling_interrupts 96.75 ± 48% +140.3% 232.50 ± 14% interrupts.CPU167.TLB:TLB_shootdowns 224.00 ± 22% +140.8% 539.50 ± 40% interrupts.CPU168.RES:Rescheduling_interrupts 87.50 ± 26% +151.1% 219.75 ± 14% interrupts.CPU168.TLB:TLB_shootdowns 1120 ± 47% +79.9% 2015 ± 27% interrupts.CPU169.NMI:Non-maskable_interrupts 1120 ± 47% +79.9% 2015 ± 27% interrupts.CPU169.PMI:Performance_monitoring_interrupts 100.25 ± 22% +117.5% 218.00 ± 9% interrupts.CPU169.TLB:TLB_shootdowns 667.75 ± 12% -30.3% 465.50 ± 14% interrupts.CPU17.TLB:TLB_shootdowns 75.00 ± 28% +252.7% 264.50 ± 22% interrupts.CPU170.TLB:TLB_shootdowns 94.25 ± 19% +126.0% 213.00 ± 13% interrupts.CPU171.TLB:TLB_shootdowns 318.25 ± 28% +53.3% 488.00 ± 18% interrupts.CPU172.RES:Rescheduling_interrupts 85.25 ± 33% +221.1% 273.75 ± 19% interrupts.CPU172.TLB:TLB_shootdowns 82.25 ± 18% +130.7% 189.75 ± 20% interrupts.CPU173.TLB:TLB_shootdowns 67.75 ± 55% +261.6% 245.00 ± 12% interrupts.CPU174.TLB:TLB_shootdowns 227.75 ± 41% +588.6% 1568 ± 95% interrupts.CPU175.RES:Rescheduling_interrupts 91.50 ± 10% +150.8% 229.50 ± 10% interrupts.CPU175.TLB:TLB_shootdowns 99.50 ± 17% +147.2% 246.00 ± 22% interrupts.CPU176.TLB:TLB_shootdowns 79.25 ± 18% +200.0% 237.75 ± 27% interrupts.CPU177.TLB:TLB_shootdowns 87.50 ± 36% +129.7% 201.00 ± 4% interrupts.CPU178.TLB:TLB_shootdowns 127.25 ± 44% +82.7% 232.50 ± 15% interrupts.CPU179.TLB:TLB_shootdowns 1161 ± 15% +137.6% 2758 ± 27% interrupts.CPU18.NMI:Non-maskable_interrupts 1161 ± 15% +137.6% 2758 ± 27% interrupts.CPU18.PMI:Performance_monitoring_interrupts 425.75 ± 15% +149.5% 1062 ± 64% interrupts.CPU18.RES:Rescheduling_interrupts 985.50 ± 13% -50.1% 492.25 ± 13% interrupts.CPU18.TLB:TLB_shootdowns 112.25 ± 33% +120.7% 247.75 ± 8% interrupts.CPU180.TLB:TLB_shootdowns 126.25 ± 15% +96.0% 247.50 ± 9% interrupts.CPU181.TLB:TLB_shootdowns 229.25 ± 25% +74.6% 400.25 ± 7% interrupts.CPU182.RES:Rescheduling_interrupts 102.50 ± 41% +173.4% 280.25 ± 4% interrupts.CPU182.TLB:TLB_shootdowns 253.25 ± 13% +52.6% 386.50 ± 8% interrupts.CPU183.RES:Rescheduling_interrupts 97.00 ± 50% +153.4% 245.75 ± 4% interrupts.CPU183.TLB:TLB_shootdowns 99.00 ± 14% +143.7% 241.25 ± 18% interrupts.CPU184.TLB:TLB_shootdowns 287.50 ± 37% +57.0% 451.25 ± 32% interrupts.CPU185.RES:Rescheduling_interrupts 92.50 ± 27% +139.2% 221.25 ± 5% interrupts.CPU185.TLB:TLB_shootdowns 2302 ± 26% +37.4% 3162 ± 5% interrupts.CPU186.NMI:Non-maskable_interrupts 2302 ± 26% +37.4% 3162 ± 5% interrupts.CPU186.PMI:Performance_monitoring_interrupts 87.75 ± 16% +204.0% 266.75 ± 20% interrupts.CPU186.TLB:TLB_shootdowns 97.00 ± 31% +157.0% 249.25 ± 10% interrupts.CPU187.TLB:TLB_shootdowns 261.50 ± 10% +54.2% 403.25 ± 15% interrupts.CPU188.RES:Rescheduling_interrupts 108.50 ± 42% +103.7% 221.00 ± 26% interrupts.CPU188.TLB:TLB_shootdowns 223.75 ± 21% +88.4% 421.50 ± 18% interrupts.CPU189.RES:Rescheduling_interrupts 119.25 ± 11% +108.4% 248.50 ± 25% interrupts.CPU189.TLB:TLB_shootdowns 400.25 ± 27% +117.4% 870.25 ± 52% interrupts.CPU19.RES:Rescheduling_interrupts 699.50 ± 16% -31.8% 476.75 ± 10% interrupts.CPU19.TLB:TLB_shootdowns 99.75 ± 43% +148.6% 248.00 ± 12% interrupts.CPU190.TLB:TLB_shootdowns 98.25 ± 10% +146.6% 242.25 ± 17% interrupts.CPU191.TLB:TLB_shootdowns 105.25 ± 29% +145.4% 258.25 ± 19% interrupts.CPU192.TLB:TLB_shootdowns 89.50 ± 23% +191.3% 260.75 ± 17% interrupts.CPU193.TLB:TLB_shootdowns 66.25 ± 25% +285.7% 255.50 ± 17% interrupts.CPU194.TLB:TLB_shootdowns 278.75 ± 10% +84.9% 515.50 ± 32% interrupts.CPU195.RES:Rescheduling_interrupts 80.00 ± 18% +247.8% 278.25 ± 14% interrupts.CPU195.TLB:TLB_shootdowns 70.25 ± 12% +246.3% 243.25 ± 11% interrupts.CPU196.TLB:TLB_shootdowns 104.75 ± 26% +147.0% 258.75 ± 23% interrupts.CPU197.TLB:TLB_shootdowns 86.75 ± 62% +188.2% 250.00 ± 20% interrupts.CPU198.TLB:TLB_shootdowns 94.25 ± 17% +150.1% 235.75 ± 19% interrupts.CPU199.TLB:TLB_shootdowns 3084 ± 4% -52.9% 1453 ± 6% interrupts.CPU2.NMI:Non-maskable_interrupts 3084 ± 4% -52.9% 1453 ± 6% interrupts.CPU2.PMI:Performance_monitoring_interrupts 556.25 ± 46% +179.6% 1555 ± 83% interrupts.CPU2.RES:Rescheduling_interrupts 891.00 ± 15% -42.6% 511.50 ± 13% interrupts.CPU2.TLB:TLB_shootdowns 364.75 ± 16% +193.9% 1072 ± 40% interrupts.CPU20.RES:Rescheduling_interrupts 825.75 ± 13% -35.7% 530.75 ± 6% interrupts.CPU20.TLB:TLB_shootdowns 129.25 ± 17% +83.0% 236.50 ± 7% interrupts.CPU200.TLB:TLB_shootdowns 88.50 ± 58% +200.0% 265.50 ± 12% interrupts.CPU201.TLB:TLB_shootdowns 116.75 ± 24% +99.8% 233.25 ± 24% interrupts.CPU202.TLB:TLB_shootdowns 254.25 ± 35% +121.8% 564.00 ± 14% interrupts.CPU203.RES:Rescheduling_interrupts 83.25 ± 27% +203.0% 252.25 ± 18% interrupts.CPU203.TLB:TLB_shootdowns 110.25 ± 16% +195.2% 325.50 ± 35% interrupts.CPU204.TLB:TLB_shootdowns 332.00 ± 44% +60.5% 532.75 ± 15% interrupts.CPU205.RES:Rescheduling_interrupts 89.00 ± 32% +165.4% 236.25 ± 11% interrupts.CPU205.TLB:TLB_shootdowns 236.25 ± 23% +112.8% 502.75 ± 10% interrupts.CPU206.RES:Rescheduling_interrupts 82.75 ± 32% +195.2% 244.25 ± 13% interrupts.CPU206.TLB:TLB_shootdowns 121.25 ± 15% +86.6% 226.25 ± 18% interrupts.CPU207.TLB:TLB_shootdowns 83.75 ± 24% +170.7% 226.75 ± 5% interrupts.CPU208.TLB:TLB_shootdowns 330.25 ± 13% +131.5% 764.50 ± 44% interrupts.CPU209.RES:Rescheduling_interrupts 75.75 ± 20% +217.8% 240.75 ± 9% interrupts.CPU209.TLB:TLB_shootdowns 778.00 ± 16% -39.2% 473.00 ± 34% interrupts.CPU21.TLB:TLB_shootdowns 268.75 ± 27% +178.4% 748.25 ± 37% interrupts.CPU210.RES:Rescheduling_interrupts 114.75 ± 16% +100.0% 229.50 ± 13% interrupts.CPU210.TLB:TLB_shootdowns 112.00 ± 29% +101.1% 225.25 ± 15% interrupts.CPU211.TLB:TLB_shootdowns 97.00 ± 58% +159.3% 251.50 ± 21% interrupts.CPU212.TLB:TLB_shootdowns 263.75 ± 29% +80.3% 475.50 ± 15% interrupts.CPU213.RES:Rescheduling_interrupts 101.25 ± 25% +98.5% 201.00 ± 28% interrupts.CPU215.TLB:TLB_shootdowns 1275 ± 12% +70.6% 2177 ± 30% interrupts.CPU216.NMI:Non-maskable_interrupts 1275 ± 12% +70.6% 2177 ± 30% interrupts.CPU216.PMI:Performance_monitoring_interrupts 278.75 ± 15% +48.7% 414.50 ± 14% interrupts.CPU216.RES:Rescheduling_interrupts 95.50 ± 26% +118.3% 208.50 ± 11% interrupts.CPU216.TLB:TLB_shootdowns 1391 ± 30% +54.2% 2146 ± 33% interrupts.CPU217.NMI:Non-maskable_interrupts 1391 ± 30% +54.2% 2146 ± 33% interrupts.CPU217.PMI:Performance_monitoring_interrupts 114.50 ± 10% +84.9% 211.75 ± 16% interrupts.CPU217.TLB:TLB_shootdowns 77.00 ± 48% +308.4% 314.50 ± 55% interrupts.CPU218.TLB:TLB_shootdowns 70.75 ± 41% +259.0% 254.00 ± 21% interrupts.CPU219.TLB:TLB_shootdowns 884.75 ± 18% -36.6% 561.25 ± 12% interrupts.CPU22.TLB:TLB_shootdowns 58.25 ± 36% +315.9% 242.25 ± 13% interrupts.CPU220.TLB:TLB_shootdowns 230.50 ± 35% +103.9% 470.00 ± 18% interrupts.CPU221.RES:Rescheduling_interrupts 61.00 ± 40% +254.1% 216.00 ± 3% interrupts.CPU221.TLB:TLB_shootdowns 114.75 ± 47% +102.6% 232.50 ± 22% interrupts.CPU223.TLB:TLB_shootdowns 94.25 ± 19% +146.9% 232.75 ± 15% interrupts.CPU224.TLB:TLB_shootdowns 92.75 ± 47% +142.6% 225.00 ± 12% interrupts.CPU225.TLB:TLB_shootdowns 84.75 ± 19% +182.0% 239.00 ± 4% interrupts.CPU226.TLB:TLB_shootdowns 91.00 ± 34% +164.8% 241.00 ± 20% interrupts.CPU227.TLB:TLB_shootdowns 2345 ± 32% -40.0% 1407 ± 17% interrupts.CPU228.NMI:Non-maskable_interrupts 2345 ± 32% -40.0% 1407 ± 17% interrupts.CPU228.PMI:Performance_monitoring_interrupts 61.75 ± 24% +232.0% 205.00 ± 10% interrupts.CPU228.TLB:TLB_shootdowns 75.00 ± 49% +188.7% 216.50 ± 14% interrupts.CPU229.TLB:TLB_shootdowns 706.25 ± 17% -38.5% 434.00 ± 19% interrupts.CPU23.TLB:TLB_shootdowns 78.50 ± 20% +208.6% 242.25 ± 11% interrupts.CPU230.TLB:TLB_shootdowns 67.50 ± 35% +214.4% 212.25 ± 20% interrupts.CPU231.TLB:TLB_shootdowns 204.25 ± 15% +141.9% 494.00 ± 11% interrupts.CPU232.RES:Rescheduling_interrupts 65.25 ± 19% +254.0% 231.00 ± 13% interrupts.CPU232.TLB:TLB_shootdowns 104.75 ± 28% +106.9% 216.75 ± 26% interrupts.CPU233.TLB:TLB_shootdowns 65.00 ± 44% +226.9% 212.50 ± 8% interrupts.CPU234.TLB:TLB_shootdowns 72.00 ± 53% +186.8% 206.50 ± 20% interrupts.CPU235.TLB:TLB_shootdowns 262.50 ± 38% +75.3% 460.25 ± 13% interrupts.CPU236.RES:Rescheduling_interrupts 72.75 ± 61% +195.5% 215.00 ± 7% interrupts.CPU236.TLB:TLB_shootdowns 78.25 ± 21% +187.2% 224.75 ± 32% interrupts.CPU237.TLB:TLB_shootdowns 92.25 ± 27% +166.9% 246.25 ± 17% interrupts.CPU238.TLB:TLB_shootdowns 120.50 ± 37% +118.5% 263.25 ± 19% interrupts.CPU239.TLB:TLB_shootdowns 871.75 ± 7% -42.3% 502.75 ± 12% interrupts.CPU24.TLB:TLB_shootdowns 63.75 ± 34% +271.0% 236.50 ± 6% interrupts.CPU240.TLB:TLB_shootdowns 77.25 ± 29% +207.4% 237.50 ± 15% interrupts.CPU241.TLB:TLB_shootdowns 49.75 ± 29% +310.6% 204.25 ± 13% interrupts.CPU242.TLB:TLB_shootdowns 76.00 ± 19% +194.7% 224.00 ± 17% interrupts.CPU243.TLB:TLB_shootdowns 80.75 ± 10% +183.6% 229.00 ± 17% interrupts.CPU244.TLB:TLB_shootdowns 86.75 ± 57% +171.8% 235.75 ± 8% interrupts.CPU245.TLB:TLB_shootdowns 56.50 ± 51% +344.2% 251.00 ± 13% interrupts.CPU246.TLB:TLB_shootdowns 270.50 ± 24% +153.1% 684.75 ± 34% interrupts.CPU247.RES:Rescheduling_interrupts 88.25 ± 24% +180.2% 247.25 ± 18% interrupts.CPU247.TLB:TLB_shootdowns 81.25 ± 37% +167.1% 217.00 ± 20% interrupts.CPU248.TLB:TLB_shootdowns 67.00 ± 26% +216.4% 212.00 ± 11% interrupts.CPU249.TLB:TLB_shootdowns 740.75 ± 11% -36.9% 467.25 ± 7% interrupts.CPU25.TLB:TLB_shootdowns 67.50 ± 29% +247.0% 234.25 ± 11% interrupts.CPU250.TLB:TLB_shootdowns 92.00 ± 63% +111.1% 194.25 ± 24% interrupts.CPU251.TLB:TLB_shootdowns 72.25 ± 45% +223.5% 233.75 ± 16% interrupts.CPU252.TLB:TLB_shootdowns 78.75 ± 29% +178.7% 219.50 ± 12% interrupts.CPU253.TLB:TLB_shootdowns 64.25 ± 58% +258.4% 230.25 ± 11% interrupts.CPU254.TLB:TLB_shootdowns 267.00 ± 17% +44.3% 385.25 ± 13% interrupts.CPU255.RES:Rescheduling_interrupts 114.25 ± 36% +106.1% 235.50 ± 12% interrupts.CPU255.TLB:TLB_shootdowns 74.00 ± 33% +213.9% 232.25 ± 13% interrupts.CPU256.TLB:TLB_shootdowns 86.00 ± 81% +158.4% 222.25 ± 19% interrupts.CPU257.TLB:TLB_shootdowns 1565 ± 38% +54.4% 2417 ± 27% interrupts.CPU258.NMI:Non-maskable_interrupts 1565 ± 38% +54.4% 2417 ± 27% interrupts.CPU258.PMI:Performance_monitoring_interrupts 252.00 ± 25% +118.6% 550.75 ± 54% interrupts.CPU258.RES:Rescheduling_interrupts 81.75 ± 21% +192.7% 239.25 ± 9% interrupts.CPU258.TLB:TLB_shootdowns 106.75 ± 37% +109.1% 223.25 ± 20% interrupts.CPU259.TLB:TLB_shootdowns 899.75 ± 8% -42.9% 514.00 ± 6% interrupts.CPU26.TLB:TLB_shootdowns 67.25 ± 41% +291.8% 263.50 ± 22% interrupts.CPU260.TLB:TLB_shootdowns 59.25 ± 34% +289.0% 230.50 ± 8% interrupts.CPU261.TLB:TLB_shootdowns 292.75 ± 12% +61.0% 471.25 ± 16% interrupts.CPU262.RES:Rescheduling_interrupts 49.75 ± 45% +400.0% 248.75 ± 14% interrupts.CPU262.TLB:TLB_shootdowns 325.00 ± 17% +52.1% 494.25 ± 27% interrupts.CPU263.RES:Rescheduling_interrupts 87.00 ± 32% +143.1% 211.50 ± 11% interrupts.CPU263.TLB:TLB_shootdowns 218.25 ± 14% +71.7% 374.75 ± 5% interrupts.CPU264.RES:Rescheduling_interrupts 75.75 ± 28% +188.8% 218.75 ± 9% interrupts.CPU264.TLB:TLB_shootdowns 56.25 ± 55% +306.2% 228.50 ± 20% interrupts.CPU265.TLB:TLB_shootdowns 80.75 ± 53% +221.1% 259.25 ± 12% interrupts.CPU266.TLB:TLB_shootdowns 271.25 ± 27% +56.2% 423.75 ± 22% interrupts.CPU267.RES:Rescheduling_interrupts 60.25 ± 48% +352.7% 272.75 ± 16% interrupts.CPU267.TLB:TLB_shootdowns 56.00 ± 43% +295.5% 221.50 ± 20% interrupts.CPU268.TLB:TLB_shootdowns 97.25 ± 14% +151.2% 244.25 ± 17% interrupts.CPU269.TLB:TLB_shootdowns 688.00 ± 13% -32.2% 466.25 ± 11% interrupts.CPU27.TLB:TLB_shootdowns 208.00 ± 27% +93.6% 402.75 ± 8% interrupts.CPU270.RES:Rescheduling_interrupts 57.50 ± 30% +368.3% 269.25 ± 19% interrupts.CPU270.TLB:TLB_shootdowns 73.75 ± 34% +288.5% 286.50 ± 14% interrupts.CPU271.TLB:TLB_shootdowns 279.25 ± 32% +37.3% 383.50 ± 10% interrupts.CPU272.RES:Rescheduling_interrupts 79.25 ± 14% +189.6% 229.50 ± 28% interrupts.CPU272.TLB:TLB_shootdowns 216.50 ± 15% +201.8% 653.50 ± 66% interrupts.CPU273.RES:Rescheduling_interrupts 65.50 ± 22% +256.1% 233.25 ± 11% interrupts.CPU273.TLB:TLB_shootdowns 74.75 ± 68% +198.3% 223.00 ± 17% interrupts.CPU274.TLB:TLB_shootdowns 68.50 ± 42% +204.4% 208.50 ± 10% interrupts.CPU275.TLB:TLB_shootdowns 59.75 ± 35% +226.8% 195.25 ± 13% interrupts.CPU276.TLB:TLB_shootdowns 292.25 ± 35% +80.2% 526.75 ± 32% interrupts.CPU277.RES:Rescheduling_interrupts 73.25 ± 39% +233.8% 244.50 ± 14% interrupts.CPU277.TLB:TLB_shootdowns 61.50 ± 60% +248.0% 214.00 ± 9% interrupts.CPU278.TLB:TLB_shootdowns 163.25 ± 15% +188.1% 470.25 ± 18% interrupts.CPU279.RES:Rescheduling_interrupts 81.50 ± 10% +142.0% 197.25 ± 8% interrupts.CPU279.TLB:TLB_shootdowns 372.75 ± 20% +139.3% 892.00 ± 59% interrupts.CPU28.RES:Rescheduling_interrupts 891.00 ± 4% -41.6% 520.50 ± 10% interrupts.CPU28.TLB:TLB_shootdowns 75.75 ± 23% +223.8% 245.25 ± 12% interrupts.CPU280.TLB:TLB_shootdowns 66.25 ± 39% +234.0% 221.25 ± 12% interrupts.CPU281.TLB:TLB_shootdowns 239.25 ± 24% +90.9% 456.75 ± 15% interrupts.CPU282.RES:Rescheduling_interrupts 63.50 ± 36% +281.9% 242.50 ± 11% interrupts.CPU282.TLB:TLB_shootdowns 75.50 ± 39% +215.2% 238.00 ± 10% interrupts.CPU283.TLB:TLB_shootdowns 269.75 ± 41% +72.2% 464.50 ± 20% interrupts.CPU284.RES:Rescheduling_interrupts 66.25 ± 51% +251.7% 233.00 ± 22% interrupts.CPU284.TLB:TLB_shootdowns 103.75 ± 33% +117.3% 225.50 ± 6% interrupts.CPU285.TLB:TLB_shootdowns 274.75 ± 25% +42.6% 391.75 ± 9% interrupts.CPU286.RES:Rescheduling_interrupts 102.50 ± 22% +106.1% 211.25 ± 3% interrupts.CPU286.TLB:TLB_shootdowns 1604 ± 9% -17.7% 1320 interrupts.CPU287.CAL:Function_call_interrupts 1860 ± 18% -26.0% 1376 ± 16% interrupts.CPU287.NMI:Non-maskable_interrupts 1860 ± 18% -26.0% 1376 ± 16% interrupts.CPU287.PMI:Performance_monitoring_interrupts 245.50 ± 19% +54.3% 378.75 ± 8% interrupts.CPU287.RES:Rescheduling_interrupts 685.00 ± 13% -35.5% 441.75 ± 4% interrupts.CPU29.TLB:TLB_shootdowns 689.75 ± 18% -32.4% 466.00 ± 6% interrupts.CPU3.TLB:TLB_shootdowns 399.75 ± 15% +149.8% 998.75 ± 69% interrupts.CPU30.RES:Rescheduling_interrupts 793.00 ± 16% -36.1% 506.75 ± 7% interrupts.CPU30.TLB:TLB_shootdowns 3182 ± 24% -56.9% 1372 ± 6% interrupts.CPU31.NMI:Non-maskable_interrupts 3182 ± 24% -56.9% 1372 ± 6% interrupts.CPU31.PMI:Performance_monitoring_interrupts 283.00 ± 10% +134.5% 663.50 ± 31% interrupts.CPU31.RES:Rescheduling_interrupts 783.50 ± 20% -43.8% 440.25 ± 3% interrupts.CPU31.TLB:TLB_shootdowns 905.25 ± 8% -39.7% 546.25 ± 19% interrupts.CPU32.TLB:TLB_shootdowns 709.25 ± 4% -35.0% 461.00 ± 14% interrupts.CPU33.TLB:TLB_shootdowns 474.50 ± 31% +92.7% 914.50 ± 50% interrupts.CPU34.RES:Rescheduling_interrupts 879.50 ± 11% -43.0% 501.50 ± 9% interrupts.CPU34.TLB:TLB_shootdowns 750.00 ± 12% -42.5% 431.25 ± 10% interrupts.CPU35.TLB:TLB_shootdowns 889.00 ± 5% -45.4% 485.25 ± 6% interrupts.CPU36.TLB:TLB_shootdowns 415.25 ± 26% +34.3% 557.75 ± 9% interrupts.CPU37.RES:Rescheduling_interrupts 818.50 ± 14% -45.1% 449.25 ± 14% interrupts.CPU37.TLB:TLB_shootdowns 453.50 ± 19% +23.7% 561.00 ± 11% interrupts.CPU38.RES:Rescheduling_interrupts 899.00 ± 5% -37.8% 558.75 ± 7% interrupts.CPU38.TLB:TLB_shootdowns 752.25 ± 14% -41.3% 441.25 ± 11% interrupts.CPU39.TLB:TLB_shootdowns 1502 ± 7% +48.7% 2234 ± 24% interrupts.CPU4.NMI:Non-maskable_interrupts 1502 ± 7% +48.7% 2234 ± 24% interrupts.CPU4.PMI:Performance_monitoring_interrupts 1012 ± 26% -47.3% 534.00 ± 6% interrupts.CPU4.TLB:TLB_shootdowns 882.25 ± 14% -41.4% 517.00 ± 17% interrupts.CPU40.TLB:TLB_shootdowns 762.50 ± 13% -35.8% 489.25 ± 4% interrupts.CPU41.TLB:TLB_shootdowns 995.75 ± 12% -49.2% 506.00 ± 8% interrupts.CPU42.TLB:TLB_shootdowns 652.50 ± 12% -35.4% 421.25 ± 11% interrupts.CPU43.TLB:TLB_shootdowns 421.25 ± 18% +102.1% 851.25 ± 47% interrupts.CPU44.RES:Rescheduling_interrupts 819.00 ± 10% -39.3% 497.25 ± 7% interrupts.CPU44.TLB:TLB_shootdowns 369.00 ± 21% +79.1% 660.75 ± 22% interrupts.CPU45.RES:Rescheduling_interrupts 801.00 ± 7% -41.6% 467.75 ± 8% interrupts.CPU45.TLB:TLB_shootdowns 786.75 ± 15% -38.5% 483.75 ± 12% interrupts.CPU46.TLB:TLB_shootdowns 716.75 ± 13% -35.4% 463.25 ± 11% interrupts.CPU47.TLB:TLB_shootdowns 813.25 ± 9% -34.6% 531.75 ± 6% interrupts.CPU48.TLB:TLB_shootdowns 658.50 ± 6% -26.2% 486.25 ± 6% interrupts.CPU49.TLB:TLB_shootdowns 735.25 ± 20% -36.6% 466.00 ± 18% interrupts.CPU5.TLB:TLB_shootdowns 852.50 ± 17% -43.0% 485.75 ± 9% interrupts.CPU50.TLB:TLB_shootdowns 815.75 ± 8% -40.3% 487.25 ± 12% interrupts.CPU51.TLB:TLB_shootdowns 899.50 ± 9% -42.5% 517.50 ± 10% interrupts.CPU52.TLB:TLB_shootdowns 654.50 ± 9% -33.8% 433.00 ± 19% interrupts.CPU53.TLB:TLB_shootdowns 920.00 ± 8% -40.9% 543.50 ± 6% interrupts.CPU54.TLB:TLB_shootdowns 687.25 ± 19% -31.5% 470.75 ± 16% interrupts.CPU55.TLB:TLB_shootdowns 2467 ± 22% -41.5% 1442 ± 13% interrupts.CPU56.NMI:Non-maskable_interrupts 2467 ± 22% -41.5% 1442 ± 13% interrupts.CPU56.PMI:Performance_monitoring_interrupts 342.00 ± 7% +106.1% 705.00 ± 30% interrupts.CPU56.RES:Rescheduling_interrupts 884.75 ± 19% -45.2% 485.25 ± 8% interrupts.CPU56.TLB:TLB_shootdowns 772.00 ± 11% -43.0% 440.00 ± 11% interrupts.CPU57.TLB:TLB_shootdowns 942.50 ± 11% -46.3% 506.00 ± 10% interrupts.CPU58.TLB:TLB_shootdowns 754.25 ± 5% -38.0% 467.50 interrupts.CPU59.TLB:TLB_shootdowns 393.75 ± 9% +311.4% 1619 ±109% interrupts.CPU6.RES:Rescheduling_interrupts 860.25 ± 12% -46.6% 459.00 ± 7% interrupts.CPU6.TLB:TLB_shootdowns 894.50 ± 16% -43.4% 506.00 ± 13% interrupts.CPU60.TLB:TLB_shootdowns 1684 ± 32% +78.1% 2999 ± 14% interrupts.CPU61.NMI:Non-maskable_interrupts 1684 ± 32% +78.1% 2999 ± 14% interrupts.CPU61.PMI:Performance_monitoring_interrupts 693.50 ± 17% -34.9% 451.75 ± 9% interrupts.CPU61.TLB:TLB_shootdowns 936.25 ± 16% -49.3% 474.75 ± 8% interrupts.CPU62.TLB:TLB_shootdowns 421.25 ± 44% +112.9% 897.00 ± 11% interrupts.CPU63.RES:Rescheduling_interrupts 731.25 ± 8% -41.1% 431.00 ± 7% interrupts.CPU63.TLB:TLB_shootdowns 883.00 ± 15% -43.7% 496.75 ± 7% interrupts.CPU64.TLB:TLB_shootdowns 736.00 ± 11% -36.8% 465.50 ± 5% interrupts.CPU65.TLB:TLB_shootdowns 880.00 ± 7% -42.6% 505.25 ± 8% interrupts.CPU66.TLB:TLB_shootdowns 943.50 ± 11% -40.5% 561.75 ± 10% interrupts.CPU68.TLB:TLB_shootdowns 393.25 ± 36% +100.5% 788.50 ± 26% interrupts.CPU69.RES:Rescheduling_interrupts 790.25 ± 9% -38.3% 487.50 ± 8% interrupts.CPU69.TLB:TLB_shootdowns 415.50 ± 24% +407.0% 2106 ±123% interrupts.CPU7.RES:Rescheduling_interrupts 679.00 ± 14% -36.8% 429.25 interrupts.CPU7.TLB:TLB_shootdowns 350.25 ± 13% +92.1% 672.75 ± 12% interrupts.CPU70.RES:Rescheduling_interrupts 778.75 ± 3% -41.8% 453.50 ± 11% interrupts.CPU70.TLB:TLB_shootdowns 673.50 ± 8% -39.8% 405.75 ± 11% interrupts.CPU71.TLB:TLB_shootdowns 460.75 ± 74% +95.7% 901.75 ± 43% interrupts.CPU74.RES:Rescheduling_interrupts 160.75 ± 33% +82.1% 292.75 ± 15% interrupts.CPU76.TLB:TLB_shootdowns 198.00 ± 22% +45.8% 288.75 ± 9% interrupts.CPU77.TLB:TLB_shootdowns 2305 ± 26% -35.5% 1486 ± 12% interrupts.CPU79.NMI:Non-maskable_interrupts 2305 ± 26% -35.5% 1486 ± 12% interrupts.CPU79.PMI:Performance_monitoring_interrupts 155.25 ± 31% +72.9% 268.50 ± 8% interrupts.CPU79.TLB:TLB_shootdowns 887.25 ± 17% -45.4% 484.50 ± 10% interrupts.CPU8.TLB:TLB_shootdowns 192.00 ± 18% +32.9% 255.25 ± 12% interrupts.CPU80.TLB:TLB_shootdowns 158.75 ± 30% +95.1% 309.75 ± 12% interrupts.CPU82.TLB:TLB_shootdowns 265.75 ± 35% +120.8% 586.75 ± 30% interrupts.CPU84.RES:Rescheduling_interrupts 146.75 ± 29% +80.2% 264.50 ± 20% interrupts.CPU84.TLB:TLB_shootdowns 186.00 ± 31% +56.0% 290.25 ± 9% interrupts.CPU86.TLB:TLB_shootdowns 169.25 ± 15% +66.5% 281.75 ± 2% interrupts.CPU88.TLB:TLB_shootdowns 879.75 ± 10% -47.5% 462.00 ± 4% interrupts.CPU9.TLB:TLB_shootdowns 161.00 ± 20% +75.8% 283.00 ± 5% interrupts.CPU90.TLB:TLB_shootdowns 194.75 ± 12% +50.3% 292.75 ± 11% interrupts.CPU91.TLB:TLB_shootdowns 2722 ± 34% -37.8% 1692 ± 6% interrupts.CPU92.NMI:Non-maskable_interrupts 2722 ± 34% -37.8% 1692 ± 6% interrupts.CPU92.PMI:Performance_monitoring_interrupts 190.75 ± 14% +36.3% 260.00 ± 22% interrupts.CPU92.TLB:TLB_shootdowns 188.00 ± 15% +57.0% 295.25 ± 10% interrupts.CPU94.TLB:TLB_shootdowns 200.25 ± 11% +59.6% 319.50 ± 16% interrupts.CPU95.TLB:TLB_shootdowns 316.25 ± 55% +105.1% 648.50 ± 19% interrupts.CPU96.RES:Rescheduling_interrupts 143.75 ± 42% +91.0% 274.50 ± 8% interrupts.CPU96.TLB:TLB_shootdowns 2409 ± 41% -34.2% 1586 ± 46% interrupts.CPU97.NMI:Non-maskable_interrupts 2409 ± 41% -34.2% 1586 ± 46% interrupts.CPU97.PMI:Performance_monitoring_interrupts 186.00 ± 33% +56.0% 290.25 ± 16% interrupts.CPU98.TLB:TLB_shootdowns vm-scalability.time.user_time 16000 +-------------------------------------------------------------------+ | + | 15000 |-+ :+ + + + | 14000 |-+ .++. +. + + +.+ :+ .++ ++. +.++ + + :+ + +| |+.+++ ++ + + + ++.+++ +.+++.++.+ ++ + +.+ + :+ | 13000 |-+ + | | | 12000 |-+ | | | 11000 |-+ | 10000 |-+ | | OO O O | 9000 |-+ OO O OO O OO O | |O OOO O O OO | 8000 +-------------------------------------------------------------------+ vm-scalability.time.voluntary_context_switches 1e+06 +------------------------------------------------------------------+ | O O | 900000 |O+OOO OO O OOO OOO O O OO | 800000 |-+ | | | 700000 |-+ | 600000 |-+ | | | 500000 |-+ | 400000 |-+ | | | 300000 |-+ | 200000 |-+ | |+.+++.+++.+ + +.+++.++.+++.+++.+++.+++. .+ +. | 100000 +------------------------------------------------------------------+ vm-scalability.throughput 1.6e+07 +-----------------------------------------------------------------+ | | 1.5e+07 |-+ + + + | 1.4e+07 |+. + + +. + + +. + + | | +++ +.+ +.+++ .++ +++ +.++ +++ +.+ +. | 1.3e+07 |-+ + +.+++ +++.++ +++.+++.+| 1.2e+07 |-+ | | | 1.1e+07 |-+ | 1e+07 |-+ | | | 9e+06 |-+ O O O O | 8e+06 |-+ O OO O OO O OO OO O | |O O O O O | 7e+06 +-----------------------------------------------------------------+ vm-scalability.median 44000 +-------------------------------------------------------------------+ 42000 |-+ + + + | | : : : : :: | 40000 |+. : +. + ++.+ .++. : + .+++. : +. + | 38000 |-++++ + +.+ ++.+++ +++ + ++.+ + +. .+++. +. ++. | | +++ + + +| 36000 |-+ | 34000 |-+ | 32000 |-+ | | | 30000 |-+ | 28000 |-+ O O O | | O O O O | 26000 |O+OOO O O OO OOO O O O | 24000 +-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

4 months, 3 weeks

3
10
0 / 0

[fs] b6509f6a8c: will-it-scale.per_thread_ops -12.6% regression

by kernel test robot

Greeting, FYI, we noticed a -12.6% regression of will-it-scale.per_thread_ops due to commit: commit: b6509f6a8c4313c068c69785c001451415969e44 ("Revert "fs: Do not check if there is a fsnotify watcher on pseudo inodes"") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: will-it-scale on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory with following parameters: nr_task: 100% mode: thread test: eventfd1 cpufreq_governor: performance ucode: 0x5002f01 test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two. test-url: https://github.com/antonblanchard/will-it-scale In addition to that, the commit also has significant impact on the following tests: +------------------+---------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_process_ops -6.4% regression | | test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | | test parameters | cpufreq_governor=performance | | | mode=process | | | nr_task=100% | | | test=unix1 | | | ucode=0x5002f01 | +------------------+---------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_thread_ops -2.3% regression | | test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | | test parameters | cpufreq_governor=performance | | | mode=thread | | | nr_task=100% | | | test=pipe1 | | | ucode=0x5002f01 | +------------------+---------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-7.6/thread/100%/debian-x86_64-20191114.cgz/lkp-csl-2ap4/eventfd1/will-it-scale/0x5002f01 commit: v5.8-rc3 b6509f6a8c ("Revert "fs: Do not check if there is a fsnotify watcher on pseudo inodes"") v5.8-rc3 b6509f6a8c4313c068c69785c00 ---------------- --------------------------- %stddev %change %stddev \ | \ 1652352 -12.6% 1444002 ± 2% will-it-scale.per_thread_ops 3.173e+08 -12.6% 2.772e+08 ± 2% will-it-scale.workload 23.95 -3.1 20.90 ± 2% mpstat.cpu.all.usr% 23.00 -12.0% 20.25 ± 4% vmstat.cpu.us 578849 ± 4% +8.6% 628428 ± 4% sched_debug.cpu.max_idle_balance_cost.max 0.00 ± 9% -14.4% 0.00 ± 13% sched_debug.cpu.next_balance.stddev 2207 ± 24% +34.7% 2973 ± 20% numa-vmstat.node0.nr_mapped 6949 ± 22% +43.7% 9984 ± 10% numa-vmstat.node0.nr_slab_reclaimable 9739 ± 13% -29.0% 6913 ± 12% numa-vmstat.node1.nr_slab_reclaimable 7247 ± 13% -28.4% 5190 ± 19% slabinfo.eventpoll_pwq.active_objs 7247 ± 13% -28.4% 5190 ± 19% slabinfo.eventpoll_pwq.num_objs 960.00 ± 11% -40.0% 576.00 ± 26% slabinfo.kmalloc-rcl-128.active_objs 960.00 ± 11% -40.0% 576.00 ± 26% slabinfo.kmalloc-rcl-128.num_objs 27801 ± 22% +43.7% 39940 ± 10% numa-meminfo.node0.KReclaimable 8718 ± 25% +35.0% 11773 ± 20% numa-meminfo.node0.Mapped 27801 ± 22% +43.7% 39940 ± 10% numa-meminfo.node0.SReclaimable 38959 ± 13% -29.0% 27656 ± 12% numa-meminfo.node1.KReclaimable 38959 ± 13% -29.0% 27656 ± 12% numa-meminfo.node1.SReclaimable 107406 ± 2% -13.6% 92844 ± 6% numa-meminfo.node1.Slab 0.00 +1.1 1.09 ± 16% perf-profile.calltrace.cycles-pp.fsnotify_parent.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +1.3 1.26 ± 18% perf-profile.calltrace.cycles-pp.fsnotify_parent.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.00 +1.8 1.76 ± 21% perf-profile.calltrace.cycles-pp.fsnotify.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +3.7 3.70 ± 20% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +3.0 3.02 ± 17% perf-profile.children.cycles-pp.fsnotify_parent 0.00 +5.5 5.55 ± 20% perf-profile.children.cycles-pp.fsnotify 0.00 +2.7 2.66 ± 17% perf-profile.self.cycles-pp.fsnotify_parent 0.00 +5.4 5.35 ± 20% perf-profile.self.cycles-pp.fsnotify 10890 ± 21% +53.7% 16738 ± 12% interrupts.CPU168.CAL:Function_call_interrupts 4602 ± 5% +22.7% 5649 ± 13% interrupts.CPU169.CAL:Function_call_interrupts 4920 ± 13% -21.3% 3874 ± 2% interrupts.CPU170.CAL:Function_call_interrupts 463.80 ± 11% -25.1% 347.50 ± 4% interrupts.CPU170.RES:Rescheduling_interrupts 3619 ± 2% +10.2% 3990 ± 9% interrupts.CPU36.CAL:Function_call_interrupts 5768 ± 34% +43.3% 8267 ± 2% interrupts.CPU74.NMI:Non-maskable_interrupts 5768 ± 34% +43.3% 8267 ± 2% interrupts.CPU74.PMI:Performance_monitoring_interrupts 5769 ± 34% +43.3% 8268 ± 2% interrupts.CPU75.NMI:Non-maskable_interrupts 5769 ± 34% +43.3% 8268 ± 2% interrupts.CPU75.PMI:Performance_monitoring_interrupts 5769 ± 34% +43.3% 8267 ± 2% interrupts.CPU76.NMI:Non-maskable_interrupts 5769 ± 34% +43.3% 8267 ± 2% interrupts.CPU76.PMI:Performance_monitoring_interrupts 5768 ± 34% +43.3% 8268 ± 2% interrupts.CPU77.NMI:Non-maskable_interrupts 5768 ± 34% +43.3% 8268 ± 2% interrupts.CPU77.PMI:Performance_monitoring_interrupts 3602 ± 2% +12.9% 4068 ± 13% interrupts.CPU81.CAL:Function_call_interrupts 0.05 ± 32% +121.5% 0.10 ± 39% perf-stat.i.MPKI 1.06 -0.1 0.94 perf-stat.i.branch-miss-rate% 1.107e+09 -13.3% 9.596e+08 ± 2% perf-stat.i.branch-misses 199835 -11.5% 176905 ± 2% perf-stat.i.dTLB-store-misses 9.558e+10 +9.4% 1.046e+11 ± 2% perf-stat.i.dTLB-stores 9.687e+08 -13.8% 8.345e+08 ± 2% perf-stat.i.iTLB-load-misses 535.53 +20.3% 644.34 perf-stat.i.instructions-per-iTLB-miss 1.10 ± 12% +79.6% 1.98 ± 2% perf-stat.i.metric.K/sec 1.05 -0.1 0.92 perf-stat.overall.branch-miss-rate% 0.00 ± 13% -0.0 0.00 ± 4% perf-stat.overall.dTLB-load-miss-rate% 0.00 -0.0 0.00 perf-stat.overall.dTLB-store-miss-rate% 528.82 +20.8% 638.59 perf-stat.overall.instructions-per-iTLB-miss 487060 +20.3% 586095 perf-stat.overall.path-length 1.103e+09 -13.3% 9.564e+08 ± 2% perf-stat.ps.branch-misses 199661 -11.5% 176727 ± 2% perf-stat.ps.dTLB-store-misses 9.525e+10 +9.5% 1.043e+11 ± 2% perf-stat.ps.dTLB-stores 9.67e+08 -13.9% 8.33e+08 ± 3% perf-stat.ps.iTLB-load-misses will-it-scale.per_thread_ops 1.7e+06 +----------------------------------------------------------------+ | .+.. .+.+.. .+.. .+ | 1.65e+06 |.+ .+.+ + +.+. .+.+ +. .+.+. | | +. +. + | 1.6e+06 |-+ | | | 1.55e+06 |-+ | | | 1.5e+06 |-+ | | O O O O O O | 1.45e+06 |-O O O O O O O O O O O O O O O O O O O O | | O | 1.4e+06 |-+ | | | 1.35e+06 +----------------------------------------------------------------+ will-it-scale.workload 3.3e+08 +-----------------------------------------------------------------+ | | 3.2e+08 |.+ .+.+..+.+..+.+.+.. .+..+.+. .+.+ | | +..+ +.+ +..+ | 3.1e+08 |-+ | | | 3e+08 |-+ | | | 2.9e+08 |-+ | | | 2.8e+08 |-O O O O O O O O O O O O O O O O O O O O O O O O | | O O O | 2.7e+08 |-+ | | | 2.6e+08 +-----------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-csl-2ap4: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-7.6/process/100%/debian-x86_64-20191114.cgz/lkp-csl-2ap4/unix1/will-it-scale/0x5002f01 commit: v5.8-rc3 b6509f6a8c ("Revert "fs: Do not check if there is a fsnotify watcher on pseudo inodes"") v5.8-rc3 b6509f6a8c4313c068c69785c00 ---------------- --------------------------- %stddev %change %stddev \ | \ 720286 -6.4% 674507 will-it-scale.per_process_ops 1.383e+08 -6.4% 1.295e+08 will-it-scale.workload 97977 +1.4% 99342 proc-vmstat.nr_anon_pages 8.31 ± 41% +48.5% 12.33 ± 3% sched_debug.cpu.sched_goidle.min 1097 ± 8% +19.8% 1315 ± 9% slabinfo.task_group.active_objs 1097 ± 8% +19.8% 1315 ± 9% slabinfo.task_group.num_objs 13194 ± 25% -29.6% 9295 ± 24% softirqs.CPU124.RCU 9178 ± 8% -7.8% 8467 ± 4% softirqs.CPU48.RCU 1229 ± 68% +156.3% 3151 ± 70% interrupts.CPU0.CAL:Function_call_interrupts 8259 -37.6% 5157 ± 34% interrupts.CPU163.NMI:Non-maskable_interrupts 8259 -37.6% 5157 ± 34% interrupts.CPU163.PMI:Performance_monitoring_interrupts 15337 ± 81% +146.4% 37788 ± 45% numa-vmstat.node2.nr_active_anon 15187 ± 81% +147.5% 37594 ± 45% numa-vmstat.node2.nr_anon_pages 15337 ± 81% +146.4% 37788 ± 45% numa-vmstat.node2.nr_zone_active_anon 127540 ± 6% -8.0% 117311 numa-vmstat.node2.numa_other 62308 ± 81% +144.0% 152033 ± 45% numa-meminfo.node2.Active 61336 ± 81% +146.7% 151288 ± 45% numa-meminfo.node2.Active(anon) 15647 ±195% +497.8% 93536 ± 57% numa-meminfo.node2.AnonHugePages 60733 ± 82% +147.8% 150509 ± 45% numa-meminfo.node2.AnonPages 803985 ± 8% +10.5% 888495 ± 9% numa-meminfo.node2.MemUsed 1.14 -0.1 1.07 perf-stat.i.branch-miss-rate% 1.223e+09 -6.3% 1.146e+09 perf-stat.i.branch-misses 0.99 -1.5% 0.98 perf-stat.i.cpi 1.619e+11 +1.4% 1.641e+11 perf-stat.i.dTLB-loads 1e+11 +4.0% 1.04e+11 perf-stat.i.dTLB-stores 1.06e+09 -7.8% 9.779e+08 perf-stat.i.iTLB-load-misses 5.531e+11 +1.3% 5.603e+11 perf-stat.i.instructions 527.69 +9.7% 578.78 perf-stat.i.instructions-per-iTLB-miss 1.01 +1.4% 1.02 perf-stat.i.ipc 1931 +1.4% 1958 perf-stat.i.metric.M/sec 1.12 -0.1 1.06 perf-stat.overall.branch-miss-rate% 0.99 -1.4% 0.97 perf-stat.overall.cpi 0.00 -0.0 0.00 perf-stat.overall.dTLB-store-miss-rate% 521.71 +9.8% 572.92 perf-stat.overall.instructions-per-iTLB-miss 1.01 +1.4% 1.03 perf-stat.overall.ipc 1206072 +8.1% 1303735 perf-stat.overall.path-length 1.218e+09 -6.3% 1.142e+09 perf-stat.ps.branch-misses 1.613e+11 +1.4% 1.635e+11 perf-stat.ps.dTLB-loads 9.97e+10 +4.0% 1.036e+11 perf-stat.ps.dTLB-stores 1.057e+09 -7.8% 9.747e+08 perf-stat.ps.iTLB-load-misses 5.512e+11 +1.3% 5.584e+11 perf-stat.ps.instructions 1.668e+14 +1.2% 1.688e+14 perf-stat.total.instructions 38.39 -2.2 36.14 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 36.80 -2.1 34.66 perf-profile.calltrace.cycles-pp.sock_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 34.46 -2.0 32.44 perf-profile.calltrace.cycles-pp.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write.ksys_write 33.29 -1.8 31.47 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 30.96 -1.8 29.19 perf-profile.calltrace.cycles-pp.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write 31.72 -1.7 30.05 perf-profile.calltrace.cycles-pp.sock_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64 25.95 -1.5 24.46 perf-profile.calltrace.cycles-pp.unix_stream_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read 53.97 -1.5 52.49 perf-profile.calltrace.cycles-pp.write 24.74 -1.4 23.30 perf-profile.calltrace.cycles-pp.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read.vfs_read 47.12 -1.0 46.10 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 46.34 -1.0 45.38 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 44.29 -0.9 43.43 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 42.43 -0.8 41.64 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 13.05 -0.8 12.28 perf-profile.calltrace.cycles-pp.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 11.31 -0.7 10.65 perf-profile.calltrace.cycles-pp.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 10.31 -0.6 9.71 perf-profile.calltrace.cycles-pp.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg 8.93 -0.5 8.39 perf-profile.calltrace.cycles-pp.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 8.64 -0.5 8.14 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 8.31 -0.5 7.85 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg 7.91 -0.5 7.45 perf-profile.calltrace.cycles-pp.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 6.55 -0.4 6.19 perf-profile.calltrace.cycles-pp.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 0.54 ± 2% -0.3 0.25 ±100% perf-profile.calltrace.cycles-pp.___might_sleep.__might_fault._copy_from_iter.skb_copy_datagram_from_iter.unix_stream_sendmsg 3.81 -0.2 3.58 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.write 3.98 -0.2 3.75 perf-profile.calltrace.cycles-pp.__kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg 3.63 -0.2 3.41 perf-profile.calltrace.cycles-pp._copy_from_iter.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 3.88 -0.2 3.65 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.read 3.82 -0.2 3.60 perf-profile.calltrace.cycles-pp.skb_release_all.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 2.87 -0.2 2.66 perf-profile.calltrace.cycles-pp.security_socket_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write 3.71 -0.2 3.50 perf-profile.calltrace.cycles-pp.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic.unix_stream_recvmsg 3.62 -0.2 3.42 perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic 3.91 -0.2 3.71 perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic 2.95 -0.2 2.76 perf-profile.calltrace.cycles-pp.security_socket_recvmsg.sock_recvmsg.sock_read_iter.new_sync_read.vfs_read 3.50 -0.2 3.31 perf-profile.calltrace.cycles-pp.__check_object_size.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 3.33 -0.2 3.15 perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb 3.44 -0.2 3.25 perf-profile.calltrace.cycles-pp.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic 3.09 -0.2 2.91 perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg 3.65 -0.2 3.47 perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor 2.38 -0.2 2.21 perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.08 -0.1 1.94 perf-profile.calltrace.cycles-pp.aa_sk_perm.security_socket_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 2.63 -0.1 2.50 perf-profile.calltrace.cycles-pp.sock_wfree.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb 3.44 -0.1 3.31 perf-profile.calltrace.cycles-pp.sock_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read 1.71 -0.1 1.59 perf-profile.calltrace.cycles-pp.common_file_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64 1.69 -0.1 1.58 perf-profile.calltrace.cycles-pp.common_file_perm.security_file_permission.vfs_write.ksys_write.do_syscall_64 1.96 -0.1 1.85 perf-profile.calltrace.cycles-pp.aa_sk_perm.security_socket_recvmsg.sock_recvmsg.sock_read_iter.new_sync_read 1.44 -0.1 1.34 perf-profile.calltrace.cycles-pp.wait_for_unix_gc.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 1.57 -0.1 1.48 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg 1.47 -0.1 1.39 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor 1.20 -0.1 1.13 perf-profile.calltrace.cycles-pp.sock_def_readable.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 0.70 -0.1 0.63 ± 4% perf-profile.calltrace.cycles-pp.__might_sleep.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb 1.10 ± 2% -0.1 1.03 ± 2% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.98 -0.1 0.91 perf-profile.calltrace.cycles-pp.skb_set_owner_w.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 1.01 ± 2% -0.1 0.94 ± 3% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.01 -0.1 0.94 perf-profile.calltrace.cycles-pp.__might_fault._copy_from_iter.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg 1.13 -0.1 1.07 perf-profile.calltrace.cycles-pp.unix_write_space.sock_wfree.unix_destruct_scm.skb_release_head_state.skb_release_all 1.05 -0.1 0.99 ± 3% perf-profile.calltrace.cycles-pp.__ksize.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg 0.96 -0.1 0.91 perf-profile.calltrace.cycles-pp._raw_spin_unlock_irqrestore.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 0.96 -0.1 0.90 perf-profile.calltrace.cycles-pp._raw_spin_unlock_irqrestore.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 0.98 -0.1 0.93 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.write 1.04 -0.1 0.98 perf-profile.calltrace.cycles-pp.skb_unlink.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 1.00 -0.1 0.94 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.read 0.80 -0.1 0.75 perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 1.02 -0.0 0.97 perf-profile.calltrace.cycles-pp.skb_queue_tail.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 0.85 -0.0 0.80 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.skb_unlink.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 0.68 ± 2% -0.0 0.64 perf-profile.calltrace.cycles-pp.__prepare_exit_to_usermode.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.71 -0.0 0.67 perf-profile.calltrace.cycles-pp.___might_sleep.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb.alloc_skb_with_frags 0.70 ± 2% -0.0 0.66 ± 2% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled.copyin._copy_from_iter.skb_copy_datagram_from_iter.unix_stream_sendmsg 0.85 -0.0 0.81 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.skb_queue_tail.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 0.56 -0.0 0.52 ± 2% perf-profile.calltrace.cycles-pp.apparmor_socket_recvmsg.security_socket_recvmsg.sock_recvmsg.sock_read_iter.new_sync_read 0.57 -0.0 0.54 perf-profile.calltrace.cycles-pp.___might_sleep.wait_for_unix_gc.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 0.68 -0.0 0.64 ± 2% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 0.57 -0.0 0.54 perf-profile.calltrace.cycles-pp.__might_sleep.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb.alloc_skb_with_frags 1.68 -0.0 1.64 perf-profile.calltrace.cycles-pp.mutex_lock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 0.65 -0.0 0.62 perf-profile.calltrace.cycles-pp.mutex_unlock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 0.00 +0.6 0.57 perf-profile.calltrace.cycles-pp.fsnotify_parent.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.6 0.62 perf-profile.calltrace.cycles-pp.fsnotify_parent.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.00 +0.6 0.64 perf-profile.calltrace.cycles-pp.fsnotify_parent.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.50 +0.7 3.20 perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.9 0.93 perf-profile.calltrace.cycles-pp.fsnotify.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 48.49 +1.3 49.77 perf-profile.calltrace.cycles-pp.read 41.56 +1.7 43.30 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read 40.78 +1.8 42.56 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 38.81 +1.9 40.68 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 37.05 +1.9 38.94 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.00 +1.9 1.90 perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 38.49 -2.2 36.24 perf-profile.children.cycles-pp.new_sync_write 36.86 -2.1 34.71 perf-profile.children.cycles-pp.sock_write_iter 34.57 -2.0 32.53 perf-profile.children.cycles-pp.sock_sendmsg 33.36 -1.8 31.55 perf-profile.children.cycles-pp.new_sync_read 31.28 -1.8 29.50 perf-profile.children.cycles-pp.unix_stream_sendmsg 31.77 -1.7 30.10 perf-profile.children.cycles-pp.sock_read_iter 26.00 -1.5 24.50 perf-profile.children.cycles-pp.unix_stream_recvmsg 54.00 -1.5 52.53 perf-profile.children.cycles-pp.write 24.99 -1.5 23.53 perf-profile.children.cycles-pp.unix_stream_read_generic 44.34 -0.9 43.48 perf-profile.children.cycles-pp.ksys_write 13.14 -0.8 12.36 perf-profile.children.cycles-pp.sock_alloc_send_pskb 42.57 -0.7 41.85 perf-profile.children.cycles-pp.vfs_write 11.37 -0.7 10.71 perf-profile.children.cycles-pp.alloc_skb_with_frags 10.51 -0.6 9.90 perf-profile.children.cycles-pp.__alloc_skb 9.00 -0.5 8.46 perf-profile.children.cycles-pp.unix_stream_read_actor 8.72 -0.5 8.21 perf-profile.children.cycles-pp.skb_copy_datagram_iter 8.00 -0.5 7.53 perf-profile.children.cycles-pp.skb_copy_datagram_from_iter 8.38 -0.5 7.91 perf-profile.children.cycles-pp.__skb_datagram_iter 7.43 -0.4 7.04 perf-profile.children.cycles-pp.__check_object_size 6.57 -0.4 6.21 perf-profile.children.cycles-pp.consume_skb 5.14 -0.3 4.83 perf-profile.children.cycles-pp.entry_SYSCALL_64 4.60 -0.3 4.32 perf-profile.children.cycles-pp.syscall_return_via_sysret 4.16 -0.3 3.89 perf-profile.children.cycles-pp.aa_sk_perm 4.22 -0.3 3.96 perf-profile.children.cycles-pp.___might_sleep 3.50 -0.2 3.26 perf-profile.children.cycles-pp.common_file_perm 4.07 -0.2 3.83 perf-profile.children.cycles-pp.__kmalloc_reserve 3.71 -0.2 3.48 perf-profile.children.cycles-pp._copy_from_iter 3.85 -0.2 3.63 perf-profile.children.cycles-pp.skb_release_all 2.95 -0.2 2.73 perf-profile.children.cycles-pp.__might_sleep 2.91 -0.2 2.70 perf-profile.children.cycles-pp.security_socket_sendmsg 3.72 -0.2 3.51 perf-profile.children.cycles-pp._copy_to_iter 3.76 -0.2 3.55 perf-profile.children.cycles-pp.skb_release_head_state 3.01 -0.2 2.81 perf-profile.children.cycles-pp.security_socket_recvmsg 3.54 -0.2 3.33 perf-profile.children.cycles-pp.__kmalloc_node_track_caller 3.97 -0.2 3.77 perf-profile.children.cycles-pp.simple_copy_to_iter 3.28 -0.2 3.09 perf-profile.children.cycles-pp.kmem_cache_alloc_node 3.54 -0.2 3.35 perf-profile.children.cycles-pp.unix_destruct_scm 2.36 ± 2% -0.2 2.21 ± 2% perf-profile.children.cycles-pp.__fdget_pos 2.64 -0.1 2.50 perf-profile.children.cycles-pp.sock_wfree 3.50 -0.1 3.37 perf-profile.children.cycles-pp.sock_recvmsg 2.01 ± 2% -0.1 1.88 ± 3% perf-profile.children.cycles-pp.__fget_light 2.10 ± 2% -0.1 1.97 ± 2% perf-profile.children.cycles-pp.__might_fault 1.97 -0.1 1.85 perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 1.54 -0.1 1.44 perf-profile.children.cycles-pp.wait_for_unix_gc 1.95 -0.1 1.85 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.43 -0.1 1.34 perf-profile.children.cycles-pp._cond_resched 1.60 -0.1 1.51 perf-profile.children.cycles-pp.copyin 1.52 -0.1 1.43 perf-profile.children.cycles-pp.__prepare_exit_to_usermode 1.67 ± 3% -0.1 1.58 ± 2% perf-profile.children.cycles-pp._raw_spin_lock 1.64 -0.1 1.55 perf-profile.children.cycles-pp.copy_user_generic_unrolled 1.50 -0.1 1.42 perf-profile.children.cycles-pp.copyout 1.21 -0.1 1.13 perf-profile.children.cycles-pp.sock_def_readable 0.98 -0.1 0.91 perf-profile.children.cycles-pp.skb_set_owner_w 0.95 -0.1 0.89 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 1.05 -0.1 0.99 ± 2% perf-profile.children.cycles-pp.__ksize 0.84 -0.1 0.78 ± 2% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 1.13 -0.1 1.08 perf-profile.children.cycles-pp.unix_write_space 1.05 -0.1 0.99 perf-profile.children.cycles-pp.skb_unlink 0.74 ± 2% -0.1 0.69 perf-profile.children.cycles-pp.apparmor_file_permission 1.02 -0.1 0.97 perf-profile.children.cycles-pp.skb_queue_tail 1.75 -0.0 1.70 perf-profile.children.cycles-pp.mutex_lock 0.56 -0.0 0.52 ± 2% perf-profile.children.cycles-pp.apparmor_socket_recvmsg 0.71 -0.0 0.67 perf-profile.children.cycles-pp.rcu_all_qs 0.67 -0.0 0.63 perf-profile.children.cycles-pp.__syscall_return_slowpath 0.67 -0.0 0.64 perf-profile.children.cycles-pp.check_stack_object 0.44 -0.0 0.41 perf-profile.children.cycles-pp.apparmor_socket_sendmsg 0.67 -0.0 0.65 perf-profile.children.cycles-pp.mutex_unlock 0.30 -0.0 0.28 ± 2% perf-profile.children.cycles-pp.put_pid 0.23 -0.0 0.21 ± 2% perf-profile.children.cycles-pp.skb_release_data 0.43 +0.0 0.46 perf-profile.children.cycles-pp.apparmor_socket_getpeersec_dgram 4.96 +0.6 5.57 perf-profile.children.cycles-pp.security_file_permission 88.79 +0.7 89.51 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 87.30 +0.8 88.11 perf-profile.children.cycles-pp.do_syscall_64 48.55 +1.3 49.85 perf-profile.children.cycles-pp.read 0.00 +1.9 1.87 perf-profile.children.cycles-pp.fsnotify_parent 38.85 +1.9 40.72 perf-profile.children.cycles-pp.ksys_read 37.17 +2.0 39.17 perf-profile.children.cycles-pp.vfs_read 0.00 +2.9 2.90 perf-profile.children.cycles-pp.fsnotify 4.56 -0.3 4.28 perf-profile.self.cycles-pp.syscall_return_via_sysret 4.10 -0.2 3.85 perf-profile.self.cycles-pp.___might_sleep 2.96 -0.2 2.75 perf-profile.self.cycles-pp.unix_stream_read_generic 2.65 -0.2 2.46 perf-profile.self.cycles-pp.__might_sleep 2.94 -0.2 2.75 perf-profile.self.cycles-pp.unix_stream_sendmsg 2.85 ± 2% -0.2 2.67 perf-profile.self.cycles-pp.common_file_perm 1.40 ± 4% -0.2 1.22 perf-profile.self.cycles-pp.new_sync_read 2.32 -0.2 2.17 perf-profile.self.cycles-pp.aa_sk_perm 2.56 -0.1 2.41 perf-profile.self.cycles-pp.entry_SYSCALL_64 1.90 ± 2% -0.1 1.77 ± 3% perf-profile.self.cycles-pp.__fget_light 2.13 -0.1 2.00 perf-profile.self.cycles-pp.__alloc_skb 2.29 -0.1 2.17 perf-profile.self.cycles-pp.sock_write_iter 1.93 -0.1 1.81 perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 1.79 -0.1 1.67 perf-profile.self.cycles-pp.write 1.83 -0.1 1.72 perf-profile.self.cycles-pp.read 1.52 -0.1 1.42 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 1.71 -0.1 1.61 perf-profile.self.cycles-pp.__kmalloc_node_track_caller 1.93 -0.1 1.84 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 1.60 ± 3% -0.1 1.52 ± 2% perf-profile.self.cycles-pp._raw_spin_lock 1.81 -0.1 1.73 perf-profile.self.cycles-pp.kmem_cache_alloc_node 1.17 -0.1 1.09 perf-profile.self.cycles-pp.sock_def_readable 1.55 -0.1 1.47 perf-profile.self.cycles-pp.copy_user_generic_unrolled 1.25 ± 2% -0.1 1.17 ± 2% perf-profile.self.cycles-pp._copy_to_iter 0.61 -0.1 0.54 perf-profile.self.cycles-pp.ksys_write 1.44 -0.1 1.37 perf-profile.self.cycles-pp.sock_wfree 0.95 -0.1 0.88 perf-profile.self.cycles-pp.skb_set_owner_w 1.06 -0.1 0.99 ± 2% perf-profile.self.cycles-pp._copy_from_iter 0.58 ± 5% -0.1 0.52 ± 5% perf-profile.self.cycles-pp.aa_file_perm 1.04 -0.1 0.97 ± 2% perf-profile.self.cycles-pp.__ksize 1.10 -0.1 1.04 perf-profile.self.cycles-pp.unix_write_space 0.68 ± 2% -0.1 0.62 perf-profile.self.cycles-pp.__skb_datagram_iter 0.93 -0.1 0.87 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.52 -0.1 0.47 perf-profile.self.cycles-pp.ksys_read 0.68 ± 2% -0.1 0.63 ± 2% perf-profile.self.cycles-pp.apparmor_file_permission 0.83 -0.0 0.78 perf-profile.self.cycles-pp.unix_destruct_scm 0.87 -0.0 0.82 perf-profile.self.cycles-pp.consume_skb 0.83 -0.0 0.79 perf-profile.self.cycles-pp.sock_alloc_send_pskb 0.71 -0.0 0.67 perf-profile.self.cycles-pp._cond_resched 0.82 -0.0 0.78 perf-profile.self.cycles-pp.alloc_skb_with_frags 0.29 ± 3% -0.0 0.25 perf-profile.self.cycles-pp.unix_stream_read_actor 0.66 -0.0 0.62 perf-profile.self.cycles-pp.skb_copy_datagram_from_iter 0.53 -0.0 0.49 ± 2% perf-profile.self.cycles-pp.apparmor_socket_recvmsg 0.64 -0.0 0.60 perf-profile.self.cycles-pp.__syscall_return_slowpath 0.60 ± 2% -0.0 0.56 ± 4% perf-profile.self.cycles-pp.__might_fault 0.50 -0.0 0.46 perf-profile.self.cycles-pp.__kmalloc_reserve 0.37 -0.0 0.34 perf-profile.self.cycles-pp.security_socket_recvmsg 2.25 -0.0 2.21 perf-profile.self.cycles-pp.sock_read_iter 0.54 -0.0 0.51 perf-profile.self.cycles-pp.rcu_all_qs 0.37 ± 5% -0.0 0.34 ± 4% perf-profile.self.cycles-pp.sock_sendmsg 0.43 -0.0 0.40 perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.98 -0.0 0.95 perf-profile.self.cycles-pp.unix_stream_recvmsg 0.35 -0.0 0.32 perf-profile.self.cycles-pp.skb_copy_datagram_iter 0.41 -0.0 0.38 perf-profile.self.cycles-pp.apparmor_socket_sendmsg 0.56 -0.0 0.54 perf-profile.self.cycles-pp.check_stack_object 0.44 -0.0 0.41 perf-profile.self.cycles-pp.wait_for_unix_gc 0.29 ± 3% -0.0 0.26 ± 2% perf-profile.self.cycles-pp.security_socket_sendmsg 0.42 -0.0 0.40 perf-profile.self.cycles-pp.security_socket_getpeersec_dgram 0.63 -0.0 0.61 perf-profile.self.cycles-pp.mutex_unlock 0.40 ± 2% -0.0 0.38 perf-profile.self.cycles-pp.__fdget_pos 0.31 -0.0 0.29 perf-profile.self.cycles-pp.copyin 0.23 -0.0 0.21 ± 2% perf-profile.self.cycles-pp.skb_release_data 0.19 -0.0 0.17 ± 2% perf-profile.self.cycles-pp.skb_release_head_state 0.24 -0.0 0.23 perf-profile.self.cycles-pp.copyout 0.21 ± 2% -0.0 0.19 ± 2% perf-profile.self.cycles-pp.simple_copy_to_iter 0.26 -0.0 0.25 perf-profile.self.cycles-pp.kmalloc_slab 0.17 ± 2% +0.0 0.20 ± 2% perf-profile.self.cycles-pp.__vfs_read 0.40 +0.0 0.43 perf-profile.self.cycles-pp.apparmor_socket_getpeersec_dgram 0.73 +0.0 0.77 perf-profile.self.cycles-pp.mutex_lock 0.51 +0.1 0.57 perf-profile.self.cycles-pp.sock_recvmsg 1.33 +0.2 1.57 perf-profile.self.cycles-pp.vfs_write 0.75 ± 6% +0.4 1.10 ± 3% perf-profile.self.cycles-pp.security_file_permission 0.97 +0.5 1.49 ± 2% perf-profile.self.cycles-pp.vfs_read 0.00 +1.7 1.65 perf-profile.self.cycles-pp.fsnotify_parent 0.00 +2.8 2.80 perf-profile.self.cycles-pp.fsnotify *************************************************************************************************** lkp-csl-2ap4: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-7.6/thread/100%/debian-x86_64-20191114.cgz/lkp-csl-2ap4/pipe1/will-it-scale/0x5002f01 commit: v5.8-rc3 b6509f6a8c ("Revert "fs: Do not check if there is a fsnotify watcher on pseudo inodes"") v5.8-rc3 b6509f6a8c4313c068c69785c00 ---------------- --------------------------- %stddev %change %stddev \ | \ 1045643 -2.3% 1021331 will-it-scale.per_thread_ops 2.008e+08 -2.3% 1.961e+08 will-it-scale.workload 29490176 ± 3% -9.8% 26607616 ± 3% meminfo.DirectMap2M 202721 ± 4% +11.5% 225943 ± 3% numa-numastat.node2.local_node 25892 ± 28% -75.5% 6341 ± 97% numa-numastat.node2.other_node 1843 +8.9% 2007 ± 5% numa-vmstat.node2.nr_mapped 130681 ± 5% -14.7% 111436 ± 5% numa-vmstat.node2.numa_other 9801 ± 5% +16.0% 11370 ± 7% sched_debug.cpu.ttwu_count.max 3052 ± 12% +23.6% 3771 ± 11% sched_debug.cpu.ttwu_local.max 136156 +1.4% 138002 proc-vmstat.nr_active_anon 109009 +1.1% 110229 proc-vmstat.nr_anon_pages 136156 +1.4% 138002 proc-vmstat.nr_zone_active_anon 1120468 +1.6% 1137854 proc-vmstat.pgalloc_normal 337.83 ± 61% +53.8% 519.75 ± 47% interrupts.39:PCI-MSI.524290-edge.eth0-TxRx-1 337.83 ± 61% +53.8% 519.75 ± 47% interrupts.CPU11.39:PCI-MSI.524290-edge.eth0-TxRx-1 303.33 +45.7% 442.00 ± 44% interrupts.CPU148.RES:Rescheduling_interrupts 5509 ± 35% +50.1% 8271 interrupts.CPU155.NMI:Non-maskable_interrupts 5509 ± 35% +50.1% 8271 interrupts.CPU155.PMI:Performance_monitoring_interrupts 5509 ± 35% +50.1% 8271 interrupts.CPU157.NMI:Non-maskable_interrupts 5509 ± 35% +50.1% 8271 interrupts.CPU157.PMI:Performance_monitoring_interrupts 5509 ± 35% +50.1% 8271 interrupts.CPU158.NMI:Non-maskable_interrupts 5509 ± 35% +50.1% 8271 interrupts.CPU158.PMI:Performance_monitoring_interrupts 15130 ± 14% -18.1% 12396 ± 8% interrupts.CPU168.CAL:Function_call_interrupts 4137 ± 15% +44.3% 5970 ± 26% interrupts.CPU48.CAL:Function_call_interrupts 336.00 ± 6% +60.0% 537.75 ± 31% interrupts.CPU48.RES:Rescheduling_interrupts 0.75 -0.0 0.73 perf-stat.i.branch-miss-rate% 8.192e+08 -2.2% 8.01e+08 perf-stat.i.branch-misses 0.98 -1.4% 0.97 perf-stat.i.cpi 1.7e+11 +1.5% 1.725e+11 perf-stat.i.dTLB-loads 1.055e+11 +2.7% 1.084e+11 perf-stat.i.dTLB-stores 7.304e+08 -2.5% 7.123e+08 perf-stat.i.iTLB-load-misses 5.6e+11 +1.6% 5.688e+11 perf-stat.i.instructions 775.04 +4.2% 807.76 perf-stat.i.instructions-per-iTLB-miss 1.02 +1.5% 1.04 perf-stat.i.ipc 2015 +1.5% 2046 perf-stat.i.metric.M/sec 0.73 -0.0 0.72 perf-stat.overall.branch-miss-rate% 0.98 -1.5% 0.96 perf-stat.overall.cpi 0.00 -0.0 0.00 perf-stat.overall.dTLB-store-miss-rate% 764.55 +4.1% 796.24 perf-stat.overall.instructions-per-iTLB-miss 1.02 +1.5% 1.04 perf-stat.overall.ipc 841233 +4.0% 874479 perf-stat.overall.path-length 8.164e+08 -2.2% 7.983e+08 perf-stat.ps.branch-misses 1.695e+11 +1.5% 1.72e+11 perf-stat.ps.dTLB-loads 1.052e+11 +2.7% 1.08e+11 perf-stat.ps.dTLB-stores 7.301e+08 -2.5% 7.119e+08 perf-stat.ps.iTLB-load-misses 5.582e+11 +1.6% 5.668e+11 perf-stat.ps.instructions 1.689e+14 +1.5% 1.715e+14 perf-stat.total.instructions 50.20 -1.4 48.82 perf-profile.calltrace.cycles-pp.__GI___libc_read 40.68 -1.2 39.52 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_read 39.53 -1.1 38.39 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 36.75 -1.1 35.70 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 32.27 -0.9 31.36 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 24.69 -0.6 24.14 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 22.23 -0.5 21.72 perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 21.04 -0.5 20.55 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 18.70 -0.4 18.27 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 6.80 -0.1 6.65 perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write 5.39 -0.1 5.26 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.__GI___libc_write 2.96 -0.1 2.84 ± 2% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.27 -0.1 2.15 perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter.pipe_write.new_sync_write.vfs_write 2.42 -0.1 2.31 ± 2% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.pipe_read.new_sync_read.vfs_read 5.38 -0.1 5.28 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.__GI___libc_read 2.61 -0.1 2.52 perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.new_sync_read.vfs_read.ksys_read 3.46 -0.1 3.38 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write 2.62 -0.1 2.55 perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.new_sync_write.vfs_write.ksys_write 2.08 -0.1 2.02 perf-profile.calltrace.cycles-pp.__pthread_disable_asynccancel 0.99 -0.1 0.94 perf-profile.calltrace.cycles-pp.fput_many.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 1.04 -0.0 1.00 perf-profile.calltrace.cycles-pp.__prepare_exit_to_usermode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 0.97 -0.0 0.93 ± 2% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled.copyin.copy_page_from_iter.pipe_write.new_sync_write 1.23 -0.0 1.19 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 1.11 -0.0 1.08 perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled.copyout.copy_page_to_iter.pipe_read.new_sync_read 1.20 -0.0 1.17 perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.pipe_write.new_sync_write.vfs_write.ksys_write 1.01 -0.0 0.98 perf-profile.calltrace.cycles-pp.__prepare_exit_to_usermode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 0.79 -0.0 0.76 perf-profile.calltrace.cycles-pp.___might_sleep.mutex_lock.pipe_read.new_sync_read.vfs_read 1.50 -0.0 1.47 perf-profile.calltrace.cycles-pp.__might_fault.copy_page_from_iter.pipe_write.new_sync_write.vfs_write 1.13 -0.0 1.11 perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.pipe_read.new_sync_read.vfs_read.ksys_read 0.79 -0.0 0.77 perf-profile.calltrace.cycles-pp.___might_sleep.copy_page_from_iter.pipe_write.new_sync_write.vfs_write 0.72 -0.0 0.70 perf-profile.calltrace.cycles-pp.__sb_end_write.pipe_write.new_sync_write.vfs_write.ksys_write 0.99 -0.0 0.97 perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_read.new_sync_read.vfs_read.ksys_read 0.00 +0.9 0.92 perf-profile.calltrace.cycles-pp.fsnotify_parent.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 49.09 +1.4 50.48 perf-profile.calltrace.cycles-pp.__GI___libc_write 0.00 +1.5 1.50 ± 5% perf-profile.calltrace.cycles-pp.fsnotify.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 39.33 +1.6 40.95 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_write 38.18 +1.7 39.84 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 35.19 +1.8 37.00 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 30.77 +1.8 32.61 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 50.18 -1.4 48.80 perf-profile.children.cycles-pp.__GI___libc_read 36.87 -1.1 35.81 perf-profile.children.cycles-pp.ksys_read 32.66 -0.9 31.73 perf-profile.children.cycles-pp.vfs_read 24.84 -0.6 24.29 perf-profile.children.cycles-pp.new_sync_write 22.51 -0.5 22.00 perf-profile.children.cycles-pp.pipe_write 21.18 -0.5 20.69 perf-profile.children.cycles-pp.new_sync_read 18.94 -0.4 18.50 perf-profile.children.cycles-pp.pipe_read 5.44 -0.2 5.27 perf-profile.children.cycles-pp.mutex_lock 7.06 -0.2 6.90 perf-profile.children.cycles-pp.copy_page_from_iter 6.34 -0.2 6.19 perf-profile.children.cycles-pp.syscall_return_via_sysret 7.28 -0.1 7.13 perf-profile.children.cycles-pp.entry_SYSCALL_64 2.33 -0.1 2.21 perf-profile.children.cycles-pp.copyin 7.14 -0.1 7.03 perf-profile.children.cycles-pp.copy_page_to_iter 2.48 -0.1 2.36 ± 2% perf-profile.children.cycles-pp.copyout 4.78 -0.1 4.67 perf-profile.children.cycles-pp.___might_sleep 2.48 -0.1 2.39 perf-profile.children.cycles-pp.copy_user_generic_unrolled 2.23 -0.1 2.14 perf-profile.children.cycles-pp.__prepare_exit_to_usermode 3.56 -0.1 3.48 perf-profile.children.cycles-pp.__wake_up_common_lock 2.69 -0.1 2.63 perf-profile.children.cycles-pp.__might_sleep 2.41 -0.1 2.35 perf-profile.children.cycles-pp._raw_spin_lock_irq 2.08 -0.1 2.02 perf-profile.children.cycles-pp.__pthread_disable_asynccancel 1.88 -0.1 1.82 perf-profile.children.cycles-pp.fput_many 1.40 -0.0 1.35 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.34 -0.0 0.29 perf-profile.children.cycles-pp.fput 1.38 -0.0 1.34 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.24 ± 7% -0.0 0.22 perf-profile.children.cycles-pp.tick_sched_handle 0.92 -0.0 0.90 perf-profile.children.cycles-pp.fpregs_assert_state_consistent 1.28 -0.0 1.26 perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.75 -0.0 0.73 perf-profile.children.cycles-pp.__sb_end_write 80.17 +0.5 80.63 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 77.95 +0.5 78.47 perf-profile.children.cycles-pp.do_syscall_64 1.98 +0.9 2.88 perf-profile.children.cycles-pp.fsnotify_parent 3.04 +1.4 4.42 ± 2% perf-profile.children.cycles-pp.fsnotify 49.09 +1.4 50.48 perf-profile.children.cycles-pp.__GI___libc_write 35.45 +1.8 37.22 perf-profile.children.cycles-pp.ksys_write 30.96 +2.0 32.93 perf-profile.children.cycles-pp.vfs_write 6.28 -0.1 6.13 perf-profile.self.cycles-pp.syscall_return_via_sysret 4.68 -0.1 4.58 perf-profile.self.cycles-pp.___might_sleep 2.35 -0.1 2.26 perf-profile.self.cycles-pp.copy_user_generic_unrolled 2.26 -0.1 2.18 perf-profile.self.cycles-pp.mutex_lock 2.61 -0.1 2.54 perf-profile.self.cycles-pp.__GI___libc_write 3.09 -0.1 3.02 perf-profile.self.cycles-pp.pipe_write 2.57 -0.1 2.50 perf-profile.self.cycles-pp.__GI___libc_read 2.26 -0.1 2.19 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 3.74 -0.1 3.68 perf-profile.self.cycles-pp.entry_SYSCALL_64 0.93 -0.1 0.87 perf-profile.self.cycles-pp.ksys_write 1.38 -0.1 1.32 perf-profile.self.cycles-pp.__prepare_exit_to_usermode 2.31 -0.1 2.25 perf-profile.self.cycles-pp._raw_spin_lock_irq 1.78 -0.1 1.72 perf-profile.self.cycles-pp.fput_many 1.99 -0.1 1.94 perf-profile.self.cycles-pp.__pthread_disable_asynccancel 2.37 -0.0 2.32 perf-profile.self.cycles-pp.__might_sleep 1.14 -0.0 1.10 perf-profile.self.cycles-pp.do_syscall_64 1.36 -0.0 1.31 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 2.22 -0.0 2.18 perf-profile.self.cycles-pp.__pthread_enable_asynccancel 1.87 -0.0 1.83 perf-profile.self.cycles-pp.mutex_unlock 1.34 -0.0 1.31 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.91 -0.0 0.89 perf-profile.self.cycles-pp.file_update_time 0.85 -0.0 0.82 perf-profile.self.cycles-pp.fpregs_assert_state_consistent 0.44 -0.0 0.41 ± 2% perf-profile.self.cycles-pp.touch_atime 0.73 -0.0 0.71 perf-profile.self.cycles-pp.__sb_end_write 1.23 -0.0 1.21 perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.21 -0.0 0.20 perf-profile.self.cycles-pp.kill_fasync 2.08 ± 2% +0.4 2.49 ± 4% perf-profile.self.cycles-pp.vfs_write 1.71 +0.8 2.51 perf-profile.self.cycles-pp.fsnotify_parent 2.94 +1.3 4.25 ± 2% perf-profile.self.cycles-pp.fsnotify Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

4 months, 3 weeks

3
3
0 / 0

Re: [mac80211_hwsim] 148fe295b7: hwsim.ap_long_preamble.fail

by Philip Li

On Fri, Oct 02, 2020 at 09:38:45AM -0700, Thomas Pedersen wrote: > On 2020-10-02 01:29, kernel test robot wrote: > > Greeting, > > > > FYI, we noticed the following commit (built with gcc-9): > > > > commit: 148fe295b7d9d892b2b0f47070233ccdc70c83cd ("mac80211_hwsim: > > indicate support for S1G") > > https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master > > > > > > in testcase: hwsim > > version: hwsim-x86_64-6eb6cf0-1_20200619 > > with following parameters: > > > > group: hwsim-04 > > ucode: 0x21 > > > > > > > > on test machine: 8 threads Intel(R) Core(TM) i7-3770K CPU @ 3.50GHz > > with 16G memory > > > > caused below changes (please refer to attached dmesg/kmsg for entire > > log/backtrace): > > > > > > If you fix the issue, kindly add following tag > > Reported-by: kernel test robot <rong.a.chen(a)intel.com> > > > > > > 2020-10-06 00:22:09 ./run-tests.py ap_long_preamble > > DEV: wlan0: 02:00:00:00:00:00 > > DEV: wlan1: 02:00:00:00:01:00 > > DEV: wlan2: 02:00:00:00:02:00 > > APDEV: wlan3 > > APDEV: wlan4 > > START ap_long_preamble 1/1 > > Test: AP with long preamble > > Starting AP wlan3 > > Failed to enable hostapd interface wlan3 > > Traceback (most recent call last): > > File "./run-tests.py", line 533, in main > > t(dev, apdev) > > File "/lkp/benchmarks/hwsim/tests/hwsim/test_ap_params.py", line > > 821, in test_ap_long_preamble > > hapd = hostapd.add_ap(apdev[0], params) > > File "/lkp/benchmarks/hwsim/tests/hwsim/hostapd.py", line 581, in > > add_ap > > hapd.enable() > > File "/lkp/benchmarks/hwsim/tests/hwsim/hostapd.py", line 248, in > > enable > > raise Exception("Failed to enable hostapd interface " + self.ifname) > > Exception: Failed to enable hostapd interface wlan3 > > FAIL ap_long_preamble 0.064398 2020-10-06 00:22:09.608978 > > passed 0 test case(s) > > skipped 0 test case(s) > > failed tests: ap_long_preamble > > This is actually a bug in hostap which was exposed by this commit (and fixed > by https://patchwork.ozlabs.org/project/hostap/patch/20200827225940.18151-1-...). Thanks for the info, we have upgraded hwsim test suite to contain this fix. And apologize for the false positive. > > -- > thomas >

4 months, 3 weeks

1
0
0 / 0

[mm] 5ef64cc898: vm-scalability.throughput -20.6% regression

by kernel test robot

Greeting, FYI, we noticed a -20.6% regression of vm-scalability.throughput due to commit: commit: 5ef64cc8987a9211d3f3667331ba3411a94ddc79 ("mm: allow a controlled amount of unfairness in the page lock") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: vm-scalability on test machine: 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory with following parameters: runtime: 300s size: 2T test: shm-xread-seq cpufreq_governor: performance ucode: 0xd6 test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us. test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/ In addition to that, the commit also has significant impact on the following tests: +------------------+---------------------------------------------------------------------------+ | testcase: change | unixbench: unixbench.score 5.4% improvement | | test machine | 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory | | test parameters | cpufreq_governor=performance | | | nr_task=30% | | | runtime=300s | | | test=shell8 | | | ucode=0xd6 | +------------------+---------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_thread_ops 688.3% improvement | | test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory | | test parameters | cpufreq_governor=performance | | | mode=thread | | | nr_task=50% | | | test=readseek2 | | | ucode=0x5002f01 | +------------------+---------------------------------------------------------------------------+ | testcase: change | stress-ng: stress-ng.timerfd.ops_per_sec -3.2% regression | | test machine | 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory | | test parameters | class=interrupt | | | cpufreq_governor=performance | | | disk=1HDD | | | nr_threads=100% | | | testtime=30s | | | ucode=0x5002f01 | +------------------+---------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/rootfs/runtime/size/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/debian-10.4-x86_64-20200603.cgz/300s/2T/lkp-cfl-e1/shm-xread-seq/vm-scalability/0xd6 commit: 5925fa68fe (" perf tools fixes for v5.9: 3rd batch") 5ef64cc898 ("mm: allow a controlled amount of unfairness in the page lock") 5925fa68fe824465 5ef64cc8987a9211d3f3667331b ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 3:4 -34% 1:4 perf-profile.calltrace.cycles-pp.sync_regs.error_entry 3:4 -24% 2:4 perf-profile.calltrace.cycles-pp.error_entry 5:4 -30% 4:4 perf-profile.children.cycles-pp.error_entry 0:4 -4% 0:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 985306 -20.6% 782124 vm-scalability.median 5.42 ± 4% -2.3 3.15 ± 3% vm-scalability.median_stddev% 15764904 -20.6% 12513939 vm-scalability.throughput 173.16 +22.0% 211.25 vm-scalability.time.elapsed_time 173.16 +22.0% 211.25 vm-scalability.time.elapsed_time.max 15477 ± 4% +129.1% 35465 ± 3% vm-scalability.time.involuntary_context_switches 2.569e+08 +56.2% 4.013e+08 vm-scalability.time.minor_page_faults 1283 +12.8% 1447 vm-scalability.time.percent_of_cpu_this_job_got 971.71 +87.0% 1816 vm-scalability.time.system_time 56042863 -10.0% 50440135 vm-scalability.time.voluntary_context_switches 197.11 +19.3% 235.15 uptime.boot 1052993 -19.6% 846362 meminfo.Active 1052899 -19.6% 846266 meminfo.Active(anon) 105575 -17.9% 86662 meminfo.max_used_kB 20.13 -12.0 8.10 mpstat.cpu.all.idle% 0.61 ± 3% -0.6 0.01 ± 3% mpstat.cpu.all.iowait% 0.95 +0.6 1.53 mpstat.cpu.all.irq% 34.10 +19.4 53.49 mpstat.cpu.all.sys% 44.17 -7.4 36.81 mpstat.cpu.all.usr% 20.75 ± 2% -60.2% 8.25 ± 5% vmstat.cpu.id 34.25 +57.7% 54.00 vmstat.cpu.sy 43.25 -16.8% 36.00 vmstat.cpu.us 11.00 +27.3% 14.00 vmstat.procs.r 637460 -26.0% 471762 vmstat.system.cs 68148 +88.2% 128254 vmstat.system.in 41584830 ± 3% -86.3% 5680589 cpuidle.C1.time 7034552 -52.7% 3328990 cpuidle.C1.usage 166290 ± 42% -52.8% 78434 ± 30% cpuidle.C10.time 1.039e+08 -87.4% 13042277 ± 3% cpuidle.C1E.time 9612513 ± 2% -96.9% 294433 ± 3% cpuidle.C1E.usage 2.713e+08 -59.5% 1.1e+08 cpuidle.POLL.time 48132156 -40.9% 28439987 cpuidle.POLL.usage 264158 -19.1% 213736 proc-vmstat.nr_active_anon 2482625 -1.7% 2441126 proc-vmstat.nr_file_pages 2240838 -1.9% 2199269 proc-vmstat.nr_shmem 264158 -19.1% 213736 proc-vmstat.nr_zone_active_anon 40104796 +19.0% 47743573 proc-vmstat.numa_hit 40104796 +19.0% 47743573 proc-vmstat.numa_local 40189131 +19.0% 47826525 proc-vmstat.pgalloc_normal 2.572e+08 +56.2% 4.016e+08 proc-vmstat.pgfault 39751695 +17.5% 46709736 ± 2% proc-vmstat.pgfree 19586 ± 2% +25.4% 24554 proc-vmstat.pgreuse 12821 ± 11% +70.1% 21804 ± 7% softirqs.CPU0.RCU 55373 +58.2% 87598 softirqs.CPU0.SCHED 13132 ± 12% +56.6% 20564 ± 2% softirqs.CPU1.RCU 54173 ± 2% +63.0% 88299 softirqs.CPU1.SCHED 12063 ± 11% +56.0% 18815 ± 8% softirqs.CPU10.RCU 52997 ± 2% +63.7% 86776 softirqs.CPU10.SCHED 11146 ± 12% +73.5% 19343 ± 6% softirqs.CPU11.RCU 52858 +62.8% 86060 softirqs.CPU11.SCHED 12394 ± 20% +57.9% 19564 ± 6% softirqs.CPU12.RCU 52153 +66.2% 86659 softirqs.CPU12.SCHED 11714 ± 11% +58.9% 18619 ± 9% softirqs.CPU13.RCU 51630 +69.1% 87317 softirqs.CPU13.SCHED 11541 ± 15% +71.1% 19751 ± 10% softirqs.CPU14.RCU 52171 ± 2% +67.7% 87471 softirqs.CPU14.SCHED 12034 ± 13% +60.5% 19317 ± 8% softirqs.CPU15.RCU 52657 +65.2% 86972 softirqs.CPU15.SCHED 11964 ± 13% +75.0% 20934 ± 6% softirqs.CPU2.RCU 53736 +62.2% 87150 softirqs.CPU2.SCHED 11927 ± 11% +61.5% 19267 ± 9% softirqs.CPU3.RCU 52931 ± 2% +63.2% 86386 softirqs.CPU3.SCHED 12353 ± 15% +58.0% 19513 ± 6% softirqs.CPU4.RCU 51881 +68.0% 87174 softirqs.CPU4.SCHED 11154 ± 16% +72.4% 19234 ± 6% softirqs.CPU5.RCU 51954 +67.9% 87209 softirqs.CPU5.SCHED 11700 ± 12% +79.5% 21004 ± 11% softirqs.CPU6.RCU 51722 +68.9% 87358 softirqs.CPU6.SCHED 11795 ± 11% +79.5% 21169 ± 13% softirqs.CPU7.RCU 52777 +64.8% 86985 softirqs.CPU7.SCHED 11352 ± 16% +70.3% 19336 ± 7% softirqs.CPU8.RCU 53939 +61.1% 86897 softirqs.CPU8.SCHED 13223 ± 21% +54.5% 20423 ± 10% softirqs.CPU9.RCU 53570 ± 2% +61.4% 86435 softirqs.CPU9.SCHED 192323 ± 12% +65.7% 318668 ± 7% softirqs.RCU 846531 +64.5% 1392755 softirqs.SCHED 13340 ± 3% +28.3% 17120 ± 3% softirqs.TIMER 5616584 +255.3% 19953996 interrupts.CAL:Function_call_interrupts 403342 ± 4% +225.2% 1311736 interrupts.CPU0.CAL:Function_call_interrupts 348468 +21.9% 424744 interrupts.CPU0.LOC:Local_timer_interrupts 28665 ± 4% -21.7% 22431 ± 2% interrupts.CPU0.RES:Rescheduling_interrupts 385359 +233.7% 1285782 interrupts.CPU1.CAL:Function_call_interrupts 348549 +21.8% 424706 interrupts.CPU1.LOC:Local_timer_interrupts 28794 ± 3% -17.9% 23633 interrupts.CPU1.RES:Rescheduling_interrupts 369509 ± 3% +240.9% 1259663 interrupts.CPU10.CAL:Function_call_interrupts 348480 +21.9% 424783 interrupts.CPU10.LOC:Local_timer_interrupts 30068 ± 3% -18.6% 24464 ± 2% interrupts.CPU10.RES:Rescheduling_interrupts 353201 ± 2% +246.8% 1225041 interrupts.CPU11.CAL:Function_call_interrupts 348488 +21.9% 424702 interrupts.CPU11.LOC:Local_timer_interrupts 30935 ± 3% -22.9% 23861 ± 5% interrupts.CPU11.RES:Rescheduling_interrupts 323460 ± 2% +276.6% 1218231 interrupts.CPU12.CAL:Function_call_interrupts 348410 +21.9% 424849 interrupts.CPU12.LOC:Local_timer_interrupts 31301 ± 3% -24.0% 23799 ± 4% interrupts.CPU12.RES:Rescheduling_interrupts 306249 +291.8% 1199851 interrupts.CPU13.CAL:Function_call_interrupts 348436 +21.9% 424721 interrupts.CPU13.LOC:Local_timer_interrupts 31048 ± 3% -19.3% 25040 ± 3% interrupts.CPU13.RES:Rescheduling_interrupts 311947 ± 2% +291.1% 1220172 interrupts.CPU14.CAL:Function_call_interrupts 348554 +21.8% 424574 interrupts.CPU14.LOC:Local_timer_interrupts 30893 ± 4% -18.7% 25116 ± 4% interrupts.CPU14.RES:Rescheduling_interrupts 339980 ± 2% +259.0% 1220678 interrupts.CPU15.CAL:Function_call_interrupts 348418 +21.9% 424803 interrupts.CPU15.LOC:Local_timer_interrupts 29624 ± 3% -16.7% 24674 interrupts.CPU15.RES:Rescheduling_interrupts 369199 ± 2% +241.6% 1261224 interrupts.CPU2.CAL:Function_call_interrupts 348518 +21.9% 424863 interrupts.CPU2.LOC:Local_timer_interrupts 29702 ± 2% -21.3% 23377 ± 4% interrupts.CPU2.RES:Rescheduling_interrupts 352942 +253.9% 1249080 interrupts.CPU3.CAL:Function_call_interrupts 348266 +21.9% 424684 interrupts.CPU3.LOC:Local_timer_interrupts 31038 -25.3% 23178 ± 4% interrupts.CPU3.RES:Rescheduling_interrupts 327561 +272.0% 1218661 interrupts.CPU4.CAL:Function_call_interrupts 348447 +21.9% 424700 interrupts.CPU4.LOC:Local_timer_interrupts 30527 -22.9% 23534 ± 3% interrupts.CPU4.RES:Rescheduling_interrupts 311428 ± 2% +286.3% 1202941 interrupts.CPU5.CAL:Function_call_interrupts 348533 +21.9% 424787 interrupts.CPU5.LOC:Local_timer_interrupts 30825 ± 4% -13.7% 26600 ± 5% interrupts.CPU5.RES:Rescheduling_interrupts 319963 ± 2% +287.0% 1238272 interrupts.CPU6.CAL:Function_call_interrupts 348246 +22.0% 424716 interrupts.CPU6.LOC:Local_timer_interrupts 29411 ± 4% -20.2% 23471 ± 2% interrupts.CPU6.RES:Rescheduling_interrupts 344529 ± 3% +263.6% 1252800 interrupts.CPU7.CAL:Function_call_interrupts 348501 +21.8% 424469 interrupts.CPU7.LOC:Local_timer_interrupts 30725 ± 3% -20.7% 24366 ± 5% interrupts.CPU7.RES:Rescheduling_interrupts 408919 ± 5% +219.7% 1307498 interrupts.CPU8.CAL:Function_call_interrupts 348306 +22.0% 424854 interrupts.CPU8.LOC:Local_timer_interrupts 27910 ± 4% -19.9% 22361 ± 2% interrupts.CPU8.RES:Rescheduling_interrupts 388993 ± 3% +229.7% 1282361 interrupts.CPU9.CAL:Function_call_interrupts 348529 +21.9% 424872 interrupts.CPU9.LOC:Local_timer_interrupts 28499 ± 2% -13.0% 24791 ± 4% interrupts.CPU9.RES:Rescheduling_interrupts 5575155 +21.9% 6795831 interrupts.LOC:Local_timer_interrupts 479969 ± 2% -19.8% 384701 interrupts.RES:Rescheduling_interrupts 239.00 ± 4% -44.9% 131.75 ± 11% interrupts.TLB:TLB_shootdowns 48085 +69.4% 81451 sched_debug.cfs_rq:/.exec_clock.avg 49258 +67.3% 82414 sched_debug.cfs_rq:/.exec_clock.max 46356 +73.3% 80327 sched_debug.cfs_rq:/.exec_clock.min 80499 ± 81% -60.4% 31857 ± 3% sched_debug.cfs_rq:/.load.stddev 127.01 ± 9% -16.2% 106.49 ± 13% sched_debug.cfs_rq:/.load_avg.avg 642.42 ± 23% -30.5% 446.56 ± 3% sched_debug.cfs_rq:/.load_avg.max 169.53 ± 17% -29.5% 119.49 ± 12% sched_debug.cfs_rq:/.load_avg.stddev 588910 +87.0% 1101108 sched_debug.cfs_rq:/.min_vruntime.avg 606363 +84.1% 1116408 sched_debug.cfs_rq:/.min_vruntime.max 561578 ± 2% +91.7% 1076386 sched_debug.cfs_rq:/.min_vruntime.min 0.71 ± 8% +24.8% 0.89 sched_debug.cfs_rq:/.nr_running.avg 0.45 ± 9% -47.2% 0.24 sched_debug.cfs_rq:/.nr_running.stddev 0.73 ± 18% +59.6% 1.16 ± 11% sched_debug.cfs_rq:/.nr_spread_over.avg 1559 ± 5% +9.0% 1699 ± 5% sched_debug.cfs_rq:/.runnable_avg.max 381.23 ± 4% +62.0% 617.48 ± 5% sched_debug.cfs_rq:/.util_est_enqueued.avg 1129 ± 8% +20.4% 1359 ± 6% sched_debug.cfs_rq:/.util_est_enqueued.max 77869 ± 6% -37.4% 48731 ± 8% sched_debug.cpu.avg_idle.avg 399988 ± 12% -30.9% 276240 ± 23% sched_debug.cpu.avg_idle.max 96550 ± 12% -34.3% 63478 ± 24% sched_debug.cpu.avg_idle.stddev 83560 +35.7% 113424 sched_debug.cpu.clock.avg 83561 +35.7% 113425 sched_debug.cpu.clock.max 83558 +35.7% 113423 sched_debug.cpu.clock.min 0.78 ± 9% -35.6% 0.50 ± 4% sched_debug.cpu.clock.stddev 82827 +35.1% 111904 sched_debug.cpu.clock_task.avg 82999 +35.0% 112089 sched_debug.cpu.clock_task.max 82262 +35.2% 111189 sched_debug.cpu.clock_task.min 1618 ± 6% +48.8% 2408 ± 2% sched_debug.cpu.curr->pid.avg 2493 +16.5% 2905 sched_debug.cpu.curr->pid.max 985.88 ± 8% -28.7% 703.01 ± 14% sched_debug.cpu.curr->pid.stddev 0.79 ± 5% +24.7% 0.98 sched_debug.cpu.nr_running.avg 0.54 ± 11% -19.9% 0.44 ± 3% sched_debug.cpu.nr_running.stddev 2444639 +11.6% 2728125 sched_debug.cpu.nr_switches.avg 2466248 +18.3% 2917708 sched_debug.cpu.nr_switches.max 13988 ± 27% +642.0% 103791 ± 3% sched_debug.cpu.nr_switches.stddev 0.21 ± 22% -75.6% 0.05 ± 76% sched_debug.cpu.nr_uninterruptible.avg 2440164 +11.6% 2723801 sched_debug.cpu.sched_count.avg 2457113 +18.4% 2909974 sched_debug.cpu.sched_count.max 12769 ± 28% +704.0% 102671 ± 3% sched_debug.cpu.sched_count.stddev 1219314 +11.5% 1359077 sched_debug.cpu.sched_goidle.avg 1227676 +18.3% 1452278 sched_debug.cpu.sched_goidle.max 6331 ± 28% +710.4% 51313 ± 3% sched_debug.cpu.sched_goidle.stddev 1220257 +11.7% 1363456 sched_debug.cpu.ttwu_count.avg 1251629 +11.3% 1392991 sched_debug.cpu.ttwu_count.max 1196282 +10.0% 1316458 sched_debug.cpu.ttwu_count.min 17387 ± 8% +16.8% 20308 ± 10% sched_debug.cpu.ttwu_count.stddev 790.29 ± 3% +163.0% 2078 ± 5% sched_debug.cpu.ttwu_local.avg 1612 ± 20% +87.9% 3028 ± 8% sched_debug.cpu.ttwu_local.max 531.25 ± 6% +148.4% 1319 ± 18% sched_debug.cpu.ttwu_local.min 283.96 ± 23% +49.2% 423.75 ± 12% sched_debug.cpu.ttwu_local.stddev 83560 +35.7% 113423 sched_debug.cpu_clk 82663 +36.2% 112557 sched_debug.ktime 84851 +35.2% 114688 sched_debug.sched_clk 32.08 +6.1% 34.03 perf-stat.i.MPKI 1.672e+10 -16.1% 1.403e+10 perf-stat.i.branch-instructions 0.26 +0.0 0.31 perf-stat.i.branch-miss-rate% 33778666 +9.6% 37021638 perf-stat.i.branch-misses 1.77 ± 2% -0.4 1.35 perf-stat.i.cache-miss-rate% 20527502 ± 2% -19.2% 16588407 perf-stat.i.cache-misses 649397 -26.3% 478422 perf-stat.i.context-switches 1.28 +13.5% 1.46 perf-stat.i.cpi 5.822e+10 +5.2% 6.125e+10 perf-stat.i.cpu-cycles 209.75 ± 6% +22.7% 257.35 ± 3% perf-stat.i.cpu-migrations 3159 +21.6% 3843 perf-stat.i.cycles-between-cache-misses 0.05 ± 5% +0.0 0.07 ± 6% perf-stat.i.dTLB-load-miss-rate% 8766755 ± 5% +14.0% 9996512 ± 5% perf-stat.i.dTLB-load-misses 1.572e+10 -15.2% 1.333e+10 perf-stat.i.dTLB-loads 0.05 +0.0 0.07 perf-stat.i.dTLB-store-miss-rate% 1534360 +27.2% 1951224 perf-stat.i.dTLB-store-misses 3.172e+09 -10.9% 2.826e+09 perf-stat.i.dTLB-stores 78.19 +15.6 93.74 perf-stat.i.iTLB-load-miss-rate% 6626547 -23.1% 5098140 perf-stat.i.iTLB-load-misses 1936185 ± 3% -84.8% 294324 perf-stat.i.iTLB-loads 5.451e+10 -15.1% 4.625e+10 perf-stat.i.instructions 0.94 -19.5% 0.76 perf-stat.i.ipc 3.64 +5.2% 3.83 perf-stat.i.metric.GHz 0.07 ± 8% -25.7% 0.06 ± 14% perf-stat.i.metric.K/sec 2310 -14.7% 1971 perf-stat.i.metric.M/sec 1488490 +27.9% 1903399 perf-stat.i.minor-faults 195100 ± 2% -26.6% 143181 perf-stat.i.node-loads 13149630 -18.3% 10746838 perf-stat.i.node-stores 1488491 +27.9% 1903399 perf-stat.i.page-faults 24.51 +17.8% 28.88 perf-stat.overall.MPKI 0.20 +0.1 0.26 perf-stat.overall.branch-miss-rate% 1.54 ± 2% -0.3 1.24 perf-stat.overall.cache-miss-rate% 1.07 +24.0% 1.32 perf-stat.overall.cpi 2837 ± 2% +30.1% 3691 perf-stat.overall.cycles-between-cache-misses 0.06 ± 5% +0.0 0.07 ± 5% perf-stat.overall.dTLB-load-miss-rate% 0.05 +0.0 0.07 perf-stat.overall.dTLB-store-miss-rate% 77.39 +17.1 94.54 perf-stat.overall.iTLB-load-miss-rate% 8229 ± 2% +10.3% 9073 perf-stat.overall.instructions-per-iTLB-miss 0.94 -19.3% 0.76 perf-stat.overall.ipc 3984 +3.7% 4129 perf-stat.overall.path-length 1.662e+10 -16.0% 1.396e+10 perf-stat.ps.branch-instructions 33589028 +9.7% 36852570 perf-stat.ps.branch-misses 20412439 ± 2% -19.1% 16512315 perf-stat.ps.cache-misses 645542 -26.3% 476080 perf-stat.ps.context-switches 5.788e+10 +5.3% 6.096e+10 perf-stat.ps.cpu-cycles 208.60 ± 5% +23.0% 256.52 ± 3% perf-stat.ps.cpu-migrations 8715455 ± 5% +14.1% 9947519 ± 5% perf-stat.ps.dTLB-load-misses 1.563e+10 -15.1% 1.327e+10 perf-stat.ps.dTLB-loads 1525309 +27.3% 1941693 perf-stat.ps.dTLB-store-misses 3.153e+09 -10.8% 2.812e+09 perf-stat.ps.dTLB-stores 6587329 -23.0% 5073245 perf-stat.ps.iTLB-load-misses 1924701 ± 3% -84.8% 292898 perf-stat.ps.iTLB-loads 5.419e+10 -15.1% 4.603e+10 perf-stat.ps.instructions 1479701 +28.0% 1894095 perf-stat.ps.minor-faults 194078 ± 2% -26.5% 142593 perf-stat.ps.node-loads 13072694 -18.2% 10694520 perf-stat.ps.node-stores 1479702 +28.0% 1894095 perf-stat.ps.page-faults 9.416e+12 +3.7% 9.76e+12 perf-stat.total.instructions 28.81 ± 37% -21.6 7.25 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64 27.38 ± 37% -20.6 6.82 ± 2% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 27.38 ± 37% -20.6 6.82 ± 2% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 27.34 ± 37% -20.5 6.79 ± 2% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 23.22 ± 37% -18.7 4.48 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 23.20 ± 37% -18.7 4.47 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 15.78 ± 39% -12.4 3.42 ± 4% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 7.97 ± 37% -7.1 0.87 ± 15% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 5.85 ± 40% -5.0 0.82 ± 13% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_page_function.__wake_up_common.wake_up_page_bit.do_fault 6.11 ± 40% -4.9 1.19 ± 12% perf-profile.calltrace.cycles-pp.__wake_up_common.wake_up_page_bit.do_fault.__handle_mm_fault.handle_mm_fault 6.02 ± 41% -4.9 1.12 ± 12% perf-profile.calltrace.cycles-pp.wake_page_function.__wake_up_common.wake_up_page_bit.do_fault.__handle_mm_fault 4.33 ± 40% -4.0 0.28 ±100% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.wake_page_function.__wake_up_common.wake_up_page_bit 4.31 ± 40% -4.0 0.28 ±100% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_page_function.__wake_up_common 4.14 ± 40% -3.9 0.27 ±100% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_page_function 2.32 ± 42% -1.6 0.74 ± 12% perf-profile.calltrace.cycles-pp.schedule.io_schedule.__lock_page.find_lock_entry.shmem_getpage_gfp 2.27 ± 42% -1.5 0.73 ± 12% perf-profile.calltrace.cycles-pp.__schedule.schedule.io_schedule.__lock_page.find_lock_entry 2.37 ± 42% -1.5 0.89 ± 18% perf-profile.calltrace.cycles-pp.io_schedule.__lock_page.find_lock_entry.shmem_getpage_gfp.shmem_fault 0.28 ±100% +0.4 0.63 ± 4% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.__sysvec_call_function_single.asm_call_on_stack.sysvec_call_function_single 0.27 ±100% +0.4 0.62 ± 4% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending.__sysvec_call_function_single.asm_call_on_stack 0.30 ±100% +0.4 0.68 ± 4% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.__sysvec_call_function_single.asm_call_on_stack.sysvec_call_function_single.asm_sysvec_call_function_single 0.32 ±100% +0.4 0.74 ± 5% perf-profile.calltrace.cycles-pp.asm_call_on_stack.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch.__schedule 0.32 ±100% +0.4 0.74 ± 5% perf-profile.calltrace.cycles-pp.__sysvec_call_function_single.asm_call_on_stack.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch 0.14 ±173% +0.5 0.59 ± 4% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending.__sysvec_call_function_single 0.35 ±100% +0.5 0.81 ± 5% perf-profile.calltrace.cycles-pp.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch.__schedule.schedule_idle 0.40 ±100% +0.5 0.90 ± 6% perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry 0.14 ±173% +0.5 0.65 ± 4% perf-profile.calltrace.cycles-pp.release_pages.pagevec_lru_move_fn.activate_page.mark_page_accessed.zap_pte_range 0.38 ±100% +0.5 0.89 ± 5% perf-profile.calltrace.cycles-pp.asm_sysvec_call_function_single.finish_task_switch.__schedule.schedule_idle.do_idle 0.18 ±173% +0.7 0.83 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.unlinkat 0.18 ±173% +0.7 0.83 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlinkat 0.18 ±173% +0.7 0.83 ± 7% perf-profile.calltrace.cycles-pp.unlinkat 0.18 ±173% +0.7 0.83 ± 7% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlinkat 0.18 ±173% +0.7 0.83 ± 7% perf-profile.calltrace.cycles-pp.evict.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlinkat 0.18 ±173% +0.7 0.83 ± 7% perf-profile.calltrace.cycles-pp.shmem_evict_inode.evict.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.18 ±173% +0.7 0.83 ± 7% perf-profile.calltrace.cycles-pp.shmem_truncate_range.shmem_evict_inode.evict.do_unlinkat.do_syscall_64 0.18 ±173% +0.7 0.83 ± 7% perf-profile.calltrace.cycles-pp.shmem_undo_range.shmem_truncate_range.shmem_evict_inode.evict.do_unlinkat 0.26 ±173% +0.9 1.13 ± 5% perf-profile.calltrace.cycles-pp.__activate_page.pagevec_lru_move_fn.activate_page.mark_page_accessed.zap_pte_range 0.28 ±173% +1.2 1.50 ± 4% perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.zap_pte_range.unmap_page_range.unmap_vmas 0.37 ±173% +1.5 1.90 ± 5% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.zap_pte_range.unmap_page_range.unmap_vmas.exit_mmap 0.73 ±173% +2.2 2.89 ± 3% perf-profile.calltrace.cycles-pp.page_remove_rmap.zap_pte_range.unmap_page_range.unmap_vmas.exit_mmap 0.76 ±173% +3.0 3.73 ± 3% perf-profile.calltrace.cycles-pp.workingset_age_nonresident.workingset_activation.mark_page_accessed.zap_pte_range.unmap_page_range 0.91 ±173% +3.4 4.34 ± 3% perf-profile.calltrace.cycles-pp.workingset_activation.mark_page_accessed.zap_pte_range.unmap_page_range.unmap_vmas 0.00 +4.7 4.65 ± 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.wake_up_page_bit.do_fault.__handle_mm_fault 0.00 +4.8 4.78 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.wake_up_page_bit.do_fault.__handle_mm_fault.handle_mm_fault 1.56 ±173% +5.9 7.47 ± 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.activate_page.mark_page_accessed 1.57 ±173% +6.0 7.53 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.activate_page.mark_page_accessed.zap_pte_range 0.00 +7.3 7.34 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.wake_up_page_bit.filemap_map_pages.do_fault 0.00 +7.5 7.46 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.wake_up_page_bit.filemap_map_pages.do_fault.__handle_mm_fault 2.07 ±173% +7.7 9.74 ± 3% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.activate_page.mark_page_accessed.zap_pte_range.unmap_page_range 0.37 ±100% +8.2 8.52 ± 2% perf-profile.calltrace.cycles-pp.wake_up_page_bit.filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault 2.41 ±173% +8.7 11.09 ± 3% perf-profile.calltrace.cycles-pp.activate_page.mark_page_accessed.zap_pte_range.unmap_page_range.unmap_vmas 18.70 ± 39% +11.2 29.95 ± 2% perf-profile.calltrace.cycles-pp.filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 4.12 ±173% +14.6 18.74 ± 3% perf-profile.calltrace.cycles-pp.mark_page_accessed.zap_pte_range.unmap_page_range.unmap_vmas.exit_mmap 5.98 ±173% +20.5 26.51 ± 3% perf-profile.calltrace.cycles-pp.zap_pte_range.unmap_page_range.unmap_vmas.exit_mmap.mmput 6.00 ±173% +20.6 26.57 ± 3% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.do_exit.do_group_exit 6.00 ±173% +20.6 26.57 ± 3% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit 6.00 ±173% +20.6 26.60 ± 3% perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 6.00 ±173% +20.6 26.60 ± 3% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group 6.00 ±173% +20.6 26.61 ± 3% perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.00 ±173% +20.6 26.61 ± 3% perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.00 ±173% +20.6 26.61 ± 3% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.00 ±173% +20.6 26.61 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 6.00 ±173% +20.6 26.61 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 28.81 ± 37% -21.6 7.25 ± 2% perf-profile.children.cycles-pp.secondary_startup_64 28.81 ± 37% -21.6 7.25 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry 28.77 ± 37% -21.6 7.22 ± 2% perf-profile.children.cycles-pp.do_idle 27.38 ± 37% -20.6 6.82 ± 2% perf-profile.children.cycles-pp.start_secondary 24.40 ± 37% -19.6 4.76 ± 3% perf-profile.children.cycles-pp.cpuidle_enter 24.38 ± 37% -19.6 4.76 ± 3% perf-profile.children.cycles-pp.cpuidle_enter_state 15.86 ± 38% -12.2 3.63 ± 3% perf-profile.children.cycles-pp.poll_idle 8.17 ± 36% -7.3 0.92 ± 13% perf-profile.children.cycles-pp.intel_idle 6.35 ± 38% -4.3 2.06 ± 4% perf-profile.children.cycles-pp.wake_page_function 6.45 ± 38% -4.3 2.20 ± 4% perf-profile.children.cycles-pp.__wake_up_common 6.17 ± 38% -4.2 1.95 ± 4% perf-profile.children.cycles-pp.try_to_wake_up 5.04 ± 38% -3.0 2.06 ± 3% perf-profile.children.cycles-pp.ttwu_do_activate 5.02 ± 38% -3.0 2.04 ± 3% perf-profile.children.cycles-pp.enqueue_task_fair 4.84 ± 38% -2.9 1.97 ± 3% perf-profile.children.cycles-pp.enqueue_entity 4.02 ± 38% -2.4 1.62 ± 3% perf-profile.children.cycles-pp.__account_scheduler_latency 3.40 ± 38% -2.0 1.36 ± 2% perf-profile.children.cycles-pp.stack_trace_save_tsk 3.17 ± 39% -1.9 1.27 perf-profile.children.cycles-pp.arch_stack_walk 2.06 ± 38% -1.3 0.79 perf-profile.children.cycles-pp.unwind_next_frame 2.40 ± 40% -1.2 1.17 perf-profile.children.cycles-pp.io_schedule 2.36 ± 40% -1.2 1.15 perf-profile.children.cycles-pp.schedule 1.42 ± 52% -1.0 0.42 ± 15% perf-profile.children.cycles-pp.start_kernel 1.34 ± 38% -1.0 0.38 ± 4% perf-profile.children.cycles-pp.menu_select 1.22 ± 40% -0.7 0.57 perf-profile.children.cycles-pp.dequeue_task_fair 1.08 ± 41% -0.6 0.50 perf-profile.children.cycles-pp.dequeue_entity 0.95 ± 38% -0.5 0.40 ± 3% perf-profile.children.cycles-pp.pick_next_task_fair 0.80 ± 37% -0.4 0.39 ± 2% perf-profile.children.cycles-pp.update_load_avg 0.62 ± 39% -0.4 0.24 ± 6% perf-profile.children.cycles-pp.set_next_entity 0.50 ± 38% -0.3 0.16 ± 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.48 ± 38% -0.3 0.21 ± 7% perf-profile.children.cycles-pp.__orc_find 0.49 ± 44% -0.3 0.22 ± 3% perf-profile.children.cycles-pp.update_curr 0.44 ± 42% -0.3 0.18 ± 4% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched 0.36 ± 38% -0.2 0.13 ± 8% perf-profile.children.cycles-pp.select_task_rq_fair 0.44 ± 39% -0.2 0.21 ± 6% perf-profile.children.cycles-pp.unwind_get_return_address 0.37 ± 39% -0.2 0.17 ± 7% perf-profile.children.cycles-pp.__kernel_text_address 0.34 ± 36% -0.2 0.14 ± 5% perf-profile.children.cycles-pp.orc_find 0.33 ± 40% -0.2 0.17 ± 3% perf-profile.children.cycles-pp.update_rq_clock 0.26 ± 33% -0.2 0.09 ± 12% perf-profile.children.cycles-pp.tick_nohz_next_event 0.29 ± 36% -0.2 0.12 ± 4% perf-profile.children.cycles-pp.__switch_to_asm 0.30 ± 41% -0.2 0.14 ± 10% perf-profile.children.cycles-pp.kernel_text_address 0.28 ± 35% -0.1 0.14 ± 9% perf-profile.children.cycles-pp.sched_clock_cpu 0.24 ± 36% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.ktime_get 0.26 ± 36% -0.1 0.12 ± 8% perf-profile.children.cycles-pp.sched_clock 0.25 ± 35% -0.1 0.12 ± 11% perf-profile.children.cycles-pp.native_sched_clock 0.25 ± 41% -0.1 0.12 ± 5% perf-profile.children.cycles-pp.__switch_to 0.18 ± 35% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.18 ± 40% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.19 ± 43% -0.1 0.07 perf-profile.children.cycles-pp.in_sched_functions 0.16 ± 42% -0.1 0.04 ± 60% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.17 ± 39% -0.1 0.05 ± 58% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.22 ± 39% -0.1 0.11 ± 7% perf-profile.children.cycles-pp.__update_load_avg_se 0.18 ± 39% -0.1 0.07 ± 14% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.16 ± 41% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.check_preempt_curr 0.11 ± 39% -0.1 0.03 ±100% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.14 ± 40% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.stack_access_ok 0.14 ± 40% -0.1 0.05 ± 9% perf-profile.children.cycles-pp.__unwind_start 0.12 ± 42% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.reweight_entity 0.15 ± 39% -0.1 0.07 ± 11% perf-profile.children.cycles-pp.read_tsc 0.15 ± 32% -0.1 0.08 ± 16% perf-profile.children.cycles-pp.delayacct_end 0.10 ± 39% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.account_entity_dequeue 0.03 ±100% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.native_apic_msr_eoi_write 0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.xas_init_marks 0.03 ±100% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.__unlock_page_memcg 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.rcu_all_qs 0.06 ± 61% +0.1 0.12 ± 5% perf-profile.children.cycles-pp.__mod_memcg_state 0.07 ± 41% +0.1 0.13 ± 17% perf-profile.children.cycles-pp.xas_store 0.05 ± 64% +0.1 0.11 ± 4% perf-profile.children.cycles-pp.__mod_node_page_state 0.02 ±173% +0.1 0.09 perf-profile.children.cycles-pp.unaccount_page_cache_page 0.02 ±173% +0.1 0.09 ± 7% perf-profile.children.cycles-pp.__tlb_remove_page_size 0.07 ± 68% +0.1 0.17 ± 9% perf-profile.children.cycles-pp.__mod_lruvec_state 0.07 ± 50% +0.1 0.18 ± 10% perf-profile.children.cycles-pp.serial8250_console_write 0.02 ±173% +0.1 0.12 ± 12% perf-profile.children.cycles-pp.devkmsg_write.cold 0.02 ±173% +0.1 0.12 ± 12% perf-profile.children.cycles-pp.devkmsg_emit 0.03 ±173% +0.1 0.14 ± 11% perf-profile.children.cycles-pp.io_serial_in 0.04 ±118% +0.1 0.15 ± 9% perf-profile.children.cycles-pp.serial8250_console_putchar 0.03 ±102% +0.1 0.14 ± 13% perf-profile.children.cycles-pp.ksys_write 0.03 ±102% +0.1 0.14 ± 13% perf-profile.children.cycles-pp.vfs_write 0.03 ±102% +0.1 0.14 ± 13% perf-profile.children.cycles-pp.new_sync_write 0.04 ±118% +0.1 0.16 ± 11% perf-profile.children.cycles-pp.wait_for_xmitr 0.02 ±173% +0.1 0.13 ± 11% perf-profile.children.cycles-pp.write 0.05 ±114% +0.1 0.17 ± 11% perf-profile.children.cycles-pp.uart_console_write 0.04 ±173% +0.1 0.15 ± 16% perf-profile.children.cycles-pp.process_one_work 0.03 ±173% +0.1 0.15 ± 16% perf-profile.children.cycles-pp.drm_fb_helper_dirty_work 0.04 ±173% +0.1 0.16 ± 17% perf-profile.children.cycles-pp.worker_thread 0.03 ±173% +0.1 0.16 ± 14% perf-profile.children.cycles-pp.memcpy_erms 0.13 ± 37% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.04 ±173% +0.1 0.16 ± 15% perf-profile.children.cycles-pp.ret_from_fork 0.09 ± 67% +0.1 0.21 ± 12% perf-profile.children.cycles-pp.vprintk_emit 0.04 ±173% +0.1 0.16 ± 15% perf-profile.children.cycles-pp.kthread 0.03 ±173% +0.1 0.16 ± 8% perf-profile.children.cycles-pp.free_pcppages_bulk 0.08 ± 61% +0.1 0.21 ± 12% perf-profile.children.cycles-pp.console_unlock 0.06 ±129% +0.2 0.23 ± 6% perf-profile.children.cycles-pp.free_unref_page_list 0.07 ±118% +0.2 0.26 ± 7% perf-profile.children.cycles-pp.__delete_from_page_cache 0.09 ±127% +0.2 0.33 ± 8% perf-profile.children.cycles-pp.__pagevec_release 0.10 ±120% +0.2 0.34 ± 9% perf-profile.children.cycles-pp.delete_from_page_cache 0.06 ±173% +0.2 0.31 ± 9% perf-profile.children.cycles-pp.mem_cgroup_page_lruvec 0.10 ±120% +0.3 0.38 ± 7% perf-profile.children.cycles-pp.truncate_inode_page 0.08 ±173% +0.3 0.39 ± 8% perf-profile.children.cycles-pp.free_pages_and_swap_cache 0.34 ± 51% +0.3 0.69 ± 5% perf-profile.children.cycles-pp.lock_page_memcg 0.54 ± 46% +0.4 0.91 ± 3% perf-profile.children.cycles-pp.sched_ttwu_pending 0.25 ± 76% +0.4 0.62 ± 4% perf-profile.children.cycles-pp.unlock_page_memcg 0.55 ± 43% +0.4 0.93 ± 3% perf-profile.children.cycles-pp.find_get_entry 0.55 ± 45% +0.4 0.93 ± 3% perf-profile.children.cycles-pp.__sysvec_call_function_single 0.60 ± 44% +0.4 1.01 ± 4% perf-profile.children.cycles-pp.sysvec_call_function_single 0.86 ± 35% +0.4 1.28 ± 3% perf-profile.children.cycles-pp.asm_call_on_stack 0.66 ± 44% +0.5 1.12 ± 3% perf-profile.children.cycles-pp.asm_sysvec_call_function_single 0.75 ± 30% +0.5 1.30 ± 4% perf-profile.children.cycles-pp.PageHuge 0.23 ±123% +0.6 0.83 ± 7% perf-profile.children.cycles-pp.do_unlinkat 0.23 ±123% +0.6 0.83 ± 7% perf-profile.children.cycles-pp.evict 0.23 ±123% +0.6 0.83 ± 7% perf-profile.children.cycles-pp.shmem_evict_inode 0.23 ±123% +0.6 0.83 ± 7% perf-profile.children.cycles-pp.shmem_truncate_range 0.23 ±123% +0.6 0.83 ± 7% perf-profile.children.cycles-pp.shmem_undo_range 0.18 ±173% +0.7 0.83 ± 7% perf-profile.children.cycles-pp.unlinkat 0.26 ±173% +0.9 1.14 ± 5% perf-profile.children.cycles-pp.__activate_page 0.37 ±173% +1.6 1.93 ± 6% perf-profile.children.cycles-pp.tlb_flush_mmu 0.57 ±147% +2.0 2.54 ± 4% perf-profile.children.cycles-pp.release_pages 0.74 ±173% +2.2 2.90 ± 3% perf-profile.children.cycles-pp.page_remove_rmap 0.76 ±173% +3.0 3.74 ± 3% perf-profile.children.cycles-pp.workingset_age_nonresident 0.91 ±173% +3.4 4.34 ± 3% perf-profile.children.cycles-pp.workingset_activation 2.37 ±148% +7.6 9.94 ± 3% perf-profile.children.cycles-pp.pagevec_lru_move_fn 7.14 ± 38% +7.8 14.90 ± 3% perf-profile.children.cycles-pp.wake_up_page_bit 2.41 ±173% +8.7 11.09 ± 3% perf-profile.children.cycles-pp.activate_page 18.80 ± 39% +11.2 30.01 ± 2% perf-profile.children.cycles-pp.filemap_map_pages 4.13 ±173% +14.6 18.76 ± 3% perf-profile.children.cycles-pp.mark_page_accessed 4.09 ± 52% +16.8 20.87 ± 3% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 2.63 ± 93% +17.4 20.05 ± 3% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 6.00 ±173% +20.6 26.56 ± 3% perf-profile.children.cycles-pp.zap_pte_range 6.00 ±173% +20.6 26.57 ± 3% perf-profile.children.cycles-pp.unmap_vmas 6.00 ±173% +20.6 26.57 ± 3% perf-profile.children.cycles-pp.unmap_page_range 6.00 ±173% +20.6 26.61 ± 3% perf-profile.children.cycles-pp.mmput 6.00 ±173% +20.6 26.61 ± 3% perf-profile.children.cycles-pp.exit_mmap 6.00 ±173% +20.6 26.61 ± 3% perf-profile.children.cycles-pp.__x64_sys_exit_group 6.00 ±173% +20.6 26.61 ± 3% perf-profile.children.cycles-pp.do_group_exit 6.00 ±173% +20.6 26.61 ± 3% perf-profile.children.cycles-pp.do_exit 6.33 ±168% +21.3 27.62 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 6.32 ±168% +21.3 27.62 ± 3% perf-profile.children.cycles-pp.do_syscall_64 15.70 ± 38% -12.1 3.56 ± 3% perf-profile.self.cycles-pp.poll_idle 8.17 ± 36% -7.3 0.92 ± 13% perf-profile.self.cycles-pp.intel_idle 1.06 ± 38% -0.7 0.38 ± 2% perf-profile.self.cycles-pp.unwind_next_frame 0.67 ± 38% -0.5 0.16 ± 9% perf-profile.self.cycles-pp.menu_select 0.60 ± 41% -0.3 0.30 ± 5% perf-profile.self.cycles-pp.__schedule 0.48 ± 38% -0.3 0.21 ± 7% perf-profile.self.cycles-pp.__orc_find 0.40 ± 40% -0.3 0.13 ± 9% perf-profile.self.cycles-pp.set_next_entity 0.46 ± 38% -0.3 0.20 ± 4% perf-profile.self.cycles-pp.__account_scheduler_latency 0.38 ± 38% -0.2 0.16 ± 8% perf-profile.self.cycles-pp.update_load_avg 0.36 ± 38% -0.2 0.17 ± 2% perf-profile.self.cycles-pp.try_to_wake_up 0.33 ± 37% -0.2 0.14 ± 7% perf-profile.self.cycles-pp.orc_find 0.33 ± 46% -0.2 0.15 ± 10% perf-profile.self.cycles-pp.update_curr 0.28 ± 39% -0.2 0.09 ± 8% perf-profile.self.cycles-pp.do_idle 0.29 ± 36% -0.2 0.12 ± 4% perf-profile.self.cycles-pp.__switch_to_asm 0.25 ± 42% -0.1 0.11 ± 6% perf-profile.self.cycles-pp.stack_trace_consume_entry_nosched 0.20 ± 37% -0.1 0.07 ± 15% perf-profile.self.cycles-pp.stack_trace_save_tsk 0.24 ± 36% -0.1 0.12 ± 7% perf-profile.self.cycles-pp.native_sched_clock 0.24 ± 39% -0.1 0.12 ± 7% perf-profile.self.cycles-pp.__switch_to 0.16 ± 42% -0.1 0.04 ± 60% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.22 ± 41% -0.1 0.11 ± 7% perf-profile.self.cycles-pp.__update_load_avg_se 0.20 ± 42% -0.1 0.09 ± 4% perf-profile.self.cycles-pp.update_rq_clock 0.17 ± 39% -0.1 0.07 perf-profile.self.cycles-pp.enqueue_task_fair 0.16 ± 37% -0.1 0.06 ± 6% perf-profile.self.cycles-pp.enqueue_entity 0.12 ± 43% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__unwind_start 0.15 ± 39% -0.1 0.07 ± 6% perf-profile.self.cycles-pp.read_tsc 0.19 ± 32% -0.1 0.11 ± 7% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.11 ± 36% -0.1 0.03 ±100% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.16 ± 38% -0.1 0.08 ± 8% perf-profile.self.cycles-pp.update_cfs_group 0.13 ± 40% -0.1 0.05 perf-profile.self.cycles-pp.stack_access_ok 0.10 ± 36% -0.1 0.03 ±100% perf-profile.self.cycles-pp.account_entity_dequeue 0.03 ±100% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.native_apic_msr_eoi_write 0.03 ±100% +0.0 0.07 ± 10% perf-profile.self.cycles-pp.__unlock_page_memcg 0.04 ± 59% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.__mod_node_page_state 0.00 +0.1 0.05 perf-profile.self.cycles-pp.__mod_zone_page_state 0.01 ±173% +0.1 0.07 ± 22% perf-profile.self.cycles-pp.__mod_lruvec_state 0.06 ± 63% +0.1 0.12 ± 7% perf-profile.self.cycles-pp.__mod_memcg_state 0.02 ±173% +0.1 0.08 ± 10% perf-profile.self.cycles-pp.vm_normal_page 0.01 ±173% +0.1 0.08 ± 6% perf-profile.self.cycles-pp.__tlb_remove_page_size 0.02 ±173% +0.1 0.10 ± 10% perf-profile.self.cycles-pp.free_pcppages_bulk 0.06 ± 71% +0.1 0.14 ± 9% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.03 ±173% +0.1 0.14 ± 11% perf-profile.self.cycles-pp.io_serial_in 0.03 ±173% +0.1 0.15 ± 16% perf-profile.self.cycles-pp.memcpy_erms 0.21 ± 42% +0.2 0.42 ± 5% perf-profile.self.cycles-pp.find_lock_entry 0.07 ±173% +0.2 0.30 ± 6% perf-profile.self.cycles-pp.pagevec_lru_move_fn 0.07 ± 64% +0.2 0.30 ± 2% perf-profile.self.cycles-pp.wake_up_page_bit 0.06 ±173% +0.2 0.30 ± 9% perf-profile.self.cycles-pp.mem_cgroup_page_lruvec 0.07 ±173% +0.3 0.36 ± 8% perf-profile.self.cycles-pp.free_pages_and_swap_cache 0.35 ± 43% +0.3 0.66 ± 3% perf-profile.self.cycles-pp.find_get_entry 0.33 ± 53% +0.3 0.68 ± 5% perf-profile.self.cycles-pp.lock_page_memcg 0.25 ± 76% +0.4 0.62 ± 3% perf-profile.self.cycles-pp.unlock_page_memcg 0.16 ±173% +0.5 0.67 ± 5% perf-profile.self.cycles-pp.__activate_page 0.75 ± 30% +0.5 1.28 ± 4% perf-profile.self.cycles-pp.PageHuge 0.49 ±150% +1.7 2.21 ± 4% perf-profile.self.cycles-pp.release_pages 0.57 ±173% +1.8 2.33 ± 3% perf-profile.self.cycles-pp.zap_pte_range 0.81 ±173% +2.5 3.32 ± 4% perf-profile.self.cycles-pp.mark_page_accessed 0.76 ±173% +3.0 3.72 ± 3% perf-profile.self.cycles-pp.workingset_age_nonresident 4.08 ± 52% +16.8 20.86 ± 3% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath vm-scalability.time.system_time 1900 +--------------------------------------------------------------------+ 1800 |-O O O O O O O O O O O O O O O O O O O O O O | | O O | 1700 |-+ | 1600 |-+ | | | 1500 |-+ | 1400 |-+ | 1300 |-+ | | | 1200 |-+ | 1100 |-+ | | | 1000 |.+..+.+..+.+.+..+.+.+..+.+..+.+.+..+.+.+..+.+..+.+.+..+.+.+..+.+..+.| 900 +--------------------------------------------------------------------+ vm-scalability.time.percent_of_cpu_this_job_got 1460 +--------------------------------------------------------------------+ 1440 |-O O O O O O O O O O O O O O O O O O O O O O O O | | | 1420 |-+ | 1400 |-+ | | | 1380 |-+ | 1360 |-+ | 1340 |-+ | | | 1320 |-+ | 1300 |-+ | | .+. .+.. .+.. .+. .+..+.+. .+.+..+.| 1280 |.+..+.+. +.+..+.+ +.+..+.+ +.+.+..+.+. + +. | 1260 +--------------------------------------------------------------------+ vm-scalability.time.elapsed_time 215 +---------------------------------------------------------------------+ | O O O O O O O O O O O O O O O O O O | 210 |-+ O O O O O O | 205 |-+ | | | 200 |-+ | 195 |-+ | | | 190 |-+ | 185 |-+ | | | 180 |-+ | 175 |-+ +. +.. + .+. | | .+.+.. + +..+. .+.+.. + .+..+. .. + .+.+.+. +..+.| 170 +---------------------------------------------------------------------+ vm-scalability.time.elapsed_time.max 215 +---------------------------------------------------------------------+ | O O O O O O O O O O O O O O O O O O | 210 |-+ O O O O O O | 205 |-+ | | | 200 |-+ | 195 |-+ | | | 190 |-+ | 185 |-+ | | | 180 |-+ | 175 |-+ +. +.. + .+. | | .+.+.. + +..+. .+.+.. + .+..+. .. + .+.+.+. +..+.| 170 +---------------------------------------------------------------------+ vm-scalability.time.minor_page_faults 4.2e+08 +-----------------------------------------------------------------+ | O O O O O O O O | 4e+08 |-O O O O O O O O O O O O O O O O | 3.8e+08 |-+ | | | 3.6e+08 |-+ | 3.4e+08 |-+ | | | 3.2e+08 |-+ | 3e+08 |-+ | | | 2.8e+08 |-+ | 2.6e+08 |-+ .+.. .+. .+. .+. | |.+..+.+.+ +.+.+.+..+.+.+..+.+ +..+.+.+..+ +.+..+.+ +..+.| 2.4e+08 +-----------------------------------------------------------------+ vm-scalability.time.voluntary_context_switches 5.7e+07 +-----------------------------------------------------------------+ | + + + .+. .+ | 5.6e+07 |-+ :+ +. :+ :+ .+ +. +| 5.5e+07 |.+ .+ : + + +. .+. .+ : +.. .+.. : +.+..+ | | +..+ + : + +. +.+. + : +.+ : | 5.4e+07 |-+ + + + | | | 5.3e+07 |-+ | | | 5.2e+07 |-+ | 5.1e+07 |-+ O | | O O O O O | 5e+07 |-+ O O O | | O O O O O O O O O O O | 4.9e+07 +-----------------------------------------------------------------+ vm-scalability.time.involuntary_context_switches 45000 +-------------------------------------------------------------------+ | O | 40000 |-+ O O | | O O O | 35000 |-+ O O O O O O O | | O O O O O O O O | 30000 |-+ O O O | | | 25000 |-+ | | | 20000 |-+ .+.. .+ .+ | |.+..+.+ .+. .+. .+.+.+. + .+.+..+ + .+. .+. | 15000 |-+ + +..+ +. +..+ +. +.+..+ +..+.| | | 10000 +-------------------------------------------------------------------+ vm-scalability.throughput 1.65e+07 +----------------------------------------------------------------+ |.+. .+. .+. | 1.6e+07 |-+ +..+.+. .+..+.+.+.+. +.+.+.. .+ +..+.+. .+..+.+.+. .+.+.| 1.55e+07 |-+ + + + +. | | | 1.5e+07 |-+ | 1.45e+07 |-+ | | | 1.4e+07 |-+ | 1.35e+07 |-+ | | | 1.3e+07 |-+ | 1.25e+07 |-O O O O O O O O O O O O O O O O O O O O O O | | O O | 1.2e+07 +----------------------------------------------------------------+ vm-scalability.median 1.05e+06 +----------------------------------------------------------------+ | | 1e+06 |.+. .+ .+.+.+..+. .+.. +.+. .+ +.. | | +..+ + .+..+ +.+ + +..+ + + +.+.+. .+.+.| | + + + +. | 950000 |-+ | | | 900000 |-+ | | | 850000 |-+ | | | | | 800000 |-O O O O O O O O O O O O O O O O O | | O O O O O O O | 750000 +----------------------------------------------------------------+ vm-scalability.median_stddev_ 6 +---------------------------------------------------------------------+ | +.. +..+. +. +. +.. .+. .+ | 5.5 |:+ + + +..+ + + : + + + +. : +.| |: : +.+ + + : +.+.. : + +..+ : .. | 5 |-+ : .. + : .. + + + + | | + + + | 4.5 |-+ | | | 4 |-+ | | | 3.5 |-+ O | | O O O O O | 3 |-+ O O O O O O O O O O O O O O O | | O O O | 2.5 +---------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-cfl-e1: 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/30%/debian-10.4-x86_64-20200603.cgz/300s/lkp-cfl-e1/shell8/unixbench/0xd6 commit: 5925fa68fe (" perf tools fixes for v5.9: 3rd batch") 5ef64cc898 ("mm: allow a controlled amount of unfairness in the page lock") 5925fa68fe824465 5ef64cc8987a9211d3f3667331b ---------------- --------------------------- %stddev %change %stddev \ | \ 21570 +5.4% 22733 unixbench.score 1054019 ± 4% +25.8% 1325439 ± 3% unixbench.time.involuntary_context_switches 299493 ± 2% -87.4% 37651 ± 3% unixbench.time.major_page_faults 1.034e+08 +5.6% 1.092e+08 unixbench.time.minor_page_faults 1286 +7.3% 1379 unixbench.time.percent_of_cpu_this_job_got 334.45 +11.0% 371.24 unixbench.time.system_time 477.46 +4.8% 500.52 unixbench.time.user_time 3401111 -7.4% 3148880 unixbench.time.voluntary_context_switches 815347 +5.4% 859335 unixbench.workload 5.09 ± 3% -5.1 0.00 ±100% mpstat.cpu.all.iowait% 1752 ± 16% -21.0% 1384 ± 13% slabinfo.skbuff_head_cache.active_objs 1752 ± 16% -19.2% 1416 ± 11% slabinfo.skbuff_head_cache.num_objs 10037 -16.6% 8374 ± 7% slabinfo.vmap_area.active_objs 10355 -11.8% 9132 ± 6% slabinfo.vmap_area.num_objs 48.00 +5.7% 50.75 vmstat.cpu.sy 31.25 +9.6% 34.25 vmstat.cpu.us 3.50 ± 24% -100.0% 0.00 vmstat.procs.b 18.75 ± 4% +17.3% 22.00 ± 3% vmstat.procs.r 111395 -9.5% 100851 vmstat.system.cs 36967 +3.2% 38149 vmstat.system.in 52268017 -42.8% 29897553 ± 3% cpuidle.C1.time 1117760 -25.5% 833099 cpuidle.C1.usage 50982561 ± 2% -61.2% 19764268 ± 6% cpuidle.C1E.time 769266 -43.4% 435332 ± 3% cpuidle.C1E.usage 74333 ± 3% -31.2% 51121 ± 16% cpuidle.C3.usage 5602742 ± 4% -97.7% 129968 ± 28% cpuidle.POLL.time 697760 ± 2% -98.4% 11332 ± 12% cpuidle.POLL.usage 16352 ± 3% -8.3% 14993 ± 2% softirqs.CPU1.SCHED 15561 -11.7% 13743 softirqs.CPU10.SCHED 15622 -10.2% 14029 softirqs.CPU13.SCHED 15418 -8.0% 14188 ± 2% softirqs.CPU14.SCHED 15598 -8.0% 14355 ± 2% softirqs.CPU15.SCHED 15749 -10.1% 14155 softirqs.CPU3.SCHED 15847 -10.0% 14262 softirqs.CPU4.SCHED 970.25 +2.3% 993.00 proc-vmstat.nr_page_table_pages 13460 +5.3% 14177 ± 3% proc-vmstat.nr_slab_unreclaimable 70057163 +4.5% 73199359 proc-vmstat.numa_hit 70057163 +4.5% 73199359 proc-vmstat.numa_local 100067 +21.2% 121296 proc-vmstat.pgactivate 74525416 +4.7% 78002806 proc-vmstat.pgalloc_normal 1.041e+08 +5.1% 1.094e+08 proc-vmstat.pgfault 74511080 +4.7% 77987815 proc-vmstat.pgfree 5126035 +8.5% 5561192 proc-vmstat.pgreuse 3425 +7.0% 3664 proc-vmstat.thp_fault_alloc 1450159 +5.4% 1528363 proc-vmstat.unevictable_pgs_culled 15.80 ±100% +200.5% 47.50 ± 32% sched_debug.cfs_rq:/.removed.load_avg.avg 61.21 ±100% +137.4% 145.31 ± 14% sched_debug.cfs_rq:/.removed.load_avg.stddev 1.85 ±130% +649.4% 13.88 ± 30% sched_debug.cfs_rq:/.removed.runnable_avg.avg 29.62 ±130% +512.2% 181.38 ± 14% sched_debug.cfs_rq:/.removed.runnable_avg.max 7.17 ±130% +531.8% 45.30 ± 17% sched_debug.cfs_rq:/.removed.runnable_avg.stddev 1.48 ±170% +815.3% 13.59 ± 29% sched_debug.cfs_rq:/.removed.util_avg.avg 23.75 ±170% +649.5% 178.00 ± 13% sched_debug.cfs_rq:/.removed.util_avg.max 5.75 ±170% +673.5% 44.47 ± 16% sched_debug.cfs_rq:/.removed.util_avg.stddev 124782 ± 12% +29.5% 161579 ± 9% sched_debug.cpu.avg_idle.avg 5321 ± 44% +152.1% 13417 ± 11% sched_debug.cpu.curr->pid.avg 7329 ± 36% +104.2% 14969 ± 8% sched_debug.cpu.curr->pid.max 0.94 ± 16% +33.3% 1.25 ± 4% sched_debug.cpu.nr_running.avg 213716 -9.1% 194283 sched_debug.cpu.nr_switches.min 219.88 ± 16% -69.1% 67.88 ± 25% sched_debug.cpu.nr_uninterruptible.max -212.88 -64.7% -75.25 sched_debug.cpu.nr_uninterruptible.min 116.88 ± 11% -68.1% 37.27 ± 11% sched_debug.cpu.nr_uninterruptible.stddev 215276 -9.2% 195388 sched_debug.cpu.sched_count.avg 219021 -9.4% 198334 sched_debug.cpu.sched_count.max 212018 -9.6% 191589 sched_debug.cpu.sched_count.min 63854 -33.3% 42613 ± 2% sched_debug.cpu.sched_goidle.avg 65292 -33.2% 43641 ± 2% sched_debug.cpu.sched_goidle.max 62644 -33.7% 41522 ± 2% sched_debug.cpu.sched_goidle.min 36980 ± 4% +15.4% 42667 ± 4% sched_debug.cpu.ttwu_local.avg 37905 ± 2% +14.8% 43522 ± 2% sched_debug.cpu.ttwu_local.max 36245 ± 5% +15.1% 41734 ± 5% sched_debug.cpu.ttwu_local.min 479.50 ±122% +208.1% 1477 ± 66% interrupts.132:IR-PCI-MSI.2097153-edge.eth1-TxRx-0 21616 +25.2% 27062 interrupts.CPU0.RES:Rescheduling_interrupts 1431 -65.8% 489.00 ± 4% interrupts.CPU0.TLB:TLB_shootdowns 479.50 ±122% +208.1% 1477 ± 66% interrupts.CPU1.132:IR-PCI-MSI.2097153-edge.eth1-TxRx-0 1687 ± 7% -12.9% 1469 ± 4% interrupts.CPU1.CAL:Function_call_interrupts 21784 +23.9% 26998 ± 2% interrupts.CPU1.RES:Rescheduling_interrupts 1399 ± 2% -64.9% 491.75 ± 7% interrupts.CPU1.TLB:TLB_shootdowns 21969 +22.0% 26811 interrupts.CPU10.RES:Rescheduling_interrupts 1388 ± 2% -64.0% 500.50 interrupts.CPU10.TLB:TLB_shootdowns 21807 +24.8% 27212 interrupts.CPU11.RES:Rescheduling_interrupts 1367 ± 2% -64.4% 487.25 ± 5% interrupts.CPU11.TLB:TLB_shootdowns 21738 ± 2% +26.4% 27485 interrupts.CPU12.RES:Rescheduling_interrupts 1376 -62.3% 518.50 ± 9% interrupts.CPU12.TLB:TLB_shootdowns 21766 +25.0% 27217 interrupts.CPU13.RES:Rescheduling_interrupts 1425 -65.6% 490.75 ± 9% interrupts.CPU13.TLB:TLB_shootdowns 1557 ± 4% -9.7% 1406 ± 6% interrupts.CPU14.CAL:Function_call_interrupts 21777 +26.0% 27447 interrupts.CPU14.RES:Rescheduling_interrupts 1426 ± 2% -64.9% 500.25 ± 7% interrupts.CPU14.TLB:TLB_shootdowns 21639 ± 2% +27.8% 27653 interrupts.CPU15.RES:Rescheduling_interrupts 1441 ± 3% -64.6% 510.75 ± 6% interrupts.CPU15.TLB:TLB_shootdowns 21908 +24.0% 27161 interrupts.CPU2.RES:Rescheduling_interrupts 1415 -64.5% 503.00 ± 2% interrupts.CPU2.TLB:TLB_shootdowns 21904 +22.4% 26804 interrupts.CPU3.RES:Rescheduling_interrupts 1474 -65.6% 507.25 ± 8% interrupts.CPU3.TLB:TLB_shootdowns 21534 ± 2% +26.2% 27181 interrupts.CPU4.RES:Rescheduling_interrupts 1356 -62.2% 513.00 ± 6% interrupts.CPU4.TLB:TLB_shootdowns 21836 +23.9% 27045 interrupts.CPU5.RES:Rescheduling_interrupts 1407 ± 2% -63.9% 508.50 ± 2% interrupts.CPU5.TLB:TLB_shootdowns 21999 +23.3% 27125 interrupts.CPU6.RES:Rescheduling_interrupts 1403 ± 4% -62.7% 524.00 ± 9% interrupts.CPU6.TLB:TLB_shootdowns 1557 ± 4% -11.0% 1385 ± 4% interrupts.CPU7.CAL:Function_call_interrupts 21508 ± 2% +26.1% 27111 interrupts.CPU7.RES:Rescheduling_interrupts 1417 ± 5% -64.1% 509.50 ± 6% interrupts.CPU7.TLB:TLB_shootdowns 21905 +25.2% 27429 interrupts.CPU8.RES:Rescheduling_interrupts 1411 ± 2% -65.4% 488.50 ± 8% interrupts.CPU8.TLB:TLB_shootdowns 21904 +24.7% 27307 interrupts.CPU9.RES:Rescheduling_interrupts 1388 ± 2% -63.7% 503.50 interrupts.CPU9.TLB:TLB_shootdowns 348600 +24.8% 435055 interrupts.RES:Rescheduling_interrupts 22530 -64.3% 8046 ± 4% interrupts.TLB:TLB_shootdowns 48.16 -1.7% 47.32 perf-stat.i.MPKI 9.687e+09 +5.1% 1.019e+10 perf-stat.i.branch-instructions 2.126e+08 +4.6% 2.224e+08 perf-stat.i.branch-misses 4.44 +0.2 4.60 perf-stat.i.cache-miss-rate% 94624278 +7.1% 1.013e+08 perf-stat.i.cache-misses 2.382e+09 +3.3% 2.461e+09 perf-stat.i.cache-references 114789 -9.1% 104363 perf-stat.i.context-switches 5.294e+10 +5.8% 5.601e+10 perf-stat.i.cpu-cycles 19853 -22.2% 15448 perf-stat.i.cpu-migrations 569.61 -1.9% 558.71 perf-stat.i.cycles-between-cache-misses 1.223e+10 +5.1% 1.285e+10 perf-stat.i.dTLB-loads 3655243 +4.1% 3805877 perf-stat.i.dTLB-store-misses 7.024e+09 +5.1% 7.383e+09 perf-stat.i.dTLB-stores 10344903 +3.7% 10732085 perf-stat.i.iTLB-load-misses 8031239 +1.9% 8185952 perf-stat.i.iTLB-loads 4.759e+10 +5.2% 5.006e+10 perf-stat.i.instructions 5236 +1.2% 5299 perf-stat.i.instructions-per-iTLB-miss 4684 ± 2% -87.4% 589.00 ± 3% perf-stat.i.major-faults 3.31 +5.8% 3.50 perf-stat.i.metric.GHz 1960 +5.0% 2058 perf-stat.i.metric.M/sec 1588100 +5.6% 1677762 perf-stat.i.minor-faults 5071078 +8.5% 5500804 perf-stat.i.node-loads 31239619 +7.2% 33482613 perf-stat.i.node-stores 1592784 +5.4% 1678351 perf-stat.i.page-faults 50.05 -1.8% 49.15 perf-stat.overall.MPKI 3.97 +0.1 4.12 perf-stat.overall.cache-miss-rate% 559.44 -1.2% 552.70 perf-stat.overall.cycles-between-cache-misses 4600 +1.4% 4664 perf-stat.overall.instructions-per-iTLB-miss 9.533e+09 +5.1% 1.002e+10 perf-stat.ps.branch-instructions 2.093e+08 +4.6% 2.189e+08 perf-stat.ps.branch-misses 93122368 +7.1% 99714732 perf-stat.ps.cache-misses 2.344e+09 +3.3% 2.421e+09 perf-stat.ps.cache-references 112962 -9.1% 102685 perf-stat.ps.context-switches 5.21e+10 +5.8% 5.511e+10 perf-stat.ps.cpu-cycles 19537 -22.2% 15200 perf-stat.ps.cpu-migrations 1.203e+10 +5.1% 1.264e+10 perf-stat.ps.dTLB-loads 3597096 +4.1% 3744712 perf-stat.ps.dTLB-store-misses 6.913e+09 +5.1% 7.264e+09 perf-stat.ps.dTLB-stores 10180397 +3.7% 10559643 perf-stat.ps.iTLB-load-misses 7903463 +1.9% 8054357 perf-stat.ps.iTLB-loads 4.684e+10 +5.2% 4.926e+10 perf-stat.ps.instructions 4609 ± 2% -87.4% 579.53 ± 3% perf-stat.ps.major-faults 1562827 +5.6% 1650780 perf-stat.ps.minor-faults 4990492 +8.5% 5412486 perf-stat.ps.node-loads 30742642 +7.2% 32944203 perf-stat.ps.node-stores 1567436 +5.4% 1651360 perf-stat.ps.page-faults 3.004e+12 +5.2% 3.159e+12 perf-stat.total.instructions 29.27 ± 57% -17.3 11.93 ±173% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 29.27 ± 57% -17.3 11.93 ±173% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 29.27 ± 57% -17.3 11.93 ±173% perf-profile.calltrace.cycles-pp.write 29.27 ± 57% -17.3 11.93 ±173% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 29.27 ± 57% -17.3 11.93 ±173% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 29.27 ± 57% -17.3 11.93 ±173% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 29.09 ± 57% -17.2 11.93 ±173% perf-profile.calltrace.cycles-pp.devkmsg_write.cold.new_sync_write.vfs_write.ksys_write.do_syscall_64 29.09 ± 57% -17.2 11.93 ±173% perf-profile.calltrace.cycles-pp.devkmsg_emit.devkmsg_write.cold.new_sync_write.vfs_write.ksys_write 29.09 ± 57% -17.2 11.93 ±173% perf-profile.calltrace.cycles-pp.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write.vfs_write 29.09 ± 57% -17.2 11.93 ±173% perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write 25.68 ± 57% -14.9 10.79 ±173% perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.cold 24.54 ± 57% -14.0 10.51 ±173% perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit 15.00 ± 46% -11.4 3.59 ±106% perf-profile.calltrace.cycles-pp.do_group_exit.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode 15.00 ± 46% -11.4 3.59 ±106% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.get_signal.arch_do_signal.exit_to_user_mode_prepare 15.00 ± 46% -11.4 3.59 ±106% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 15.00 ± 46% -11.4 3.59 ±106% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 15.00 ± 46% -11.4 3.59 ±106% perf-profile.calltrace.cycles-pp.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 15.00 ± 46% -11.4 3.59 ±106% perf-profile.calltrace.cycles-pp.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 20.19 ± 58% -11.1 9.09 ±173% perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock 20.19 ± 58% -11.1 9.09 ±173% perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit 13.48 ± 48% -10.9 2.58 ±109% perf-profile.calltrace.cycles-pp.perf_release.__fput.task_work_run.do_exit.do_group_exit 13.48 ± 48% -10.9 2.58 ±109% perf-profile.calltrace.cycles-pp.perf_event_release_kernel.perf_release.__fput.task_work_run.do_exit 16.11 ± 40% -10.4 5.73 ±114% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 13.48 ± 48% -9.9 3.59 ±106% perf-profile.calltrace.cycles-pp.task_work_run.do_exit.do_group_exit.get_signal.arch_do_signal 13.48 ± 48% -9.9 3.59 ±106% perf-profile.calltrace.cycles-pp.__fput.task_work_run.do_exit.do_group_exit.get_signal 18.44 ± 58% -9.6 8.81 ±173% perf-profile.calltrace.cycles-pp.io_serial_in.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write 4.35 ± 76% -3.5 0.85 ±173% perf-profile.calltrace.cycles-pp.io_serial_out.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit 47.23 ± 27% -26.2 21.02 ± 78% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 29.27 ± 57% -17.3 11.93 ±173% perf-profile.children.cycles-pp.write 29.27 ± 57% -17.3 11.93 ±173% perf-profile.children.cycles-pp.ksys_write 29.27 ± 57% -17.3 11.93 ±173% perf-profile.children.cycles-pp.vfs_write 29.27 ± 57% -17.3 11.93 ±173% perf-profile.children.cycles-pp.new_sync_write 29.09 ± 57% -17.2 11.93 ±173% perf-profile.children.cycles-pp.devkmsg_write.cold 29.09 ± 57% -17.2 11.93 ±173% perf-profile.children.cycles-pp.devkmsg_emit 29.09 ± 57% -17.2 11.93 ±173% perf-profile.children.cycles-pp.vprintk_emit 29.09 ± 57% -17.2 11.93 ±173% perf-profile.children.cycles-pp.console_unlock 25.68 ± 57% -14.9 10.79 ±173% perf-profile.children.cycles-pp.serial8250_console_write 24.54 ± 57% -14.3 10.23 ±173% perf-profile.children.cycles-pp.uart_console_write 15.19 ± 44% -11.6 3.59 ±106% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 15.19 ± 44% -11.6 3.59 ±106% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 15.74 ± 41% -11.6 4.15 ±112% perf-profile.children.cycles-pp.do_group_exit 15.74 ± 41% -11.6 4.15 ±112% perf-profile.children.cycles-pp.do_exit 21.15 ± 58% -11.5 9.66 ±173% perf-profile.children.cycles-pp.wait_for_xmitr 15.00 ± 46% -11.4 3.59 ±106% perf-profile.children.cycles-pp.arch_do_signal 15.00 ± 46% -11.4 3.59 ±106% perf-profile.children.cycles-pp.get_signal 20.19 ± 58% -11.1 9.09 ±173% perf-profile.children.cycles-pp.serial8250_console_putchar 13.48 ± 48% -10.9 2.58 ±109% perf-profile.children.cycles-pp.perf_release 13.48 ± 48% -10.9 2.58 ±109% perf-profile.children.cycles-pp.perf_event_release_kernel 19.40 ± 58% -10.0 9.38 ±173% perf-profile.children.cycles-pp.io_serial_in 13.48 ± 48% -9.9 3.59 ±106% perf-profile.children.cycles-pp.task_work_run 13.48 ± 48% -9.9 3.59 ±106% perf-profile.children.cycles-pp.__fput 4.54 ± 79% -3.4 1.14 ±173% perf-profile.children.cycles-pp.io_serial_out 19.40 ± 58% -10.0 9.38 ±173% perf-profile.self.cycles-pp.io_serial_in 4.54 ± 79% -3.4 1.14 ±173% perf-profile.self.cycles-pp.io_serial_out *************************************************************************************************** lkp-csl-2ap3: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/thread/50%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2ap3/readseek2/will-it-scale/0x5002f01 commit: 5925fa68fe (" perf tools fixes for v5.9: 3rd batch") 5ef64cc898 ("mm: allow a controlled amount of unfairness in the page lock") 5925fa68fe824465 5ef64cc8987a9211d3f3667331b ---------------- --------------------------- %stddev %change %stddev \ | \ 1266 +688.3% 9979 ± 3% will-it-scale.per_thread_ops 121587 +688.0% 958052 ± 3% will-it-scale.workload 71.50 ± 5% -28.3% 51.25 vmstat.cpu.id 25.00 ± 18% -100.0% 0.00 vmstat.cpu.wa 1.00 +8975.0% 90.75 vmstat.procs.r 1.225e+09 ± 41% -63.7% 4.441e+08 ± 69% cpuidle.C1.time 1.272e+08 ± 18% -43.3% 72207404 ± 7% cpuidle.C1E.usage 26464356 ± 10% +69.2% 44765776 ± 10% cpuidle.POLL.time 2008351 ± 16% +641.3% 14887271 ± 10% cpuidle.POLL.usage 7829 ± 6% +1248.0% 105533 ± 5% meminfo.Active 7825 ± 6% +1248.6% 105529 ± 5% meminfo.Active(anon) 36955 +11.8% 41313 meminfo.Mapped 27224 +368.3% 127479 ± 4% meminfo.Shmem 31081 -59.8% 12502 ±104% numa-numastat.node1.other_node 220546 ± 7% -28.7% 157349 ± 3% numa-numastat.node2.local_node 251604 ± 6% -28.2% 180707 ± 7% numa-numastat.node2.numa_hit 7880 ±170% +294.3% 31072 numa-numastat.node3.other_node 71.78 ± 6% -20.4 51.40 mpstat.cpu.all.idle% 25.99 ± 16% -26.0 0.03 ±105% mpstat.cpu.all.iowait% 1.53 ± 3% -1.0 0.52 ± 2% mpstat.cpu.all.irq% 0.11 ± 2% -0.0 0.07 ± 3% mpstat.cpu.all.soft% 0.53 ± 2% +47.4 47.91 mpstat.cpu.all.sys% 0.05 +0.0 0.09 ± 22% mpstat.cpu.all.usr% 1988 ± 18% +31.3% 2610 ± 20% numa-vmstat.node0.nr_mapped 77149 ± 37% -63.9% 27823 ± 25% numa-vmstat.node0.numa_other 179.00 ±130% +232.8% 595.75 ± 56% numa-vmstat.node1.nr_active_anon 179.00 ±130% +232.8% 595.75 ± 56% numa-vmstat.node1.nr_zone_active_anon 1260 ± 23% +1900.9% 25226 ± 5% numa-vmstat.node3.nr_active_anon 71809 +34.9% 96880 ± 3% numa-vmstat.node3.nr_file_pages 1845 ± 34% +1367.1% 27068 ± 11% numa-vmstat.node3.nr_shmem 9936 ± 9% -42.1% 5758 ± 4% numa-vmstat.node3.nr_slab_reclaimable 1260 ± 23% +1900.8% 25225 ± 5% numa-vmstat.node3.nr_zone_active_anon 65717 ± 43% +87.3% 123087 numa-vmstat.node3.numa_other 1181 ± 13% +28.6% 1520 ± 5% slabinfo.dmaengine-unmap-16.active_objs 1181 ± 13% +28.6% 1520 ± 5% slabinfo.dmaengine-unmap-16.num_objs 6785 ± 9% +24.7% 8464 ± 2% slabinfo.files_cache.active_objs 6785 ± 9% +24.7% 8464 ± 2% slabinfo.files_cache.num_objs 3748 ± 5% +13.8% 4267 ± 2% slabinfo.sighand_cache.active_objs 3793 ± 5% +13.4% 4300 ± 2% slabinfo.sighand_cache.num_objs 829.50 ± 14% +23.8% 1027 ± 5% slabinfo.skbuff_fclone_cache.active_objs 829.50 ± 14% +23.8% 1027 ± 5% slabinfo.skbuff_fclone_cache.num_objs 25690 -17.0% 21326 slabinfo.vmap_area.active_objs 25696 -17.0% 21331 slabinfo.vmap_area.num_objs 7835 ± 19% +30.5% 10227 ± 22% numa-meminfo.node0.Mapped 718.00 ±129% +232.6% 2387 ± 56% numa-meminfo.node1.Active 718.00 ±129% +232.1% 2384 ± 56% numa-meminfo.node1.Active(anon) 5038 ± 23% +1904.1% 100980 ± 5% numa-meminfo.node3.Active 5035 ± 23% +1905.3% 100980 ± 5% numa-meminfo.node3.Active(anon) 287239 +34.9% 387535 ± 3% numa-meminfo.node3.FilePages 39748 ± 9% -42.0% 23046 ± 4% numa-meminfo.node3.KReclaimable 789152 ± 4% +7.8% 850631 ± 6% numa-meminfo.node3.MemUsed 39748 ± 9% -42.0% 23046 ± 4% numa-meminfo.node3.SReclaimable 7378 ± 34% +1367.6% 108288 ± 11% numa-meminfo.node3.Shmem 112975 ± 7% -22.4% 87674 ± 10% numa-meminfo.node3.Slab 1955 ± 6% +1249.2% 26376 ± 5% proc-vmstat.nr_active_anon 292548 +8.6% 317683 proc-vmstat.nr_file_pages 9365 +12.1% 10501 proc-vmstat.nr_mapped 6805 +368.3% 31870 ± 4% proc-vmstat.nr_shmem 31824 +1.8% 32389 proc-vmstat.nr_slab_reclaimable 1955 ± 6% +1249.2% 26376 ± 5% proc-vmstat.nr_zone_active_anon 2404 ± 12% +107.0% 4976 ± 49% proc-vmstat.numa_hint_faults_local 996995 +3.3% 1030379 proc-vmstat.numa_hit 903561 +3.7% 936976 proc-vmstat.numa_local 92254 ± 13% +44.3% 133088 ± 10% proc-vmstat.numa_pte_updates 1519 ± 24% +1609.0% 25963 ± 6% proc-vmstat.pgactivate 1084057 +3.1% 1117729 proc-vmstat.pgalloc_normal 1156577 +4.0% 1202453 proc-vmstat.pgfault 170.02 ± 57% +8564.4% 14731 ± 41% sched_debug.cfs_rq:/.MIN_vruntime.avg 16736 ± 45% +11393.3% 1923555 ± 36% sched_debug.cfs_rq:/.MIN_vruntime.max 1596 ± 49% +10399.2% 167614 ± 39% sched_debug.cfs_rq:/.MIN_vruntime.stddev 1242 ± 10% +5367.8% 67950 ± 8% sched_debug.cfs_rq:/.exec_clock.avg 3496 ± 16% +3299.1% 118860 ± 6% sched_debug.cfs_rq:/.exec_clock.max 307.99 ± 22% +5682.7% 17809 ± 31% sched_debug.cfs_rq:/.exec_clock.min 443.83 ± 8% +2973.4% 13640 ± 4% sched_debug.cfs_rq:/.exec_clock.stddev 466502 ± 18% -85.2% 69202 ±129% sched_debug.cfs_rq:/.load.max 56674 ± 17% -82.3% 10016 ± 67% sched_debug.cfs_rq:/.load.stddev 553.96 ± 7% -54.4% 252.48 ± 39% sched_debug.cfs_rq:/.load_avg.max 53.50 ± 10% -43.5% 30.25 ± 38% sched_debug.cfs_rq:/.load_avg.stddev 170.02 ± 57% +8564.4% 14731 ± 41% sched_debug.cfs_rq:/.max_vruntime.avg 16736 ± 45% +11393.3% 1923555 ± 36% sched_debug.cfs_rq:/.max_vruntime.max 1596 ± 49% +10399.2% 167614 ± 39% sched_debug.cfs_rq:/.max_vruntime.stddev 33466 ± 25% +17200.5% 5789901 ± 8% sched_debug.cfs_rq:/.min_vruntime.avg 60233 ± 19% +16685.1% 10110254 ± 6% sched_debug.cfs_rq:/.min_vruntime.max 20331 ± 26% +7420.2% 1528965 ± 32% sched_debug.cfs_rq:/.min_vruntime.min 4797 ± 11% +24047.1% 1158377 ± 4% sched_debug.cfs_rq:/.min_vruntime.stddev 0.03 ± 15% +1586.0% 0.53 ± 6% sched_debug.cfs_rq:/.nr_running.avg 0.17 ± 8% +155.9% 0.43 ± 2% sched_debug.cfs_rq:/.nr_running.stddev 0.13 ±103% +263.7% 0.49 ± 18% sched_debug.cfs_rq:/.nr_spread_over.avg 1.13 ± 63% +237.5% 3.82 ± 15% sched_debug.cfs_rq:/.nr_spread_over.max 0.17 ± 89% +337.2% 0.76 ± 11% sched_debug.cfs_rq:/.nr_spread_over.stddev 31.86 ± 14% +1420.5% 484.49 ± 7% sched_debug.cfs_rq:/.runnable_avg.avg 702.53 ± 4% +33.6% 938.62 ± 5% sched_debug.cfs_rq:/.runnable_avg.max 86.88 ± 7% +323.3% 367.76 ± 2% sched_debug.cfs_rq:/.runnable_avg.stddev -1332 -1.7e+05% 2293744 ± 23% sched_debug.cfs_rq:/.spread0.avg 25416 ± 45% +25922.7% 6614096 ± 10% sched_debug.cfs_rq:/.spread0.max -14452 +13512.9% -1967432 sched_debug.cfs_rq:/.spread0.min 4799 ± 11% +24038.1% 1158452 ± 4% sched_debug.cfs_rq:/.spread0.stddev 31.73 ± 14% +1425.9% 484.20 ± 7% sched_debug.cfs_rq:/.util_avg.avg 702.49 ± 4% +33.6% 938.58 ± 5% sched_debug.cfs_rq:/.util_avg.max 86.82 ± 7% +323.6% 367.72 ± 2% sched_debug.cfs_rq:/.util_avg.stddev 3.25 ± 12% +13255.4% 434.48 ± 6% sched_debug.cfs_rq:/.util_est_enqueued.avg 259.20 ± 5% +242.9% 888.80 sched_debug.cfs_rq:/.util_est_enqueued.max 24.35 ± 6% +1360.2% 355.60 sched_debug.cfs_rq:/.util_est_enqueued.stddev 853642 -37.8% 530714 sched_debug.cpu.avg_idle.avg 75902 ± 12% -80.9% 14497 ± 29% sched_debug.cpu.avg_idle.min 177509 ± 4% +147.6% 439550 sched_debug.cpu.avg_idle.stddev 96.07 ± 9% +1468.1% 1506 ± 2% sched_debug.cpu.curr->pid.avg 720.78 ± 4% +132.6% 1676 sched_debug.cpu.curr->pid.stddev 0.00 ± 20% +322.0% 0.00 ± 27% sched_debug.cpu.next_balance.stddev 0.02 ± 8% +1657.9% 0.41 sched_debug.cpu.nr_running.avg 0.15 ± 4% +207.4% 0.45 sched_debug.cpu.nr_running.stddev 49550 ± 6% -31.8% 33787 ± 10% sched_debug.cpu.nr_switches.stddev 0.40 -94.3% 0.02 ± 42% sched_debug.cpu.nr_uninterruptible.avg 49442 ± 6% -31.9% 33686 ± 10% sched_debug.cpu.sched_count.stddev 24716 ± 6% -31.9% 16830 ± 10% sched_debug.cpu.sched_goidle.stddev 24764 ± 6% -32.3% 16770 ± 10% sched_debug.cpu.ttwu_count.stddev 4432 ± 40% -60.8% 1735 ± 26% sched_debug.cpu.ttwu_local.max 337.31 ± 35% -54.2% 154.44 ± 23% sched_debug.cpu.ttwu_local.stddev 17.43 -85.9% 2.46 ± 7% perf-stat.i.MPKI 7.452e+08 +805.2% 6.745e+09 perf-stat.i.branch-instructions 1.69 -1.3 0.34 ± 3% perf-stat.i.branch-miss-rate% 13281209 +71.2% 22738819 ± 2% perf-stat.i.branch-misses 13.68 ± 6% +40.3 54.02 ± 2% perf-stat.i.cache-miss-rate% 8061015 ± 8% +357.2% 36853851 ± 9% perf-stat.i.cache-misses 59267552 ± 2% +15.1% 68218277 ± 7% perf-stat.i.cache-references 3.22 ± 2% +221.8% 10.36 perf-stat.i.cpi 1.103e+10 ± 2% +2512.2% 2.882e+11 perf-stat.i.cpu-cycles 223.55 +11.5% 249.23 perf-stat.i.cpu-migrations 1409 ± 5% +459.4% 7886 ± 10% perf-stat.i.cycles-between-cache-misses 0.00 ± 3% -0.0 0.00 ± 4% perf-stat.i.dTLB-load-miss-rate% 42216 ± 6% +374.4% 200286 ± 4% perf-stat.i.dTLB-load-misses 9.242e+08 +667.5% 7.093e+09 perf-stat.i.dTLB-loads 0.00 -0.0 0.00 ± 3% perf-stat.i.dTLB-store-miss-rate% 13269 ± 2% +23.8% 16421 perf-stat.i.dTLB-store-misses 5.132e+08 +64.4% 8.439e+08 ± 2% perf-stat.i.dTLB-stores 57.39 +14.0 71.43 perf-stat.i.iTLB-load-miss-rate% 7475200 ± 2% +51.8% 11347314 ± 4% perf-stat.i.iTLB-load-misses 5545950 -18.1% 4541031 ± 7% perf-stat.i.iTLB-loads 3.499e+09 +694.7% 2.781e+10 perf-stat.i.instructions 470.84 +421.6% 2455 ± 4% perf-stat.i.instructions-per-iTLB-miss 0.31 ± 2% -68.9% 0.10 perf-stat.i.ipc 0.69 ± 3% +55.3% 1.07 ± 5% perf-stat.i.major-faults 0.06 ± 2% +2510.5% 1.50 perf-stat.i.metric.GHz 0.44 ± 14% +128.0% 1.01 ± 2% perf-stat.i.metric.K/sec 11.72 +556.3% 76.89 perf-stat.i.metric.M/sec 3716 +4.5% 3884 perf-stat.i.minor-faults 96.24 +2.0 98.23 perf-stat.i.node-load-miss-rate% 1506224 ± 8% +563.7% 9996147 perf-stat.i.node-load-misses 59182 ± 20% +202.2% 178865 ± 2% perf-stat.i.node-loads 97.87 +1.9 99.75 perf-stat.i.node-store-miss-rate% 406316 ± 6% +1532.3% 6632290 perf-stat.i.node-store-misses 9574 ± 16% +26.7% 12131 ± 8% perf-stat.i.node-stores 3717 +4.5% 3885 perf-stat.i.page-faults 16.94 -85.5% 2.45 ± 7% perf-stat.overall.MPKI 1.78 -1.4 0.34 ± 3% perf-stat.overall.branch-miss-rate% 13.59 ± 6% +40.3 53.94 ± 2% perf-stat.overall.cache-miss-rate% 3.15 ± 2% +228.8% 10.37 perf-stat.overall.cpi 1374 ± 5% +474.4% 7895 ± 10% perf-stat.overall.cycles-between-cache-misses 0.00 ± 6% -0.0 0.00 ± 4% perf-stat.overall.dTLB-load-miss-rate% 0.00 -0.0 0.00 ± 3% perf-stat.overall.dTLB-store-miss-rate% 57.40 +14.1 71.46 perf-stat.overall.iTLB-load-miss-rate% 468.36 ± 2% +424.0% 2454 ± 4% perf-stat.overall.instructions-per-iTLB-miss 0.32 ± 2% -69.6% 0.10 perf-stat.overall.ipc 96.24 +2.0 98.24 perf-stat.overall.node-load-miss-rate% 97.70 +2.1 99.82 perf-stat.overall.node-store-miss-rate% 7.428e+08 +804.5% 6.719e+09 perf-stat.ps.branch-instructions 13241794 +70.8% 22612139 ± 2% perf-stat.ps.branch-misses 8035056 ± 8% +356.9% 36710582 ± 9% perf-stat.ps.cache-misses 59071874 ± 2% +15.0% 67947551 ± 7% perf-stat.ps.cache-references 1.1e+10 ± 2% +2510.8% 2.871e+11 perf-stat.ps.cpu-cycles 222.96 +11.4% 248.34 perf-stat.ps.cpu-migrations 42122 ± 6% +373.7% 199521 ± 4% perf-stat.ps.dTLB-load-misses 9.212e+08 +667.0% 7.065e+09 perf-stat.ps.dTLB-loads 13235 ± 2% +23.4% 16333 perf-stat.ps.dTLB-store-misses 5.116e+08 +64.3% 8.404e+08 ± 2% perf-stat.ps.dTLB-stores 7450273 ± 2% +51.7% 11304013 ± 4% perf-stat.ps.iTLB-load-misses 5527433 -18.2% 4522978 ± 7% perf-stat.ps.iTLB-loads 3.488e+09 +694.1% 2.77e+10 perf-stat.ps.instructions 0.69 ± 3% +53.2% 1.05 ± 5% perf-stat.ps.major-faults 3705 +4.3% 3862 perf-stat.ps.minor-faults 1501438 ± 8% +563.2% 9958261 perf-stat.ps.node-load-misses 59037 ± 20% +202.0% 178306 ± 2% perf-stat.ps.node-loads 405024 ± 6% +1531.3% 6607029 perf-stat.ps.node-store-misses 9563 ± 16% +26.0% 12047 ± 8% perf-stat.ps.node-stores 3705 +4.3% 3863 perf-stat.ps.page-faults 1.053e+12 +693.1% 8.355e+12 perf-stat.total.instructions 89.08 -56.7 32.42 ± 20% perf-profile.calltrace.cycles-pp.secondary_startup_64 88.49 -56.3 32.22 ± 20% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 88.48 -56.3 32.22 ± 20% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 88.43 -56.2 32.22 ± 20% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 71.64 -39.7 31.95 ± 20% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 67.10 -35.2 31.95 ± 20% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 25.60 ± 4% -25.6 0.00 perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 14.64 ± 7% -14.6 0.00 perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 45.20 -13.4 31.77 ± 20% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 12.89 ± 2% -12.9 0.00 perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 9.12 ± 6% -9.1 0.00 perf-profile.calltrace.cycles-pp.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 9.08 ± 6% -9.1 0.00 perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 8.88 ± 6% -8.9 0.00 perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 2.17 +25.8 27.93 ± 10% perf-profile.calltrace.cycles-pp.__lock_page.find_lock_entry.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read 2.46 +26.5 28.95 ± 10% perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read.vfs_read.ksys_read 2.42 +26.5 28.91 ± 10% perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read.vfs_read 0.00 +27.4 27.39 ± 10% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.__lock_page.find_lock_entry.shmem_getpage_gfp 0.00 +27.5 27.48 ± 10% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.__lock_page.find_lock_entry.shmem_getpage_gfp.shmem_file_read_iter 4.69 ± 4% +32.8 37.48 ± 9% perf-profile.calltrace.cycles-pp.wake_up_page_bit.shmem_file_read_iter.new_sync_read.vfs_read.ksys_read 0.00 +36.9 36.91 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.wake_up_page_bit.shmem_file_read_iter.new_sync_read 0.00 +37.0 36.98 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.wake_up_page_bit.shmem_file_read_iter.new_sync_read.vfs_read 9.25 ± 2% +58.2 67.42 ± 9% perf-profile.calltrace.cycles-pp.__libc_read 8.75 ± 2% +58.6 67.37 ± 9% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_read 8.61 ± 2% +58.8 67.36 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read 8.53 ± 2% +58.8 67.35 ± 9% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read 8.33 ± 2% +59.0 67.30 ± 9% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read 8.04 ± 2% +59.2 67.27 ± 9% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 7.99 ± 2% +59.3 67.26 ± 9% perf-profile.calltrace.cycles-pp.shmem_file_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64 89.08 -56.7 32.42 ± 20% perf-profile.children.cycles-pp.secondary_startup_64 89.08 -56.7 32.42 ± 20% perf-profile.children.cycles-pp.cpu_startup_entry 89.06 -56.6 32.42 ± 20% perf-profile.children.cycles-pp.do_idle 88.49 -56.3 32.22 ± 20% perf-profile.children.cycles-pp.start_secondary 72.17 -40.0 32.15 ± 20% perf-profile.children.cycles-pp.cpuidle_enter 72.13 -40.0 32.15 ± 20% perf-profile.children.cycles-pp.cpuidle_enter_state 20.61 ± 2% -20.3 0.29 ± 17% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 14.94 ± 7% -14.7 0.23 ± 19% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 45.50 -13.5 31.96 ± 20% perf-profile.children.cycles-pp.intel_idle 12.98 ± 2% -12.9 0.04 ± 59% perf-profile.children.cycles-pp.menu_select 11.71 ± 6% -11.5 0.22 ± 17% perf-profile.children.cycles-pp.asm_call_on_stack 9.28 ± 6% -9.1 0.16 ± 15% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 9.08 ± 6% -8.9 0.16 ± 15% perf-profile.children.cycles-pp.hrtimer_interrupt 4.91 ± 4% -4.8 0.11 ± 11% perf-profile.children.cycles-pp.__hrtimer_run_queues 4.24 ± 4% -4.1 0.18 ± 6% perf-profile.children.cycles-pp.__wake_up_common 4.10 ± 4% -4.0 0.15 ± 5% perf-profile.children.cycles-pp.wake_page_function 3.90 ± 4% -3.8 0.11 ± 4% perf-profile.children.cycles-pp.try_to_wake_up 3.39 ± 3% -3.3 0.13 ± 6% perf-profile.children.cycles-pp.ttwu_do_activate 3.36 ± 3% -3.2 0.13 ± 6% perf-profile.children.cycles-pp.enqueue_task_fair 3.19 ± 3% -3.1 0.13 ± 5% perf-profile.children.cycles-pp.enqueue_entity 3.09 ± 6% -3.0 0.08 ± 19% perf-profile.children.cycles-pp.tick_sched_timer 2.83 ± 2% -2.7 0.14 ± 5% perf-profile.children.cycles-pp.__schedule 2.67 ± 5% -2.6 0.03 ±105% perf-profile.children.cycles-pp.irq_exit_rcu 2.42 ± 6% -2.3 0.07 ± 15% perf-profile.children.cycles-pp.tick_sched_handle 2.40 ± 6% -2.3 0.07 ± 15% perf-profile.children.cycles-pp.update_process_times 2.33 ± 4% -2.2 0.10 ± 4% perf-profile.children.cycles-pp.__account_scheduler_latency 2.05 ± 5% -2.0 0.08 ± 5% perf-profile.children.cycles-pp.stack_trace_save_tsk 1.85 ± 4% -1.8 0.08 ± 10% perf-profile.children.cycles-pp.arch_stack_walk 1.74 -1.6 0.10 ± 4% perf-profile.children.cycles-pp.schedule 1.71 -1.6 0.10 ± 7% perf-profile.children.cycles-pp.io_schedule 1.20 ± 4% -1.1 0.06 ± 7% perf-profile.children.cycles-pp.unwind_next_frame 1.15 ± 6% -1.1 0.04 ± 58% perf-profile.children.cycles-pp.scheduler_tick 1.19 ± 18% -1.1 0.13 ± 6% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle 1.07 ± 18% -0.9 0.12 ± 6% perf-profile.children.cycles-pp.sched_ttwu_pending 0.65 ± 10% -0.5 0.14 ± 11% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.55 ± 17% -0.5 0.10 ± 16% perf-profile.children.cycles-pp.poll_idle 0.53 ± 7% -0.4 0.10 ± 10% perf-profile.children.cycles-pp.__libc_lseek64 0.59 ± 29% -0.4 0.20 ± 20% perf-profile.children.cycles-pp.start_kernel 0.50 ± 2% -0.4 0.12 ± 10% perf-profile.children.cycles-pp.copy_page_to_iter 0.25 ± 13% -0.2 0.03 ±100% perf-profile.children.cycles-pp.ksys_lseek 0.30 ± 6% -0.2 0.09 ± 9% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.29 ± 6% -0.2 0.09 ± 9% perf-profile.children.cycles-pp.copyout 0.25 ± 26% -0.2 0.05 ± 8% perf-profile.children.cycles-pp.__fdget_pos 0.00 +0.1 0.14 ± 10% perf-profile.children.cycles-pp.mark_page_accessed 0.07 ± 17% +0.5 0.54 ± 11% perf-profile.children.cycles-pp.find_get_entry 2.18 +25.8 27.95 ± 10% perf-profile.children.cycles-pp.__lock_page 2.46 +26.5 28.95 ± 10% perf-profile.children.cycles-pp.shmem_getpage_gfp 2.43 +26.5 28.92 ± 10% perf-profile.children.cycles-pp.find_lock_entry 0.23 ± 13% +27.3 27.49 ± 10% perf-profile.children.cycles-pp._raw_spin_lock_irq 4.69 ± 4% +32.8 37.48 ± 9% perf-profile.children.cycles-pp.wake_up_page_bit 1.40 ± 5% +35.6 37.03 ± 9% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 9.53 ± 2% +57.9 67.46 ± 9% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 9.32 ± 2% +58.1 67.43 ± 9% perf-profile.children.cycles-pp.__libc_read 9.33 ± 2% +58.1 67.44 ± 9% perf-profile.children.cycles-pp.do_syscall_64 8.61 ± 2% +58.7 67.35 ± 9% perf-profile.children.cycles-pp.ksys_read 8.42 ± 2% +58.9 67.30 ± 9% perf-profile.children.cycles-pp.vfs_read 8.05 ± 2% +59.2 67.27 ± 9% perf-profile.children.cycles-pp.new_sync_read 7.99 ± 2% +59.3 67.26 ± 9% perf-profile.children.cycles-pp.shmem_file_read_iter 0.34 ± 7% +64.0 64.31 ± 9% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 45.49 -13.5 31.96 ± 20% perf-profile.self.cycles-pp.intel_idle 9.33 ± 5% -9.3 0.00 perf-profile.self.cycles-pp.menu_select 9.05 ± 14% -9.1 0.00 perf-profile.self.cycles-pp.cpuidle_enter_state 1.15 ± 5% -1.0 0.11 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.49 ± 16% -0.4 0.10 ± 16% perf-profile.self.cycles-pp.poll_idle 0.29 ± 5% -0.2 0.09 ± 9% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.00 +0.1 0.14 ± 11% perf-profile.self.cycles-pp.mark_page_accessed 0.00 +0.2 0.18 ± 11% perf-profile.self.cycles-pp.wake_up_page_bit 0.19 ± 14% +0.3 0.47 ± 12% perf-profile.self.cycles-pp.shmem_file_read_iter 0.01 ±173% +0.3 0.33 ± 11% perf-profile.self.cycles-pp.find_lock_entry 0.06 ± 14% +0.5 0.51 ± 11% perf-profile.self.cycles-pp.find_get_entry 0.34 ± 7% +64.0 64.31 ± 9% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 40631 +54.3% 62702 ± 5% softirqs.CPU0.SCHED 39633 ± 5% +94.6% 77112 ± 7% softirqs.CPU1.SCHED 38496 +106.7% 79558 ± 4% softirqs.CPU10.SCHED 38753 +88.1% 72913 ± 7% softirqs.CPU100.SCHED 38787 +84.0% 71383 ± 12% softirqs.CPU101.SCHED 38756 +75.9% 68184 ± 7% softirqs.CPU102.SCHED 38730 +78.4% 69103 ± 6% softirqs.CPU103.SCHED 38745 +75.2% 67870 ± 5% softirqs.CPU104.SCHED 38709 +94.0% 75083 ± 8% softirqs.CPU105.SCHED 38983 +69.0% 65884 ± 10% softirqs.CPU106.SCHED 38712 +73.6% 67205 ± 6% softirqs.CPU107.SCHED 38657 +79.1% 69224 ± 6% softirqs.CPU108.SCHED 38755 +82.1% 70592 ± 9% softirqs.CPU109.SCHED 38376 +103.8% 78211 ± 7% softirqs.CPU11.SCHED 38830 +73.5% 67362 ± 8% softirqs.CPU110.SCHED 38711 +78.9% 69245 ± 12% softirqs.CPU111.SCHED 38752 +74.7% 67717 ± 6% softirqs.CPU112.SCHED 38878 +82.8% 71085 ± 8% softirqs.CPU113.SCHED 38720 +79.7% 69581 ± 9% softirqs.CPU114.SCHED 38626 +74.7% 67473 ± 7% softirqs.CPU115.SCHED 34760 ± 20% +102.9% 70520 ± 8% softirqs.CPU116.SCHED 38677 +76.2% 68131 ± 7% softirqs.CPU117.SCHED 35465 ± 21% +91.8% 68005 ± 7% softirqs.CPU118.SCHED 34519 ± 20% +103.1% 70108 ± 7% softirqs.CPU119.SCHED 38170 +100.7% 76597 ± 9% softirqs.CPU12.SCHED 39018 +83.8% 71712 ± 8% softirqs.CPU120.SCHED 38857 +75.0% 67994 ± 9% softirqs.CPU121.SCHED 38733 +76.0% 68183 ± 8% softirqs.CPU122.SCHED 38784 +78.3% 69142 ± 6% softirqs.CPU123.SCHED 38778 +74.8% 67770 ± 3% softirqs.CPU124.SCHED 39019 +74.5% 68088 ± 6% softirqs.CPU125.SCHED 38781 +74.9% 67826 ± 7% softirqs.CPU126.SCHED 38770 +71.9% 66651 ± 8% softirqs.CPU127.SCHED 38841 +81.5% 70505 ± 8% softirqs.CPU128.SCHED 38690 +75.1% 67746 ± 4% softirqs.CPU129.SCHED 38239 ± 2% +96.2% 75045 ± 6% softirqs.CPU13.SCHED 38875 +79.2% 69655 ± 8% softirqs.CPU130.SCHED 38866 +73.9% 67575 ± 7% softirqs.CPU131.SCHED 38723 +75.5% 67944 ± 7% softirqs.CPU132.SCHED 38643 +78.7% 69042 ± 9% softirqs.CPU133.SCHED 38669 +78.9% 69174 ± 9% softirqs.CPU134.SCHED 38658 +78.7% 69077 ± 9% softirqs.CPU135.SCHED 38795 +75.0% 67873 ± 12% softirqs.CPU136.SCHED 38817 +70.2% 66079 ± 8% softirqs.CPU137.SCHED 39032 +75.8% 68606 ± 6% softirqs.CPU138.SCHED 38864 +72.8% 67154 ± 10% softirqs.CPU139.SCHED 38779 ± 3% +102.2% 78423 ± 5% softirqs.CPU14.SCHED 38948 +81.9% 70830 ± 10% softirqs.CPU140.SCHED 38662 +83.5% 70926 ± 12% softirqs.CPU141.SCHED 35132 ± 19% +98.2% 69627 ± 8% softirqs.CPU142.SCHED 38825 +69.5% 65816 ± 5% softirqs.CPU143.SCHED 35007 ± 20% +99.3% 69785 ± 8% softirqs.CPU144.SCHED 38938 +76.3% 68648 ± 10% softirqs.CPU145.SCHED 38990 +67.6% 65363 ± 3% softirqs.CPU146.SCHED 39037 +74.1% 67972 ± 2% softirqs.CPU147.SCHED 38810 +76.8% 68600 ± 4% softirqs.CPU148.SCHED 38929 +76.2% 68578 ± 10% softirqs.CPU149.SCHED 38071 +101.6% 76734 ± 6% softirqs.CPU15.SCHED 38904 +81.0% 70427 ± 14% softirqs.CPU150.SCHED 38908 +72.7% 67194 ± 10% softirqs.CPU151.SCHED 38827 +75.7% 68201 ± 8% softirqs.CPU152.SCHED 38848 +70.5% 66256 ± 4% softirqs.CPU153.SCHED 38894 +75.4% 68216 ± 9% softirqs.CPU154.SCHED 38881 +79.8% 69913 ± 4% softirqs.CPU155.SCHED 38886 +73.5% 67482 ± 9% softirqs.CPU156.SCHED 38777 +73.2% 67168 ± 6% softirqs.CPU157.SCHED 38833 +76.4% 68520 ± 10% softirqs.CPU158.SCHED 38874 +71.4% 66620 ± 9% softirqs.CPU159.SCHED 38189 +104.4% 78046 ± 6% softirqs.CPU16.SCHED 38889 +71.9% 66832 ± 7% softirqs.CPU160.SCHED 38982 +80.9% 70533 ± 7% softirqs.CPU161.SCHED 38937 +71.4% 66745 ± 4% softirqs.CPU162.SCHED 34815 ± 20% +96.1% 68256 ± 6% softirqs.CPU163.SCHED 38870 +72.7% 67148 ± 9% softirqs.CPU164.SCHED 38827 +76.0% 68355 ± 6% softirqs.CPU165.SCHED 38850 +82.1% 70729 ± 10% softirqs.CPU166.SCHED 35197 ± 21% +100.0% 70389 ± 10% softirqs.CPU167.SCHED 39361 ± 2% +82.8% 71946 ± 6% softirqs.CPU168.SCHED 38813 +82.6% 70862 ± 7% softirqs.CPU169.SCHED 38121 +95.0% 74331 ± 7% softirqs.CPU17.SCHED 38956 +80.2% 70181 ± 6% softirqs.CPU170.SCHED 38916 +79.7% 69914 ± 6% softirqs.CPU171.SCHED 38859 +76.2% 68479 softirqs.CPU172.SCHED 39012 +78.8% 69749 ± 9% softirqs.CPU173.SCHED 38863 +71.7% 66736 ± 4% softirqs.CPU174.SCHED 38841 +81.3% 70431 ± 7% softirqs.CPU175.SCHED 38806 +78.9% 69422 ± 10% softirqs.CPU176.SCHED 38885 +71.6% 66722 ± 6% softirqs.CPU177.SCHED 38896 +79.5% 69803 ± 9% softirqs.CPU178.SCHED 38940 +72.3% 67090 ± 12% softirqs.CPU179.SCHED 37988 +101.2% 76416 ± 6% softirqs.CPU18.SCHED 38844 +74.8% 67888 ± 4% softirqs.CPU180.SCHED 38949 +70.0% 66213 ± 5% softirqs.CPU181.SCHED 39087 +70.4% 66587 ± 5% softirqs.CPU182.SCHED 38848 +70.4% 66185 ± 5% softirqs.CPU183.SCHED 38838 +78.3% 69242 ± 7% softirqs.CPU184.SCHED 38993 +72.7% 67340 ± 10% softirqs.CPU185.SCHED 38797 +67.6% 65035 ± 7% softirqs.CPU186.SCHED 38794 +69.4% 65713 ± 6% softirqs.CPU187.SCHED 38914 +62.2% 63112 ± 6% softirqs.CPU188.SCHED 38898 +71.8% 66822 ± 4% softirqs.CPU189.SCHED 38250 +102.0% 77270 ± 7% softirqs.CPU19.SCHED 38851 +63.0% 63339 ± 4% softirqs.CPU190.SCHED 38794 +23.5% 47899 ± 3% softirqs.CPU191.SCHED 38426 +97.9% 76043 ± 11% softirqs.CPU2.SCHED 38106 +97.4% 75204 ± 5% softirqs.CPU20.SCHED 39713 ± 7% +95.0% 77425 ± 10% softirqs.CPU21.SCHED 38374 +102.0% 77519 ± 5% softirqs.CPU22.SCHED 38131 +98.3% 75617 ± 6% softirqs.CPU23.SCHED 39241 ± 3% +83.5% 72016 ± 5% softirqs.CPU24.SCHED 30118 ± 27% +151.0% 75608 ± 6% softirqs.CPU25.SCHED 38278 +97.2% 75482 ± 6% softirqs.CPU26.SCHED 38217 +96.1% 74939 ± 6% softirqs.CPU27.SCHED 38037 +99.1% 75732 ± 9% softirqs.CPU28.SCHED 38193 +98.2% 75710 ± 6% softirqs.CPU29.SCHED 38287 +102.3% 77439 ± 6% softirqs.CPU3.SCHED 38154 +99.0% 75924 ± 7% softirqs.CPU30.SCHED 38073 +102.0% 76913 ± 6% softirqs.CPU31.SCHED 38084 +92.9% 73483 ± 6% softirqs.CPU32.SCHED 38042 +99.3% 75828 ± 10% softirqs.CPU33.SCHED 38193 +94.2% 74188 ± 5% softirqs.CPU34.SCHED 38243 +98.8% 76013 ± 5% softirqs.CPU35.SCHED 37961 +99.4% 75711 ± 5% softirqs.CPU36.SCHED 38135 +94.9% 74336 ± 6% softirqs.CPU37.SCHED 38335 +94.2% 74461 ± 3% softirqs.CPU38.SCHED 38342 +94.4% 74533 ± 8% softirqs.CPU39.SCHED 37627 ± 2% +94.6% 73233 ± 6% softirqs.CPU4.SCHED 38084 +98.8% 75711 ± 2% softirqs.CPU40.SCHED 38257 +102.8% 77575 ± 5% softirqs.CPU41.SCHED 37955 +97.2% 74843 ± 9% softirqs.CPU42.SCHED 38071 +100.0% 76133 ± 4% softirqs.CPU43.SCHED 38082 +92.2% 73183 ± 5% softirqs.CPU44.SCHED 38148 +90.7% 72759 ± 7% softirqs.CPU45.SCHED 34308 ± 20% +115.3% 73863 ± 7% softirqs.CPU46.SCHED 38238 +103.4% 77791 ± 9% softirqs.CPU47.SCHED 38665 +94.8% 75310 ± 5% softirqs.CPU48.SCHED 38415 +99.2% 76524 ± 5% softirqs.CPU49.SCHED 38158 +94.4% 74167 ± 6% softirqs.CPU5.SCHED 38443 +104.8% 78724 ± 7% softirqs.CPU50.SCHED 34425 ± 20% +125.0% 77470 ± 10% softirqs.CPU51.SCHED 38267 +99.8% 76461 ± 7% softirqs.CPU52.SCHED 38349 +99.2% 76392 ± 4% softirqs.CPU53.SCHED 38403 +94.9% 74848 ± 5% softirqs.CPU54.SCHED 38395 +101.7% 77431 ± 5% softirqs.CPU55.SCHED 38356 +100.3% 76846 ± 5% softirqs.CPU56.SCHED 38445 +105.2% 78902 ± 11% softirqs.CPU57.SCHED 38351 +100.3% 76801 ± 4% softirqs.CPU58.SCHED 38463 +96.3% 75505 ± 9% softirqs.CPU59.SCHED 38189 +102.9% 77480 ± 6% softirqs.CPU6.SCHED 38471 +101.3% 77442 ± 6% softirqs.CPU60.SCHED 38361 +102.9% 77834 ± 10% softirqs.CPU61.SCHED 38143 +98.5% 75709 ± 7% softirqs.CPU62.SCHED 38955 ± 2% +102.1% 78740 ± 6% softirqs.CPU63.SCHED 38370 +103.9% 78255 ± 6% softirqs.CPU64.SCHED 38401 +94.2% 74557 ± 5% softirqs.CPU65.SCHED 38433 +104.2% 78462 ± 7% softirqs.CPU66.SCHED 38339 +100.5% 76880 ± 6% softirqs.CPU67.SCHED 38398 +103.3% 78048 ± 4% softirqs.CPU68.SCHED 38319 +100.5% 76811 ± 8% softirqs.CPU69.SCHED 34179 ± 21% +123.9% 76523 ± 7% softirqs.CPU7.SCHED 38552 +93.5% 74604 ± 4% softirqs.CPU70.SCHED 38506 +93.4% 74456 ± 6% softirqs.CPU71.SCHED 38504 +92.3% 74035 ± 5% softirqs.CPU72.SCHED 38134 +96.9% 75089 ± 7% softirqs.CPU73.SCHED 38196 +99.0% 76000 ± 6% softirqs.CPU74.SCHED 38306 +99.1% 76276 ± 6% softirqs.CPU75.SCHED 38705 +100.5% 77595 ± 10% softirqs.CPU76.SCHED 38366 +99.0% 76349 ± 5% softirqs.CPU77.SCHED 38450 +106.6% 79426 ± 8% softirqs.CPU78.SCHED 38155 +98.8% 75834 ± 4% softirqs.CPU79.SCHED 37097 ± 2% +111.0% 78291 ± 8% softirqs.CPU8.SCHED 38264 +100.0% 76540 ± 3% softirqs.CPU80.SCHED 34260 ± 20% +130.9% 79108 ± 7% softirqs.CPU81.SCHED 38212 +99.3% 76155 ± 4% softirqs.CPU82.SCHED 38116 +106.6% 78750 softirqs.CPU83.SCHED 38164 +104.8% 78146 ± 7% softirqs.CPU84.SCHED 38154 +109.1% 79799 ± 7% softirqs.CPU85.SCHED 38363 +107.0% 79418 ± 9% softirqs.CPU86.SCHED 38224 +108.8% 79830 ± 7% softirqs.CPU87.SCHED 38587 +99.1% 76832 ± 6% softirqs.CPU88.SCHED 38495 +104.7% 78813 ± 3% softirqs.CPU89.SCHED 38367 ± 2% +83.6% 70426 ± 4% softirqs.CPU9.SCHED 34134 ± 19% +137.1% 80916 ± 10% softirqs.CPU90.SCHED 38192 +109.9% 80161 ± 7% softirqs.CPU91.SCHED 38336 +116.7% 83080 ± 7% softirqs.CPU92.SCHED 38193 +107.3% 79164 ± 8% softirqs.CPU93.SCHED 27437 ± 12% -25.5% 20438 ± 13% softirqs.CPU94.RCU 38299 +115.9% 82699 ± 8% softirqs.CPU94.SCHED 18235 ± 4% +202.2% 55116 ± 33% softirqs.CPU95.SCHED 36482 ± 13% +135.6% 85946 ± 9% softirqs.CPU96.SCHED 38587 +80.8% 69767 ± 4% softirqs.CPU97.SCHED 38930 +78.6% 69537 ± 4% softirqs.CPU98.SCHED 32564 ± 32% +111.7% 68941 ± 7% softirqs.CPU99.SCHED 7325109 +89.6% 13891305 ± 6% softirqs.SCHED 236548 ± 4% +1218.3% 3118323 ± 8% interrupts.CAL:Function_call_interrupts 1429 ± 10% +585.9% 9804 ± 24% interrupts.CPU0.CAL:Function_call_interrupts 231.75 ± 33% +2494.9% 6013 ± 13% interrupts.CPU0.NMI:Non-maskable_interrupts 231.75 ± 33% +2494.9% 6013 ± 13% interrupts.CPU0.PMI:Performance_monitoring_interrupts 6.00 ± 69% +6658.3% 405.50 ± 23% interrupts.CPU0.TLB:TLB_shootdowns 1364 ± 16% +1245.8% 18364 ± 4% interrupts.CPU1.CAL:Function_call_interrupts 203.00 +3411.8% 7129 ± 4% interrupts.CPU1.NMI:Non-maskable_interrupts 203.00 +3411.8% 7129 ± 4% interrupts.CPU1.PMI:Performance_monitoring_interrupts 1143 ± 15% -66.3% 385.25 ± 8% interrupts.CPU1.RES:Rescheduling_interrupts 21.00 ± 83% +3652.4% 788.00 ± 7% interrupts.CPU1.TLB:TLB_shootdowns 1110 ± 5% +1759.6% 20646 ± 12% interrupts.CPU10.CAL:Function_call_interrupts 208.00 +2277.9% 4946 ± 29% interrupts.CPU10.NMI:Non-maskable_interrupts 208.00 +2277.9% 4946 ± 29% interrupts.CPU10.PMI:Performance_monitoring_interrupts 830.50 ± 28% -51.5% 402.50 ± 13% interrupts.CPU10.RES:Rescheduling_interrupts 29.00 ±143% +2773.3% 833.25 ± 13% interrupts.CPU10.TLB:TLB_shootdowns 1131 ± 18% +1366.0% 16591 ± 7% interrupts.CPU100.CAL:Function_call_interrupts 204.00 ± 3% +2103.3% 4494 ± 20% interrupts.CPU100.NMI:Non-maskable_interrupts 204.00 ± 3% +2103.3% 4494 ± 20% interrupts.CPU100.PMI:Performance_monitoring_interrupts 1286 ± 8% -74.4% 329.50 ± 9% interrupts.CPU100.RES:Rescheduling_interrupts 9.00 ± 65% +8488.9% 773.00 ± 14% interrupts.CPU100.TLB:TLB_shootdowns 1189 ± 23% +1270.2% 16298 ± 12% interrupts.CPU101.CAL:Function_call_interrupts 202.00 ± 3% +3234.9% 6736 ± 14% interrupts.CPU101.NMI:Non-maskable_interrupts 202.00 ± 3% +3234.9% 6736 ± 14% interrupts.CPU101.PMI:Performance_monitoring_interrupts 1486 ± 20% -80.0% 297.50 ± 11% interrupts.CPU101.RES:Rescheduling_interrupts 17.75 ± 97% +3942.3% 717.50 ± 10% interrupts.CPU101.TLB:TLB_shootdowns 1066 ± 9% +1193.7% 13800 ± 7% interrupts.CPU102.CAL:Function_call_interrupts 201.75 ± 3% +2311.2% 4864 ± 29% interrupts.CPU102.NMI:Non-maskable_interrupts 201.75 ± 3% +2311.2% 4864 ± 29% interrupts.CPU102.PMI:Performance_monitoring_interrupts 1124 ± 17% -75.4% 276.25 ± 10% interrupts.CPU102.RES:Rescheduling_interrupts 8.00 ± 30% +7431.2% 602.50 ± 11% interrupts.CPU102.TLB:TLB_shootdowns 1151 ± 12% +1149.8% 14391 ± 5% interrupts.CPU103.CAL:Function_call_interrupts 180.75 ± 26% +2754.5% 5159 ± 23% interrupts.CPU103.NMI:Non-maskable_interrupts 180.75 ± 26% +2754.5% 5159 ± 23% interrupts.CPU103.PMI:Performance_monitoring_interrupts 1452 ± 9% -79.3% 301.25 ± 16% interrupts.CPU103.RES:Rescheduling_interrupts 22.00 ± 69% +2867.0% 652.75 ± 17% interrupts.CPU103.TLB:TLB_shootdowns 1373 ± 17% +954.6% 14487 ± 8% interrupts.CPU104.CAL:Function_call_interrupts 176.00 ± 25% +2905.3% 5289 ± 23% interrupts.CPU104.NMI:Non-maskable_interrupts 176.00 ± 25% +2905.3% 5289 ± 23% interrupts.CPU104.PMI:Performance_monitoring_interrupts 1366 ± 24% -80.1% 271.75 ± 18% interrupts.CPU104.RES:Rescheduling_interrupts 9.25 ± 15% +6373.0% 598.75 ± 14% interrupts.CPU104.TLB:TLB_shootdowns 1337 ± 8% +1221.1% 17663 ± 12% interrupts.CPU105.CAL:Function_call_interrupts 205.25 +2922.3% 6203 ± 26% interrupts.CPU105.NMI:Non-maskable_interrupts 205.25 +2922.3% 6203 ± 26% interrupts.CPU105.PMI:Performance_monitoring_interrupts 1466 ± 13% -77.0% 337.50 ± 11% interrupts.CPU105.RES:Rescheduling_interrupts 29.50 ± 66% +2657.6% 813.50 ± 9% interrupts.CPU105.TLB:TLB_shootdowns 1314 ± 10% +937.2% 13633 ± 17% interrupts.CPU106.CAL:Function_call_interrupts 179.00 ± 24% +2685.2% 4985 ± 31% interrupts.CPU106.NMI:Non-maskable_interrupts 179.00 ± 24% +2685.2% 4985 ± 31% interrupts.CPU106.PMI:Performance_monitoring_interrupts 1635 ± 9% -84.8% 248.00 ± 4% interrupts.CPU106.RES:Rescheduling_interrupts 11.25 ± 21% +5428.9% 622.00 ± 18% interrupts.CPU106.TLB:TLB_shootdowns 1110 ± 6% +1134.1% 13701 ± 2% interrupts.CPU107.CAL:Function_call_interrupts 174.75 ± 24% +2917.6% 5273 ± 28% interrupts.CPU107.NMI:Non-maskable_interrupts 174.75 ± 24% +2917.6% 5273 ± 28% interrupts.CPU107.PMI:Performance_monitoring_interrupts 1395 ± 27% -82.0% 250.75 ± 16% interrupts.CPU107.RES:Rescheduling_interrupts 8.75 ± 35% +7760.0% 687.75 ± 19% interrupts.CPU107.TLB:TLB_shootdowns 1461 ± 9% +997.1% 16036 ± 18% interrupts.CPU108.CAL:Function_call_interrupts 177.25 ± 25% +3711.1% 6755 ± 15% interrupts.CPU108.NMI:Non-maskable_interrupts 177.25 ± 25% +3711.1% 6755 ± 15% interrupts.CPU108.PMI:Performance_monitoring_interrupts 1525 ± 9% -81.6% 280.25 ± 19% interrupts.CPU108.RES:Rescheduling_interrupts 22.00 ± 60% +2913.6% 663.00 ± 14% interrupts.CPU108.TLB:TLB_shootdowns 1167 ± 10% +1162.5% 14736 ± 14% interrupts.CPU109.CAL:Function_call_interrupts 151.50 ± 31% +3887.3% 6040 ± 33% interrupts.CPU109.NMI:Non-maskable_interrupts 151.50 ± 31% +3887.3% 6040 ± 33% interrupts.CPU109.PMI:Performance_monitoring_interrupts 1331 ± 28% -76.7% 310.50 ± 14% interrupts.CPU109.RES:Rescheduling_interrupts 8.00 ± 39% +8687.5% 703.00 ± 14% interrupts.CPU109.TLB:TLB_shootdowns 1125 ± 13% +1642.3% 19605 ± 14% interrupts.CPU11.CAL:Function_call_interrupts 176.25 ± 23% +2172.6% 4005 ± 44% interrupts.CPU11.NMI:Non-maskable_interrupts 176.25 ± 23% +2172.6% 4005 ± 44% interrupts.CPU11.PMI:Performance_monitoring_interrupts 1199 ± 31% -67.0% 395.50 ± 13% interrupts.CPU11.RES:Rescheduling_interrupts 18.00 ± 74% +4216.7% 777.00 ± 15% interrupts.CPU11.TLB:TLB_shootdowns 1108 ± 10% +1073.9% 13009 ± 5% interrupts.CPU110.CAL:Function_call_interrupts 149.50 ± 31% +2692.1% 4174 ± 41% interrupts.CPU110.NMI:Non-maskable_interrupts 149.50 ± 31% +2692.1% 4174 ± 41% interrupts.CPU110.PMI:Performance_monitoring_interrupts 1303 ± 9% -80.7% 251.50 ± 12% interrupts.CPU110.RES:Rescheduling_interrupts 18.25 ± 79% +3406.8% 640.00 ± 17% interrupts.CPU110.TLB:TLB_shootdowns 1189 ± 21% +1172.3% 15130 ± 19% interrupts.CPU111.CAL:Function_call_interrupts 147.75 ± 33% +2802.4% 4288 ± 42% interrupts.CPU111.NMI:Non-maskable_interrupts 147.75 ± 33% +2802.4% 4288 ± 42% interrupts.CPU111.PMI:Performance_monitoring_interrupts 1547 ± 28% -82.1% 277.25 ± 21% interrupts.CPU111.RES:Rescheduling_interrupts 28.50 ± 99% +2150.9% 641.50 ± 29% interrupts.CPU111.TLB:TLB_shootdowns 1135 ± 12% +1154.3% 14236 ± 8% interrupts.CPU112.CAL:Function_call_interrupts 148.75 ± 32% +2586.7% 3996 ± 48% interrupts.CPU112.NMI:Non-maskable_interrupts 148.75 ± 32% +2586.7% 3996 ± 48% interrupts.CPU112.PMI:Performance_monitoring_interrupts 1316 ± 12% -79.5% 270.00 ± 13% interrupts.CPU112.RES:Rescheduling_interrupts 7.50 ± 46% +7680.0% 583.50 ± 12% interrupts.CPU112.TLB:TLB_shootdowns 1193 ± 16% +1226.6% 15833 ± 21% interrupts.CPU113.CAL:Function_call_interrupts 149.75 ± 32% +4233.9% 6490 ± 10% interrupts.CPU113.NMI:Non-maskable_interrupts 149.75 ± 32% +4233.9% 6490 ± 10% interrupts.CPU113.PMI:Performance_monitoring_interrupts 1572 ± 33% -81.0% 298.00 ± 11% interrupts.CPU113.RES:Rescheduling_interrupts 9.75 ± 61% +7625.6% 753.25 ± 10% interrupts.CPU113.TLB:TLB_shootdowns 1397 ± 15% +992.7% 15273 ± 9% interrupts.CPU114.CAL:Function_call_interrupts 148.00 ± 32% +3691.9% 5612 ± 39% interrupts.CPU114.NMI:Non-maskable_interrupts 148.00 ± 32% +3691.9% 5612 ± 39% interrupts.CPU114.PMI:Performance_monitoring_interrupts 1313 ± 13% -79.0% 276.00 ± 8% interrupts.CPU114.RES:Rescheduling_interrupts 28.75 ±101% +2879.1% 856.50 ± 18% interrupts.CPU114.TLB:TLB_shootdowns 1152 ± 11% +1054.8% 13309 ± 5% interrupts.CPU115.CAL:Function_call_interrupts 176.75 ± 25% +2775.8% 5083 ± 26% interrupts.CPU115.NMI:Non-maskable_interrupts 176.75 ± 25% +2775.8% 5083 ± 26% interrupts.CPU115.PMI:Performance_monitoring_interrupts 1278 ± 22% -78.1% 280.00 ± 12% interrupts.CPU115.RES:Rescheduling_interrupts 8.75 ± 31% +7614.3% 675.00 ± 11% interrupts.CPU115.TLB:TLB_shootdowns 1427 ± 24% +934.8% 14774 ± 15% interrupts.CPU116.CAL:Function_call_interrupts 203.00 ± 3% +2693.3% 5670 ± 25% interrupts.CPU116.NMI:Non-maskable_interrupts 203.00 ± 3% +2693.3% 5670 ± 25% interrupts.CPU116.PMI:Performance_monitoring_interrupts 1451 ± 35% -77.1% 331.75 ± 13% interrupts.CPU116.RES:Rescheduling_interrupts 11.50 ± 29% +4582.6% 538.50 ± 14% interrupts.CPU116.TLB:TLB_shootdowns 1225 ± 16% +1001.5% 13499 ± 21% interrupts.CPU117.CAL:Function_call_interrupts 176.50 ± 25% +2546.0% 4670 ± 23% interrupts.CPU117.NMI:Non-maskable_interrupts 176.50 ± 25% +2546.0% 4670 ± 23% interrupts.CPU117.PMI:Performance_monitoring_interrupts 1317 ± 28% -78.7% 281.25 ± 30% interrupts.CPU117.RES:Rescheduling_interrupts 8.25 ± 71% +7412.1% 619.75 ± 30% interrupts.CPU117.TLB:TLB_shootdowns 1216 ± 12% +1026.3% 13704 ± 6% interrupts.CPU118.CAL:Function_call_interrupts 204.75 ± 4% +2645.8% 5622 ± 29% interrupts.CPU118.NMI:Non-maskable_interrupts 204.75 ± 4% +2645.8% 5622 ± 29% interrupts.CPU118.PMI:Performance_monitoring_interrupts 1314 ± 20% -78.5% 283.00 ± 9% interrupts.CPU118.RES:Rescheduling_interrupts 19.25 ± 81% +3127.3% 621.25 ± 17% interrupts.CPU118.TLB:TLB_shootdowns 1140 ± 8% +1211.5% 14961 ± 4% interrupts.CPU119.CAL:Function_call_interrupts 202.75 ± 4% +2414.2% 5097 ± 29% interrupts.CPU119.NMI:Non-maskable_interrupts 202.75 ± 4% +2414.2% 5097 ± 29% interrupts.CPU119.PMI:Performance_monitoring_interrupts 1249 ± 11% -76.3% 296.00 ± 18% interrupts.CPU119.RES:Rescheduling_interrupts 10.00 ± 27% +6227.5% 632.75 ± 11% interrupts.CPU119.TLB:TLB_shootdowns 1262 ± 10% +1468.3% 19799 ± 8% interrupts.CPU12.CAL:Function_call_interrupts 207.25 ± 2% +1845.1% 4031 ± 23% interrupts.CPU12.NMI:Non-maskable_interrupts 207.25 ± 2% +1845.1% 4031 ± 23% interrupts.CPU12.PMI:Performance_monitoring_interrupts 810.50 ± 27% -52.0% 389.00 ± 10% interrupts.CPU12.RES:Rescheduling_interrupts 15.75 ± 90% +5019.0% 806.25 ± 8% interrupts.CPU12.TLB:TLB_shootdowns 1266 ± 4% +1199.9% 16462 ± 7% interrupts.CPU120.CAL:Function_call_interrupts 203.75 ± 3% +2367.0% 5026 ± 32% interrupts.CPU120.NMI:Non-maskable_interrupts 203.75 ± 3% +2367.0% 5026 ± 32% interrupts.CPU120.PMI:Performance_monitoring_interrupts 1049 ± 15% -66.2% 354.75 ± 17% interrupts.CPU120.RES:Rescheduling_interrupts 18.75 ± 84% +3682.7% 709.25 ± 12% interrupts.CPU120.TLB:TLB_shootdowns 1206 ± 15% +1076.3% 14194 ± 7% interrupts.CPU121.CAL:Function_call_interrupts 199.50 ± 4% +2815.2% 5815 ± 17% interrupts.CPU121.NMI:Non-maskable_interrupts 199.50 ± 4% +2815.2% 5815 ± 17% interrupts.CPU121.PMI:Performance_monitoring_interrupts 1507 ± 28% -81.1% 284.50 ± 18% interrupts.CPU121.RES:Rescheduling_interrupts 11.00 ± 22% +5811.4% 650.25 ± 20% interrupts.CPU121.TLB:TLB_shootdowns 1016 ± 5% +1261.5% 13839 ± 7% interrupts.CPU122.CAL:Function_call_interrupts 198.75 ± 4% +3276.7% 6711 ± 4% interrupts.CPU122.NMI:Non-maskable_interrupts 198.75 ± 4% +3276.7% 6711 ± 4% interrupts.CPU122.PMI:Performance_monitoring_interrupts 1169 ± 30% -73.5% 310.00 ± 2% interrupts.CPU122.RES:Rescheduling_interrupts 12.50 ± 32% +5146.0% 655.75 ± 20% interrupts.CPU122.TLB:TLB_shootdowns 1141 ± 5% +1093.9% 13625 ± 10% interrupts.CPU123.CAL:Function_call_interrupts 178.75 ± 27% +3893.4% 7138 ± 11% interrupts.CPU123.NMI:Non-maskable_interrupts 178.75 ± 27% +3893.4% 7138 ± 11% interrupts.CPU123.PMI:Performance_monitoring_interrupts 1197 ± 52% -73.1% 321.50 ± 16% interrupts.CPU123.RES:Rescheduling_interrupts 8.75 ± 75% +7505.7% 665.50 ± 24% interrupts.CPU123.TLB:TLB_shootdowns 1079 ± 8% +1259.3% 14673 ± 12% interrupts.CPU124.CAL:Function_call_interrupts 198.50 ± 4% +2452.9% 5067 ± 28% interrupts.CPU124.NMI:Non-maskable_interrupts 198.50 ± 4% +2452.9% 5067 ± 28% interrupts.CPU124.PMI:Performance_monitoring_interrupts 1326 ± 10% -78.6% 284.25 ± 27% interrupts.CPU124.RES:Rescheduling_interrupts 11.25 ± 14% +6237.8% 713.00 ± 14% interrupts.CPU124.TLB:TLB_shootdowns 1146 ± 8% +1212.8% 15051 ± 7% interrupts.CPU125.CAL:Function_call_interrupts 200.50 ± 3% +2483.8% 5180 ± 28% interrupts.CPU125.NMI:Non-maskable_interrupts 200.50 ± 3% +2483.8% 5180 ± 28% interrupts.CPU125.PMI:Performance_monitoring_interrupts 1121 ± 12% -75.7% 272.25 ± 11% interrupts.CPU125.RES:Rescheduling_interrupts 8.00 ± 46% +8106.2% 656.50 ± 6% interrupts.CPU125.TLB:TLB_shootdowns 1054 ± 6% +1175.3% 13451 ± 12% interrupts.CPU126.CAL:Function_call_interrupts 196.00 ± 3% +2189.5% 4487 ± 37% interrupts.CPU126.NMI:Non-maskable_interrupts 196.00 ± 3% +2189.5% 4487 ± 37% interrupts.CPU126.PMI:Performance_monitoring_interrupts 1300 ± 6% -77.5% 293.25 ± 13% interrupts.CPU126.RES:Rescheduling_interrupts 10.50 ± 44% +6485.7% 691.50 ± 8% interrupts.CPU126.TLB:TLB_shootdowns 1201 ± 16% +1013.0% 13375 ± 7% interrupts.CPU127.CAL:Function_call_interrupts 175.50 ± 25% +3272.9% 5919 ± 33% interrupts.CPU127.NMI:Non-maskable_interrupts 175.50 ± 25% +3272.9% 5919 ± 33% interrupts.CPU127.PMI:Performance_monitoring_interrupts 1281 ± 10% -75.4% 315.75 ± 19% interrupts.CPU127.RES:Rescheduling_interrupts 33.75 ± 81% +1794.8% 639.50 ± 3% interrupts.CPU127.TLB:TLB_shootdowns 1316 ± 10% +941.9% 13716 ± 22% interrupts.CPU128.CAL:Function_call_interrupts 171.50 ± 23% +2881.6% 5113 ± 31% interrupts.CPU128.NMI:Non-maskable_interrupts 171.50 ± 23% +2881.6% 5113 ± 31% interrupts.CPU128.PMI:Performance_monitoring_interrupts 1202 ± 9% -73.0% 324.25 ± 13% interrupts.CPU128.RES:Rescheduling_interrupts 14.50 ± 28% +4265.5% 633.00 ± 22% interrupts.CPU128.TLB:TLB_shootdowns 1198 ± 10% +1072.9% 14057 ± 19% interrupts.CPU129.CAL:Function_call_interrupts 173.00 ± 25% +2972.8% 5316 ± 41% interrupts.CPU129.NMI:Non-maskable_interrupts 173.00 ± 25% +2972.8% 5316 ± 41% interrupts.CPU129.PMI:Performance_monitoring_interrupts 1219 ± 38% -74.2% 314.75 ± 22% interrupts.CPU129.RES:Rescheduling_interrupts 15.25 ± 43% +4042.6% 631.75 ± 15% interrupts.CPU129.TLB:TLB_shootdowns 1569 ± 50% +997.0% 17214 ± 9% interrupts.CPU13.CAL:Function_call_interrupts 204.75 ± 5% +2106.8% 4518 ± 53% interrupts.CPU13.NMI:Non-maskable_interrupts 204.75 ± 5% +2106.8% 4518 ± 53% interrupts.CPU13.PMI:Performance_monitoring_interrupts 1204 ± 29% -71.1% 348.50 ± 27% interrupts.CPU13.RES:Rescheduling_interrupts 16.75 ± 87% +4329.9% 742.00 ± 14% interrupts.CPU13.TLB:TLB_shootdowns 1000 ± 4% +1382.7% 14830 ± 12% interrupts.CPU130.CAL:Function_call_interrupts 172.00 ± 24% +3391.7% 6005 ± 23% interrupts.CPU130.NMI:Non-maskable_interrupts 172.00 ± 24% +3391.7% 6005 ± 23% interrupts.CPU130.PMI:Performance_monitoring_interrupts 1174 ± 14% -73.3% 313.25 ± 19% interrupts.CPU130.RES:Rescheduling_interrupts 10.25 ± 32% +6546.3% 681.25 ± 4% interrupts.CPU130.TLB:TLB_shootdowns 1156 ± 9% +1093.9% 13804 ± 14% interrupts.CPU131.CAL:Function_call_interrupts 176.00 ± 28% +2972.2% 5407 ± 28% interrupts.CPU131.NMI:Non-maskable_interrupts 176.00 ± 28% +2972.2% 5407 ± 28% interrupts.CPU131.PMI:Performance_monitoring_interrupts 1370 ± 22% -76.7% 319.25 ± 14% interrupts.CPU131.RES:Rescheduling_interrupts 30.00 ± 52% +1986.7% 626.00 ± 19% interrupts.CPU131.TLB:TLB_shootdowns 1151 ± 9% +1135.4% 14222 ± 13% interrupts.CPU132.CAL:Function_call_interrupts 168.00 ± 23% +2673.5% 4659 ± 29% interrupts.CPU132.NMI:Non-maskable_interrupts 168.00 ± 23% +2673.5% 4659 ± 29% interrupts.CPU132.PMI:Performance_monitoring_interrupts 1643 ± 13% -79.8% 332.75 ± 16% interrupts.CPU132.RES:Rescheduling_interrupts 14.50 ± 36% +5208.6% 769.75 ± 11% interrupts.CPU132.TLB:TLB_shootdowns 1150 ± 9% +1148.8% 14370 ± 9% interrupts.CPU133.CAL:Function_call_interrupts 144.25 ± 34% +3515.1% 5214 ± 25% interrupts.CPU133.NMI:Non-maskable_interrupts 144.25 ± 34% +3515.1% 5214 ± 25% interrupts.CPU133.PMI:Performance_monitoring_interrupts 1200 ± 27% -74.7% 303.50 ± 14% interrupts.CPU133.RES:Rescheduling_interrupts 27.75 ± 77% +2288.3% 662.75 ± 13% interrupts.CPU133.TLB:TLB_shootdowns 1041 ± 11% +1120.7% 12707 ± 6% interrupts.CPU134.CAL:Function_call_interrupts 172.75 ± 27% +2867.6% 5126 ± 25% interrupts.CPU134.NMI:Non-maskable_interrupts 172.75 ± 27% +2867.6% 5126 ± 25% interrupts.CPU134.PMI:Performance_monitoring_interrupts 1147 ± 32% -70.3% 340.50 ± 22% interrupts.CPU134.RES:Rescheduling_interrupts 8.50 ± 37% +8305.9% 714.50 ± 23% interrupts.CPU134.TLB:TLB_shootdowns 1169 ± 8% +1200.7% 15208 ± 16% interrupts.CPU135.CAL:Function_call_interrupts 171.50 ± 27% +2944.2% 5220 ± 35% interrupts.CPU135.NMI:Non-maskable_interrupts 171.50 ± 27% +2944.2% 5220 ± 35% interrupts.CPU135.PMI:Performance_monitoring_interrupts 1110 ± 16% -68.3% 351.50 ± 21% interrupts.CPU135.RES:Rescheduling_interrupts 12.00 ± 33% +5641.7% 689.00 ± 21% interrupts.CPU135.TLB:TLB_shootdowns 1118 ± 7% +1085.7% 13265 ± 12% interrupts.CPU136.CAL:Function_call_interrupts 174.25 ± 27% +2698.6% 4876 ± 24% interrupts.CPU136.NMI:Non-maskable_interrupts 174.25 ± 27% +2698.6% 4876 ± 24% interrupts.CPU136.PMI:Performance_monitoring_interrupts 1392 ± 7% -79.5% 285.25 ± 12% interrupts.CPU136.RES:Rescheduling_interrupts 58.25 ±108% +987.1% 633.25 ± 17% interrupts.CPU136.TLB:TLB_shootdowns 1250 ± 29% +980.4% 13513 ± 14% interrupts.CPU137.CAL:Function_call_interrupts 199.25 ± 3% +2614.4% 5408 ± 24% interrupts.CPU137.NMI:Non-maskable_interrupts 199.25 ± 3% +2614.4% 5408 ± 24% interrupts.CPU137.PMI:Performance_monitoring_interrupts 1281 ± 10% -77.5% 288.75 ± 31% interrupts.CPU137.RES:Rescheduling_interrupts 21.75 ± 76% +2344.8% 531.75 ± 15% interrupts.CPU137.TLB:TLB_shootdowns 1161 ± 9% +1142.5% 14431 ± 10% interrupts.CPU138.CAL:Function_call_interrupts 204.75 ± 11% +2804.8% 5947 ± 19% interrupts.CPU138.NMI:Non-maskable_interrupts 204.75 ± 11% +2804.8% 5947 ± 19% interrupts.CPU138.PMI:Performance_monitoring_interrupts 1324 ± 19% -75.6% 322.75 ± 23% interrupts.CPU138.RES:Rescheduling_interrupts 12.25 ± 21% +5142.9% 642.25 ± 11% interrupts.CPU138.TLB:TLB_shootdowns 1089 ± 11% +1073.7% 12781 ± 9% interrupts.CPU139.CAL:Function_call_interrupts 174.00 ± 24% +3120.3% 5603 ± 31% interrupts.CPU139.NMI:Non-maskable_interrupts 174.00 ± 24% +3120.3% 5603 ± 31% interrupts.CPU139.PMI:Performance_monitoring_interrupts 1434 ± 19% -82.0% 258.00 ± 8% interrupts.CPU139.RES:Rescheduling_interrupts 30.75 ±119% +2056.9% 663.25 ± 14% interrupts.CPU139.TLB:TLB_shootdowns 1220 ± 14% +1438.2% 18769 ± 8% interrupts.CPU14.CAL:Function_call_interrupts 206.75 ± 4% +2813.7% 6024 ± 25% interrupts.CPU14.NMI:Non-maskable_interrupts 206.75 ± 4% +2813.7% 6024 ± 25% interrupts.CPU14.PMI:Performance_monitoring_interrupts 1255 ± 29% -67.5% 408.00 ± 23% interrupts.CPU14.RES:Rescheduling_interrupts 11.25 ± 22% +7417.8% 845.75 ± 11% interrupts.CPU14.TLB:TLB_shootdowns 1172 ± 9% +1141.5% 14556 ± 10% interrupts.CPU140.CAL:Function_call_interrupts 172.00 ± 23% +2840.4% 5057 ± 26% interrupts.CPU140.NMI:Non-maskable_interrupts 172.00 ± 23% +2840.4% 5057 ± 26% interrupts.CPU140.PMI:Performance_monitoring_interrupts 1538 ± 33% -77.5% 346.00 ± 19% interrupts.CPU140.RES:Rescheduling_interrupts 13.00 ± 56% +4734.6% 628.50 ± 25% interrupts.CPU140.TLB:TLB_shootdowns 1131 ± 11% +1224.3% 14981 ± 4% interrupts.CPU141.CAL:Function_call_interrupts 174.00 ± 25% +3593.5% 6426 ± 16% interrupts.CPU141.NMI:Non-maskable_interrupts 174.00 ± 25% +3593.5% 6426 ± 16% interrupts.CPU141.PMI:Performance_monitoring_interrupts 1099 ± 4% -73.7% 289.00 ± 12% interrupts.CPU141.RES:Rescheduling_interrupts 10.25 ± 17% +6936.6% 721.25 ± 21% interrupts.CPU141.TLB:TLB_shootdowns 1101 ± 13% +1300.5% 15422 ± 16% interrupts.CPU142.CAL:Function_call_interrupts 171.25 ± 23% +2942.3% 5210 ± 19% interrupts.CPU142.NMI:Non-maskable_interrupts 171.25 ± 23% +2942.3% 5210 ± 19% interrupts.CPU142.PMI:Performance_monitoring_interrupts 1238 ± 3% -75.2% 307.25 ± 19% interrupts.CPU142.RES:Rescheduling_interrupts 13.75 ± 17% +5021.8% 704.25 ± 21% interrupts.CPU142.TLB:TLB_shootdowns 1014 ± 12% +1164.9% 12826 ± 14% interrupts.CPU143.CAL:Function_call_interrupts 171.50 ± 24% +3326.4% 5876 ± 10% interrupts.CPU143.NMI:Non-maskable_interrupts 171.50 ± 24% +3326.4% 5876 ± 10% interrupts.CPU143.PMI:Performance_monitoring_interrupts 1299 ± 32% -75.4% 319.00 ± 21% interrupts.CPU143.RES:Rescheduling_interrupts 10.00 ± 37% +7027.5% 712.75 ± 15% interrupts.CPU143.TLB:TLB_shootdowns 1149 ± 4% +1225.5% 15239 ± 11% interrupts.CPU144.CAL:Function_call_interrupts 199.00 ± 31% +2607.5% 5388 ± 38% interrupts.CPU144.NMI:Non-maskable_interrupts 199.00 ± 31% +2607.5% 5388 ± 38% interrupts.CPU144.PMI:Performance_monitoring_interrupts 901.00 ± 17% -67.5% 292.75 ± 7% interrupts.CPU144.RES:Rescheduling_interrupts 29.75 ± 64% +2062.2% 643.25 ± 18% interrupts.CPU144.TLB:TLB_shootdowns 1240 ± 5% +1016.7% 13849 ± 6% interrupts.CPU145.CAL:Function_call_interrupts 170.25 ± 25% +3281.4% 5756 ± 7% interrupts.CPU145.NMI:Non-maskable_interrupts 170.25 ± 25% +3281.4% 5756 ± 7% interrupts.CPU145.PMI:Performance_monitoring_interrupts 1430 ± 17% -81.6% 263.75 ± 22% interrupts.CPU145.RES:Rescheduling_interrupts 14.75 ± 10% +4771.2% 718.50 ± 16% interrupts.CPU145.TLB:TLB_shootdowns 1360 ± 33% +901.6% 13626 ± 13% interrupts.CPU146.CAL:Function_call_interrupts 196.75 ± 2% +2932.3% 5966 ± 27% interrupts.CPU146.NMI:Non-maskable_interrupts 196.75 ± 2% +2932.3% 5966 ± 27% interrupts.CPU146.PMI:Performance_monitoring_interrupts 1173 ± 14% -77.6% 263.00 ± 21% interrupts.CPU146.RES:Rescheduling_interrupts 19.00 ± 82% +2542.1% 502.00 ± 35% interrupts.CPU146.TLB:TLB_shootdowns 1161 ± 27% +1038.3% 13224 ± 21% interrupts.CPU147.CAL:Function_call_interrupts 197.25 ± 2% +2361.7% 4855 ± 39% interrupts.CPU147.NMI:Non-maskable_interrupts 197.25 ± 2% +2361.7% 4855 ± 39% interrupts.CPU147.PMI:Performance_monitoring_interrupts 1253 ± 27% -76.8% 291.25 ± 23% interrupts.CPU147.RES:Rescheduling_interrupts 12.25 ± 63% +4467.3% 559.50 ± 29% interrupts.CPU147.TLB:TLB_shootdowns 1127 ± 13% +1099.5% 13527 ± 8% interrupts.CPU148.CAL:Function_call_interrupts 200.75 ± 3% +2706.2% 5633 ± 37% interrupts.CPU148.NMI:Non-maskable_interrupts 200.75 ± 3% +2706.2% 5633 ± 37% interrupts.CPU148.PMI:Performance_monitoring_interrupts 1375 ± 15% -79.6% 280.25 ± 12% interrupts.CPU148.RES:Rescheduling_interrupts 16.50 ± 29% +3775.8% 639.50 ± 10% interrupts.CPU148.TLB:TLB_shootdowns 1132 ± 13% +1194.9% 14664 ± 19% interrupts.CPU149.CAL:Function_call_interrupts 197.50 ± 2% +2371.9% 4882 ± 33% interrupts.CPU149.NMI:Non-maskable_interrupts 197.50 ± 2% +2371.9% 4882 ± 33% interrupts.CPU149.PMI:Performance_monitoring_interrupts 1546 ± 22% -81.7% 283.50 ± 12% interrupts.CPU149.RES:Rescheduling_interrupts 34.75 ± 42% +1830.2% 670.75 ± 17% interrupts.CPU149.TLB:TLB_shootdowns 1273 ± 32% +1440.2% 19606 ± 13% interrupts.CPU15.CAL:Function_call_interrupts 201.00 ± 2% +2902.0% 6034 ± 26% interrupts.CPU15.NMI:Non-maskable_interrupts 201.00 ± 2% +2902.0% 6034 ± 26% interrupts.CPU15.PMI:Performance_monitoring_interrupts 7.25 ± 54% +11358.6% 830.75 ± 21% interrupts.CPU15.TLB:TLB_shootdowns 1135 ± 14% +1192.5% 14676 ± 21% interrupts.CPU150.CAL:Function_call_interrupts 172.25 ± 25% +2381.3% 4274 ± 34% interrupts.CPU150.NMI:Non-maskable_interrupts 172.25 ± 25% +2381.3% 4274 ± 34% interrupts.CPU150.PMI:Performance_monitoring_interrupts 1234 ± 23% -76.3% 292.00 ± 14% interrupts.CPU150.RES:Rescheduling_interrupts 12.25 ± 38% +5240.8% 654.25 ± 23% interrupts.CPU150.TLB:TLB_shootdowns 1328 ± 22% +941.4% 13832 ± 15% interrupts.CPU151.CAL:Function_call_interrupts 171.25 ± 25% +2801.0% 4968 ± 33% interrupts.CPU151.NMI:Non-maskable_interrupts 171.25 ± 25% +2801.0% 4968 ± 33% interrupts.CPU151.PMI:Performance_monitoring_interrupts 1492 ± 11% -82.1% 266.75 ± 15% interrupts.CPU151.RES:Rescheduling_interrupts 18.25 ± 35% +2826.0% 534.00 ± 30% interrupts.CPU151.TLB:TLB_shootdowns 1203 ± 6% +1112.1% 14588 ± 18% interrupts.CPU152.CAL:Function_call_interrupts 171.50 ± 25% +2989.7% 5298 ± 26% interrupts.CPU152.NMI:Non-maskable_interrupts 171.50 ± 25% +2989.7% 5298 ± 26% interrupts.CPU152.PMI:Performance_monitoring_interrupts 1402 ± 26% -79.6% 285.50 ± 12% interrupts.CPU152.RES:Rescheduling_interrupts 12.50 ± 47% +4642.0% 592.75 ± 15% interrupts.CPU152.TLB:TLB_shootdowns 1075 ± 5% +1003.9% 11870 ± 26% interrupts.CPU153.CAL:Function_call_interrupts 178.50 ± 27% +3121.7% 5750 ± 17% interrupts.CPU153.NMI:Non-maskable_interrupts 178.50 ± 27% +3121.7% 5750 ± 17% interrupts.CPU153.PMI:Performance_monitoring_interrupts 1309 ± 26% -79.7% 265.25 ± 24% interrupts.CPU153.RES:Rescheduling_interrupts 33.00 ±119% +1569.7% 551.00 ± 32% interrupts.CPU153.TLB:TLB_shootdowns 1275 ± 18% +953.4% 13433 ± 13% interrupts.CPU154.CAL:Function_call_interrupts 174.25 ± 25% +3646.2% 6527 ± 22% interrupts.CPU154.NMI:Non-maskable_interrupts 174.25 ± 25% +3646.2% 6527 ± 22% interrupts.CPU154.PMI:Performance_monitoring_interrupts 1363 ± 24% -79.2% 283.75 ± 12% interrupts.CPU154.RES:Rescheduling_interrupts 19.75 ± 27% +2900.0% 592.50 ± 15% interrupts.CPU154.TLB:TLB_shootdowns 1179 ± 10% +1137.7% 14592 ± 20% interrupts.CPU155.CAL:Function_call_interrupts 172.50 ± 25% +4136.8% 7308 ± 15% interrupts.CPU155.NMI:Non-maskable_interrupts 172.50 ± 25% +4136.8% 7308 ± 15% interrupts.CPU155.PMI:Performance_monitoring_interrupts 1368 ± 17% -78.3% 297.25 ± 18% interrupts.CPU155.RES:Rescheduling_interrupts 17.00 ± 39% +3847.1% 671.00 ± 8% interrupts.CPU155.TLB:TLB_shootdowns 1130 ± 15% +1116.7% 13754 ± 8% interrupts.CPU156.CAL:Function_call_interrupts 171.00 ± 23% +3322.1% 5851 ± 16% interrupts.CPU156.NMI:Non-maskable_interrupts 171.00 ± 23% +3322.1% 5851 ± 16% interrupts.CPU156.PMI:Performance_monitoring_interrupts 1229 ± 24% -78.5% 264.25 ± 18% interrupts.CPU156.RES:Rescheduling_interrupts 19.00 ± 69% +3373.7% 660.00 ± 10% interrupts.CPU156.TLB:TLB_shootdowns 1025 ± 7% +1280.2% 14154 ± 26% interrupts.CPU157.CAL:Function_call_interrupts 170.50 ± 25% +3323.3% 5836 ± 12% interrupts.CPU157.NMI:Non-maskable_interrupts 170.50 ± 25% +3323.3% 5836 ± 12% interrupts.CPU157.PMI:Performance_monitoring_interrupts 1303 ± 12% -79.6% 265.50 ± 27% interrupts.CPU157.RES:Rescheduling_interrupts 20.50 ±100% +2854.9% 605.75 ± 5% interrupts.CPU157.TLB:TLB_shootdowns 1248 ± 13% +1136.5% 15432 ± 6% interrupts.CPU158.CAL:Function_call_interrupts 146.25 ± 35% +3346.5% 5040 ± 26% interrupts.CPU158.NMI:Non-maskable_interrupts 146.25 ± 35% +3346.5% 5040 ± 26% interrupts.CPU158.PMI:Performance_monitoring_interrupts 1532 ± 23% -78.8% 324.75 ± 18% interrupts.CPU158.RES:Rescheduling_interrupts 15.00 ± 37% +4298.3% 659.75 ± 34% interrupts.CPU158.TLB:TLB_shootdowns 1242 ± 7% +942.0% 12942 ± 12% interrupts.CPU159.CAL:Function_call_interrupts 148.50 ± 36% +3184.8% 4878 ± 21% interrupts.CPU159.NMI:Non-maskable_interrupts 148.50 ± 36% +3184.8% 4878 ± 21% interrupts.CPU159.PMI:Performance_monitoring_interrupts 1268 ± 21% -79.8% 256.75 ± 20% interrupts.CPU159.RES:Rescheduling_interrupts 32.50 ± 90% +1569.2% 542.50 ± 16% interrupts.CPU159.TLB:TLB_shootdowns 1106 ± 8% +1676.8% 19659 ± 12% interrupts.CPU16.CAL:Function_call_interrupts 205.75 ± 3% +2565.1% 5483 ± 36% interrupts.CPU16.NMI:Non-maskable_interrupts 205.75 ± 3% +2565.1% 5483 ± 36% interrupts.CPU16.PMI:Performance_monitoring_interrupts 1281 ± 30% -67.6% 414.50 ± 13% interrupts.CPU16.RES:Rescheduling_interrupts 21.50 ± 55% +4008.1% 883.25 ± 6% interrupts.CPU16.TLB:TLB_shootdowns 1168 ± 12% +1036.9% 13284 ± 14% interrupts.CPU160.CAL:Function_call_interrupts 144.25 ± 34% +4039.7% 5971 ± 30% interrupts.CPU160.NMI:Non-maskable_interrupts 144.25 ± 34% +4039.7% 5971 ± 30% interrupts.CPU160.PMI:Performance_monitoring_interrupts 1048 ± 27% -76.3% 249.00 ± 16% interrupts.CPU160.RES:Rescheduling_interrupts 11.00 ± 38% +6231.8% 696.50 ± 11% interrupts.CPU160.TLB:TLB_shootdowns 1106 ± 14% +1200.8% 14396 ± 18% interrupts.CPU161.CAL:Function_call_interrupts 147.25 ± 33% +3577.9% 5415 ± 14% interrupts.CPU161.NMI:Non-maskable_interrupts 147.25 ± 33% +3577.9% 5415 ± 14% interrupts.CPU161.PMI:Performance_monitoring_interrupts 1495 ± 15% -80.4% 293.25 ± 17% interrupts.CPU161.RES:Rescheduling_interrupts 18.25 ± 5% +3780.8% 708.25 ± 8% interrupts.CPU161.TLB:TLB_shootdowns 1217 ± 23% +998.1% 13369 ± 14% interrupts.CPU162.CAL:Function_call_interrupts 153.25 ± 33% +3249.8% 5133 ± 37% interrupts.CPU162.NMI:Non-maskable_interrupts 153.25 ± 33% +3249.8% 5133 ± 37% interrupts.CPU162.PMI:Performance_monitoring_interrupts 1321 ± 29% -81.0% 251.50 ± 14% interrupts.CPU162.RES:Rescheduling_interrupts 30.50 ± 62% +1946.7% 624.25 ± 8% interrupts.CPU162.TLB:TLB_shootdowns 1071 ± 4% +1210.4% 14044 ± 12% interrupts.CPU163.CAL:Function_call_interrupts 146.50 ± 34% +3657.0% 5504 ± 31% interrupts.CPU163.NMI:Non-maskable_interrupts 146.50 ± 34% +3657.0% 5504 ± 31% interrupts.CPU163.PMI:Performance_monitoring_interrupts 1582 ± 14% -82.1% 283.00 ± 11% interrupts.CPU163.RES:Rescheduling_interrupts 11.75 ± 21% +5280.9% 632.25 ± 14% interrupts.CPU163.TLB:TLB_shootdowns 1089 ± 10% +1103.2% 13105 ± 10% interrupts.CPU164.CAL:Function_call_interrupts 147.75 ± 36% +3304.1% 5029 ± 51% interrupts.CPU164.NMI:Non-maskable_interrupts 147.75 ± 36% +3304.1% 5029 ± 51% interrupts.CPU164.PMI:Performance_monitoring_interrupts 1245 ± 28% -79.0% 261.25 ± 13% interrupts.CPU164.RES:Rescheduling_interrupts 24.00 ± 80% +2418.8% 604.50 ± 14% interrupts.CPU164.TLB:TLB_shootdowns 1067 ± 6% +1151.9% 13361 ± 13% interrupts.CPU165.CAL:Function_call_interrupts 147.50 ± 34% +4051.4% 6123 ± 28% interrupts.CPU165.NMI:Non-maskable_interrupts 147.50 ± 34% +4051.4% 6123 ± 28% interrupts.CPU165.PMI:Performance_monitoring_interrupts 1398 ± 30% -79.5% 286.25 ± 18% interrupts.CPU165.RES:Rescheduling_interrupts 22.00 ± 73% +2510.2% 574.25 ± 24% interrupts.CPU165.TLB:TLB_shootdowns 1009 ± 8% +1390.8% 15053 ± 11% interrupts.CPU166.CAL:Function_call_interrupts 152.00 ± 36% +3428.5% 5363 ± 26% interrupts.CPU166.NMI:Non-maskable_interrupts 152.00 ± 36% +3428.5% 5363 ± 26% interrupts.CPU166.PMI:Performance_monitoring_interrupts 1299 ± 12% -76.7% 302.75 ± 12% interrupts.CPU166.RES:Rescheduling_interrupts 9.50 ± 39% +6428.9% 620.25 ± 13% interrupts.CPU166.TLB:TLB_shootdowns 1049 ± 12% +1315.0% 14850 ± 8% interrupts.CPU167.CAL:Function_call_interrupts 157.00 ± 40% +3769.9% 6075 ± 41% interrupts.CPU167.NMI:Non-maskable_interrupts 157.00 ± 40% +3769.9% 6075 ± 41% interrupts.CPU167.PMI:Performance_monitoring_interrupts 1629 ± 6% -81.5% 302.00 ± 19% interrupts.CPU167.RES:Rescheduling_interrupts 14.50 ± 25% +4098.3% 608.75 ± 20% interrupts.CPU167.TLB:TLB_shootdowns 1799 ± 40% +813.1% 16428 ± 3% interrupts.CPU168.CAL:Function_call_interrupts 181.00 ± 24% +3204.0% 5980 ± 34% interrupts.CPU168.NMI:Non-maskable_interrupts 181.00 ± 24% +3204.0% 5980 ± 34% interrupts.CPU168.PMI:Performance_monitoring_interrupts 987.50 ± 10% -70.2% 294.50 ± 12% interrupts.CPU168.RES:Rescheduling_interrupts 20.75 ± 81% +3185.5% 681.75 ± 19% interrupts.CPU168.TLB:TLB_shootdowns 1475 ± 21% +927.6% 15162 ± 10% interrupts.CPU169.CAL:Function_call_interrupts 178.25 ± 22% +3114.6% 5730 ± 22% interrupts.CPU169.NMI:Non-maskable_interrupts 178.25 ± 22% +3114.6% 5730 ± 22% interrupts.CPU169.PMI:Performance_monitoring_interrupts 1203 ± 19% -75.2% 298.00 ± 19% interrupts.CPU169.RES:Rescheduling_interrupts 46.00 ± 95% +1379.9% 680.75 ± 19% interrupts.CPU169.TLB:TLB_shootdowns 1073 ± 12% +1504.9% 17232 ± 11% interrupts.CPU17.CAL:Function_call_interrupts 203.75 ± 2% +1949.0% 4174 ± 15% interrupts.CPU17.NMI:Non-maskable_interrupts 203.75 ± 2% +1949.0% 4174 ± 15% interrupts.CPU17.PMI:Performance_monitoring_interrupts 1024 ± 30% -66.9% 339.25 ± 16% interrupts.CPU17.RES:Rescheduling_interrupts 16.75 ±105% +4129.9% 708.50 ± 12% interrupts.CPU17.TLB:TLB_shootdowns 1363 ± 13% +986.6% 14813 ± 10% interrupts.CPU170.CAL:Function_call_interrupts 175.50 ± 26% +3093.4% 5604 ± 28% interrupts.CPU170.NMI:Non-maskable_interrupts 175.50 ± 26% +3093.4% 5604 ± 28% interrupts.CPU170.PMI:Performance_monitoring_interrupts 1143 ± 37% -76.2% 272.75 ± 21% interrupts.CPU170.RES:Rescheduling_interrupts 23.25 ±111% +2730.1% 658.00 ± 8% interrupts.CPU170.TLB:TLB_shootdowns 1430 ± 9% +994.8% 15658 ± 9% interrupts.CPU171.CAL:Function_call_interrupts 188.50 ± 30% +2864.6% 5588 ± 24% interrupts.CPU171.NMI:Non-maskable_interrupts 188.50 ± 30% +2864.6% 5588 ± 24% interrupts.CPU171.PMI:Performance_monitoring_interrupts 1123 ± 33% -76.3% 266.25 ± 12% interrupts.CPU171.RES:Rescheduling_interrupts 10.25 ± 24% +6714.6% 698.50 ± 12% interrupts.CPU171.TLB:TLB_shootdowns 1565 ± 49% +811.5% 14268 ± 15% interrupts.CPU172.CAL:Function_call_interrupts 208.25 ± 5% +2480.3% 5373 ± 31% interrupts.CPU172.NMI:Non-maskable_interrupts 208.25 ± 5% +2480.3% 5373 ± 31% interrupts.CPU172.PMI:Performance_monitoring_interrupts 35.25 ±128% +1641.1% 613.75 ± 11% interrupts.CPU172.TLB:TLB_shootdowns 1228 ± 15% +1209.1% 16085 ± 12% interrupts.CPU173.CAL:Function_call_interrupts 203.00 ± 4% +3154.1% 6605 ± 13% interrupts.CPU173.NMI:Non-maskable_interrupts 203.00 ± 4% +3154.1% 6605 ± 13% interrupts.CPU173.PMI:Performance_monitoring_interrupts 1248 ± 26% -78.0% 274.50 ± 21% interrupts.CPU173.RES:Rescheduling_interrupts 33.50 ± 62% +1862.7% 657.50 ± 27% interrupts.CPU173.TLB:TLB_shootdowns 1070 ± 8% +1239.8% 14338 ± 11% interrupts.CPU174.CAL:Function_call_interrupts 203.50 ± 4% +2676.9% 5651 ± 18% interrupts.CPU174.NMI:Non-maskable_interrupts 203.50 ± 4% +2676.9% 5651 ± 18% interrupts.CPU174.PMI:Performance_monitoring_interrupts 19.50 ± 70% +3064.1% 617.00 ± 9% interrupts.CPU174.TLB:TLB_shootdowns 1468 ± 19% +1011.8% 16329 ± 3% interrupts.CPU175.CAL:Function_call_interrupts 200.50 ± 3% +2875.7% 5966 ± 16% interrupts.CPU175.NMI:Non-maskable_interrupts 200.50 ± 3% +2875.7% 5966 ± 16% interrupts.CPU175.PMI:Performance_monitoring_interrupts 1106 ± 31% -75.1% 275.25 ± 7% interrupts.CPU175.RES:Rescheduling_interrupts 28.75 ± 60% +2479.1% 741.50 ± 14% interrupts.CPU175.TLB:TLB_shootdowns 1393 ± 8% +876.9% 13611 ± 8% interrupts.CPU176.CAL:Function_call_interrupts 200.00 ± 3% +3190.5% 6581 ± 13% interrupts.CPU176.NMI:Non-maskable_interrupts 200.00 ± 3% +3190.5% 6581 ± 13% interrupts.CPU176.PMI:Performance_monitoring_interrupts 971.50 ± 11% -71.1% 280.75 ± 7% interrupts.CPU176.RES:Rescheduling_interrupts 14.00 ± 49% +5275.0% 752.50 ± 6% interrupts.CPU176.TLB:TLB_shootdowns 1394 ± 12% +803.9% 12600 ± 6% interrupts.CPU177.CAL:Function_call_interrupts 202.25 ± 2% +2877.6% 6022 ± 13% interrupts.CPU177.NMI:Non-maskable_interrupts 202.25 ± 2% +2877.6% 6022 ± 13% interrupts.CPU177.PMI:Performance_monitoring_interrupts 1117 ± 18% -76.0% 268.00 ± 21% interrupts.CPU177.RES:Rescheduling_interrupts 14.00 ± 26% +4117.9% 590.50 ± 14% interrupts.CPU177.TLB:TLB_shootdowns 1430 ± 15% +968.2% 15281 ± 4% interrupts.CPU178.CAL:Function_call_interrupts 207.25 ± 9% +2723.2% 5851 ± 21% interrupts.CPU178.NMI:Non-maskable_interrupts 207.25 ± 9% +2723.2% 5851 ± 21% interrupts.CPU178.PMI:Performance_monitoring_interrupts 916.50 ± 21% -74.1% 237.25 ± 6% interrupts.CPU178.RES:Rescheduling_interrupts 20.50 ± 69% +2967.1% 628.75 ± 12% interrupts.CPU178.TLB:TLB_shootdowns 1350 ± 12% +866.1% 13042 ± 16% interrupts.CPU179.CAL:Function_call_interrupts 203.25 ± 3% +2323.0% 4924 ± 28% interrupts.CPU179.NMI:Non-maskable_interrupts 203.25 ± 3% +2323.0% 4924 ± 28% interrupts.CPU179.PMI:Performance_monitoring_interrupts 1495 ± 14% -83.6% 245.75 ± 12% interrupts.CPU179.RES:Rescheduling_interrupts 23.75 ± 76% +2553.7% 630.25 ± 17% interrupts.CPU179.TLB:TLB_shootdowns 1155 ± 9% +1583.0% 19451 ± 15% interrupts.CPU18.CAL:Function_call_interrupts 202.50 ± 3% +2122.7% 4501 ± 44% interrupts.CPU18.NMI:Non-maskable_interrupts 202.50 ± 3% +2122.7% 4501 ± 44% interrupts.CPU18.PMI:Performance_monitoring_interrupts 1107 ± 20% -67.0% 365.50 ± 24% interrupts.CPU18.RES:Rescheduling_interrupts 5.50 ± 32% +14081.8% 780.00 ± 15% interrupts.CPU18.TLB:TLB_shootdowns 1327 ± 4% +1054.4% 15324 ± 6% interrupts.CPU180.CAL:Function_call_interrupts 179.25 ± 26% +3402.6% 6278 ± 12% interrupts.CPU180.NMI:Non-maskable_interrupts 179.25 ± 26% +3402.6% 6278 ± 12% interrupts.CPU180.PMI:Performance_monitoring_interrupts 1134 ± 19% -78.7% 241.25 ± 21% interrupts.CPU180.RES:Rescheduling_interrupts 19.75 ± 59% +3427.8% 696.75 ± 11% interrupts.CPU180.TLB:TLB_shootdowns 1279 ± 5% +947.7% 13403 ± 8% interrupts.CPU181.CAL:Function_call_interrupts 184.50 ± 25% +3133.9% 5966 ± 15% interrupts.CPU181.NMI:Non-maskable_interrupts 184.50 ± 25% +3133.9% 5966 ± 15% interrupts.CPU181.PMI:Performance_monitoring_interrupts 1399 ± 8% -83.7% 228.75 ± 21% interrupts.CPU181.RES:Rescheduling_interrupts 17.25 ± 49% +3360.9% 597.00 ± 14% interrupts.CPU181.TLB:TLB_shootdowns 1176 ± 11% +971.9% 12610 ± 12% interrupts.CPU182.CAL:Function_call_interrupts 179.75 ± 27% +2885.3% 5366 ± 25% interrupts.CPU182.NMI:Non-maskable_interrupts 179.75 ± 27% +2885.3% 5366 ± 25% interrupts.CPU182.PMI:Performance_monitoring_interrupts 813.25 ± 28% -70.0% 244.25 ± 24% interrupts.CPU182.RES:Rescheduling_interrupts 9.25 ± 55% +7583.8% 710.75 ± 18% interrupts.CPU182.TLB:TLB_shootdowns 1458 ± 24% +788.6% 12958 ± 14% interrupts.CPU183.CAL:Function_call_interrupts 177.00 ± 27% +3059.6% 5592 ± 8% interrupts.CPU183.NMI:Non-maskable_interrupts 177.00 ± 27% +3059.6% 5592 ± 8% interrupts.CPU183.PMI:Performance_monitoring_interrupts 1085 ± 28% -78.8% 229.75 ± 12% interrupts.CPU183.RES:Rescheduling_interrupts 22.00 ± 71% +2365.9% 542.50 ± 23% interrupts.CPU183.TLB:TLB_shootdowns 1143 ± 6% +1166.9% 14480 ± 6% interrupts.CPU184.CAL:Function_call_interrupts 178.00 ± 27% +3791.3% 6926 ± 14% interrupts.CPU184.NMI:Non-maskable_interrupts 178.00 ± 27% +3791.3% 6926 ± 14% interrupts.CPU184.PMI:Performance_monitoring_interrupts 1061 ± 17% -73.8% 278.25 ± 19% interrupts.CPU184.RES:Rescheduling_interrupts 11.00 ± 43% +5834.1% 652.75 ± 26% interrupts.CPU184.TLB:TLB_shootdowns 1274 ± 11% +969.3% 13628 ± 4% interrupts.CPU185.CAL:Function_call_interrupts 181.75 ± 27% +3123.4% 5858 ± 34% interrupts.CPU185.NMI:Non-maskable_interrupts 181.75 ± 27% +3123.4% 5858 ± 34% interrupts.CPU185.PMI:Performance_monitoring_interrupts 1332 ± 19% -82.9% 227.50 ± 5% interrupts.CPU185.RES:Rescheduling_interrupts 15.00 ± 30% +3793.3% 584.00 ± 10% interrupts.CPU185.TLB:TLB_shootdowns 1452 ± 24% +830.7% 13514 ± 13% interrupts.CPU186.CAL:Function_call_interrupts 175.75 ± 26% +2956.8% 5372 ± 35% interrupts.CPU186.NMI:Non-maskable_interrupts 175.75 ± 26% +2956.8% 5372 ± 35% interrupts.CPU186.PMI:Performance_monitoring_interrupts 1349 ± 18% -83.2% 226.75 ± 14% interrupts.CPU186.RES:Rescheduling_interrupts 21.50 ± 44% +2820.9% 628.00 ± 15% interrupts.CPU186.TLB:TLB_shootdowns 1241 ± 14% +969.0% 13269 ± 6% interrupts.CPU187.CAL:Function_call_interrupts 177.25 ± 26% +2643.6% 4863 ± 33% interrupts.CPU187.NMI:Non-maskable_interrupts 177.25 ± 26% +2643.6% 4863 ± 33% interrupts.CPU187.PMI:Performance_monitoring_interrupts 1196 ± 46% -79.0% 251.25 ± 23% interrupts.CPU187.RES:Rescheduling_interrupts 21.25 ± 42% +2525.9% 558.00 ± 23% interrupts.CPU187.TLB:TLB_shootdowns 1401 ± 16% +720.2% 11493 ± 12% interrupts.CPU188.CAL:Function_call_interrupts 182.50 ± 27% +2534.8% 4808 ± 31% interrupts.CPU188.NMI:Non-maskable_interrupts 182.50 ± 27% +2534.8% 4808 ± 31% interrupts.CPU188.PMI:Performance_monitoring_interrupts 1079 ± 23% -80.9% 206.50 ± 17% interrupts.CPU188.RES:Rescheduling_interrupts 13.75 ± 13% +3150.9% 447.00 ± 23% interrupts.CPU188.TLB:TLB_shootdowns 1352 ± 11% +881.9% 13277 ± 16% interrupts.CPU189.CAL:Function_call_interrupts 179.50 ± 26% +2773.8% 5158 ± 37% interrupts.CPU189.NMI:Non-maskable_interrupts 179.50 ± 26% +2773.8% 5158 ± 37% interrupts.CPU189.PMI:Performance_monitoring_interrupts 1375 ± 28% -82.5% 240.25 ± 17% interrupts.CPU189.RES:Rescheduling_interrupts 35.25 ± 48% +1895.7% 703.50 ± 19% interrupts.CPU189.TLB:TLB_shootdowns 1156 ± 4% +1495.6% 18453 ± 14% interrupts.CPU19.CAL:Function_call_interrupts 204.50 +2211.9% 4727 ± 23% interrupts.CPU19.NMI:Non-maskable_interrupts 204.50 +2211.9% 4727 ± 23% interrupts.CPU19.PMI:Performance_monitoring_interrupts 1344 ± 21% -69.5% 410.50 ± 15% interrupts.CPU19.RES:Rescheduling_interrupts 12.25 ± 15% +6300.0% 784.00 ± 7% interrupts.CPU19.TLB:TLB_shootdowns 1154 ± 6% +947.2% 12092 ± 11% interrupts.CPU190.CAL:Function_call_interrupts 176.75 ± 26% +2962.0% 5412 ± 25% interrupts.CPU190.NMI:Non-maskable_interrupts 176.75 ± 26% +2962.0% 5412 ± 25% interrupts.CPU190.PMI:Performance_monitoring_interrupts 1021 ± 17% -79.4% 210.25 ± 23% interrupts.CPU190.RES:Rescheduling_interrupts 18.00 ± 25% +2488.9% 466.00 ± 17% interrupts.CPU190.TLB:TLB_shootdowns 1060 ± 12% +354.3% 4815 ± 10% interrupts.CPU191.CAL:Function_call_interrupts 183.25 ± 25% +2279.8% 4361 ± 29% interrupts.CPU191.NMI:Non-maskable_interrupts 183.25 ± 25% +2279.8% 4361 ± 29% interrupts.CPU191.PMI:Performance_monitoring_interrupts 642.50 ± 26% -85.0% 96.50 ± 11% interrupts.CPU191.RES:Rescheduling_interrupts 1533 ± 33% +1016.4% 17117 ± 4% interrupts.CPU2.CAL:Function_call_interrupts 211.75 ± 8% +3240.4% 7073 ± 16% interrupts.CPU2.NMI:Non-maskable_interrupts 211.75 ± 8% +3240.4% 7073 ± 16% interrupts.CPU2.PMI:Performance_monitoring_interrupts 1065 ± 7% -64.9% 374.25 ± 10% interrupts.CPU2.RES:Rescheduling_interrupts 9.75 ± 48% +8120.5% 801.50 ± 17% interrupts.CPU2.TLB:TLB_shootdowns 1158 ± 9% +1451.8% 17977 ± 18% interrupts.CPU20.CAL:Function_call_interrupts 206.50 ± 4% +1652.7% 3619 ± 28% interrupts.CPU20.NMI:Non-maskable_interrupts 206.50 ± 4% +1652.7% 3619 ± 28% interrupts.CPU20.PMI:Performance_monitoring_interrupts 1099 ± 49% -65.9% 375.00 ± 16% interrupts.CPU20.RES:Rescheduling_interrupts 20.75 ± 86% +4350.6% 923.50 ± 7% interrupts.CPU20.TLB:TLB_shootdowns 4622 ±128% +288.3% 17949 ± 16% interrupts.CPU21.CAL:Function_call_interrupts 175.25 ± 24% +2803.9% 5089 ± 22% interrupts.CPU21.NMI:Non-maskable_interrupts 175.25 ± 24% +2803.9% 5089 ± 22% interrupts.CPU21.PMI:Performance_monitoring_interrupts 1170 ± 33% -65.3% 405.50 ± 16% interrupts.CPU21.RES:Rescheduling_interrupts 9.75 ± 8% +8459.0% 834.50 ± 23% interrupts.CPU21.TLB:TLB_shootdowns 1130 ± 8% +1540.3% 18539 ± 19% interrupts.CPU22.CAL:Function_call_interrupts 181.75 ± 26% +2270.2% 4307 ± 15% interrupts.CPU22.NMI:Non-maskable_interrupts 181.75 ± 26% +2270.2% 4307 ± 15% interrupts.CPU22.PMI:Performance_monitoring_interrupts 1330 ± 25% -70.1% 398.00 ± 20% interrupts.CPU22.RES:Rescheduling_interrupts 10.25 ± 54% +8246.3% 855.50 ± 15% interrupts.CPU22.TLB:TLB_shootdowns 1130 ± 12% +1531.3% 18446 ± 13% interrupts.CPU23.CAL:Function_call_interrupts 177.50 ± 23% +2556.3% 4715 ± 31% interrupts.CPU23.NMI:Non-maskable_interrupts 177.50 ± 23% +2556.3% 4715 ± 31% interrupts.CPU23.PMI:Performance_monitoring_interrupts 1240 ± 6% -68.6% 389.75 ± 15% interrupts.CPU23.RES:Rescheduling_interrupts 33.00 ± 84% +2371.2% 815.50 ± 6% interrupts.CPU23.TLB:TLB_shootdowns 1247 ± 11% +1214.2% 16394 ± 13% interrupts.CPU24.CAL:Function_call_interrupts 180.25 ± 27% +3176.8% 5906 ± 31% interrupts.CPU24.NMI:Non-maskable_interrupts 180.25 ± 27% +3176.8% 5906 ± 31% interrupts.CPU24.PMI:Performance_monitoring_interrupts 934.00 ± 6% -59.9% 374.25 ± 17% interrupts.CPU24.RES:Rescheduling_interrupts 12.50 ± 36% +6030.0% 766.25 ± 12% interrupts.CPU24.TLB:TLB_shootdowns 1104 ± 13% +1607.5% 18855 ± 21% interrupts.CPU25.CAL:Function_call_interrupts 199.75 ± 3% +2961.6% 6115 ± 38% interrupts.CPU25.NMI:Non-maskable_interrupts 199.75 ± 3% +2961.6% 6115 ± 38% interrupts.CPU25.PMI:Performance_monitoring_interrupts 1100 ± 41% -59.5% 445.25 ± 14% interrupts.CPU25.RES:Rescheduling_interrupts 9.00 ± 47% +9119.4% 829.75 ± 13% interrupts.CPU25.TLB:TLB_shootdowns 1463 ± 17% +1091.0% 17433 ± 4% interrupts.CPU26.CAL:Function_call_interrupts 199.25 ± 4% +2527.7% 5235 ± 37% interrupts.CPU26.NMI:Non-maskable_interrupts 199.25 ± 4% +2527.7% 5235 ± 37% interrupts.CPU26.PMI:Performance_monitoring_interrupts 1474 ± 18% -73.8% 386.25 ± 25% interrupts.CPU26.RES:Rescheduling_interrupts 11.75 ± 38% +6944.7% 827.75 ± 14% interrupts.CPU26.TLB:TLB_shootdowns 1148 ± 17% +1236.0% 15346 ± 6% interrupts.CPU27.CAL:Function_call_interrupts 204.50 ± 4% +2298.5% 4905 ± 40% interrupts.CPU27.NMI:Non-maskable_interrupts 204.50 ± 4% +2298.5% 4905 ± 40% interrupts.CPU27.PMI:Performance_monitoring_interrupts 1265 ± 31% -69.6% 384.50 ± 20% interrupts.CPU27.RES:Rescheduling_interrupts 24.00 ± 68% +3257.3% 805.75 ± 20% interrupts.CPU27.TLB:TLB_shootdowns 1024 ± 5% +1668.9% 18118 ± 7% interrupts.CPU28.CAL:Function_call_interrupts 198.25 ± 3% +3294.2% 6729 ± 16% interrupts.CPU28.NMI:Non-maskable_interrupts 198.25 ± 3% +3294.2% 6729 ± 16% interrupts.CPU28.PMI:Performance_monitoring_interrupts 1301 ± 8% -69.6% 395.00 ± 6% interrupts.CPU28.RES:Rescheduling_interrupts 32.25 ± 61% +2263.6% 762.25 ± 11% interrupts.CPU28.TLB:TLB_shootdowns 1072 ± 7% +1619.3% 18435 ± 11% interrupts.CPU29.CAL:Function_call_interrupts 200.00 ± 3% +3180.0% 6560 ± 13% interrupts.CPU29.NMI:Non-maskable_interrupts 200.00 ± 3% +3180.0% 6560 ± 13% interrupts.CPU29.PMI:Performance_monitoring_interrupts 1335 ± 15% -68.9% 415.75 ± 11% interrupts.CPU29.RES:Rescheduling_interrupts 23.50 ± 56% +3357.4% 812.50 ± 7% interrupts.CPU29.TLB:TLB_shootdowns 1328 ± 33% +1287.1% 18424 ± 17% interrupts.CPU3.CAL:Function_call_interrupts 204.00 ± 3% +3221.1% 6775 ± 15% interrupts.CPU3.NMI:Non-maskable_interrupts 204.00 ± 3% +3221.1% 6775 ± 15% interrupts.CPU3.PMI:Performance_monitoring_interrupts 1256 ± 9% -70.6% 369.25 ± 13% interrupts.CPU3.RES:Rescheduling_interrupts 11.75 ± 46% +6491.5% 774.50 ± 10% interrupts.CPU3.TLB:TLB_shootdowns 1028 ± 3% +1513.6% 16588 ± 12% interrupts.CPU30.CAL:Function_call_interrupts 194.50 ± 2% +3653.2% 7300 ± 20% interrupts.CPU30.NMI:Non-maskable_interrupts 194.50 ± 2% +3653.2% 7300 ± 20% interrupts.CPU30.PMI:Performance_monitoring_interrupts 1336 ± 11% -67.4% 435.25 ± 23% interrupts.CPU30.RES:Rescheduling_interrupts 40.50 ±122% +1838.9% 785.25 ± 7% interrupts.CPU30.TLB:TLB_shootdowns 1140 ± 6% +1545.2% 18768 ± 8% interrupts.CPU31.CAL:Function_call_interrupts 200.25 ± 4% +2843.4% 5894 ± 32% interrupts.CPU31.NMI:Non-maskable_interrupts 200.25 ± 4% +2843.4% 5894 ± 32% interrupts.CPU31.PMI:Performance_monitoring_interrupts 1193 ± 27% -65.4% 413.25 ± 11% interrupts.CPU31.RES:Rescheduling_interrupts 34.50 ± 85% +2294.9% 826.25 ± 5% interrupts.CPU31.TLB:TLB_shootdowns 1205 ± 9% +1171.7% 15324 ± 11% interrupts.CPU32.CAL:Function_call_interrupts 197.75 ± 5% +3269.5% 6663 ± 14% interrupts.CPU32.NMI:Non-maskable_interrupts 197.75 ± 5% +3269.5% 6663 ± 14% interrupts.CPU32.PMI:Performance_monitoring_interrupts 1052 ± 15% -63.8% 380.75 ± 14% interrupts.CPU32.RES:Rescheduling_interrupts 7.50 ± 39% +11026.7% 834.50 ± 17% interrupts.CPU32.TLB:TLB_shootdowns 1199 ± 15% +1305.8% 16855 ± 6% interrupts.CPU33.CAL:Function_call_interrupts 176.00 ± 26% +3479.7% 6300 ± 32% interrupts.CPU33.NMI:Non-maskable_interrupts 176.00 ± 26% +3479.7% 6300 ± 32% interrupts.CPU33.PMI:Performance_monitoring_interrupts 1174 ± 39% -66.5% 393.25 ± 11% interrupts.CPU33.RES:Rescheduling_interrupts 21.75 ± 89% +3767.8% 841.25 ± 11% interrupts.CPU33.TLB:TLB_shootdowns 1103 ± 5% +1436.9% 16955 ± 11% interrupts.CPU34.CAL:Function_call_interrupts 170.75 ± 24% +3065.3% 5404 ± 23% interrupts.CPU34.NMI:Non-maskable_interrupts 170.75 ± 24% +3065.3% 5404 ± 23% interrupts.CPU34.PMI:Performance_monitoring_interrupts 1522 ± 14% -76.6% 355.75 ± 14% interrupts.CPU34.RES:Rescheduling_interrupts 41.50 ±119% +1819.3% 796.50 ± 4% interrupts.CPU34.TLB:TLB_shootdowns 1107 ± 12% +1574.7% 18539 ± 15% interrupts.CPU35.CAL:Function_call_interrupts 200.75 ± 6% +2967.6% 6158 ± 23% interrupts.CPU35.NMI:Non-maskable_interrupts 200.75 ± 6% +2967.6% 6158 ± 23% interrupts.CPU35.PMI:Performance_monitoring_interrupts 1132 ± 20% -63.5% 413.00 ± 8% interrupts.CPU35.RES:Rescheduling_interrupts 9.00 ± 30% +9308.3% 846.75 ± 16% interrupts.CPU35.TLB:TLB_shootdowns 1011 ± 5% +1621.5% 17417 ± 8% interrupts.CPU36.CAL:Function_call_interrupts 194.75 ± 3% +3467.9% 6948 ± 7% interrupts.CPU36.NMI:Non-maskable_interrupts 194.75 ± 3% +3467.9% 6948 ± 7% interrupts.CPU36.PMI:Performance_monitoring_interrupts 983.00 ± 32% -58.4% 409.25 ± 22% interrupts.CPU36.RES:Rescheduling_interrupts 21.75 ± 75% +3134.5% 703.50 ± 10% interrupts.CPU36.TLB:TLB_shootdowns 1136 ± 9% +1481.5% 17970 ± 15% interrupts.CPU37.CAL:Function_call_interrupts 192.75 ± 3% +3192.0% 6345 ± 12% interrupts.CPU37.NMI:Non-maskable_interrupts 192.75 ± 3% +3192.0% 6345 ± 12% interrupts.CPU37.PMI:Performance_monitoring_interrupts 1269 ± 40% -70.2% 379.00 ± 22% interrupts.CPU37.RES:Rescheduling_interrupts 16.50 ± 21% +5768.2% 968.25 ± 32% interrupts.CPU37.TLB:TLB_shootdowns 1168 ± 11% +1204.1% 15238 ± 13% interrupts.CPU38.CAL:Function_call_interrupts 195.25 ± 3% +3163.8% 6372 ± 13% interrupts.CPU38.NMI:Non-maskable_interrupts 195.25 ± 3% +3163.8% 6372 ± 13% interrupts.CPU38.PMI:Performance_monitoring_interrupts 1412 ± 26% -71.1% 408.00 ± 21% interrupts.CPU38.RES:Rescheduling_interrupts 27.00 ±104% +2736.1% 765.75 ± 20% interrupts.CPU38.TLB:TLB_shootdowns 1159 ± 2% +1433.1% 17769 ± 19% interrupts.CPU39.CAL:Function_call_interrupts 170.50 ± 26% +3568.5% 6254 ± 25% interrupts.CPU39.NMI:Non-maskable_interrupts 170.50 ± 26% +3568.5% 6254 ± 25% interrupts.CPU39.PMI:Performance_monitoring_interrupts 1395 ± 22% -72.4% 385.50 ± 17% interrupts.CPU39.RES:Rescheduling_interrupts 33.00 ± 79% +2272.0% 782.75 ± 16% interrupts.CPU39.TLB:TLB_shootdowns 1093 ± 8% +1469.4% 17154 ± 11% interrupts.CPU4.CAL:Function_call_interrupts 205.50 ± 3% +2958.8% 6285 ± 27% interrupts.CPU4.NMI:Non-maskable_interrupts 205.50 ± 3% +2958.8% 6285 ± 27% interrupts.CPU4.PMI:Performance_monitoring_interrupts 1344 ± 24% -73.6% 354.75 ± 11% interrupts.CPU4.RES:Rescheduling_interrupts 21.00 ± 71% +3188.1% 690.50 ± 14% interrupts.CPU4.TLB:TLB_shootdowns 1058 ± 9% +1555.4% 17518 ± 16% interrupts.CPU40.CAL:Function_call_interrupts 147.00 ± 34% +4442.0% 6676 ± 10% interrupts.CPU40.NMI:Non-maskable_interrupts 147.00 ± 34% +4442.0% 6676 ± 10% interrupts.CPU40.PMI:Performance_monitoring_interrupts 1115 ± 11% -63.5% 407.75 ± 18% interrupts.CPU40.RES:Rescheduling_interrupts 33.50 ± 74% +2391.8% 834.75 ± 16% interrupts.CPU40.TLB:TLB_shootdowns 1037 ± 9% +1763.6% 19334 ± 8% interrupts.CPU41.CAL:Function_call_interrupts 148.00 ± 34% +4094.8% 6208 ± 6% interrupts.CPU41.NMI:Non-maskable_interrupts 148.00 ± 34% +4094.8% 6208 ± 6% interrupts.CPU41.PMI:Performance_monitoring_interrupts 1286 ± 16% -69.1% 397.25 ± 11% interrupts.CPU41.RES:Rescheduling_interrupts 8.00 ± 23% +11725.0% 946.00 ± 6% interrupts.CPU41.TLB:TLB_shootdowns 1202 ± 7% +1323.9% 17118 ± 16% interrupts.CPU42.CAL:Function_call_interrupts 170.75 ± 25% +3722.4% 6526 ± 13% interrupts.CPU42.NMI:Non-maskable_interrupts 170.75 ± 25% +3722.4% 6526 ± 13% interrupts.CPU42.PMI:Performance_monitoring_interrupts 1201 ± 21% -68.9% 373.00 ± 8% interrupts.CPU42.RES:Rescheduling_interrupts 27.50 ±115% +2939.1% 835.75 ± 5% interrupts.CPU42.TLB:TLB_shootdowns 1114 ± 8% +1456.3% 17337 ± 15% interrupts.CPU43.CAL:Function_call_interrupts 151.00 ± 37% +4446.0% 6864 ± 11% interrupts.CPU43.NMI:Non-maskable_interrupts 151.00 ± 37% +4446.0% 6864 ± 11% interrupts.CPU43.PMI:Performance_monitoring_interrupts 1182 ± 22% -65.1% 412.50 ± 12% interrupts.CPU43.RES:Rescheduling_interrupts 20.50 ± 72% +3782.9% 796.00 ± 7% interrupts.CPU43.TLB:TLB_shootdowns 1072 ± 13% +1418.1% 16273 ± 19% interrupts.CPU44.CAL:Function_call_interrupts 147.00 ± 33% +4449.7% 6688 ± 13% interrupts.CPU44.NMI:Non-maskable_interrupts 147.00 ± 33% +4449.7% 6688 ± 13% interrupts.CPU44.PMI:Performance_monitoring_interrupts 1036 ± 47% -62.0% 393.75 ± 23% interrupts.CPU44.RES:Rescheduling_interrupts 19.00 ± 78% +4377.6% 850.75 ± 16% interrupts.CPU44.TLB:TLB_shootdowns 1324 ± 20% +1200.4% 17217 ± 25% interrupts.CPU45.CAL:Function_call_interrupts 146.50 ± 34% +4031.6% 6052 ± 9% interrupts.CPU45.NMI:Non-maskable_interrupts 146.50 ± 34% +4031.6% 6052 ± 9% interrupts.CPU45.PMI:Performance_monitoring_interrupts 1421 ± 17% -69.5% 433.50 ± 23% interrupts.CPU45.RES:Rescheduling_interrupts 12.75 ± 32% +5831.4% 756.25 ± 18% interrupts.CPU45.TLB:TLB_shootdowns 1117 ± 8% +1500.1% 17885 ± 6% interrupts.CPU46.CAL:Function_call_interrupts 147.00 ± 35% +4182.7% 6295 ± 26% interrupts.CPU46.NMI:Non-maskable_interrupts 147.00 ± 35% +4182.7% 6295 ± 26% interrupts.CPU46.PMI:Performance_monitoring_interrupts 1382 ± 19% -72.6% 378.75 ± 18% interrupts.CPU46.RES:Rescheduling_interrupts 17.25 ± 82% +4456.5% 786.00 ± 14% interrupts.CPU46.TLB:TLB_shootdowns 991.00 ± 3% +1739.2% 18226 ± 21% interrupts.CPU47.CAL:Function_call_interrupts 146.50 ± 34% +4033.8% 6056 ± 38% interrupts.CPU47.NMI:Non-maskable_interrupts 146.50 ± 34% +4033.8% 6056 ± 38% interrupts.CPU47.PMI:Performance_monitoring_interrupts 1355 ± 27% -71.1% 392.25 ± 7% interrupts.CPU47.RES:Rescheduling_interrupts 9.75 ± 36% +7759.0% 766.25 ± 13% interrupts.CPU47.TLB:TLB_shootdowns 1255 ± 4% +1345.2% 18141 ± 12% interrupts.CPU48.CAL:Function_call_interrupts 185.25 ± 28% +3158.0% 6035 ± 20% interrupts.CPU48.NMI:Non-maskable_interrupts 185.25 ± 28% +3158.0% 6035 ± 20% interrupts.CPU48.PMI:Performance_monitoring_interrupts 1187 ± 9% -63.4% 434.50 ± 11% interrupts.CPU48.RES:Rescheduling_interrupts 10.75 ± 27% +7479.1% 814.75 ± 14% interrupts.CPU48.TLB:TLB_shootdowns 1049 +1531.7% 17116 ± 14% interrupts.CPU49.CAL:Function_call_interrupts 193.50 ± 3% +2870.8% 5748 ± 24% interrupts.CPU49.NMI:Non-maskable_interrupts 193.50 ± 3% +2870.8% 5748 ± 24% interrupts.CPU49.PMI:Performance_monitoring_interrupts 1169 ± 24% -65.7% 400.75 ± 15% interrupts.CPU49.RES:Rescheduling_interrupts 12.50 ± 41% +5830.0% 741.25 ± 15% interrupts.CPU49.TLB:TLB_shootdowns 1230 ± 22% +1391.4% 18352 ± 14% interrupts.CPU5.CAL:Function_call_interrupts 179.00 ± 26% +2636.3% 4898 ± 21% interrupts.CPU5.NMI:Non-maskable_interrupts 179.00 ± 26% +2636.3% 4898 ± 21% interrupts.CPU5.PMI:Performance_monitoring_interrupts 1262 ± 25% -72.4% 349.00 ± 27% interrupts.CPU5.RES:Rescheduling_interrupts 8.50 ± 39% +8964.7% 770.50 ± 6% interrupts.CPU5.TLB:TLB_shootdowns 1181 ± 2% +1606.9% 20171 ± 8% interrupts.CPU50.CAL:Function_call_interrupts 195.50 ± 3% +2789.4% 5648 ± 24% interrupts.CPU50.NMI:Non-maskable_interrupts 195.50 ± 3% +2789.4% 5648 ± 24% interrupts.CPU50.PMI:Performance_monitoring_interrupts 1315 ± 15% -68.4% 416.25 ± 14% interrupts.CPU50.RES:Rescheduling_interrupts 25.50 ± 78% +3609.8% 946.00 ± 19% interrupts.CPU50.TLB:TLB_shootdowns 1153 ± 16% +1384.8% 17131 ± 4% interrupts.CPU51.CAL:Function_call_interrupts 197.00 ± 2% +2581.5% 5282 ± 26% interrupts.CPU51.NMI:Non-maskable_interrupts 197.00 ± 2% +2581.5% 5282 ± 26% interrupts.CPU51.PMI:Performance_monitoring_interrupts 1266 ± 14% -65.7% 433.75 ± 9% interrupts.CPU51.RES:Rescheduling_interrupts 14.00 ± 39% +6333.9% 900.75 ± 19% interrupts.CPU51.TLB:TLB_shootdowns 1022 ± 4% +1549.3% 16868 ± 11% interrupts.CPU52.CAL:Function_call_interrupts 199.75 ± 3% +2957.8% 6108 ± 27% interrupts.CPU52.NMI:Non-maskable_interrupts 199.75 ± 3% +2957.8% 6108 ± 27% interrupts.CPU52.PMI:Performance_monitoring_interrupts 1245 ± 30% -69.1% 385.00 ± 10% interrupts.CPU52.RES:Rescheduling_interrupts 12.00 ± 45% +6639.6% 808.75 ± 4% interrupts.CPU52.TLB:TLB_shootdowns 1071 ± 10% +1656.0% 18811 ± 15% interrupts.CPU53.CAL:Function_call_interrupts 198.75 ± 3% +2980.1% 6121 ± 29% interrupts.CPU53.NMI:Non-maskable_interrupts 198.75 ± 3% +2980.1% 6121 ± 29% interrupts.CPU53.PMI:Performance_monitoring_interrupts 1074 ± 34% -63.5% 392.50 ± 13% interrupts.CPU53.RES:Rescheduling_interrupts 15.00 ±105% +5255.0% 803.25 ± 14% interrupts.CPU53.TLB:TLB_shootdowns 1127 ± 21% +1410.0% 17017 ± 21% interrupts.CPU54.CAL:Function_call_interrupts 169.50 ± 24% +3912.4% 6801 ± 27% interrupts.CPU54.NMI:Non-maskable_interrupts 169.50 ± 24% +3912.4% 6801 ± 27% interrupts.CPU54.PMI:Performance_monitoring_interrupts 1311 ± 26% -71.2% 377.25 ± 23% interrupts.CPU54.RES:Rescheduling_interrupts 13.00 ± 21% +6096.2% 805.50 ± 18% interrupts.CPU54.TLB:TLB_shootdowns 1322 ± 31% +1308.5% 18620 ± 15% interrupts.CPU55.CAL:Function_call_interrupts 147.00 ± 35% +3924.8% 5916 ± 29% interrupts.CPU55.NMI:Non-maskable_interrupts 147.00 ± 35% +3924.8% 5916 ± 29% interrupts.CPU55.PMI:Performance_monitoring_interrupts 1107 ± 16% -65.8% 379.00 ± 19% interrupts.CPU55.RES:Rescheduling_interrupts 24.25 ±114% +3718.6% 926.00 ± 19% interrupts.CPU55.TLB:TLB_shootdowns 1116 ± 4% +1521.7% 18110 ± 14% interrupts.CPU56.CAL:Function_call_interrupts 173.25 ± 26% +3283.4% 5861 ± 39% interrupts.CPU56.NMI:Non-maskable_interrupts 173.25 ± 26% +3283.4% 5861 ± 39% interrupts.CPU56.PMI:Performance_monitoring_interrupts 1150 ± 23% -68.1% 366.50 ± 20% interrupts.CPU56.RES:Rescheduling_interrupts 10.50 ± 39% +8031.0% 853.75 ± 7% interrupts.CPU56.TLB:TLB_shootdowns 1202 ± 21% +1357.6% 17531 ± 21% interrupts.CPU57.CAL:Function_call_interrupts 188.50 ± 31% +3120.7% 6071 ± 34% interrupts.CPU57.NMI:Non-maskable_interrupts 188.50 ± 31% +3120.7% 6071 ± 34% interrupts.CPU57.PMI:Performance_monitoring_interrupts 1343 ± 16% -70.7% 393.50 ± 10% interrupts.CPU57.RES:Rescheduling_interrupts 12.75 ± 24% +7007.8% 906.25 ± 19% interrupts.CPU57.TLB:TLB_shootdowns 1054 ± 9% +1572.7% 17643 ± 15% interrupts.CPU58.CAL:Function_call_interrupts 173.00 ± 26% +2821.1% 5053 ± 23% interrupts.CPU58.NMI:Non-maskable_interrupts 173.00 ± 26% +2821.1% 5053 ± 23% interrupts.CPU58.PMI:Performance_monitoring_interrupts 1287 ± 19% -68.4% 407.00 ± 17% interrupts.CPU58.RES:Rescheduling_interrupts 16.00 ± 98% +5365.6% 874.50 ± 11% interrupts.CPU58.TLB:TLB_shootdowns 1035 ± 11% +1525.8% 16831 ± 19% interrupts.CPU59.CAL:Function_call_interrupts 171.25 ± 26% +2705.4% 4804 ± 56% interrupts.CPU59.NMI:Non-maskable_interrupts 171.25 ± 26% +2705.4% 4804 ± 56% interrupts.CPU59.PMI:Performance_monitoring_interrupts 1214 ± 30% -71.0% 352.50 ± 5% interrupts.CPU59.RES:Rescheduling_interrupts 27.50 ±116% +3414.5% 966.50 ± 27% interrupts.CPU59.TLB:TLB_shootdowns 1158 ± 11% +1497.6% 18500 ± 7% interrupts.CPU6.CAL:Function_call_interrupts 176.75 ± 25% +3246.7% 5915 ± 28% interrupts.CPU6.NMI:Non-maskable_interrupts 176.75 ± 25% +3246.7% 5915 ± 28% interrupts.CPU6.PMI:Performance_monitoring_interrupts 1568 ± 19% -75.1% 391.00 ± 17% interrupts.CPU6.RES:Rescheduling_interrupts 9.00 ± 40% +9402.8% 855.25 ± 6% interrupts.CPU6.TLB:TLB_shootdowns 1036 ± 7% +1762.4% 19294 ± 24% interrupts.CPU60.CAL:Function_call_interrupts 172.25 ± 26% +3278.2% 5819 ± 27% interrupts.CPU60.NMI:Non-maskable_interrupts 172.25 ± 26% +3278.2% 5819 ± 27% interrupts.CPU60.PMI:Performance_monitoring_interrupts 1405 ± 24% -71.3% 404.00 ± 14% interrupts.CPU60.RES:Rescheduling_interrupts 24.75 ± 80% +3187.9% 813.75 ± 8% interrupts.CPU60.TLB:TLB_shootdowns 1071 ± 7% +1622.3% 18449 ± 12% interrupts.CPU61.CAL:Function_call_interrupts 170.75 ± 27% +3293.9% 5795 ± 30% interrupts.CPU61.NMI:Non-maskable_interrupts 170.75 ± 27% +3293.9% 5795 ± 30% interrupts.CPU61.PMI:Performance_monitoring_interrupts 1413 ± 13% -71.7% 400.00 ± 5% interrupts.CPU61.RES:Rescheduling_interrupts 13.75 ± 22% +6080.0% 849.75 ± 4% interrupts.CPU61.TLB:TLB_shootdowns 1145 ± 13% +1577.6% 19212 ± 26% interrupts.CPU62.CAL:Function_call_interrupts 170.75 ± 27% +3811.3% 6678 ± 32% interrupts.CPU62.NMI:Non-maskable_interrupts 170.75 ± 27% +3811.3% 6678 ± 32% interrupts.CPU62.PMI:Performance_monitoring_interrupts 1050 ± 33% -64.0% 378.25 ± 18% interrupts.CPU62.RES:Rescheduling_interrupts 9.25 ± 59% +8451.4% 791.00 ± 30% interrupts.CPU62.TLB:TLB_shootdowns 2207 ± 90% +761.8% 19021 ± 12% interrupts.CPU63.CAL:Function_call_interrupts 172.25 ± 27% +3726.7% 6591 ± 23% interrupts.CPU63.NMI:Non-maskable_interrupts 172.25 ± 27% +3726.7% 6591 ± 23% interrupts.CPU63.PMI:Performance_monitoring_interrupts 1324 ± 27% -70.2% 395.00 ± 18% interrupts.CPU63.RES:Rescheduling_interrupts 22.00 ± 50% +4025.0% 907.50 ± 10% interrupts.CPU63.TLB:TLB_shootdowns 1163 ± 5% +1450.6% 18045 ± 10% interrupts.CPU64.CAL:Function_call_interrupts 192.50 ± 2% +2521.7% 5046 ± 33% interrupts.CPU64.NMI:Non-maskable_interrupts 192.50 ± 2% +2521.7% 5046 ± 33% interrupts.CPU64.PMI:Performance_monitoring_interrupts 1376 ± 28% -71.2% 395.75 ± 12% interrupts.CPU64.RES:Rescheduling_interrupts 21.00 ± 27% +3470.2% 749.75 ± 8% interrupts.CPU64.TLB:TLB_shootdowns 1069 ± 9% +1462.5% 16710 ± 11% interrupts.CPU65.CAL:Function_call_interrupts 193.00 ± 2% +3553.5% 7051 ± 13% interrupts.CPU65.NMI:Non-maskable_interrupts 193.00 ± 2% +3553.5% 7051 ± 13% interrupts.CPU65.PMI:Performance_monitoring_interrupts 1199 ± 24% -68.8% 374.00 ± 12% interrupts.CPU65.RES:Rescheduling_interrupts 11.75 ± 62% +6238.3% 744.75 ± 9% interrupts.CPU65.TLB:TLB_shootdowns 1055 ± 7% +1710.1% 19105 ± 13% interrupts.CPU66.CAL:Function_call_interrupts 204.25 ± 7% +3271.5% 6886 ± 16% interrupts.CPU66.NMI:Non-maskable_interrupts 204.25 ± 7% +3271.5% 6886 ± 16% interrupts.CPU66.PMI:Performance_monitoring_interrupts 1186 ± 43% -65.7% 406.75 ± 5% interrupts.CPU66.RES:Rescheduling_interrupts 17.00 ± 89% +4783.8% 830.25 ± 8% interrupts.CPU66.TLB:TLB_shootdowns 1190 ± 16% +1446.7% 18409 ± 12% interrupts.CPU67.CAL:Function_call_interrupts 193.50 ± 3% +3171.6% 6330 ± 15% interrupts.CPU67.NMI:Non-maskable_interrupts 193.50 ± 3% +3171.6% 6330 ± 15% interrupts.CPU67.PMI:Performance_monitoring_interrupts 1108 ± 17% -64.6% 392.00 ± 14% interrupts.CPU67.RES:Rescheduling_interrupts 16.75 ± 68% +4800.0% 820.75 ± 10% interrupts.CPU67.TLB:TLB_shootdowns 1058 ± 3% +1616.3% 18158 ± 16% interrupts.CPU68.CAL:Function_call_interrupts 194.75 ± 3% +3460.2% 6933 ± 13% interrupts.CPU68.NMI:Non-maskable_interrupts 194.75 ± 3% +3460.2% 6933 ± 13% interrupts.CPU68.PMI:Performance_monitoring_interrupts 1436 ± 22% -72.7% 392.50 ± 17% interrupts.CPU68.RES:Rescheduling_interrupts 15.50 ± 39% +5325.8% 841.00 ± 11% interrupts.CPU68.TLB:TLB_shootdowns 1025 ± 7% +1608.1% 17512 ± 20% interrupts.CPU69.CAL:Function_call_interrupts 193.25 ± 3% +2644.6% 5304 ± 28% interrupts.CPU69.NMI:Non-maskable_interrupts 193.25 ± 3% +2644.6% 5304 ± 28% interrupts.CPU69.PMI:Performance_monitoring_interrupts 1345 ± 30% -72.5% 369.75 ± 15% interrupts.CPU69.RES:Rescheduling_interrupts 20.25 ± 41% +4295.1% 890.00 ± 15% interrupts.CPU69.TLB:TLB_shootdowns 1217 ± 11% +1464.7% 19046 ± 14% interrupts.CPU7.CAL:Function_call_interrupts 208.50 ± 6% +2593.2% 5615 ± 29% interrupts.CPU7.NMI:Non-maskable_interrupts 208.50 ± 6% +2593.2% 5615 ± 29% interrupts.CPU7.PMI:Performance_monitoring_interrupts 1075 ± 19% -64.9% 377.00 ± 9% interrupts.CPU7.RES:Rescheduling_interrupts 7.75 ± 27% +10390.3% 813.00 ± 16% interrupts.CPU7.TLB:TLB_shootdowns 1022 ± 7% +1610.7% 17483 ± 8% interrupts.CPU70.CAL:Function_call_interrupts 199.25 ± 3% +3039.6% 6255 ± 16% interrupts.CPU70.NMI:Non-maskable_interrupts 199.25 ± 3% +3039.6% 6255 ± 16% interrupts.CPU70.PMI:Performance_monitoring_interrupts 1400 ± 10% -71.7% 396.75 ± 17% interrupts.CPU70.RES:Rescheduling_interrupts 9.75 ± 24% +8520.5% 840.50 ± 10% interrupts.CPU70.TLB:TLB_shootdowns 946.25 ± 2% +1795.8% 17939 ± 20% interrupts.CPU71.CAL:Function_call_interrupts 199.50 ± 8% +2880.2% 5945 ± 28% interrupts.CPU71.NMI:Non-maskable_interrupts 199.50 ± 8% +2880.2% 5945 ± 28% interrupts.CPU71.PMI:Performance_monitoring_interrupts 1114 ± 24% -68.6% 350.00 ± 22% interrupts.CPU71.RES:Rescheduling_interrupts 20.75 ±115% +3991.6% 849.00 ± 14% interrupts.CPU71.TLB:TLB_shootdowns 1275 ± 6% +1258.0% 17321 ± 5% interrupts.CPU72.CAL:Function_call_interrupts 217.50 ± 9% +2579.8% 5828 ± 19% interrupts.CPU72.NMI:Non-maskable_interrupts 217.50 ± 9% +2579.8% 5828 ± 19% interrupts.CPU72.PMI:Performance_monitoring_interrupts 989.25 ± 7% -62.1% 375.00 ± 17% interrupts.CPU72.RES:Rescheduling_interrupts 12.25 ± 40% +6334.7% 788.25 ± 18% interrupts.CPU72.TLB:TLB_shootdowns 947.00 ± 14% +1776.1% 17766 ± 12% interrupts.CPU73.CAL:Function_call_interrupts 210.00 ± 7% +2687.9% 5854 ± 21% interrupts.CPU73.NMI:Non-maskable_interrupts 210.00 ± 7% +2687.9% 5854 ± 21% interrupts.CPU73.PMI:Performance_monitoring_interrupts 972.75 ± 14% -61.3% 376.00 ± 18% interrupts.CPU73.RES:Rescheduling_interrupts 13.00 ± 47% +5917.3% 782.25 ± 13% interrupts.CPU73.TLB:TLB_shootdowns 1414 ± 15% +1142.3% 17569 ± 8% interrupts.CPU74.CAL:Function_call_interrupts 199.75 ± 3% +2971.5% 6135 ± 14% interrupts.CPU74.NMI:Non-maskable_interrupts 199.75 ± 3% +2971.5% 6135 ± 14% interrupts.CPU74.PMI:Performance_monitoring_interrupts 1032 ± 22% -64.1% 370.50 ± 12% interrupts.CPU74.RES:Rescheduling_interrupts 12.75 ± 15% +6227.5% 806.75 ± 10% interrupts.CPU74.TLB:TLB_shootdowns 1299 ± 9% +1348.1% 18810 ± 13% interrupts.CPU75.CAL:Function_call_interrupts 203.50 ± 3% +2811.8% 5925 ± 22% interrupts.CPU75.NMI:Non-maskable_interrupts 203.50 ± 3% +2811.8% 5925 ± 22% interrupts.CPU75.PMI:Performance_monitoring_interrupts 1076 ± 11% -65.2% 374.00 ± 15% interrupts.CPU75.RES:Rescheduling_interrupts 10.50 ± 39% +7202.4% 766.75 ± 14% interrupts.CPU75.TLB:TLB_shootdowns 1345 ± 17% +1239.1% 18014 ± 10% interrupts.CPU76.CAL:Function_call_interrupts 206.50 ± 7% +2614.3% 5605 ± 24% interrupts.CPU76.NMI:Non-maskable_interrupts 206.50 ± 7% +2614.3% 5605 ± 24% interrupts.CPU76.PMI:Performance_monitoring_interrupts 1611 ± 33% -77.8% 357.75 ± 6% interrupts.CPU76.RES:Rescheduling_interrupts 28.25 ± 59% +2906.2% 849.25 ± 6% interrupts.CPU76.TLB:TLB_shootdowns 1213 ± 13% +1514.4% 19595 ± 17% interrupts.CPU77.CAL:Function_call_interrupts 201.50 ± 4% +2808.8% 5861 ± 16% interrupts.CPU77.NMI:Non-maskable_interrupts 201.50 ± 4% +2808.8% 5861 ± 16% interrupts.CPU77.PMI:Performance_monitoring_interrupts 1088 ± 13% -67.2% 356.50 ± 21% interrupts.CPU77.RES:Rescheduling_interrupts 20.00 ± 82% +3843.8% 788.75 ± 21% interrupts.CPU77.TLB:TLB_shootdowns 1274 ± 15% +1467.5% 19973 ± 15% interrupts.CPU78.CAL:Function_call_interrupts 203.00 ± 6% +2826.2% 5940 ± 26% interrupts.CPU78.NMI:Non-maskable_interrupts 203.00 ± 6% +2826.2% 5940 ± 26% interrupts.CPU78.PMI:Performance_monitoring_interrupts 1368 ± 23% -72.7% 374.00 ± 12% interrupts.CPU78.RES:Rescheduling_interrupts 15.00 ± 35% +5416.7% 827.50 ± 8% interrupts.CPU78.TLB:TLB_shootdowns 1218 ± 10% +1509.9% 19608 ± 11% interrupts.CPU79.CAL:Function_call_interrupts 198.00 ± 3% +2778.9% 5700 ± 34% interrupts.CPU79.NMI:Non-maskable_interrupts 198.00 ± 3% +2778.9% 5700 ± 34% interrupts.CPU79.PMI:Performance_monitoring_interrupts 994.00 ± 53% -63.5% 362.50 ± 16% interrupts.CPU79.RES:Rescheduling_interrupts 12.50 ± 37% +5876.0% 747.00 ± 19% interrupts.CPU79.TLB:TLB_shootdowns 1216 ± 12% +1528.0% 19804 ± 9% interrupts.CPU8.CAL:Function_call_interrupts 204.25 ± 2% +2584.2% 5482 ± 23% interrupts.CPU8.NMI:Non-maskable_interrupts 204.25 ± 2% +2584.2% 5482 ± 23% interrupts.CPU8.PMI:Performance_monitoring_interrupts 908.00 ± 25% -57.7% 384.50 ± 15% interrupts.CPU8.RES:Rescheduling_interrupts 17.75 ± 98% +4738.0% 858.75 ± 7% interrupts.CPU8.TLB:TLB_shootdowns 1431 ± 5% +1096.4% 17127 ± 19% interrupts.CPU80.CAL:Function_call_interrupts 198.50 ± 3% +2388.4% 4939 ± 36% interrupts.CPU80.NMI:Non-maskable_interrupts 198.50 ± 3% +2388.4% 4939 ± 36% interrupts.CPU80.PMI:Performance_monitoring_interrupts 990.75 ± 20% -62.3% 373.25 ± 17% interrupts.CPU80.RES:Rescheduling_interrupts 15.00 ± 12% +4636.7% 710.50 ± 9% interrupts.CPU80.TLB:TLB_shootdowns 1297 ± 6% +1303.6% 18211 ± 13% interrupts.CPU81.CAL:Function_call_interrupts 199.75 ± 3% +2650.4% 5494 ± 30% interrupts.CPU81.NMI:Non-maskable_interrupts 199.75 ± 3% +2650.4% 5494 ± 30% interrupts.CPU81.PMI:Performance_monitoring_interrupts 1206 ± 21% -67.1% 397.00 ± 15% interrupts.CPU81.RES:Rescheduling_interrupts 9.00 ± 45% +9580.6% 871.25 ± 10% interrupts.CPU81.TLB:TLB_shootdowns 1290 ± 16% +1374.2% 19024 ± 17% interrupts.CPU82.CAL:Function_call_interrupts 213.75 ± 16% +2576.6% 5721 ± 24% interrupts.CPU82.NMI:Non-maskable_interrupts 213.75 ± 16% +2576.6% 5721 ± 24% interrupts.CPU82.PMI:Performance_monitoring_interrupts 1347 ± 19% -73.0% 363.75 ± 19% interrupts.CPU82.RES:Rescheduling_interrupts 16.50 ± 17% +4842.4% 815.50 ± 13% interrupts.CPU82.TLB:TLB_shootdowns 1438 ± 49% +1202.3% 18734 ± 11% interrupts.CPU83.CAL:Function_call_interrupts 202.00 ± 2% +3182.2% 6630 ± 27% interrupts.CPU83.NMI:Non-maskable_interrupts 202.00 ± 2% +3182.2% 6630 ± 27% interrupts.CPU83.PMI:Performance_monitoring_interrupts 972.00 ± 34% -56.0% 427.50 ± 28% interrupts.CPU83.RES:Rescheduling_interrupts 10.25 ± 4% +8290.2% 860.00 ± 9% interrupts.CPU83.TLB:TLB_shootdowns 1247 ± 8% +1491.5% 19857 ± 3% interrupts.CPU84.CAL:Function_call_interrupts 204.25 ± 6% +2474.4% 5258 ± 20% interrupts.CPU84.NMI:Non-maskable_interrupts 204.25 ± 6% +2474.4% 5258 ± 20% interrupts.CPU84.PMI:Performance_monitoring_interrupts 1083 ± 20% -64.8% 381.00 ± 11% interrupts.CPU84.RES:Rescheduling_interrupts 28.75 ± 70% +2530.4% 756.25 ± 8% interrupts.CPU84.TLB:TLB_shootdowns 1190 ± 9% +1535.3% 19468 ± 10% interrupts.CPU85.CAL:Function_call_interrupts 204.25 ± 5% +2661.3% 5640 ± 21% interrupts.CPU85.NMI:Non-maskable_interrupts 204.25 ± 5% +2661.3% 5640 ± 21% interrupts.CPU85.PMI:Performance_monitoring_interrupts 879.50 ± 5% -56.1% 386.25 ± 11% interrupts.CPU85.RES:Rescheduling_interrupts 11.75 ± 38% +7053.2% 840.50 ± 10% interrupts.CPU85.TLB:TLB_shootdowns 1306 ± 11% +1246.6% 17593 ± 11% interrupts.CPU86.CAL:Function_call_interrupts 205.50 ± 6% +2968.5% 6305 ± 20% interrupts.CPU86.NMI:Non-maskable_interrupts 205.50 ± 6% +2968.5% 6305 ± 20% interrupts.CPU86.PMI:Performance_monitoring_interrupts 1465 ± 22% -72.2% 406.75 ± 14% interrupts.CPU86.RES:Rescheduling_interrupts 21.00 ± 22% +3439.3% 743.25 ± 14% interrupts.CPU86.TLB:TLB_shootdowns 1271 ± 16% +1446.3% 19653 ± 14% interrupts.CPU87.CAL:Function_call_interrupts 170.00 ± 21% +3408.2% 5964 ± 28% interrupts.CPU87.NMI:Non-maskable_interrupts 170.00 ± 21% +3408.2% 5964 ± 28% interrupts.CPU87.PMI:Performance_monitoring_interrupts 1211 ± 33% -66.4% 407.00 ± 15% interrupts.CPU87.RES:Rescheduling_interrupts 36.75 ± 66% +2429.3% 929.50 ± 15% interrupts.CPU87.TLB:TLB_shootdowns 1240 ± 8% +1407.9% 18705 ± 8% interrupts.CPU88.CAL:Function_call_interrupts 171.25 ± 22% +2680.7% 4762 ± 26% interrupts.CPU88.NMI:Non-maskable_interrupts 171.25 ± 22% +2680.7% 4762 ± 26% interrupts.CPU88.PMI:Performance_monitoring_interrupts 1250 ± 19% -71.0% 363.00 ± 13% interrupts.CPU88.RES:Rescheduling_interrupts 19.00 ± 59% +4122.4% 802.25 ± 18% interrupts.CPU88.TLB:TLB_shootdowns 1401 ± 39% +1330.7% 20051 ± 20% interrupts.CPU89.CAL:Function_call_interrupts 174.50 ± 19% +2893.8% 5224 ± 34% interrupts.CPU89.NMI:Non-maskable_interrupts 174.50 ± 19% +2893.8% 5224 ± 34% interrupts.CPU89.PMI:Performance_monitoring_interrupts 1102 ± 28% -63.8% 399.50 ± 18% interrupts.CPU89.RES:Rescheduling_interrupts 14.50 ± 44% +6006.9% 885.50 ± 10% interrupts.CPU89.TLB:TLB_shootdowns 1137 ± 6% +1300.8% 15931 ± 9% interrupts.CPU9.CAL:Function_call_interrupts 209.25 +2083.9% 4569 ± 34% interrupts.CPU9.NMI:Non-maskable_interrupts 209.25 +2083.9% 4569 ± 34% interrupts.CPU9.PMI:Performance_monitoring_interrupts 868.25 ± 9% -64.5% 308.25 ± 22% interrupts.CPU9.RES:Rescheduling_interrupts 16.25 ± 99% +3958.5% 659.50 ± 12% interrupts.CPU9.TLB:TLB_shootdowns 1735 ± 24% +1116.8% 21117 ± 12% interrupts.CPU90.CAL:Function_call_interrupts 172.25 ± 22% +3146.7% 5592 ± 22% interrupts.CPU90.NMI:Non-maskable_interrupts 172.25 ± 22% +3146.7% 5592 ± 22% interrupts.CPU90.PMI:Performance_monitoring_interrupts 11.00 ± 51% +7452.3% 830.75 ± 12% interrupts.CPU90.TLB:TLB_shootdowns 1216 ± 9% +1593.4% 20592 ± 9% interrupts.CPU91.CAL:Function_call_interrupts 171.50 ± 24% +2807.9% 4987 ± 37% interrupts.CPU91.NMI:Non-maskable_interrupts 171.50 ± 24% +2807.9% 4987 ± 37% interrupts.CPU91.PMI:Performance_monitoring_interrupts 10.00 ± 33% +9285.0% 938.50 ± 3% interrupts.CPU91.TLB:TLB_shootdowns 1601 ± 31% +1199.7% 20807 ± 5% interrupts.CPU92.CAL:Function_call_interrupts 176.25 ± 22% +2839.7% 5181 ± 26% interrupts.CPU92.NMI:Non-maskable_interrupts 176.25 ± 22% +2839.7% 5181 ± 26% interrupts.CPU92.PMI:Performance_monitoring_interrupts 980.00 ± 29% -53.0% 461.00 ± 16% interrupts.CPU92.RES:Rescheduling_interrupts 27.50 ± 89% +3560.9% 1006 ± 10% interrupts.CPU92.TLB:TLB_shootdowns 1250 ± 11% +1394.2% 18678 ± 11% interrupts.CPU93.CAL:Function_call_interrupts 173.00 ± 23% +3162.4% 5644 ± 41% interrupts.CPU93.NMI:Non-maskable_interrupts 173.00 ± 23% +3162.4% 5644 ± 41% interrupts.CPU93.PMI:Performance_monitoring_interrupts 860.00 ± 44% -54.3% 393.00 ± 7% interrupts.CPU93.RES:Rescheduling_interrupts 5.25 ± 47% +14252.4% 753.50 ± 16% interrupts.CPU93.TLB:TLB_shootdowns 1246 ± 10% +1684.5% 22235 ± 11% interrupts.CPU94.CAL:Function_call_interrupts 171.25 ± 22% +2938.8% 5204 ± 34% interrupts.CPU94.NMI:Non-maskable_interrupts 171.25 ± 22% +2938.8% 5204 ± 34% interrupts.CPU94.PMI:Performance_monitoring_interrupts 1248 ± 28% -65.6% 429.50 ± 11% interrupts.CPU94.RES:Rescheduling_interrupts 15.50 ± 18% +6246.8% 983.75 ± 7% interrupts.CPU94.TLB:TLB_shootdowns 1366 ± 11% +1942.5% 27906 ± 11% interrupts.CPU95.CAL:Function_call_interrupts 178.50 ± 21% +3917.6% 7171 ± 24% interrupts.CPU95.NMI:Non-maskable_interrupts 178.50 ± 21% +3917.6% 7171 ± 24% interrupts.CPU95.PMI:Performance_monitoring_interrupts 1552 ± 14% -65.5% 535.75 ± 12% interrupts.CPU95.RES:Rescheduling_interrupts 24.75 ± 11% +4877.8% 1232 ± 4% interrupts.CPU95.TLB:TLB_shootdowns 1383 ± 18% +1511.1% 22285 ± 7% interrupts.CPU96.CAL:Function_call_interrupts 189.75 ± 24% +2856.4% 5609 ± 22% interrupts.CPU96.NMI:Non-maskable_interrupts 189.75 ± 24% +2856.4% 5609 ± 22% interrupts.CPU96.PMI:Performance_monitoring_interrupts 2279 ± 13% -80.7% 439.25 ± 13% interrupts.CPU96.RES:Rescheduling_interrupts 18.25 ± 19% +5732.9% 1064 ± 8% interrupts.CPU96.TLB:TLB_shootdowns 1344 ± 21% +988.4% 14633 ± 11% interrupts.CPU97.CAL:Function_call_interrupts 175.25 ± 24% +2505.1% 4565 ± 24% interrupts.CPU97.NMI:Non-maskable_interrupts 175.25 ± 24% +2505.1% 4565 ± 24% interrupts.CPU97.PMI:Performance_monitoring_interrupts 1252 ± 35% -75.2% 311.25 ± 7% interrupts.CPU97.RES:Rescheduling_interrupts 23.25 ±106% +2841.9% 684.00 ± 11% interrupts.CPU97.TLB:TLB_shootdowns 1460 ± 19% +897.0% 14556 ± 16% interrupts.CPU98.CAL:Function_call_interrupts 208.00 ± 5% +2507.9% 5424 ± 33% interrupts.CPU98.NMI:Non-maskable_interrupts 208.00 ± 5% +2507.9% 5424 ± 33% interrupts.CPU98.PMI:Performance_monitoring_interrupts 1478 ± 21% -80.3% 291.25 ± 24% interrupts.CPU98.RES:Rescheduling_interrupts 14.00 ± 44% +4632.1% 662.50 ± 24% interrupts.CPU98.TLB:TLB_shootdowns 1310 ± 32% +1008.5% 14523 ± 11% interrupts.CPU99.CAL:Function_call_interrupts 203.00 ± 3% +2390.0% 5054 ± 28% interrupts.CPU99.NMI:Non-maskable_interrupts 203.00 ± 3% +2390.0% 5054 ± 28% interrupts.CPU99.PMI:Performance_monitoring_interrupts 1333 ± 13% -77.4% 300.75 ± 17% interrupts.CPU99.RES:Rescheduling_interrupts 15.25 ± 37% +4483.6% 699.00 ± 12% interrupts.CPU99.TLB:TLB_shootdowns 3.25 ± 13% +6584.6% 217.25 ± 8% interrupts.IWI:IRQ_work_interrupts 35365 ± 2% +2967.1% 1084710 ± 7% interrupts.NMI:Non-maskable_interrupts 35365 ± 2% +2967.1% 1084710 ± 7% interrupts.PMI:Performance_monitoring_interrupts 237203 ± 2% -72.7% 64704 ± 12% interrupts.RES:Rescheduling_interrupts 3697 ± 12% +3721.5% 141290 interrupts.TLB:TLB_shootdowns *************************************************************************************************** lkp-csl-2sp5: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory ========================================================================================= class/compiler/cpufreq_governor/disk/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode: interrupt/gcc-9/performance/1HDD/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp5/stress-ng/30s/0x5002f01 commit: 5925fa68fe (" perf tools fixes for v5.9: 3rd batch") 5ef64cc898 ("mm: allow a controlled amount of unfairness in the page lock") 5925fa68fe824465 5ef64cc8987a9211d3f3667331b ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 50% 2:4 kmsg.BTRFS_error(device_sda5):bdev/dev/sda5_errs:wr#,rd#,flush#,corrupt#,gen %stddev %change %stddev \ | \ 1543392 ± 2% -62.7% 575755 ± 90% stress-ng.sigchld.ops 51445 ± 2% -62.7% 19191 ± 90% stress-ng.sigchld.ops_per_sec 2.397e+08 ± 46% -90.9% 21848257 ± 2% stress-ng.sigrt.ops 7970038 ± 46% -90.9% 727138 ± 2% stress-ng.sigrt.ops_per_sec 6635 +3.0% 6831 stress-ng.time.percent_of_cpu_this_job_got 42339 +4.7% 44340 stress-ng.time.system_time 4468 ± 2% -15.0% 3800 ± 7% stress-ng.time.user_time 1.629e+09 -3.2% 1.576e+09 ± 2% stress-ng.timerfd.ops 54286374 -3.2% 52528279 ± 2% stress-ng.timerfd.ops_per_sec 0.75 ±173% +33333.3% 250.75 ±149% interrupts.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68 0.75 ±173% +33266.7% 250.25 ±150% interrupts.CPU68.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68 15.59 ± 2% -1.8 13.80 ± 3% mpstat.cpu.all.idle% 3.17 ± 4% -0.7 2.48 ± 13% mpstat.cpu.all.iowait% 46863 ± 29% -21.0% 37005 ± 30% proc-vmstat.nr_kernel_stack 6181473 ± 3% -60.5% 2442698 ± 88% proc-vmstat.pgreuse 6.755e+08 ± 8% -27.7% 4.883e+08 ± 16% cpuidle.C1.time 1.461e+08 ± 42% -50.0% 73023084 ± 7% cpuidle.POLL.time 12133129 ± 45% -87.8% 1477722 ± 8% cpuidle.POLL.usage 15.92 ± 2% -11.7% 14.06 ± 3% iostat.cpu.idle 3.18 ± 4% -22.0% 2.48 ± 12% iostat.cpu.iowait 76.37 +3.6% 79.12 iostat.cpu.system 15.25 ± 2% -11.5% 13.50 ± 3% vmstat.cpu.id 76.25 +3.0% 78.50 vmstat.cpu.sy 129.50 ± 59% -96.9% 4.00 ± 25% vmstat.procs.b 77813 ± 2% -10.5% 69667 ± 7% softirqs.CPU25.SCHED 81392 ± 7% -15.5% 68815 ± 8% softirqs.CPU41.SCHED 78946 ± 2% -10.3% 70795 ± 6% softirqs.CPU76.SCHED 78599 ± 2% -12.4% 68835 ± 8% softirqs.CPU77.SCHED 81487 ± 6% -14.0% 70042 ± 9% softirqs.CPU83.SCHED 67827 ± 16% -31.1% 46745 ± 2% slabinfo.Acpi-State.active_objs 1370 ± 17% -32.8% 920.25 ± 2% slabinfo.Acpi-State.active_slabs 69916 ± 17% -32.8% 46969 ± 2% slabinfo.Acpi-State.num_objs 1370 ± 17% -32.8% 920.25 ± 2% slabinfo.Acpi-State.num_slabs 810.00 ± 6% +17.8% 954.00 ± 3% slabinfo.kmem_cache_node.active_objs 847.50 ± 6% +17.0% 991.50 ± 3% slabinfo.kmem_cache_node.num_objs 5228 -16.6% 4359 ± 9% slabinfo.sighand_cache.active_objs 5314 -15.0% 4516 ± 8% slabinfo.sighand_cache.num_objs 50134 ± 42% -70.9% 14578 ± 46% sched_debug.cfs_rq:/.MIN_vruntime.avg 2621056 ± 41% -46.6% 1399499 ± 46% sched_debug.cfs_rq:/.MIN_vruntime.max 345309 ± 38% -58.9% 142092 ± 46% sched_debug.cfs_rq:/.MIN_vruntime.stddev 50134 ± 42% -70.9% 14578 ± 46% sched_debug.cfs_rq:/.max_vruntime.avg 2621056 ± 41% -46.6% 1399499 ± 46% sched_debug.cfs_rq:/.max_vruntime.max 345309 ± 38% -58.9% 142092 ± 46% sched_debug.cfs_rq:/.max_vruntime.stddev 139637 ± 19% +35.2% 188810 ± 14% sched_debug.cpu.avg_idle.min 5696 ± 33% -57.4% 2425 ± 58% sched_debug.cpu.max_idle_balance_cost.stddev 575.75 -83.2% 96.71 ± 16% sched_debug.cpu.nr_uninterruptible.max -567.52 -73.4% -150.73 sched_debug.cpu.nr_uninterruptible.min 304.20 ± 8% -88.5% 35.11 ± 18% sched_debug.cpu.nr_uninterruptible.stddev 286124 ± 3% -13.0% 248853 ± 9% sched_debug.cpu.sched_goidle.avg 250037 ± 2% -14.0% 214914 ± 8% sched_debug.cpu.sched_goidle.min 1.051e+08 -6.7% 98127607 ± 4% perf-stat.i.branch-misses 63185666 ± 7% -16.5% 52728923 ± 15% perf-stat.i.cache-misses 2.133e+11 +3.0% 2.196e+11 perf-stat.i.cpu-cycles 5687177 ± 2% -5.4% 5377921 ± 3% perf-stat.i.dTLB-store-misses 8.732e+09 -4.0% 8.379e+09 perf-stat.i.dTLB-stores 73450472 -4.3% 70273743 perf-stat.i.iTLB-load-misses 0.26 -5.7% 0.25 ± 2% perf-stat.i.ipc 2.21 +3.0% 2.28 perf-stat.i.metric.GHz 532333 -9.8% 480107 ± 6% perf-stat.i.page-faults 5.10 ± 4% -13.4% 4.42 ± 11% perf-stat.overall.MPKI 0.94 -0.0 0.92 perf-stat.overall.branch-miss-rate% 70.77 -6.0 64.73 ± 4% perf-stat.overall.node-load-miss-rate% 83.74 -1.1 82.62 perf-stat.overall.node-store-miss-rate% 1.018e+08 -6.6% 95063940 ± 4% perf-stat.ps.branch-misses 71426753 ± 6% -13.6% 61704660 ± 12% perf-stat.ps.cache-misses 2.156e+11 +2.8% 2.216e+11 perf-stat.ps.cpu-cycles 8.315e+09 -4.1% 7.972e+09 ± 2% perf-stat.ps.dTLB-stores 69988088 -4.5% 66854914 perf-stat.ps.iTLB-load-misses Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

4 months, 3 weeks

3
2
0 / 0

[kunit] c89d849f69: UBSAN:invalid-load_in_lib/kunit/test.c

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: c89d849f6934c3f3e65a77dfa9734164218a166e ("[PATCH 1/2] kunit: Support for Parameterized Testing") url: https://github.com/0day-ci/linux/commits/Arpitha-Raghunandan/kunit-Suppor... base: https://git.kernel.org/cgit/linux/kernel/git/tytso/ext4.git dev in testcase: trinity version: trinity-i386-4d2343bd-1_20200320 with following parameters: runtime: 300s test-description: Trinity is a linux system call fuzz tester. test-url: http://codemonkey.org.uk/projects/trinity/ on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +----------------------------------------+------------+------------+ | | 9cb3701fb5 | c89d849f69 | +----------------------------------------+------------+------------+ | boot_successes | 8 | 0 | | boot_failures | 0 | 6 | | UBSAN:invalid-load_in_lib/kunit/test.c | 0 | 6 | +----------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 86.984701] UBSAN: invalid-load in lib/kunit/test.c:277:11 [ 86.986363] load of value 41 is not a valid value for type '_Bool' [ 86.987708] CPU: 0 PID: 289 Comm: kunit_try_catch Not tainted 5.9.0-rc7-00035-gc89d849f6934c #1 [ 86.989652] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 86.991492] Call Trace: [ 86.992176] dump_stack+0x6d/0x99 [ 86.992984] ubsan_epilogue+0x8/0x3e [ 86.993880] __ubsan_handle_load_invalid_value.cold+0x42/0x47 [ 86.995137] ? _raw_spin_unlock_irqrestore+0x3d/0x40 [ 86.996245] ? lockdep_hardirqs_on_prepare+0xfc/0x1b0 [ 86.997386] kunit_try_run_case.cold+0x10/0x25 [ 86.998432] kunit_generic_run_threadfn_adapter+0xc/0x20 [ 86.999629] kthread+0x107/0x120 [ 87.000457] ? kunit_try_catch_throw+0x20/0x20 [ 87.002254] ? kthread_stop+0x290/0x290 [ 87.003108] ret_from_fork+0x19/0x24 [ 87.003952] ================================================================================ [ 103.329893] ok 1 - inode_test_xtimestamp_decoding [ 103.329897] ok 1 - ext4_inode_test [ 103.339337] Btrfs loaded, crc32c=crc32c-intel, integrity-checker=on, ref-verify=on [ 103.341469] # Subtest: apparmor_policy_unpack [ 103.341471] 1..30 [ 103.343065] ok 1 - policy_unpack_test_inbounds_when_inbounds [ 103.343855] ok 2 - policy_unpack_test_inbounds_when_out_of_bounds [ 103.345393] ok 3 - policy_unpack_test_unpack_array_with_null_name [ 103.347053] ok 4 - policy_unpack_test_unpack_array_with_name [ 103.348677] ok 5 - policy_unpack_test_unpack_array_out_of_bounds [ 103.350201] ok 6 - policy_unpack_test_unpack_blob_with_null_name [ 103.351867] ok 7 - policy_unpack_test_unpack_blob_with_name [ 103.353558] ok 8 - policy_unpack_test_unpack_blob_out_of_bounds [ 103.355165] ok 9 - policy_unpack_test_unpack_nameX_with_null_name [ 103.356794] ok 10 - policy_unpack_test_unpack_nameX_with_wrong_code [ 103.358646] ok 11 - policy_unpack_test_unpack_nameX_with_name [ 103.360375] ok 12 - policy_unpack_test_unpack_nameX_with_wrong_name [ 103.361921] ok 13 - policy_unpack_test_unpack_str_with_null_name [ 103.365212] ok 14 - policy_unpack_test_unpack_str_with_name [ 103.370046] ok 15 - policy_unpack_test_unpack_str_out_of_bounds [ 103.371617] ok 16 - policy_unpack_test_unpack_strdup_with_null_name [ 103.373347] ok 17 - policy_unpack_test_unpack_strdup_with_name [ 103.375023] ok 18 - policy_unpack_test_unpack_strdup_out_of_bounds [ 103.376544] ok 19 - policy_unpack_test_unpack_u16_chunk_basic [ 103.378152] ok 20 - policy_unpack_test_unpack_u16_chunk_out_of_bounds_1 [ 103.379736] ok 21 - policy_unpack_test_unpack_u16_chunk_out_of_bounds_2 [ 103.381438] ok 22 - policy_unpack_test_unpack_u32_with_null_name [ 103.388133] ok 23 - policy_unpack_test_unpack_u32_with_name [ 103.389767] ok 24 - policy_unpack_test_unpack_u32_out_of_bounds [ 103.391356] ok 25 - policy_unpack_test_unpack_u64_with_null_name [ 103.393195] ok 26 - policy_unpack_test_unpack_u64_with_name [ 103.394780] ok 27 - policy_unpack_test_unpack_u64_out_of_bounds [ 103.396308] ok 28 - policy_unpack_test_unpack_X_code_match [ 103.397961] ok 29 - policy_unpack_test_unpack_X_code_mismatch [ 103.399374] ok 30 - policy_unpack_test_unpack_X_out_of_bounds [ 103.400753] ok 2 - apparmor_policy_unpack [ 103.403320] AppArmor: AppArmor sha1 policy hashing enabled [ 103.410418] ima: No TPM chip found, activating TPM-bypass! [ 103.411805] ima: Allocated hash algorithm: sha256 [ 103.413187] ima: No architecture policies found [ 103.416171] # Subtest: kunit-try-catch-test [ 103.416175] 1..2 [ 105.412314] rcu-torture: rcu_torture_read_exit: Start of episode [ 105.458748] rcu-torture: rcu_torture_read_exit: End of episode [ 106.171539] kunit_try_catch (9479) used greatest stack depth: 6392 bytes left [ 112.831599] kunit_try_catch (26158) used greatest stack depth: 6368 bytes left [ 119.013165] rcu-torture: rcu_torture_read_exit: Start of episode [ 119.244274] rcu-torture: rcu_torture_read_exit: End of episode [ 132.852213] rcu-torture: rcu_torture_read_exit: Start of episode [ 135.816147] rcu-torture: rcu_torture_read_exit: End of episode [ 140.942223] rcu-torture: rtc: (ptrval) ver: 1070 tfle: 0 rta: 1071 rtaf: 0 rtf: 1061 rtmbe: 0 rtbe: 0 rtbke: 0 rtbre: 0 rtbf: 0 rtb: 0 nt: 4157 onoff: 0/0:0/0 -1,0:-1,0 0:0 (HZ=100) barrier: 0/0:0 read-exits: 135 [ 140.946168] rcu-torture: Reader Pipe: 9171121 50 0 0 0 0 0 0 0 0 0 [ 140.947629] rcu-torture: Reader Batch: 9170828 343 0 0 0 0 0 0 0 0 0 [ 140.949106] rcu-torture: Free-Block Circulation: 1070 1069 1068 1067 1066 1065 1064 1063 1062 1061 0 [ 149.412890] rcu-torture: rcu_torture_read_exit: Start of episode [ 149.579098] rcu-torture: rcu_torture_read_exit: End of episode [ 163.172214] rcu-torture: rcu_torture_read_exit: Start of episode [ 163.194427] rcu-torture: rcu_torture_read_exit: End of episode [ 176.782188] rcu-torture: rcu_torture_read_exit: Start of episode [ 176.818242] rcu-torture: rcu_torture_read_exit: End of episode [ 180.452640] rcu_torture_fwd_prog_nr: Duration 10026 cver 1689 gps 4385 [ 190.532908] rcu-torture: rcu_torture_read_exit: Start of episode [ 190.544968] rcu-torture: rcu_torture_read_exit: End of episode [ 202.383687] rcu-torture: rtc: (ptrval) ver: 2405 tfle: 0 rta: 2405 rtaf: 0 rtf: 2393 rtmbe: 0 rtbe: 0 rtbke: 0 rtbre: 0 rtbf: 0 rtb: 0 nt: 6439 onoff: 0/0:0/0 -1,0:-1,0 0:0 (HZ=100) barrier: 0/0:0 read-exits: 203 [ 202.387918] rcu-torture: Reader Pipe: 14079393 218 0 0 0 0 0 0 0 0 0 [ 202.389371] rcu-torture: Reader Batch: 14078475 1136 0 0 0 0 0 0 0 0 0 [ 202.390876] rcu-torture: Free-Block Circulation: 2404 2404 2403 2402 2401 2399 2398 2397 2394 2393 0 [ 204.212351] rcu-torture: rcu_torture_read_exit: Start of episode [ 204.231090] rcu-torture: rcu_torture_read_exit: End of episode [ 219.206128] rcu-torture: rcu_torture_read_exit: Start of episode [ 219.357586] rcu-torture: rcu_torture_read_exit: End of episode [ 233.254429] rcu-torture: rcu_torture_read_exit: Start of episode [ 233.446637] rcu-torture: rcu_torture_read_exit: End of episode [ 247.252348] rcu-torture: rcu_torture_read_exit: Start of episode [ 248.612429] rcu-torture: rcu_torture_read_exit: End of episode [ 262.212257] rcu-torture: rcu_torture_read_exit: Start of episode [ 262.238186] rcu-torture: rcu_torture_read_exit: End of episode [ 263.820785] rcu-torture: rtc: (ptrval) ver: 3552 tfle: 0 rta: 3553 rtaf: 0 rtf: 3539 rtmbe: 0 rtbe: 0 rtbke: 0 rtbre: 0 rtbf: 0 rtb: 0 nt: 8461 onoff: 0/0:0/0 -1,0:-1,0 0:0 (HZ=100) barrier: 0/0:0 read-exits: 288 [ 263.841057] rcu-torture: Reader Pipe: 18852184 371 0 0 0 0 0 0 0 0 0 [ 263.842544] rcu-torture: Reader Batch: 18850453 2102 0 0 0 0 0 0 0 0 0 [ 263.844013] rcu-torture: Free-Block Circulation: 3552 3552 3551 3549 3547 3546 3545 3543 3541 3540 0 [ 275.820884] rcu-torture: rcu_torture_read_exit: Start of episode [ 276.012299] rcu-torture: rcu_torture_read_exit: End of episode [ 289.572388] rcu-torture: rcu_torture_read_exit: Start of episode To reproduce: # build kernel cd linux cp config-5.9.0-rc7-00035-gc89d849f6934c .config make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, lkp

4 months, 3 weeks

1
0
0 / 0

[io_uring] b166b25674: BUG:KASAN:null-ptr-deref_in_i

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: b166b25674b991268afbe1bcbfee7d1eadf1203d ("io_uring: Fix XArray usage in io_uring_add_task_file") url: https://github.com/0day-ci/linux/commits/Matthew-Wilcox-Oracle/io_uring-F... in testcase: trinity version: trinity-static-x86_64-x86_64-f93256fb_2019-08-28 with following parameters: runtime: 300s test-description: Trinity is a linux system call fuzz tester. test-url: http://codemonkey.org.uk/projects/trinity/ on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +---------------------------------------------+------------+------------+ | | 0fcb19f37b | b166b25674 | +---------------------------------------------+------------+------------+ | boot_successes | 4 | 0 | | boot_failures | 0 | 4 | | BUG:KASAN:null-ptr-deref_in_i | 0 | 4 | | BUG:kernel_NULL_pointer_dereference,address | 0 | 4 | | Oops:#[##] | 0 | 4 | | RIP:io_uring_add_task_file | 0 | 4 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 4 | +---------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 62.517646] BUG: KASAN: null-ptr-deref in io_uring_add_task_file+0x4c/0xe0 [ 62.519048] Read of size 8 at addr 00000000000000b0 by task trinity-c1/829 [ 62.523951] [ 62.524242] CPU: 1 PID: 829 Comm: trinity-c1 Not tainted 5.9.0-rc8-next-20201009-00002-gb166b25674b9 #2 [ 62.526099] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 62.527815] Call Trace: [ 62.528308] dump_stack+0xd1/0x119 [ 62.529059] ? io_uring_add_task_file+0x4c/0xe0 [ 62.529957] ? io_uring_add_task_file+0x4c/0xe0 [ 62.530314] random: get_random_u64 called from arch_pick_mmap_layout+0xb6/0x280 with crng_init=1 [ 62.530331] random: get_random_u64 called from arch_pick_mmap_layout+0x1d4/0x280 with crng_init=1 [ 62.534194] kasan_report.cold+0x5/0x37 [ 62.535041] ? io_uring_add_task_file+0x4c/0xe0 [ 62.535996] io_uring_add_task_file+0x4c/0xe0 [ 62.536869] io_uring_create+0xa0c/0xc60 [ 62.537703] io_uring_setup+0xb6/0x120 [ 62.538429] ? io_uring_create+0xc60/0xc60 [ 62.539309] ? syscall_enter_from_user_mode+0x74/0xc0 [ 62.540382] ? trace_hardirqs_on+0x48/0x120 [ 62.541262] do_syscall_64+0x34/0x50 [ 62.542051] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 62.543035] RIP: 0033:0x453b29 [ 62.543562] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 3b 84 00 00 c3 66 2e 0f 1f 84 00 00 00 00 [ 62.547371] RSP: 002b:00007ffc0a17d778 EFLAGS: 00000246 ORIG_RAX: 00000000000001a9 [ 62.565017] RAX: ffffffffffffffda RBX: 00000000000001a9 RCX: 0000000000453b29 [ 62.566269] RDX: 00000000000000e7 RSI: 00007f36ac820000 RDI: 00000000000000cf [ 62.567534] RBP: 00007ffc0a17d820 R08: 00000000c00000ce R09: 00000000000000bb [ 62.568803] R10: 000000000000ff93 R11: 0000000000000246 R12: 0000000000000002 [ 62.570093] R13: 00007f36acb4e058 R14: 0000000001afd830 R15: 00007f36acb4e000 [ 62.571485] ================================================================== [ 62.572888] Disabling lock debugging due to kernel taint [ 62.574137] BUG: kernel NULL pointer dereference, address: 00000000000000b0 [ 62.575657] #PF: supervisor read access in kernel mode [ 62.576757] #PF: error_code(0x0000) - not-present page [ 62.577826] PGD 8000000125f81067 P4D 8000000125f81067 PUD 10c4f8067 PMD 0 [ 62.579272] Oops: 0000 [#1] SMP KASAN PTI [ 62.590855] CPU: 1 PID: 829 Comm: trinity-c1 Tainted: G B 5.9.0-rc8-next-20201009-00002-gb166b25674b9 #2 [ 62.592683] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 62.594078] RIP: 0010:io_uring_add_task_file+0x4c/0xe0 [ 62.594962] Code: e8 69 70 f1 ff 49 8b ac 24 e8 05 00 00 48 85 ed 0f 84 89 00 00 00 e8 13 4b d1 ff 4c 8d a5 b0 00 00 00 4c 89 e7 e8 44 70 f1 ff <48> 39 9d b0 00 00 00 74 29 e8 f6 4a d1 ff 48 89 de 48 89 ef e8 ab [ 62.597942] RSP: 0018:ffff8881180b7db0 EFLAGS: 00010282 [ 62.598810] RAX: 0000000000000001 RBX: ffff88811bb9c7c0 RCX: ffffffff81192dd3 [ 62.600042] RDX: 0000000000000000 RSI: ffffffff8127c238 RDI: ffffffff823657c9 [ 62.601200] RBP: 0000000000000000 R08: ffffffff81192dc4 R09: fffffbfff0722d8d [ 62.602476] R10: ffffffff83916c63 R11: fffffbfff0722d8c R12: 00000000000000b0 [ 62.603680] R13: ffff8881180b7e6c R14: ffff8881268b8aa8 R15: ffff88811bb9c7c0 [ 62.604885] FS: 0000000001afd880(0000) GS:ffff8881f7200000(0000) knlGS:0000000000000000 [ 62.609926] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 62.611890] CR2: 00000000000000b0 CR3: 000000010d07e000 CR4: 00000000000406a0 [ 62.614187] DR0: 00007f36ac420000 DR1: 0000000000000000 DR2: 0000000000000000 [ 62.616402] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600 [ 62.617646] Call Trace: [ 62.618083] io_uring_create+0xa0c/0xc60 [ 62.618744] io_uring_setup+0xb6/0x120 [ 62.630890] ? io_uring_create+0xc60/0xc60 [ 62.633250] ? syscall_enter_from_user_mode+0x74/0xc0 [ 62.635172] ? trace_hardirqs_on+0x48/0x120 [ 62.644116] do_syscall_64+0x34/0x50 [ 62.644736] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 62.645564] RIP: 0033:0x453b29 [ 62.646478] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 3b 84 00 00 c3 66 2e 0f 1f 84 00 00 00 00 [ 62.658096] RSP: 002b:00007ffc0a17d778 EFLAGS: 00000246 ORIG_RAX: 00000000000001a9 [ 62.659354] RAX: ffffffffffffffda RBX: 00000000000001a9 RCX: 0000000000453b29 [ 62.660754] RDX: 00000000000000e7 RSI: 00007f36ac820000 RDI: 00000000000000cf [ 62.661911] RBP: 00007ffc0a17d820 R08: 00000000c00000ce R09: 00000000000000bb [ 62.663066] R10: 000000000000ff93 R11: 0000000000000246 R12: 0000000000000002 [ 62.664242] R13: 00007f36acb4e058 R14: 0000000001afd830 R15: 00007f36acb4e000 [ 62.665397] Modules linked in: input_leds led_class parport_pc qemu_fw_cfg [ 62.666562] CR2: 00000000000000b0 [ 62.667344] ---[ end trace b0d4015dae9c12ae ]--- To reproduce: # build kernel cd linux cp config-5.9.0-rc8-next-20201009-00002-gb166b25674b9 .config make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, lkp

4 months, 4 weeks

2
1
0 / 0

[drm/amdkfd] b7b6c38529: BUG:KASAN:slab-out-of-bounds_in_k

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: b7b6c38529c9ea8ebab287d84f27fca2472a5737 ("drm/amdkfd: Calculate CPU VCRAT size dynamically (v2)") git://people.freedesktop.org/~agd5f/linux.git drm-fixes-5.10 in testcase: boot on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-----------------------------------+------------+------------+ | | c7651b7358 | b7b6c38529 | +-----------------------------------+------------+------------+ | boot_successes | 12 | 0 | | boot_failures | 0 | 8 | | BUG:KASAN:slab-out-of-bounds_in_k | 0 | 8 | +-----------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 12.814960] BUG: KASAN: slab-out-of-bounds in kfd_create_crat_image_virtual+0x1145/0x11f0 [ 12.814960] Read of size 1 at addr ffff8881e3663c81 by task swapper/0/1 [ 12.814960] [ 12.814960] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.9.0-rc5-00905-gb7b6c38529c9e #1 [ 12.814960] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 12.814960] Call Trace: [ 12.814960] dump_stack+0xa4/0xda [ 12.814960] print_address_description+0x21/0x210 [ 12.814960] ? kmsg_dump_rewind_nolock+0xe4/0xe4 [ 12.814960] ? rwlock_bug+0x90/0x90 [ 12.814960] ? kfd_create_crat_image_virtual+0x1145/0x11f0 [ 12.814960] kasan_report.cold+0x37/0x7c [ 12.814960] ? kfd_create_crat_image_virtual+0x1145/0x11f0 [ 12.814960] __asan_report_load1_noabort+0x14/0x20 [ 12.814960] kfd_create_crat_image_virtual+0x1145/0x11f0 [ 12.814960] ? kfd_create_crat_image_acpi+0x2d0/0x2d0 [ 12.814960] kfd_topology_init+0x3de/0x5c0 [ 12.814960] ? kfd_create_topology_device+0x320/0x320 [ 12.814960] ? __class_register+0x2c1/0x450 [ 12.814960] ? radeon_init+0xeb/0xeb [ 12.814960] kgd2kfd_init+0x99/0xf0 [ 12.814960] amdgpu_amdkfd_init+0x87/0xc0 [ 12.814960] ? athub_v2_1_get_clockgating+0x120/0x120 [ 12.814960] ? radeon_init+0xeb/0xeb [ 12.814960] amdgpu_init+0xa4/0xc3 [ 12.814960] do_one_initcall+0x11b/0x5ea [ 12.814960] ? trace_event_raw_event_initcall_finish+0x1b0/0x1b0 [ 12.814960] ? parameq+0x70/0xd0 [ 12.814960] ? __kasan_check_read+0x11/0x20 [ 12.814960] ? test_bit+0x2a/0x40 [ 12.814960] kernel_init_freeable+0x34d/0x3a3 [ 12.814960] ? rest_init+0x177/0x177 [ 12.814960] kernel_init+0x12/0x129 [ 12.814960] ret_from_fork+0x1f/0x30 [ 12.814960] [ 12.814960] Allocated by task 1: [ 12.814960] kasan_save_stack+0x23/0x50 [ 12.814960] __kasan_kmalloc+0xcf/0xe0 [ 12.814960] kasan_kmalloc+0x9/0x10 [ 12.814960] __kmalloc+0x15a/0x310 [ 12.814960] kfd_create_crat_image_virtual+0xe8/0x11f0 [ 12.814960] kfd_topology_init+0x3de/0x5c0 [ 12.814960] kgd2kfd_init+0x99/0xf0 [ 12.814960] amdgpu_amdkfd_init+0x87/0xc0 [ 12.814960] amdgpu_init+0xa4/0xc3 [ 12.874675] do_one_initcall+0x11b/0x5ea [ 12.874675] kernel_init_freeable+0x34d/0x3a3 [ 12.874675] kernel_init+0x12/0x129 [ 12.874675] ret_from_fork+0x1f/0x30 [ 12.874675] [ 12.874675] The buggy address belongs to the object at ffff8881e3663c00 [ 12.874675] which belongs to the cache kmalloc-128 of size 128 [ 12.874675] The buggy address is located 1 bytes to the right of [ 12.874675] 128-byte region [ffff8881e3663c00, ffff8881e3663c80) [ 12.874675] The buggy address belongs to the page: [ 12.874675] page:(____ptrval____) refcount:1 mapcount:0 mapping:0000000000000000 index:0x0 pfn:0x1e3663 [ 12.874675] flags: 0x17ffffc0000200(slab) [ 12.874675] raw: 0017ffffc0000200 dead000000000100 dead000000000122 ffff888107c41640 [ 12.874675] raw: 0000000000000000 0000000080100010 00000001ffffffff 0000000000000000 [ 12.874675] page dumped because: kasan: bad access detected [ 12.874675] [ 12.874675] Memory state around the buggy address: [ 12.874675] ffff8881e3663b80: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc [ 12.874675] ffff8881e3663c00: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 [ 12.874675] >ffff8881e3663c80: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc [ 12.874675] ^ [ 12.874675] ffff8881e3663d00: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc [ 12.874675] ffff8881e3663d80: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc [ 12.874675] ================================================================== [ 12.874675] Disabling lock debugging due to kernel taint [ 12.908327] Virtual CRAT table created for CPU [ 12.909513] amdgpu: Topology: Add CPU node [ 13.188149] [drm] Initialized vkms 1.0.0 20180514 for vkms on minor 0 [ 13.191785] usbcore: registered new interface driver udl [ 20.578772] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console [ 20.584955] Console: switching to colour dummy device 80x25 [ 20.587505] [drm] Found bochs VGA, ID 0xb0c0. [ 20.588149] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebf0000. [ 20.592533] rcu-ref-scale: Experiment #0 (Format: <THREAD-NUM>:<Total loop time in ns>) [ 20.592533] 0: 1485069 [ 20.592533] [ 20.592722] [TTM] Zone kernel: Available graphics memory: 3362650 KiB [ 20.595622] [TTM] Zone dma32: Available graphics memory: 2097152 KiB [ 20.595625] [TTM] Initializing pool allocator [ 20.595685] [TTM] Initializing DMA pool allocator [ 20.599597] [drm] Initialized bochs-drm 1.0.0 20130925 for 0000:00:02.0 on minor 1 [ 20.606279] rcu-ref-scale: Experiment #1 (Format: <THREAD-NUM>:<Total loop time in ns>) [ 20.606279] 0: 1274432 [ 20.606279] [ 20.608519] fbcon: bochs-drmdrmfb (fb0) is primary device [ 20.620228] Console: switching to colour frame buffer device 128x48 [ 20.630337] rcu-ref-scale: Experiment #2 (Format: <THREAD-NUM>:<Total loop time in ns>) [ 20.630337] 0: 1459295 [ 20.630337] [ 20.631175] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device [ 20.640755] parport_pc 00:04: reported by Plug and Play ACPI [ 20.642407] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] [ 20.649010] rcu-ref-scale: Experiment #3 (Format: <THREAD-NUM>:<Total loop time in ns>) [ 20.649010] 0: 1268302 [ 20.649010] [ 20.654172] rcu-ref-scale: Experiment #4 (Format: <THREAD-NUM>:<Total loop time in ns>) To reproduce: # build kernel cd linux cp config-5.9.0-rc5-00905-gb7b6c38529c9e .config make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

4 months, 4 weeks

1
0
0 / 0

[f2fs] 79963d967b: aim7.jobs-per-min 468.8% improvement

by kernel test robot

Greeting, FYI, we noticed a 468.8% improvement of aim7.jobs-per-min due to commit: commit: 79963d967b492876fa17c8c2c2c17b7438683d9b ("f2fs: shrink node_write lock coverage") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: aim7 on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory with following parameters: disk: 1BRD_48G fs: f2fs test: sync_disk_rw load: 200 cpufreq_governor: performance ucode: 0x5002f01 test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/1BRD_48G/f2fs/x86_64-rhel-8.3/200/debian-10.4-x86_64-20200603.cgz/lkp-csl-2ap2/sync_disk_rw/aim7/0x5002f01 commit: fa6795552a ("f2fs: fix to document reserved special compression extension") 79963d967b ("f2fs: shrink node_write lock coverage") fa6795552ad20509 79963d967b492876fa17c8c2c2c ---------------- --------------------------- %stddev %change %stddev \ | \ 1370 ± 2% +468.8% 7792 ± 15% aim7.jobs-per-min 876.51 ± 2% -81.9% 158.27 ± 17% aim7.time.elapsed_time 876.51 ± 2% -81.9% 158.27 ± 17% aim7.time.elapsed_time.max 1.604e+08 +3.3% 1.657e+08 aim7.time.file_system_outputs 41711 ± 2% -56.5% 18159 ± 8% aim7.time.involuntary_context_switches 2844 -1.5% 2800 aim7.time.maximum_resident_set_size 117378 ± 4% -55.7% 51974 ± 6% aim7.time.minor_page_faults 17820 ± 2% -64.2% 6388 ± 11% aim7.time.system_time 15577866 +115.4% 33561536 ± 13% aim7.time.voluntary_context_switches 88.28 -11.6% 78.04 ± 2% iostat.cpu.idle 11.71 ± 2% +87.1% 21.91 ± 8% iostat.cpu.system 4604431 ± 9% -14.4% 3939581 ± 2% numa-numastat.node2.local_node 4629384 ± 9% -14.4% 3964542 ± 3% numa-numastat.node2.numa_hit 88.25 -10.5 77.78 ± 2% mpstat.cpu.all.idle% 0.00 ±200% +0.0 0.00 ±100% mpstat.cpu.all.iowait% 10.65 ± 2% +10.5 21.16 ± 9% mpstat.cpu.all.sys% 0.01 +0.0 0.05 ± 17% mpstat.cpu.all.usr% 87.80 -11.8% 77.40 ± 2% vmstat.cpu.id 90927 ± 2% +478.5% 526006 ± 16% vmstat.io.bo 21.40 ± 4% +85.0% 39.60 ± 11% vmstat.procs.r 40230 ± 2% +1010.3% 446688 ± 25% vmstat.system.cs 385344 +3.0% 396868 vmstat.system.in 1.354e+11 ± 11% -82.8% 2.323e+10 ± 19% cpuidle.C1E.time 2.672e+08 ± 23% -71.6% 75950107 ± 7% cpuidle.C1E.usage 1.007e+10 ±137% -98.3% 1.752e+08 ± 51% cpuidle.C6.time 16563905 ±149% -97.9% 349707 ± 36% cpuidle.C6.usage 3816407 ± 20% +109.1% 7979303 ± 22% cpuidle.POLL.time 1164151 ± 2% +146.2% 2866043 ± 28% cpuidle.POLL.usage 231796 -26.6% 170051 ± 8% meminfo.AnonHugePages 679298 ± 5% +10.5% 750947 meminfo.Committed_AS 68768 +28.4% 88313 ± 3% meminfo.Dirty 1742 ± 18% -49.7% 877.40 ± 51% meminfo.Mlocked 71475 +41.4% 101091 ± 15% meminfo.Shmem 517.00 ± 3% +667.8% 3969 ± 31% meminfo.Writeback 61981 ± 2% +463.8% 349439 ± 15% meminfo.max_used_kB 96239 ± 63% -74.3% 24717 ± 44% numa-meminfo.node0.AnonHugePages 16746 ± 4% +31.4% 22001 ± 3% numa-meminfo.node0.Dirty 214.20 ± 7% +521.9% 1332 ± 27% numa-meminfo.node0.Writeback 1395 ± 2% +20.3% 1678 ± 6% numa-meminfo.node1.Active(file) 17299 ± 3% +29.1% 22334 ± 3% numa-meminfo.node1.Dirty 210.40 ± 9% +508.3% 1279 ± 28% numa-meminfo.node1.Writeback 17612 ± 5% +24.7% 21966 ± 3% numa-meminfo.node2.Dirty 51522 ± 6% -10.6% 46075 ± 2% numa-meminfo.node2.Inactive(file) 208.60 ± 7% +467.0% 1182 ± 23% numa-meminfo.node2.Writeback 74287 ± 18% +120.3% 163676 ± 47% numa-meminfo.node3.Active 72903 ± 19% +121.8% 161688 ± 47% numa-meminfo.node3.Active(anon) 1383 ± 3% +43.6% 1987 ± 34% numa-meminfo.node3.Active(file) 16997 ± 2% +29.7% 22046 ± 3% numa-meminfo.node3.Dirty 344385 ± 4% +12.3% 386888 ± 2% numa-meminfo.node3.FilePages 47297 ± 14% +72.4% 81527 ± 17% numa-meminfo.node3.Shmem 198.20 ± 4% +471.1% 1132 ± 26% numa-meminfo.node3.Writeback 216435 ± 3% -8.3% 198505 slabinfo.dentry.active_objs 5188 ± 3% -8.0% 4770 slabinfo.dentry.active_slabs 217935 ± 3% -8.0% 200398 slabinfo.dentry.num_objs 5188 ± 3% -8.0% 4770 slabinfo.dentry.num_slabs 27011 -13.5% 23361 slabinfo.ext4_pending_reservation.active_objs 27011 -13.5% 23361 slabinfo.ext4_pending_reservation.num_objs 140304 ± 4% -12.7% 122490 ± 3% slabinfo.filp.active_objs 2204 ± 3% -12.6% 1927 ± 3% slabinfo.filp.active_slabs 141088 ± 3% -12.6% 123363 ± 3% slabinfo.filp.num_objs 2204 ± 3% -12.6% 1927 ± 3% slabinfo.filp.num_slabs 386.20 ± 12% -62.7% 144.20 ± 3% slabinfo.nfs_read_data.active_objs 386.20 ± 12% -62.7% 144.20 ± 3% slabinfo.nfs_read_data.num_objs 1133 ± 7% -30.5% 787.60 ± 6% slabinfo.skbuff_fclone_cache.active_objs 1133 ± 7% -30.5% 787.60 ± 6% slabinfo.skbuff_fclone_cache.num_objs 1585 ± 6% -12.8% 1382 ± 9% slabinfo.task_group.active_objs 1585 ± 6% -12.8% 1382 ± 9% slabinfo.task_group.num_objs 26573 -28.1% 19116 ± 3% slabinfo.vmap_area.active_objs 445.60 -33.0% 298.40 ± 3% slabinfo.vmap_area.active_slabs 28545 -33.0% 19130 ± 3% slabinfo.vmap_area.num_objs 445.60 -33.0% 298.40 ± 3% slabinfo.vmap_area.num_slabs 4185 ± 4% +30.2% 5450 ± 3% numa-vmstat.node0.nr_dirty 51.80 ± 5% +503.9% 312.80 ± 25% numa-vmstat.node0.nr_writeback 4312 ± 4% +29.9% 5603 numa-vmstat.node0.nr_zone_write_pending 348.80 ± 2% +20.2% 419.20 ± 7% numa-vmstat.node1.nr_active_file 4329 ± 3% +28.0% 5543 numa-vmstat.node1.nr_dirty 93.00 ± 18% -49.7% 46.80 ± 51% numa-vmstat.node1.nr_mlock 52.20 ± 7% +468.2% 296.60 ± 23% numa-vmstat.node1.nr_writeback 348.80 ± 2% +20.2% 419.20 ± 7% numa-vmstat.node1.nr_zone_active_file 4456 ± 4% +27.0% 5662 numa-vmstat.node1.nr_zone_write_pending 3004701 ± 6% -9.0% 2735334 ± 4% numa-vmstat.node1.numa_hit 2911028 ± 6% -9.9% 2623089 ± 4% numa-vmstat.node1.numa_local 4400 ± 5% +24.4% 5473 ± 2% numa-vmstat.node2.nr_dirty 52.00 ± 9% +455.8% 289.00 ± 24% numa-vmstat.node2.nr_writeback 4533 ± 5% +24.2% 5631 numa-vmstat.node2.nr_zone_write_pending 3186079 ± 8% -13.3% 2761823 ± 3% numa-vmstat.node2.numa_hit 3077478 ± 8% -13.4% 2665765 ± 3% numa-vmstat.node2.numa_local 18225 ± 19% +121.8% 40417 ± 47% numa-vmstat.node3.nr_active_anon 345.60 ± 3% +43.9% 497.20 ± 33% numa-vmstat.node3.nr_active_file 4248 ± 2% +29.4% 5497 numa-vmstat.node3.nr_dirty 86095 ± 4% +12.3% 96722 ± 2% numa-vmstat.node3.nr_file_pages 153.80 ± 19% -65.1% 53.60 ± 56% numa-vmstat.node3.nr_mlock 11822 ± 14% +72.4% 20378 ± 17% numa-vmstat.node3.nr_shmem 49.00 ± 4% +462.0% 275.40 ± 19% numa-vmstat.node3.nr_writeback 18225 ± 19% +121.8% 40416 ± 47% numa-vmstat.node3.nr_zone_active_anon 345.60 ± 3% +43.9% 497.20 ± 33% numa-vmstat.node3.nr_zone_active_file 4373 ± 2% +28.9% 5636 numa-vmstat.node3.nr_zone_write_pending 85549 +11.8% 95665 ± 3% proc-vmstat.nr_active_anon 1840 +12.7% 2074 ± 3% proc-vmstat.nr_active_file 73018 +3.7% 75737 proc-vmstat.nr_anon_pages 112.60 -26.5% 82.80 ± 8% proc-vmstat.nr_anon_transparent_hugepages 19992743 +3.5% 20687022 proc-vmstat.nr_dirtied 17157 +29.0% 22139 ± 3% proc-vmstat.nr_dirty 320292 +1.5% 325170 proc-vmstat.nr_file_pages 49434 -5.7% 46605 ± 2% proc-vmstat.nr_inactive_file 29057 +7.7% 31304 proc-vmstat.nr_kernel_stack 8420 +9.0% 9174 ± 4% proc-vmstat.nr_mapped 435.40 ± 18% -49.7% 219.00 ± 51% proc-vmstat.nr_mlock 17867 +41.5% 25273 ± 15% proc-vmstat.nr_shmem 57803 -4.2% 55357 proc-vmstat.nr_slab_reclaimable 128.80 ± 2% +713.8% 1048 ± 29% proc-vmstat.nr_writeback 19901345 +3.5% 20594405 proc-vmstat.nr_written 85549 +11.8% 95665 ± 3% proc-vmstat.nr_zone_active_anon 1840 +12.7% 2074 ± 3% proc-vmstat.nr_zone_active_file 49434 -5.7% 46605 ± 2% proc-vmstat.nr_zone_inactive_file 17668 +28.9% 22766 ± 3% proc-vmstat.nr_zone_write_pending 107218 ± 5% -61.7% 41098 ± 5% proc-vmstat.numa_hint_faults 73720 ± 6% -62.3% 27790 ± 5% proc-vmstat.numa_hint_faults_local 17699040 -10.0% 15922834 proc-vmstat.numa_hit 17605500 -10.1% 15829310 proc-vmstat.numa_local 110883 ± 9% -57.6% 46987 ± 25% proc-vmstat.numa_pte_updates 22749 ± 5% +66.6% 37908 ± 9% proc-vmstat.pgactivate 17877147 -10.5% 16001378 proc-vmstat.pgalloc_normal 18254 +7.4% 19613 proc-vmstat.pgdeactivate 3368698 ± 2% -79.3% 696904 ± 14% proc-vmstat.pgfault 5326179 -34.6% 3481040 ± 2% proc-vmstat.pgfree 79655896 +3.5% 82432256 proc-vmstat.pgpgout 36480 +7.5% 39217 proc-vmstat.pgrotated 2.41 +139.0% 5.77 ± 13% perf-stat.i.MPKI 4.305e+09 +74.5% 7.514e+09 ± 6% perf-stat.i.branch-instructions 0.25 +0.3 0.54 ± 13% perf-stat.i.branch-miss-rate% 9787519 +210.0% 30344928 ± 16% perf-stat.i.branch-misses 37.38 +8.4 45.74 ± 2% perf-stat.i.cache-miss-rate% 17212612 ± 3% +417.5% 89073152 ± 16% perf-stat.i.cache-misses 45692866 ± 2% +313.7% 1.89e+08 ± 16% perf-stat.i.cache-references 40158 ± 2% +1027.9% 452960 ± 26% perf-stat.i.context-switches 7.522e+10 +80.4% 1.357e+11 ± 7% perf-stat.i.cpu-cycles 1173 ± 2% +820.3% 10798 ± 17% perf-stat.i.cpu-migrations 4477 ± 2% -60.3% 1779 ± 11% perf-stat.i.cycles-between-cache-misses 0.03 ± 15% +0.1 0.10 ± 19% perf-stat.i.dTLB-load-miss-rate% 1306799 ± 13% +616.5% 9363238 ± 21% perf-stat.i.dTLB-load-misses 5.163e+09 +79.2% 9.255e+09 ± 6% perf-stat.i.dTLB-loads 0.01 ± 21% +0.0 0.03 ± 12% perf-stat.i.dTLB-store-miss-rate% 53041 ± 20% +577.3% 359241 ± 26% perf-stat.i.dTLB-store-misses 4.194e+08 +186.5% 1.202e+09 ± 15% perf-stat.i.dTLB-stores 3000111 +135.1% 7054045 ± 13% perf-stat.i.iTLB-load-misses 4886564 +128.8% 11179945 ± 15% perf-stat.i.iTLB-loads 2.029e+10 +76.6% 3.584e+10 ± 6% perf-stat.i.instructions 6775 -18.8% 5503 ± 8% perf-stat.i.instructions-per-iTLB-miss 0.39 +80.4% 0.71 ± 7% perf-stat.i.metric.GHz 1.09 ± 5% -72.5% 0.30 ± 27% perf-stat.i.metric.K/sec 51.80 +83.2% 94.91 ± 7% perf-stat.i.metric.M/sec 3762 +12.6% 4236 ± 2% perf-stat.i.minor-faults 5501237 ± 2% +592.7% 38108380 ± 17% perf-stat.i.node-load-misses 341091 ± 4% +495.0% 2029602 ± 16% perf-stat.i.node-loads 93.96 +1.1 95.03 perf-stat.i.node-store-miss-rate% 1717467 ± 2% +646.8% 12825609 ± 18% perf-stat.i.node-store-misses 108726 ± 6% +465.3% 614610 ± 17% perf-stat.i.node-stores 3762 +12.6% 4236 ± 2% perf-stat.i.page-faults 2.25 +133.1% 5.25 ± 12% perf-stat.overall.MPKI 0.23 +0.2 0.40 ± 12% perf-stat.overall.branch-miss-rate% 37.66 +9.5 47.12 ± 2% perf-stat.overall.cache-miss-rate% 3.71 +2.1% 3.78 perf-stat.overall.cpi 4372 -64.5% 1553 ± 12% perf-stat.overall.cycles-between-cache-misses 0.03 ± 13% +0.1 0.10 ± 17% perf-stat.overall.dTLB-load-miss-rate% 0.01 ± 20% +0.0 0.03 ± 12% perf-stat.overall.dTLB-store-miss-rate% 6765 -23.9% 5149 ± 9% perf-stat.overall.instructions-per-iTLB-miss 0.27 -2.0% 0.26 perf-stat.overall.ipc 94.05 +1.4 95.42 perf-stat.overall.node-store-miss-rate% 4.3e+09 +73.8% 7.472e+09 ± 6% perf-stat.ps.branch-instructions 9778000 +208.2% 30137670 ± 16% perf-stat.ps.branch-misses 17192809 ± 3% +414.5% 88461433 ± 16% perf-stat.ps.cache-misses 45641335 ± 2% +311.4% 1.878e+08 ± 16% perf-stat.ps.cache-references 40112 ± 2% +1021.3% 449796 ± 26% perf-stat.ps.context-switches 7.513e+10 +79.6% 1.349e+11 ± 8% perf-stat.ps.cpu-cycles 1172 ± 2% +815.3% 10728 ± 17% perf-stat.ps.cpu-migrations 1305261 ± 13% +611.7% 9289474 ± 21% perf-stat.ps.dTLB-load-misses 5.157e+09 +78.5% 9.204e+09 ± 6% perf-stat.ps.dTLB-loads 52985 ± 20% +573.6% 356909 ± 26% perf-stat.ps.dTLB-store-misses 4.189e+08 +184.9% 1.194e+09 ± 15% perf-stat.ps.dTLB-stores 2996689 +133.8% 7006295 ± 13% perf-stat.ps.iTLB-load-misses 4880923 +127.5% 11102675 ± 15% perf-stat.ps.iTLB-loads 2.027e+10 +75.8% 3.564e+10 ± 6% perf-stat.ps.instructions 3757 +12.0% 4207 ± 2% perf-stat.ps.minor-faults 5495021 ± 2% +588.8% 37849270 ± 17% perf-stat.ps.node-load-misses 340723 ± 4% +491.8% 2016412 ± 15% perf-stat.ps.node-loads 1715501 ± 2% +642.3% 12734422 ± 18% perf-stat.ps.node-store-misses 108608 ± 6% +462.0% 610345 ± 17% perf-stat.ps.node-stores 3757 +12.0% 4207 ± 2% perf-stat.ps.page-faults 1.778e+13 ± 2% -68.4% 5.621e+12 ± 12% perf-stat.total.instructions 43558 ± 5% -68.1% 13889 ± 15% sched_debug.cfs_rq:/.exec_clock.avg 59229 ± 6% -73.7% 15563 ± 15% sched_debug.cfs_rq:/.exec_clock.max 39429 ± 6% -67.3% 12882 ± 14% sched_debug.cfs_rq:/.exec_clock.min 2347 ± 4% -83.7% 382.25 ± 31% sched_debug.cfs_rq:/.exec_clock.stddev 4.90 ± 5% +137.6% 11.65 ± 26% sched_debug.cfs_rq:/.load_avg.avg 125.09 ± 8% +175.0% 343.98 ± 16% sched_debug.cfs_rq:/.load_avg.max 17.20 ± 8% +158.1% 44.40 ± 23% sched_debug.cfs_rq:/.load_avg.stddev 1249606 ± 6% -37.2% 784849 ± 24% sched_debug.cfs_rq:/.min_vruntime.avg 1565669 ± 5% -45.8% 849305 ± 24% sched_debug.cfs_rq:/.min_vruntime.max 1125571 ± 7% -36.5% 715126 ± 24% sched_debug.cfs_rq:/.min_vruntime.min 56525 ± 3% -59.3% 22991 ± 22% sched_debug.cfs_rq:/.min_vruntime.stddev 0.11 ± 17% +47.4% 0.17 ± 9% sched_debug.cfs_rq:/.nr_running.avg 0.30 ± 6% +19.8% 0.36 ± 2% sched_debug.cfs_rq:/.nr_running.stddev 0.81 ± 14% -97.3% 0.02 ± 60% sched_debug.cfs_rq:/.nr_spread_over.avg 4.20 ± 13% -73.8% 1.10 ± 50% sched_debug.cfs_rq:/.nr_spread_over.max 0.55 ± 9% -72.9% 0.15 ± 52% sched_debug.cfs_rq:/.nr_spread_over.stddev 136.81 ± 10% +118.4% 298.75 ± 10% sched_debug.cfs_rq:/.runnable_avg.avg 1188 ± 4% +43.2% 1701 ± 24% sched_debug.cfs_rq:/.runnable_avg.max 195.87 ± 4% +54.2% 301.98 ± 21% sched_debug.cfs_rq:/.runnable_avg.stddev 315750 ± 14% -66.4% 106242 ± 31% sched_debug.cfs_rq:/.spread0.max -124387 -77.6% -27893 sched_debug.cfs_rq:/.spread0.min 56528 ± 3% -59.3% 22985 ± 22% sched_debug.cfs_rq:/.spread0.stddev 109.01 ± 9% +85.1% 201.72 ± 3% sched_debug.cfs_rq:/.util_avg.avg 800.14 ± 3% +30.8% 1046 ± 12% sched_debug.cfs_rq:/.util_avg.max 156.60 ± 4% +18.9% 186.16 ± 14% sched_debug.cfs_rq:/.util_avg.stddev 17.76 ± 17% +86.3% 33.08 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.avg 68.19 ± 8% +43.4% 97.81 ± 10% sched_debug.cfs_rq:/.util_est_enqueued.stddev 776647 -18.6% 632133 ± 10% sched_debug.cpu.avg_idle.avg 1085484 ± 4% +38.9% 1508053 ± 27% sched_debug.cpu.avg_idle.max 40752 ± 16% -58.2% 17048 ± 65% sched_debug.cpu.avg_idle.min 448303 ± 5% -76.1% 107028 ± 11% sched_debug.cpu.clock.avg 448318 ± 5% -76.1% 107047 ± 11% sched_debug.cpu.clock.max 448288 ± 5% -76.1% 107009 ± 11% sched_debug.cpu.clock.min 8.98 ± 4% +23.5% 11.10 ± 4% sched_debug.cpu.clock.stddev 443708 ± 5% -76.1% 106213 ± 11% sched_debug.cpu.clock_task.avg 444016 ± 5% -76.0% 106373 ± 11% sched_debug.cpu.clock_task.max 435173 ± 5% -77.4% 98297 ± 12% sched_debug.cpu.clock_task.min 16088 ± 4% -65.5% 5546 ± 6% sched_debug.cpu.curr->pid.max 1562 ± 5% -25.0% 1171 ± 3% sched_debug.cpu.curr->pid.stddev 574107 ± 5% +67.9% 963985 ± 36% sched_debug.cpu.max_idle_balance_cost.max 8428 ± 49% +472.2% 48227 ± 79% sched_debug.cpu.max_idle_balance_cost.stddev 0.11 ± 17% +39.4% 0.15 ± 11% sched_debug.cpu.nr_running.avg 0.29 ± 7% +14.0% 0.33 ± 3% sched_debug.cpu.nr_running.stddev 84963 ± 4% +71.1% 145410 ± 14% sched_debug.cpu.nr_switches.avg 118995 ± 7% +32.8% 158052 ± 14% sched_debug.cpu.nr_switches.max 78727 ± 4% +77.2% 139470 ± 15% sched_debug.cpu.nr_switches.min 5200 ± 5% -52.4% 2476 ± 11% sched_debug.cpu.nr_switches.stddev 0.81 ± 2% -55.3% 0.36 ± 12% sched_debug.cpu.nr_uninterruptible.avg 1356 ± 7% -64.1% 486.83 ± 12% sched_debug.cpu.nr_uninterruptible.max -79.49 -46.4% -42.58 sched_debug.cpu.nr_uninterruptible.min 174.73 ± 4% -68.5% 54.99 ± 15% sched_debug.cpu.nr_uninterruptible.stddev 84042 ± 4% +73.5% 145814 ± 14% sched_debug.cpu.sched_count.avg 78099 ± 4% +78.2% 139170 ± 15% sched_debug.cpu.sched_count.min 4846 ± 4% -56.0% 2134 ± 11% sched_debug.cpu.sched_count.stddev 41262 ± 4% +73.9% 71768 ± 14% sched_debug.cpu.sched_goidle.avg 38325 ± 4% +78.7% 68469 ± 15% sched_debug.cpu.sched_goidle.min 2414 ± 4% -56.6% 1048 ± 11% sched_debug.cpu.sched_goidle.stddev 43323 ± 4% +72.1% 74551 ± 14% sched_debug.cpu.ttwu_count.avg 68008 ± 8% +43.1% 97317 ± 13% sched_debug.cpu.ttwu_count.max 32779 ± 6% +86.4% 61098 ± 14% sched_debug.cpu.ttwu_count.min 1525 ± 6% -84.2% 241.21 ± 19% sched_debug.cpu.ttwu_local.avg 3446 ± 6% -83.6% 565.65 ± 18% sched_debug.cpu.ttwu_local.max 1130 ± 8% -84.1% 179.32 ± 16% sched_debug.cpu.ttwu_local.min 243.70 ± 6% -81.8% 44.32 ± 28% sched_debug.cpu.ttwu_local.stddev 448287 ± 5% -76.1% 107010 ± 11% sched_debug.cpu_clk 447410 ± 5% -76.3% 106136 ± 12% sched_debug.ktime 448642 ± 5% -76.1% 107367 ± 11% sched_debug.sched_clk 42.99 ± 5% -43.0 0.00 perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter 42.66 ± 5% -42.7 0.00 perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file 40.14 ± 5% -40.1 0.00 perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.__write_node_page.f2fs_fsync_node_pages 47.64 ± 5% -24.3 23.30 ± 20% perf-profile.calltrace.cycles-pp.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write 12.39 ± 12% -12.4 0.00 perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page 12.32 ± 12% -12.3 0.00 perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data 12.18 ± 12% -12.2 0.00 perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.f2fs_allocate_data_block.do_write_page 12.53 ± 12% -10.0 2.53 ± 21% perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page 13.66 ± 12% -7.4 6.28 ± 36% perf-profile.calltrace.cycles-pp.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages 13.71 ± 12% -7.2 6.47 ± 35% perf-profile.calltrace.cycles-pp.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages 13.87 ± 12% -4.5 9.38 ± 13% perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages 13.90 ± 12% -4.4 9.53 ± 13% perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range 3.95 ± 32% -3.6 0.37 ± 82% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 4.43 ± 20% -3.3 1.14 ± 22% perf-profile.calltrace.cycles-pp.__irqentry_text_start.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 3.26 ± 25% -2.2 1.06 ± 21% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.__irqentry_text_start.cpuidle_enter_state.cpuidle_enter.do_idle 1.56 ± 10% -1.0 0.51 ± 51% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.__irqentry_text_start.cpuidle_enter_state.cpuidle_enter 0.93 ± 3% +0.6 1.58 ± 28% perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page 0.98 ± 3% +0.8 1.80 ± 24% perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page 0.00 +0.9 0.94 ± 30% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file 0.00 +1.0 0.96 ± 30% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter 1.06 ± 4% +1.1 2.16 ± 19% perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages 0.34 ± 82% +1.4 1.73 ± 36% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_write_cache_pages 0.36 ± 82% +1.5 1.86 ± 33% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages 0.00 +1.5 1.51 ± 25% perf-profile.calltrace.cycles-pp.find_get_pages_range_tag.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter 0.36 ± 82% +1.5 1.87 ± 33% perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages 0.00 +1.5 1.51 ± 25% perf-profile.calltrace.cycles-pp.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write 0.00 +1.5 1.55 ± 49% perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter 0.00 +1.7 1.68 ± 60% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_need_dentry_mark.f2fs_fsync_node_pages 0.00 +1.7 1.73 ± 59% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file 0.00 +1.9 1.85 ± 31% perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data 0.74 ± 15% +1.9 2.62 ± 27% perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range 0.00 +2.1 2.07 ± 51% perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter 0.60 ± 10% +2.1 2.70 ± 40% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file 0.00 +2.1 2.11 ± 27% perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page 0.61 ± 10% +2.1 2.73 ± 39% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file.f2fs_file_write_iter 0.00 +2.2 2.16 ± 58% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page 0.00 +2.2 2.18 ± 49% perf-profile.calltrace.cycles-pp.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write 0.00 +2.2 2.23 ± 57% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page 0.71 ± 9% +2.4 3.10 ± 34% perf-profile.calltrace.cycles-pp.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write 0.72 ± 10% +2.4 3.11 ± 34% perf-profile.calltrace.cycles-pp.f2fs_space_for_roll_forward.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write 1.06 ± 17% +2.5 3.57 ± 51% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data 1.07 ± 17% +2.5 3.58 ± 51% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page 0.00 +2.5 2.52 ± 52% perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages 1.11 ± 16% +2.6 3.72 ± 48% perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page 0.00 +2.6 2.63 ± 50% perf-profile.calltrace.cycles-pp.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages 0.00 +3.0 3.02 ± 62% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_is_checkpointed_node.f2fs_do_sync_file 0.00 +3.1 3.12 ± 63% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter 0.00 +3.5 3.53 ± 55% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file 0.00 +3.6 3.65 ± 55% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter 0.00 +3.7 3.75 ± 53% perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write 0.00 +3.9 3.93 ± 51% perf-profile.calltrace.cycles-pp.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write 0.00 +4.7 4.73 ± 43% perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write 0.00 +4.9 4.87 ± 43% perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write 0.00 +7.2 7.17 ± 29% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.set_node_addr.__write_node_page 0.00 +7.6 7.58 ± 29% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.set_node_addr.__write_node_page.f2fs_fsync_node_pages 0.00 +7.8 7.84 ± 29% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file 0.00 +7.9 7.92 ± 29% perf-profile.calltrace.cycles-pp.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter 1.16 ± 5% +9.9 11.04 ± 35% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_fsync_node_pages 1.20 ± 5% +10.1 11.33 ± 35% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file 1.20 ± 5% +10.2 11.37 ± 35% perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter 1.46 ± 5% +11.1 12.53 ± 36% perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write 47.64 ± 5% -24.3 23.30 ± 20% perf-profile.children.cycles-pp.__write_node_page 45.03 ± 5% -17.2 27.84 ± 12% perf-profile.children.cycles-pp.rwsem_down_read_slowpath 62.32 ± 6% -14.0 48.35 ± 15% perf-profile.children.cycles-pp.rwsem_optimistic_spin 13.95 ± 11% -9.3 4.69 ± 20% perf-profile.children.cycles-pp.f2fs_allocate_data_block 14.06 ± 12% -7.6 6.47 ± 35% perf-profile.children.cycles-pp.f2fs_outplace_write_data 13.87 ± 12% -4.5 9.38 ± 13% perf-profile.children.cycles-pp.f2fs_do_write_data_page 13.90 ± 12% -4.4 9.53 ± 13% perf-profile.children.cycles-pp.f2fs_write_single_data_page 3.98 ± 32% -3.4 0.53 ± 25% perf-profile.children.cycles-pp.menu_select 4.42 ± 19% -2.8 1.67 ± 11% perf-profile.children.cycles-pp.__irqentry_text_start 3.81 ± 21% -2.3 1.55 ± 10% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 2.02 ± 7% -1.0 1.01 ± 7% perf-profile.children.cycles-pp.hrtimer_interrupt 1.28 ± 54% -0.9 0.36 ± 19% perf-profile.children.cycles-pp.irq_exit 1.37 ± 11% -0.8 0.59 ± 18% perf-profile.children.cycles-pp.ktime_get 0.82 ± 68% -0.6 0.22 ± 19% perf-profile.children.cycles-pp.__softirqentry_text_start 1.05 ± 5% -0.5 0.56 ± 6% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.67 ± 32% -0.4 0.26 ± 23% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.61 ± 32% -0.4 0.22 ± 23% perf-profile.children.cycles-pp.tick_nohz_next_event 0.46 ± 79% -0.4 0.10 ± 18% perf-profile.children.cycles-pp.rebalance_domains 0.82 ± 4% -0.3 0.47 ± 9% perf-profile.children.cycles-pp.tick_sched_timer 0.64 ± 10% -0.3 0.30 ± 17% perf-profile.children.cycles-pp.clockevents_program_event 0.47 ± 8% -0.3 0.18 ± 18% perf-profile.children.cycles-pp.irq_enter 0.32 ± 82% -0.3 0.06 ± 21% perf-profile.children.cycles-pp._raw_spin_trylock 0.61 ± 4% -0.2 0.36 ± 13% perf-profile.children.cycles-pp.tick_sched_handle 0.30 ± 64% -0.2 0.05 ± 50% perf-profile.children.cycles-pp.native_irq_return_iret 0.61 ± 3% -0.2 0.36 ± 14% perf-profile.children.cycles-pp.update_process_times 0.39 ± 9% -0.2 0.15 ± 21% perf-profile.children.cycles-pp.tick_irq_enter 0.32 ± 40% -0.2 0.08 ± 51% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.31 ± 25% -0.2 0.09 ± 23% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.25 ± 40% -0.2 0.03 ± 82% perf-profile.children.cycles-pp.irqtime_account_irq 0.41 ± 2% -0.1 0.26 ± 20% perf-profile.children.cycles-pp.scheduler_tick 0.26 ± 10% -0.1 0.11 ± 15% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.15 ± 6% -0.1 0.04 ± 50% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.19 ± 30% -0.1 0.10 ± 21% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.14 ± 26% -0.1 0.06 ± 51% perf-profile.children.cycles-pp.__next_timer_interrupt 0.18 ± 41% -0.1 0.11 ± 6% perf-profile.children.cycles-pp.load_balance 0.15 ± 36% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.find_busiest_group 0.15 ± 39% -0.1 0.09 ± 8% perf-profile.children.cycles-pp.update_sd_lb_stats 0.08 ± 12% -0.1 0.03 ± 81% perf-profile.children.cycles-pp.read_tsc 0.06 ± 12% +0.0 0.10 ± 10% perf-profile.children.cycles-pp.schedule_timeout 0.06 ± 14% +0.0 0.11 ± 10% perf-profile.children.cycles-pp.wait_for_completion 0.12 ± 6% +0.1 0.18 ± 10% perf-profile.children.cycles-pp.update_load_avg 0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.f2fs_inplace_write_data 0.00 +0.1 0.06 ± 18% perf-profile.children.cycles-pp.f2fs_update_inode 0.08 ± 14% +0.1 0.14 ± 10% perf-profile.children.cycles-pp.pick_next_task_fair 0.00 +0.1 0.07 ± 23% perf-profile.children.cycles-pp.llist_add_batch 0.00 +0.1 0.07 ± 23% perf-profile.children.cycles-pp.read_node_page 0.00 +0.1 0.07 ± 18% perf-profile.children.cycles-pp.up_write 0.00 +0.1 0.07 ± 15% perf-profile.children.cycles-pp.__has_merged_page 0.00 +0.1 0.07 ± 15% perf-profile.children.cycles-pp.get_page_from_freelist 0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.__alloc_pages_nodemask 0.00 +0.1 0.07 ± 27% perf-profile.children.cycles-pp.__orc_find 0.00 +0.1 0.07 ± 18% perf-profile.children.cycles-pp.mutex_lock 0.07 ± 7% +0.1 0.15 ± 17% perf-profile.children.cycles-pp.kthread 0.07 ± 7% +0.1 0.15 ± 19% perf-profile.children.cycles-pp.ret_from_fork 0.00 +0.1 0.08 ± 20% perf-profile.children.cycles-pp.locate_dirty_segment 0.00 +0.1 0.08 ± 31% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.update_curr 0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.__list_del_entry_valid 0.00 +0.1 0.08 ± 12% perf-profile.children.cycles-pp.f2fs_invalidate_blocks 0.00 +0.1 0.09 ± 9% perf-profile.children.cycles-pp.f2fs_do_truncate_blocks 0.00 +0.1 0.09 ± 9% perf-profile.children.cycles-pp.f2fs_truncate_data_blocks_range 0.00 +0.1 0.09 ± 22% perf-profile.children.cycles-pp.pagecache_get_page 0.00 +0.1 0.09 ± 28% perf-profile.children.cycles-pp.orc_find 0.00 +0.1 0.09 ± 8% perf-profile.children.cycles-pp.f2fs_truncate 0.00 +0.1 0.09 ± 28% perf-profile.children.cycles-pp.__radix_tree_lookup 0.05 ± 9% +0.1 0.15 ± 22% perf-profile.children.cycles-pp.__test_set_page_writeback 0.00 +0.1 0.10 ± 20% perf-profile.children.cycles-pp.swake_up_locked 0.00 +0.1 0.10 ± 19% perf-profile.children.cycles-pp.complete 0.09 ± 8% +0.1 0.19 ± 12% perf-profile.children.cycles-pp.f2fs_issue_flush 0.00 +0.1 0.11 ± 21% perf-profile.children.cycles-pp.f2fs_set_data_page_dirty 0.00 +0.1 0.11 ± 26% perf-profile.children.cycles-pp.ttwu_queue_wakelist 0.00 +0.1 0.11 ± 18% perf-profile.children.cycles-pp.down_write 0.00 +0.1 0.12 ± 18% perf-profile.children.cycles-pp.f2fs_submit_merged_ipu_write 0.00 +0.1 0.12 ± 22% perf-profile.children.cycles-pp.f2fs_update_inode_page 0.00 +0.1 0.12 ± 22% perf-profile.children.cycles-pp.end_page_writeback 0.00 +0.1 0.12 ± 22% perf-profile.children.cycles-pp.test_clear_page_writeback 0.00 +0.1 0.12 ± 22% perf-profile.children.cycles-pp.dequeue_entity 0.05 +0.1 0.17 ± 22% perf-profile.children.cycles-pp.brd_insert_page 0.02 ±122% +0.1 0.14 ± 20% perf-profile.children.cycles-pp.f2fs_write_end 0.00 +0.1 0.13 ± 28% perf-profile.children.cycles-pp.__lookup_nat_cache 0.00 +0.1 0.13 ± 24% perf-profile.children.cycles-pp.dequeue_task_fair 0.03 ± 81% +0.1 0.16 ± 23% perf-profile.children.cycles-pp.f2fs_is_valid_blkaddr 0.00 +0.1 0.13 ± 19% perf-profile.children.cycles-pp.f2fs_write_inode 0.00 +0.1 0.13 ± 19% perf-profile.children.cycles-pp.issue_flush_thread 0.00 +0.1 0.14 ± 21% perf-profile.children.cycles-pp.f2fs_balance_fs 0.03 ± 82% +0.1 0.18 ± 18% perf-profile.children.cycles-pp.f2fs_set_data_blkaddr 0.03 ± 82% +0.1 0.18 ± 18% perf-profile.children.cycles-pp.f2fs_update_data_blkaddr 0.00 +0.1 0.14 ± 23% perf-profile.children.cycles-pp.rwsem_mark_wake 0.00 +0.1 0.15 ± 27% perf-profile.children.cycles-pp.select_task_rq_fair 0.00 +0.1 0.15 ± 26% perf-profile.children.cycles-pp.osq_unlock 0.00 +0.1 0.15 ± 25% perf-profile.children.cycles-pp.schedule_idle 0.02 ±122% +0.1 0.17 ± 28% perf-profile.children.cycles-pp.xas_find_marked 0.06 ± 14% +0.2 0.21 ± 19% perf-profile.children.cycles-pp.f2fs_set_node_page_dirty 0.00 +0.2 0.16 ± 28% perf-profile.children.cycles-pp.__close 0.00 +0.2 0.16 ± 28% perf-profile.children.cycles-pp.__fput 0.00 +0.2 0.16 ± 28% perf-profile.children.cycles-pp.dput 0.00 +0.2 0.16 ± 28% perf-profile.children.cycles-pp.__dentry_kill 0.00 +0.2 0.16 ± 28% perf-profile.children.cycles-pp.evict 0.00 +0.2 0.16 ± 28% perf-profile.children.cycles-pp.f2fs_evict_inode 0.06 ± 14% +0.2 0.21 ± 20% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers 0.00 +0.2 0.16 ± 23% perf-profile.children.cycles-pp.update_sit_entry 0.00 +0.2 0.16 ± 26% perf-profile.children.cycles-pp.task_work_run 0.00 +0.2 0.16 ± 26% perf-profile.children.cycles-pp.exit_to_usermode_loop 0.00 +0.2 0.16 ± 23% perf-profile.children.cycles-pp.up_read 0.05 ± 9% +0.2 0.22 ± 21% perf-profile.children.cycles-pp.__get_node_page 0.08 ± 5% +0.2 0.26 ± 22% perf-profile.children.cycles-pp.f2fs_write_begin 0.07 ± 12% +0.2 0.27 ± 20% perf-profile.children.cycles-pp.f2fs_write_end_io 0.07 ± 11% +0.2 0.29 ± 23% perf-profile.children.cycles-pp.down_read 0.14 ± 11% +0.2 0.36 ± 18% perf-profile.children.cycles-pp.schedule 0.14 ± 8% +0.2 0.37 ± 19% perf-profile.children.cycles-pp._raw_spin_lock 0.02 ±122% +0.2 0.25 ± 25% perf-profile.children.cycles-pp.unwind_next_frame 0.10 ± 9% +0.3 0.36 ± 20% perf-profile.children.cycles-pp.brd_do_bvec 0.06 ± 12% +0.3 0.37 ± 24% perf-profile.children.cycles-pp.arch_stack_walk 0.13 ± 5% +0.3 0.45 ± 20% perf-profile.children.cycles-pp.generic_perform_write 0.07 ± 12% +0.3 0.40 ± 24% perf-profile.children.cycles-pp.stack_trace_save_tsk 0.16 ± 8% +0.3 0.50 ± 19% perf-profile.children.cycles-pp.__sched_text_start 0.14 ± 5% +0.3 0.48 ± 20% perf-profile.children.cycles-pp.__generic_file_write_iter 0.71 ± 6% +0.4 1.11 ± 19% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.00 +0.4 0.42 ± 22% perf-profile.children.cycles-pp.mutex_spin_on_owner 0.16 ± 13% +0.4 0.58 ± 20% perf-profile.children.cycles-pp.__submit_merged_bio 0.18 ± 10% +0.5 0.64 ± 20% perf-profile.children.cycles-pp.brd_make_request 0.18 ± 8% +0.5 0.66 ± 20% perf-profile.children.cycles-pp.submit_bio 0.18 ± 8% +0.5 0.66 ± 20% perf-profile.children.cycles-pp.generic_make_request 0.09 ± 13% +0.5 0.58 ± 26% perf-profile.children.cycles-pp.__account_scheduler_latency 0.10 ± 7% +0.6 0.68 ± 25% perf-profile.children.cycles-pp.sched_ttwu_pending 0.10 ± 8% +0.6 0.68 ± 26% perf-profile.children.cycles-pp.release_pages 0.10 ± 8% +0.6 0.68 ± 26% perf-profile.children.cycles-pp.__pagevec_release 0.10 ± 3% +0.6 0.72 ± 25% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle 0.12 ± 10% +0.7 0.77 ± 25% perf-profile.children.cycles-pp.enqueue_entity 0.08 ± 14% +0.7 0.75 ± 26% perf-profile.children.cycles-pp.wake_up_q 0.11 ± 11% +0.7 0.80 ± 25% perf-profile.children.cycles-pp.try_to_wake_up 0.13 ± 9% +0.7 0.82 ± 25% perf-profile.children.cycles-pp.enqueue_task_fair 0.13 ± 9% +0.7 0.83 ± 25% perf-profile.children.cycles-pp.ttwu_do_activate 0.13 ± 9% +0.7 0.83 ± 25% perf-profile.children.cycles-pp.activate_task 0.10 ± 11% +0.8 0.86 ± 26% perf-profile.children.cycles-pp.rwsem_wake 0.30 ± 7% +1.2 1.52 ± 25% perf-profile.children.cycles-pp.pagevec_lookup_range_tag 0.30 ± 7% +1.2 1.52 ± 25% perf-profile.children.cycles-pp.find_get_pages_range_tag 0.08 ± 23% +2.1 2.20 ± 28% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.00 +2.2 2.18 ± 49% perf-profile.children.cycles-pp.f2fs_need_dentry_mark 0.71 ± 9% +2.4 3.10 ± 34% perf-profile.children.cycles-pp.__percpu_counter_sum 0.72 ± 10% +2.4 3.11 ± 34% perf-profile.children.cycles-pp.f2fs_space_for_roll_forward 0.79 ± 7% +2.5 3.32 ± 31% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.98 ± 3% +2.9 3.90 ± 25% perf-profile.children.cycles-pp.__mutex_lock 0.00 +3.9 3.93 ± 51% perf-profile.children.cycles-pp.f2fs_is_checkpointed_node 0.10 ± 16% +4.1 4.22 ± 50% perf-profile.children.cycles-pp.f2fs_get_node_info 0.72 ± 9% +4.4 5.10 ± 21% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.14 ± 12% +4.7 4.87 ± 43% perf-profile.children.cycles-pp.f2fs_need_inode_block_update 0.17 ± 18% +7.8 7.94 ± 29% perf-profile.children.cycles-pp.set_node_addr 2.28 ± 8% +12.9 15.21 ± 34% perf-profile.children.cycles-pp.__submit_merged_write_cond 3.28 ± 32% -3.0 0.26 ± 36% perf-profile.self.cycles-pp.menu_select 2.62 ± 4% -2.0 0.63 ± 19% perf-profile.self.cycles-pp.rwsem_optimistic_spin 1.73 ± 24% -1.6 0.16 ± 38% perf-profile.self.cycles-pp.cpuidle_enter_state 1.30 ± 11% -0.8 0.55 ± 19% perf-profile.self.cycles-pp.ktime_get 0.32 ± 82% -0.3 0.06 ± 21% perf-profile.self.cycles-pp._raw_spin_trylock 0.30 ± 64% -0.2 0.05 ± 50% perf-profile.self.cycles-pp.native_irq_return_iret 0.32 ± 40% -0.2 0.08 ± 51% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.24 ± 11% -0.1 0.10 ± 13% perf-profile.self.cycles-pp.ktime_get_update_offsets_now 0.00 +0.1 0.06 ± 12% perf-profile.self.cycles-pp.f2fs_submit_page_write 0.00 +0.1 0.06 ± 15% perf-profile.self.cycles-pp.f2fs_write_data_pages 0.00 +0.1 0.07 ± 15% perf-profile.self.cycles-pp.mutex_lock 0.00 +0.1 0.07 ± 23% perf-profile.self.cycles-pp.llist_add_batch 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.__has_merged_page 0.00 +0.1 0.07 ± 18% perf-profile.self.cycles-pp.up_write 0.00 +0.1 0.07 ± 27% perf-profile.self.cycles-pp.__orc_find 0.00 +0.1 0.08 ± 31% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.00 +0.1 0.08 ± 22% perf-profile.self.cycles-pp.__list_del_entry_valid 0.00 +0.1 0.09 ± 28% perf-profile.self.cycles-pp.__radix_tree_lookup 0.01 ±200% +0.1 0.10 ± 28% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.00 +0.1 0.09 ± 29% perf-profile.self.cycles-pp.__account_scheduler_latency 0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.f2fs_do_sync_file 0.00 +0.1 0.10 ± 16% perf-profile.self.cycles-pp.down_write 0.00 +0.1 0.10 ± 27% perf-profile.self.cycles-pp.__get_node_page 0.00 +0.1 0.10 ± 27% perf-profile.self.cycles-pp.try_to_wake_up 0.00 +0.1 0.12 ± 20% perf-profile.self.cycles-pp.f2fs_allocate_data_block 0.00 +0.1 0.13 ± 21% perf-profile.self.cycles-pp.unwind_next_frame 0.01 ±200% +0.1 0.14 ± 20% perf-profile.self.cycles-pp.brd_do_bvec 0.03 ± 81% +0.1 0.16 ± 21% perf-profile.self.cycles-pp.f2fs_is_valid_blkaddr 0.00 +0.1 0.14 ± 21% perf-profile.self.cycles-pp.f2fs_balance_fs 0.00 +0.1 0.14 ± 25% perf-profile.self.cycles-pp.osq_unlock 0.02 ±122% +0.1 0.17 ± 28% perf-profile.self.cycles-pp.xas_find_marked 0.00 +0.2 0.16 ± 21% perf-profile.self.cycles-pp.update_sit_entry 0.00 +0.2 0.16 ± 22% perf-profile.self.cycles-pp.up_read 0.06 ± 12% +0.2 0.25 ± 24% perf-profile.self.cycles-pp.f2fs_fsync_node_pages 0.13 ± 8% +0.2 0.33 ± 18% perf-profile.self.cycles-pp._raw_spin_lock 0.07 ± 11% +0.2 0.28 ± 23% perf-profile.self.cycles-pp.down_read 0.12 ± 9% +0.2 0.35 ± 23% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.08 ± 6% +0.2 0.30 ± 16% perf-profile.self.cycles-pp.__percpu_counter_sum 0.00 +0.3 0.26 ± 24% perf-profile.self.cycles-pp.rwsem_down_read_slowpath 0.00 +0.4 0.42 ± 21% perf-profile.self.cycles-pp.mutex_spin_on_owner 0.09 ± 12% +0.6 0.65 ± 26% perf-profile.self.cycles-pp.release_pages 0.45 ± 9% +0.6 1.05 ± 20% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.25 ± 8% +1.1 1.31 ± 25% perf-profile.self.cycles-pp.find_get_pages_range_tag 0.72 ± 9% +4.4 5.10 ± 21% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 43728 ± 4% -29.1% 30986 ± 10% softirqs.CPU0.RCU 109444 ± 3% -75.6% 26711 ± 13% softirqs.CPU0.SCHED 339195 ± 5% -78.2% 73813 ± 16% softirqs.CPU0.TIMER 39399 -32.4% 26645 ± 8% softirqs.CPU1.RCU 103015 ± 3% -75.9% 24851 ± 10% softirqs.CPU1.SCHED 315672 ± 5% -79.6% 64493 ± 14% softirqs.CPU1.TIMER 38813 -32.0% 26409 ± 7% softirqs.CPU10.RCU 102980 ± 3% -76.7% 23980 ± 13% softirqs.CPU10.SCHED 315372 ± 5% -80.0% 63182 ± 16% softirqs.CPU10.TIMER 38721 ± 2% -32.7% 26042 ± 7% softirqs.CPU100.RCU 103337 ± 4% -77.0% 23811 ± 11% softirqs.CPU100.SCHED 321248 ± 5% -80.8% 61781 ± 15% softirqs.CPU100.TIMER 38593 ± 2% -32.2% 26164 ± 6% softirqs.CPU101.RCU 105394 ± 4% -77.5% 23741 ± 11% softirqs.CPU101.SCHED 321052 ± 5% -80.8% 61675 ± 15% softirqs.CPU101.TIMER 38708 ± 2% -32.5% 26114 ± 7% softirqs.CPU102.RCU 105906 ± 3% -77.7% 23601 ± 12% softirqs.CPU102.SCHED 321659 ± 5% -80.8% 61831 ± 15% softirqs.CPU102.TIMER 38449 -32.2% 26072 ± 5% softirqs.CPU103.RCU 106174 ± 3% -78.3% 22988 ± 7% softirqs.CPU103.SCHED 319597 ± 5% -80.5% 62254 ± 14% softirqs.CPU103.TIMER 38271 ± 2% -32.4% 25884 ± 6% softirqs.CPU104.RCU 104278 ± 2% -77.3% 23691 ± 11% softirqs.CPU104.SCHED 317219 ± 5% -80.7% 61369 ± 15% softirqs.CPU104.TIMER 38340 -32.3% 25955 ± 6% softirqs.CPU105.RCU 105404 ± 3% -77.6% 23652 ± 10% softirqs.CPU105.SCHED 318495 ± 5% -80.7% 61429 ± 15% softirqs.CPU105.TIMER 38466 ± 2% -32.5% 25954 ± 6% softirqs.CPU106.RCU 105956 ± 3% -78.1% 23172 ± 14% softirqs.CPU106.SCHED 320347 ± 5% -80.9% 61315 ± 15% softirqs.CPU106.TIMER 38651 ± 2% -32.5% 26077 ± 7% softirqs.CPU107.RCU 104312 ± 4% -77.3% 23677 ± 11% softirqs.CPU107.SCHED 321286 ± 5% -80.8% 61647 ± 15% softirqs.CPU107.TIMER 38814 ± 2% -32.7% 26121 ± 7% softirqs.CPU108.RCU 105948 ± 2% -77.7% 23599 ± 10% softirqs.CPU108.SCHED 321249 ± 4% -80.9% 61270 ± 15% softirqs.CPU108.TIMER 38197 ± 2% -32.6% 25756 ± 7% softirqs.CPU109.RCU 104668 ± 3% -77.4% 23673 ± 11% softirqs.CPU109.SCHED 317400 ± 5% -80.5% 61886 ± 14% softirqs.CPU109.TIMER 38930 ± 2% -31.9% 26503 ± 6% softirqs.CPU11.RCU 104054 ± 2% -77.2% 23719 ± 11% softirqs.CPU11.SCHED 314476 ± 5% -80.0% 63014 ± 15% softirqs.CPU11.TIMER 38335 ± 2% -32.5% 25865 ± 7% softirqs.CPU110.RCU 104575 ± 3% -77.4% 23672 ± 10% softirqs.CPU110.SCHED 316664 ± 5% -80.6% 61392 ± 15% softirqs.CPU110.TIMER 38404 ± 2% -32.7% 25851 ± 6% softirqs.CPU111.RCU 105567 ± 3% -77.6% 23654 ± 11% softirqs.CPU111.SCHED 323237 ± 5% -81.0% 61533 ± 15% softirqs.CPU111.TIMER 38683 ± 2% -30.9% 26734 ± 7% softirqs.CPU112.RCU 105755 ± 2% -77.6% 23670 ± 11% softirqs.CPU112.SCHED 320786 ± 5% -80.8% 61672 ± 15% softirqs.CPU112.TIMER 38881 -30.9% 26876 ± 8% softirqs.CPU113.RCU 106405 ± 3% -77.6% 23790 ± 11% softirqs.CPU113.SCHED 321051 ± 5% -80.7% 61815 ± 15% softirqs.CPU113.TIMER 39041 ± 2% -31.6% 26695 ± 7% softirqs.CPU114.RCU 106151 ± 4% -77.5% 23891 ± 11% softirqs.CPU114.SCHED 323320 ± 5% -80.8% 62037 ± 15% softirqs.CPU114.TIMER 38871 ± 2% -31.6% 26593 ± 7% softirqs.CPU115.RCU 105317 ± 3% -77.5% 23735 ± 11% softirqs.CPU115.SCHED 319916 ± 5% -80.8% 61449 ± 15% softirqs.CPU115.TIMER 38390 ± 3% -30.7% 26593 ± 7% softirqs.CPU116.RCU 107012 ± 2% -77.8% 23742 ± 10% softirqs.CPU116.SCHED 321325 ± 5% -80.8% 61817 ± 15% softirqs.CPU116.TIMER 38776 -31.3% 26641 ± 6% softirqs.CPU117.RCU 105110 ± 4% -77.4% 23763 ± 11% softirqs.CPU117.SCHED 319810 ± 4% -80.8% 61422 ± 15% softirqs.CPU117.TIMER 38846 ± 2% -31.4% 26640 ± 7% softirqs.CPU118.RCU 106071 ± 3% -77.8% 23528 ± 10% softirqs.CPU118.SCHED 319672 ± 5% -80.8% 61416 ± 15% softirqs.CPU118.TIMER 38855 -31.7% 26535 ± 7% softirqs.CPU119.RCU 105792 ± 2% -77.5% 23805 ± 11% softirqs.CPU119.SCHED 319023 ± 5% -80.8% 61371 ± 15% softirqs.CPU119.TIMER 39200 ± 2% -32.2% 26569 ± 7% softirqs.CPU12.RCU 103205 ± 2% -76.8% 23907 ± 11% softirqs.CPU12.SCHED 317087 ± 6% -80.0% 63314 ± 16% softirqs.CPU12.TIMER 39395 -31.6% 26933 ± 8% softirqs.CPU120.RCU 105766 ± 2% -77.6% 23701 ± 11% softirqs.CPU120.SCHED 324484 ± 3% -80.8% 62154 ± 14% softirqs.CPU120.TIMER 39174 -32.4% 26488 ± 6% softirqs.CPU121.RCU 105328 ± 3% -77.6% 23616 ± 10% softirqs.CPU121.SCHED 324237 ± 4% -81.0% 61475 ± 14% softirqs.CPU121.TIMER 39304 -32.6% 26479 ± 6% softirqs.CPU122.RCU 105789 ± 3% -77.9% 23424 ± 10% softirqs.CPU122.SCHED 325339 ± 4% -81.3% 60837 ± 14% softirqs.CPU122.TIMER 39540 ± 2% -32.7% 26594 ± 6% softirqs.CPU123.RCU 105462 ± 3% -77.4% 23827 ± 11% softirqs.CPU123.SCHED 326564 ± 4% -81.0% 62113 ± 15% softirqs.CPU123.TIMER 39343 ± 2% -32.5% 26575 ± 6% softirqs.CPU124.RCU 105583 ± 2% -77.5% 23751 ± 11% softirqs.CPU124.SCHED 325023 ± 4% -81.0% 61742 ± 14% softirqs.CPU124.TIMER 39519 -32.7% 26613 ± 6% softirqs.CPU125.RCU 106100 ± 4% -77.6% 23721 ± 11% softirqs.CPU125.SCHED 326100 ± 4% -81.1% 61705 ± 14% softirqs.CPU125.TIMER 40241 ± 3% -33.8% 26655 ± 6% softirqs.CPU126.RCU 106265 ± 3% -77.6% 23816 ± 11% softirqs.CPU126.SCHED 326128 ± 4% -81.1% 61787 ± 15% softirqs.CPU126.TIMER 39243 -32.0% 26681 ± 6% softirqs.CPU127.RCU 105479 ± 2% -77.9% 23358 ± 8% softirqs.CPU127.SCHED 324707 ± 4% -81.0% 61636 ± 15% softirqs.CPU127.TIMER 38935 -33.7% 25833 ± 6% softirqs.CPU128.RCU 104755 -77.6% 23511 ± 9% softirqs.CPU128.SCHED 322793 ± 4% -80.9% 61692 ± 14% softirqs.CPU128.TIMER 38459 -33.1% 25724 ± 6% softirqs.CPU129.RCU 105830 ± 2% -77.8% 23460 ± 10% softirqs.CPU129.SCHED 322798 ± 3% -80.9% 61707 ± 15% softirqs.CPU129.TIMER 38843 ± 3% -31.9% 26448 ± 7% softirqs.CPU13.RCU 104235 ± 3% -77.1% 23901 ± 10% softirqs.CPU13.SCHED 317117 ± 5% -79.9% 63752 ± 15% softirqs.CPU13.TIMER 38387 -32.8% 25815 ± 6% softirqs.CPU130.RCU 103814 ± 4% -77.1% 23729 ± 11% softirqs.CPU130.SCHED 325519 ± 4% -81.1% 61615 ± 15% softirqs.CPU130.TIMER 38841 -33.5% 25821 ± 6% softirqs.CPU131.RCU 106323 ± 3% -77.6% 23825 ± 11% softirqs.CPU131.SCHED 325941 ± 4% -80.9% 62158 ± 15% softirqs.CPU131.TIMER 39032 -33.5% 25947 ± 6% softirqs.CPU132.RCU 105094 ± 4% -77.4% 23778 ± 11% softirqs.CPU132.SCHED 324315 ± 4% -80.9% 61936 ± 15% softirqs.CPU132.TIMER 38376 -32.6% 25865 ± 6% softirqs.CPU133.RCU 104304 ± 3% -77.2% 23766 ± 11% softirqs.CPU133.SCHED 321727 ± 3% -80.8% 61666 ± 15% softirqs.CPU133.TIMER 38745 -33.5% 25757 ± 6% softirqs.CPU134.RCU 105482 ± 3% -77.6% 23657 ± 11% softirqs.CPU134.SCHED 325026 ± 4% -81.1% 61311 ± 15% softirqs.CPU134.TIMER 38436 ± 2% -33.3% 25628 ± 6% softirqs.CPU135.RCU 105533 ± 4% -77.5% 23704 ± 11% softirqs.CPU135.SCHED 323329 ± 4% -80.9% 61679 ± 15% softirqs.CPU135.TIMER 38967 ± 4% -34.2% 25647 ± 6% softirqs.CPU136.RCU 105374 ± 3% -77.5% 23712 ± 11% softirqs.CPU136.SCHED 324202 ± 5% -81.0% 61556 ± 15% softirqs.CPU136.TIMER 39130 ± 2% -34.0% 25842 ± 6% softirqs.CPU137.RCU 106097 ± 3% -77.6% 23809 ± 11% softirqs.CPU137.SCHED 325456 ± 4% -81.0% 61786 ± 15% softirqs.CPU137.TIMER 38706 ± 2% -33.0% 25944 ± 7% softirqs.CPU138.RCU 105803 ± 2% -77.5% 23778 ± 11% softirqs.CPU138.SCHED 325891 ± 4% -81.0% 61810 ± 14% softirqs.CPU138.TIMER 38605 -33.7% 25598 ± 6% softirqs.CPU139.RCU 105652 ± 3% -77.6% 23663 ± 11% softirqs.CPU139.SCHED 323205 ± 4% -81.0% 61438 ± 15% softirqs.CPU139.TIMER 38533 ± 2% -31.8% 26279 ± 7% softirqs.CPU14.RCU 103886 ± 3% -77.6% 23282 ± 13% softirqs.CPU14.SCHED 316556 ± 5% -80.1% 62904 ± 15% softirqs.CPU14.TIMER 38456 -33.2% 25680 ± 6% softirqs.CPU140.RCU 105541 ± 3% -77.5% 23797 ± 11% softirqs.CPU140.SCHED 323754 ± 3% -80.9% 61937 ± 15% softirqs.CPU140.TIMER 38400 -33.2% 25665 ± 5% softirqs.CPU141.RCU 105977 ± 3% -77.6% 23695 ± 11% softirqs.CPU141.SCHED 323714 ± 4% -81.0% 61587 ± 14% softirqs.CPU141.TIMER 38760 ± 2% -33.4% 25824 ± 6% softirqs.CPU142.RCU 105231 ± 2% -77.4% 23831 ± 11% softirqs.CPU142.SCHED 323574 ± 4% -80.9% 61889 ± 14% softirqs.CPU142.TIMER 39016 ± 2% -34.1% 25693 ± 6% softirqs.CPU143.RCU 106323 ± 3% -77.7% 23715 ± 10% softirqs.CPU143.SCHED 325075 ± 4% -81.1% 61407 ± 14% softirqs.CPU143.TIMER 38355 -33.8% 25396 ± 5% softirqs.CPU144.RCU 105479 ± 3% -77.4% 23853 ± 11% softirqs.CPU144.SCHED 317365 ± 4% -80.7% 61116 ± 13% softirqs.CPU144.TIMER 38978 -34.5% 25520 ± 6% softirqs.CPU145.RCU 105315 ± 2% -77.2% 23975 ± 12% softirqs.CPU145.SCHED 318767 ± 5% -80.9% 61008 ± 14% softirqs.CPU145.TIMER 38207 -33.5% 25401 ± 6% softirqs.CPU146.RCU 105995 ± 2% -77.6% 23771 ± 10% softirqs.CPU146.SCHED 320447 ± 5% -80.9% 61313 ± 13% softirqs.CPU146.TIMER 38092 -33.6% 25299 ± 6% softirqs.CPU147.RCU 105805 ± 4% -77.5% 23805 ± 10% softirqs.CPU147.SCHED 321396 ± 5% -80.9% 61302 ± 13% softirqs.CPU147.TIMER 38227 -33.9% 25266 ± 5% softirqs.CPU148.RCU 106074 ± 2% -77.6% 23736 ± 11% softirqs.CPU148.SCHED 320567 ± 5% -81.0% 60823 ± 14% softirqs.CPU148.TIMER 38456 -33.4% 25596 ± 5% softirqs.CPU149.RCU 106480 ± 3% -77.8% 23675 ± 11% softirqs.CPU149.SCHED 319766 ± 5% -80.8% 61417 ± 13% softirqs.CPU149.TIMER 38913 -32.4% 26297 ± 7% softirqs.CPU15.RCU 104794 ± 2% -77.2% 23850 ± 11% softirqs.CPU15.SCHED 315838 ± 5% -80.1% 62944 ± 16% softirqs.CPU15.TIMER 38404 -34.4% 25189 ± 5% softirqs.CPU150.RCU 105312 ± 2% -77.1% 24107 ± 13% softirqs.CPU150.SCHED 321235 ± 5% -78.7% 68354 ± 32% softirqs.CPU150.TIMER 37573 ± 2% -32.6% 25318 ± 5% softirqs.CPU151.RCU 101482 ± 4% -76.7% 23681 ± 10% softirqs.CPU151.SCHED 315839 ± 4% -80.8% 60629 ± 13% softirqs.CPU151.TIMER 37977 -32.3% 25711 ± 7% softirqs.CPU152.RCU 105444 ± 3% -77.6% 23569 ± 11% softirqs.CPU152.SCHED 319250 ± 4% -80.6% 61905 ± 15% softirqs.CPU152.TIMER 38260 -33.9% 25294 ± 5% softirqs.CPU153.RCU 106282 ± 3% -77.7% 23725 ± 11% softirqs.CPU153.SCHED 320761 ± 5% -81.0% 60821 ± 14% softirqs.CPU153.TIMER 38746 ± 2% -33.2% 25894 ± 7% softirqs.CPU154.RCU 106104 ± 3% -77.3% 24035 ± 12% softirqs.CPU154.SCHED 319478 ± 5% -78.2% 69496 ± 29% softirqs.CPU154.TIMER 39070 -33.9% 25821 ± 6% softirqs.CPU155.RCU 105488 ± 2% -77.8% 23443 ± 11% softirqs.CPU155.SCHED 320040 ± 4% -81.0% 60769 ± 14% softirqs.CPU155.TIMER 38036 -33.3% 25387 ± 6% softirqs.CPU156.RCU 104271 ± 4% -77.3% 23648 ± 11% softirqs.CPU156.SCHED 314164 ± 5% -80.7% 60505 ± 14% softirqs.CPU156.TIMER 38224 -33.8% 25320 ± 6% softirqs.CPU157.RCU 103028 ± 3% -77.3% 23414 ± 13% softirqs.CPU157.SCHED 315464 ± 4% -80.8% 60589 ± 13% softirqs.CPU157.TIMER 37833 -33.7% 25076 ± 5% softirqs.CPU158.RCU 105898 ± 2% -77.7% 23631 ± 10% softirqs.CPU158.SCHED 319067 ± 5% -81.0% 60733 ± 13% softirqs.CPU158.TIMER 38156 -34.0% 25164 ± 5% softirqs.CPU159.RCU 104825 ± 3% -77.5% 23631 ± 11% softirqs.CPU159.SCHED 319695 ± 4% -81.1% 60493 ± 14% softirqs.CPU159.TIMER 39346 ± 2% -30.9% 27170 ± 7% softirqs.CPU16.RCU 104094 ± 3% -77.1% 23826 ± 11% softirqs.CPU16.SCHED 314323 ± 5% -80.0% 62969 ± 15% softirqs.CPU16.TIMER 39627 -32.5% 26758 ± 5% softirqs.CPU160.RCU 107897 ± 3% -78.7% 22964 ± 7% softirqs.CPU160.SCHED 347619 ± 14% -82.6% 60577 ± 13% softirqs.CPU160.TIMER 39609 -32.3% 26804 ± 6% softirqs.CPU161.RCU 106352 ± 3% -78.6% 22739 ± 11% softirqs.CPU161.SCHED 319768 ± 5% -81.0% 60875 ± 13% softirqs.CPU161.TIMER 39982 -32.4% 27047 ± 6% softirqs.CPU162.RCU 106144 ± 3% -78.5% 22864 ± 7% softirqs.CPU162.SCHED 318374 ± 5% -81.0% 60411 ± 13% softirqs.CPU162.TIMER 39977 -32.4% 27026 ± 5% softirqs.CPU163.RCU 106157 ± 3% -77.5% 23875 ± 11% softirqs.CPU163.SCHED 318535 ± 5% -81.0% 60540 ± 13% softirqs.CPU163.TIMER 39834 -33.0% 26696 ± 6% softirqs.CPU164.RCU 106314 ± 3% -78.5% 22811 ± 11% softirqs.CPU164.SCHED 321013 ± 5% -81.1% 60670 ± 14% softirqs.CPU164.TIMER 39571 -31.8% 26994 ± 7% softirqs.CPU165.RCU 105687 ± 3% -77.5% 23817 ± 11% softirqs.CPU165.SCHED 316976 ± 5% -80.6% 61361 ± 16% softirqs.CPU165.TIMER 39769 -31.9% 27063 ± 4% softirqs.CPU166.RCU 106553 ± 3% -77.8% 23697 ± 11% softirqs.CPU166.SCHED 319814 ± 5% -81.0% 60740 ± 14% softirqs.CPU166.TIMER 40361 ± 2% -33.7% 26774 ± 5% softirqs.CPU167.RCU 105717 ± 2% -77.8% 23502 ± 12% softirqs.CPU167.SCHED 319158 ± 5% -80.9% 60846 ± 14% softirqs.CPU167.TIMER 37451 -32.2% 25400 ± 6% softirqs.CPU168.RCU 106591 ± 3% -78.0% 23455 ± 10% softirqs.CPU168.SCHED 326882 ± 3% -81.0% 62146 ± 14% softirqs.CPU168.TIMER 37832 -33.5% 25145 ± 8% softirqs.CPU169.RCU 104005 ± 3% -77.1% 23825 ± 10% softirqs.CPU169.SCHED 321720 ± 4% -81.3% 60254 ± 16% softirqs.CPU169.TIMER 39409 ± 2% -31.0% 27212 ± 7% softirqs.CPU17.RCU 104453 ± 3% -77.2% 23823 ± 11% softirqs.CPU17.SCHED 314553 ± 5% -80.0% 62997 ± 16% softirqs.CPU17.TIMER 37872 -33.0% 25381 ± 6% softirqs.CPU170.RCU 105879 ± 3% -77.5% 23775 ± 12% softirqs.CPU170.SCHED 326178 ± 3% -81.0% 61893 ± 15% softirqs.CPU170.TIMER 37495 -32.5% 25291 ± 6% softirqs.CPU171.RCU 106964 ± 3% -77.6% 23987 ± 11% softirqs.CPU171.SCHED 327826 ± 4% -81.1% 62056 ± 15% softirqs.CPU171.TIMER 37580 -33.0% 25191 ± 7% softirqs.CPU172.RCU 107225 ± 3% -77.7% 23942 ± 11% softirqs.CPU172.SCHED 327592 ± 4% -81.1% 61839 ± 15% softirqs.CPU172.TIMER 37452 -32.7% 25208 ± 7% softirqs.CPU173.RCU 106656 ± 3% -77.4% 24109 ± 12% softirqs.CPU173.SCHED 324770 ± 3% -80.8% 62264 ± 16% softirqs.CPU173.TIMER 37554 -32.3% 25439 ± 7% softirqs.CPU174.RCU 106980 ± 2% -77.4% 24204 ± 10% softirqs.CPU174.SCHED 326356 ± 3% -80.9% 62386 ± 14% softirqs.CPU174.TIMER 37500 -31.6% 25649 ± 8% softirqs.CPU175.RCU 105194 ± 2% -77.6% 23524 ± 13% softirqs.CPU175.SCHED 320325 ± 2% -80.9% 61250 ± 15% softirqs.CPU175.TIMER 36751 -33.4% 24483 ± 6% softirqs.CPU176.RCU 104153 ± 2% -77.4% 23562 ± 12% softirqs.CPU176.SCHED 317899 ± 2% -80.8% 61028 ± 15% softirqs.CPU176.TIMER 36901 -33.8% 24424 ± 6% softirqs.CPU177.RCU 104332 ± 6% -77.2% 23759 ± 10% softirqs.CPU177.SCHED 324245 ± 4% -81.2% 61016 ± 15% softirqs.CPU177.TIMER 36997 ± 2% -33.8% 24493 ± 6% softirqs.CPU178.RCU 105760 ± 3% -77.6% 23727 ± 11% softirqs.CPU178.SCHED 322862 ± 3% -81.0% 61271 ± 15% softirqs.CPU178.TIMER 37132 -33.7% 24628 ± 6% softirqs.CPU179.RCU 106509 ± 2% -77.6% 23815 ± 11% softirqs.CPU179.SCHED 326307 ± 3% -81.1% 61651 ± 14% softirqs.CPU179.TIMER 39329 ± 2% -31.5% 26932 ± 7% softirqs.CPU18.RCU 104815 ± 3% -77.4% 23736 ± 11% softirqs.CPU18.SCHED 314958 ± 5% -80.0% 62936 ± 15% softirqs.CPU18.TIMER 37339 -33.4% 24886 ± 7% softirqs.CPU180.RCU 105582 ± 4% -77.4% 23819 ± 11% softirqs.CPU180.SCHED 323259 ± 3% -80.9% 61867 ± 14% softirqs.CPU180.TIMER 37178 -33.3% 24806 ± 7% softirqs.CPU181.RCU 106714 ± 3% -77.6% 23850 ± 10% softirqs.CPU181.SCHED 325532 ± 3% -81.1% 61524 ± 15% softirqs.CPU181.TIMER 37293 ± 2% -33.6% 24754 ± 5% softirqs.CPU182.RCU 106464 ± 3% -77.6% 23854 ± 11% softirqs.CPU182.SCHED 324518 ± 3% -81.1% 61251 ± 15% softirqs.CPU182.TIMER 36861 ± 2% -33.8% 24418 ± 6% softirqs.CPU183.RCU 105652 ± 2% -77.4% 23833 ± 10% softirqs.CPU183.SCHED 322813 ± 3% -81.0% 61391 ± 14% softirqs.CPU183.TIMER 36576 -33.1% 24479 ± 6% softirqs.CPU184.RCU 105286 ± 2% -77.4% 23769 ± 11% softirqs.CPU184.SCHED 318664 ± 2% -80.8% 61061 ± 15% softirqs.CPU184.TIMER 37274 ± 2% -34.5% 24409 ± 6% softirqs.CPU185.RCU 106155 ± 3% -77.4% 23944 ± 11% softirqs.CPU185.SCHED 324516 ± 3% -81.3% 60751 ± 17% softirqs.CPU185.TIMER 36927 -33.5% 24539 ± 6% softirqs.CPU186.RCU 106828 ± 3% -77.7% 23843 ± 11% softirqs.CPU186.SCHED 326229 ± 3% -81.1% 61783 ± 15% softirqs.CPU186.TIMER 36855 -32.8% 24750 ± 5% softirqs.CPU187.RCU 105125 -77.2% 23962 ± 10% softirqs.CPU187.SCHED 321392 ± 3% -81.0% 61102 ± 15% softirqs.CPU187.TIMER 36738 -33.5% 24437 ± 6% softirqs.CPU188.RCU 105977 ± 2% -77.5% 23827 ± 11% softirqs.CPU188.SCHED 324488 ± 4% -81.1% 61472 ± 15% softirqs.CPU188.TIMER 36889 -33.7% 24457 ± 6% softirqs.CPU189.RCU 106623 ± 3% -77.7% 23758 ± 10% softirqs.CPU189.SCHED 325816 ± 4% -81.1% 61610 ± 15% softirqs.CPU189.TIMER 39485 ± 2% -31.8% 26930 ± 7% softirqs.CPU19.RCU 103935 ± 3% -77.1% 23769 ± 11% softirqs.CPU19.SCHED 314653 ± 5% -80.1% 62605 ± 15% softirqs.CPU19.TIMER 37069 -33.1% 24797 ± 5% softirqs.CPU190.RCU 107051 ± 3% -77.8% 23809 ± 11% softirqs.CPU190.SCHED 328056 ± 4% -81.1% 61884 ± 15% softirqs.CPU190.TIMER 37553 ± 3% -33.8% 24877 ± 5% softirqs.CPU191.RCU 107000 ± 3% -77.9% 23671 ± 12% softirqs.CPU191.SCHED 326739 ± 4% -81.0% 62158 ± 14% softirqs.CPU191.TIMER 39112 -32.1% 26561 ± 9% softirqs.CPU2.RCU 103603 ± 2% -76.9% 23971 ± 10% softirqs.CPU2.SCHED 315235 ± 5% -80.0% 63005 ± 16% softirqs.CPU2.TIMER 38746 ± 4% -30.5% 26919 ± 7% softirqs.CPU20.RCU 105442 ± 2% -77.7% 23520 ± 12% softirqs.CPU20.SCHED 344913 ± 12% -81.7% 62974 ± 15% softirqs.CPU20.TIMER 39173 -30.8% 27124 ± 7% softirqs.CPU21.RCU 104010 ± 3% -77.3% 23561 ± 11% softirqs.CPU21.SCHED 313897 ± 5% -80.0% 62797 ± 15% softirqs.CPU21.TIMER 39553 -31.7% 27010 ± 7% softirqs.CPU22.RCU 104678 ± 3% -77.3% 23718 ± 10% softirqs.CPU22.SCHED 315825 ± 5% -80.2% 62673 ± 15% softirqs.CPU22.TIMER 39343 ± 2% -31.2% 27068 ± 7% softirqs.CPU23.RCU 103357 ± 4% -77.0% 23746 ± 11% softirqs.CPU23.SCHED 315053 ± 5% -80.1% 62755 ± 15% softirqs.CPU23.TIMER 39838 -31.9% 27129 ± 6% softirqs.CPU24.RCU 101724 ± 2% -76.5% 23885 ± 10% softirqs.CPU24.SCHED 322399 ± 3% -80.3% 63455 ± 15% softirqs.CPU24.TIMER 39935 -32.3% 27051 ± 6% softirqs.CPU25.RCU 103556 ± 3% -77.2% 23656 ± 10% softirqs.CPU25.SCHED 323520 ± 3% -80.6% 62875 ± 15% softirqs.CPU25.TIMER 39717 -32.2% 26923 ± 6% softirqs.CPU26.RCU 102237 ± 4% -77.9% 22585 ± 11% softirqs.CPU26.SCHED 317102 ± 3% -81.3% 59454 ± 16% softirqs.CPU26.TIMER 39792 -32.0% 27070 ± 6% softirqs.CPU27.RCU 104949 ± 3% -77.8% 23308 ± 12% softirqs.CPU27.SCHED 321255 ± 3% -80.3% 63420 ± 15% softirqs.CPU27.TIMER 40447 ± 4% -33.6% 26851 ± 6% softirqs.CPU28.RCU 104178 ± 3% -77.2% 23701 ± 11% softirqs.CPU28.SCHED 322220 ± 3% -80.5% 62878 ± 15% softirqs.CPU28.TIMER 40068 ± 2% -32.8% 26929 ± 6% softirqs.CPU29.RCU 105244 ± 3% -77.5% 23713 ± 11% softirqs.CPU29.SCHED 321058 ± 3% -80.4% 62876 ± 15% softirqs.CPU29.TIMER 39036 -32.4% 26393 ± 6% softirqs.CPU3.RCU 105165 ± 3% -77.2% 23937 ± 11% softirqs.CPU3.SCHED 316079 ± 5% -80.0% 63183 ± 15% softirqs.CPU3.TIMER 39748 -32.1% 27005 ± 6% softirqs.CPU30.RCU 102851 ± 2% -77.4% 23214 ± 14% softirqs.CPU30.SCHED 321305 ± 3% -80.4% 62902 ± 15% softirqs.CPU30.TIMER 39629 -31.4% 27175 ± 6% softirqs.CPU31.RCU 103868 ± 2% -77.1% 23793 ± 10% softirqs.CPU31.SCHED 320260 ± 3% -80.3% 63232 ± 14% softirqs.CPU31.TIMER 39459 -33.0% 26425 ± 6% softirqs.CPU32.RCU 104500 ± 3% -77.3% 23702 ± 11% softirqs.CPU32.SCHED 320466 ± 3% -80.3% 63004 ± 15% softirqs.CPU32.TIMER 39202 -32.9% 26289 ± 6% softirqs.CPU33.RCU 104156 ± 3% -77.2% 23729 ± 11% softirqs.CPU33.SCHED 320917 ± 3% -80.3% 63114 ± 16% softirqs.CPU33.TIMER 39206 -32.5% 26470 ± 7% softirqs.CPU34.RCU 104050 ± 2% -77.1% 23836 ± 11% softirqs.CPU34.SCHED 322745 ± 3% -80.4% 63416 ± 16% softirqs.CPU34.TIMER 39259 -32.9% 26356 ± 6% softirqs.CPU35.RCU 104804 ± 3% -77.3% 23774 ± 11% softirqs.CPU35.SCHED 320908 ± 3% -80.3% 63181 ± 15% softirqs.CPU35.TIMER 39574 ± 2% -33.6% 26259 ± 6% softirqs.CPU36.RCU 104792 ± 2% -77.3% 23754 ± 11% softirqs.CPU36.SCHED 320375 ± 3% -80.3% 62966 ± 15% softirqs.CPU36.TIMER 39237 -32.7% 26388 ± 6% softirqs.CPU37.RCU 103864 ± 3% -77.2% 23695 ± 11% softirqs.CPU37.SCHED 323739 ± 3% -80.6% 62810 ± 15% softirqs.CPU37.TIMER 39463 -33.6% 26209 ± 6% softirqs.CPU38.RCU 104503 ± 2% -77.4% 23654 ± 11% softirqs.CPU38.SCHED 322559 ± 3% -80.6% 62638 ± 15% softirqs.CPU38.TIMER 39381 ± 2% -32.7% 26513 ± 7% softirqs.CPU39.RCU 102928 ± 4% -76.9% 23733 ± 11% softirqs.CPU39.SCHED 322354 ± 2% -80.3% 63459 ± 16% softirqs.CPU39.TIMER 39340 -32.4% 26602 ± 6% softirqs.CPU4.RCU 104042 ± 4% -77.1% 23799 ± 12% softirqs.CPU4.SCHED 316106 ± 5% -80.0% 63259 ± 16% softirqs.CPU4.TIMER 39540 ± 3% -33.5% 26298 ± 7% softirqs.CPU40.RCU 104044 ± 3% -77.1% 23873 ± 11% softirqs.CPU40.SCHED 320611 ± 3% -80.4% 62906 ± 15% softirqs.CPU40.TIMER 39332 -33.3% 26219 ± 6% softirqs.CPU41.RCU 104642 ± 2% -77.3% 23734 ± 11% softirqs.CPU41.SCHED 321284 ± 3% -80.4% 62814 ± 15% softirqs.CPU41.TIMER 39297 -33.3% 26207 ± 6% softirqs.CPU42.RCU 104394 ± 3% -77.3% 23704 ± 11% softirqs.CPU42.SCHED 320615 ± 3% -80.4% 62835 ± 15% softirqs.CPU42.TIMER 39528 -33.4% 26340 ± 6% softirqs.CPU43.RCU 103840 ± 3% -77.1% 23747 ± 11% softirqs.CPU43.SCHED 321044 ± 3% -80.5% 62732 ± 15% softirqs.CPU43.TIMER 39291 -33.2% 26252 ± 6% softirqs.CPU44.RCU 104222 ± 3% -77.3% 23611 ± 10% softirqs.CPU44.SCHED 319951 ± 3% -80.4% 62781 ± 15% softirqs.CPU44.TIMER 39170 -33.5% 26041 ± 6% softirqs.CPU45.RCU 104312 ± 2% -77.3% 23658 ± 11% softirqs.CPU45.SCHED 321419 ± 3% -80.5% 62664 ± 15% softirqs.CPU45.TIMER 39168 -33.3% 26125 ± 6% softirqs.CPU46.RCU 104970 ± 3% -77.4% 23758 ± 11% softirqs.CPU46.SCHED 321098 ± 3% -80.4% 62962 ± 15% softirqs.CPU46.TIMER 39409 ± 2% -33.5% 26192 ± 6% softirqs.CPU47.RCU 104346 ± 3% -77.3% 23733 ± 11% softirqs.CPU47.SCHED 320909 ± 3% -80.4% 62806 ± 15% softirqs.CPU47.TIMER 39070 ± 2% -33.5% 25999 ± 5% softirqs.CPU48.RCU 101010 ± 3% -76.2% 24012 ± 10% softirqs.CPU48.SCHED 314239 ± 3% -80.1% 62614 ± 13% softirqs.CPU48.TIMER 38803 -33.6% 25751 ± 5% softirqs.CPU49.RCU 103195 ± 2% -77.1% 23679 ± 10% softirqs.CPU49.SCHED 312361 ± 4% -80.2% 61801 ± 14% softirqs.CPU49.TIMER 39185 ± 2% -32.3% 26536 ± 6% softirqs.CPU5.RCU 104414 ± 3% -77.4% 23590 ± 10% softirqs.CPU5.SCHED 316156 ± 5% -80.0% 63117 ± 15% softirqs.CPU5.TIMER 38793 -33.5% 25779 ± 6% softirqs.CPU50.RCU 103973 ± 2% -77.3% 23560 ± 12% softirqs.CPU50.SCHED 313392 ± 3% -80.2% 62068 ± 14% softirqs.CPU50.TIMER 38688 -33.0% 25928 ± 4% softirqs.CPU51.RCU 104523 ± 3% -77.4% 23651 ± 11% softirqs.CPU51.SCHED 314990 ± 3% -80.1% 62785 ± 13% softirqs.CPU51.TIMER 38989 -33.9% 25790 ± 5% softirqs.CPU52.RCU 102869 ± 3% -77.0% 23701 ± 11% softirqs.CPU52.SCHED 313144 ± 4% -80.2% 61994 ± 14% softirqs.CPU52.TIMER 38983 -33.8% 25814 ± 5% softirqs.CPU53.RCU 101736 ± 5% -76.7% 23656 ± 11% softirqs.CPU53.SCHED 312900 ± 4% -80.1% 62166 ± 14% softirqs.CPU53.TIMER 38972 -34.5% 25510 ± 5% softirqs.CPU54.RCU 104553 ± 3% -77.4% 23667 ± 11% softirqs.CPU54.SCHED 313818 ± 3% -80.3% 61673 ± 13% softirqs.CPU54.TIMER 38582 -32.4% 26076 ± 4% softirqs.CPU55.RCU 104914 ± 5% -77.5% 23571 ± 11% softirqs.CPU55.SCHED 347314 ± 16% -81.9% 62753 ± 13% softirqs.CPU55.TIMER 38644 -31.4% 26511 ± 4% softirqs.CPU56.RCU 104080 ± 2% -77.4% 23554 ± 11% softirqs.CPU56.SCHED 315039 ± 4% -80.1% 62727 ± 13% softirqs.CPU56.TIMER 38978 -33.7% 25851 ± 5% softirqs.CPU57.RCU 104075 ± 3% -77.3% 23648 ± 11% softirqs.CPU57.SCHED 313643 ± 3% -80.3% 61873 ± 14% softirqs.CPU57.TIMER 39130 -34.7% 25548 ± 5% softirqs.CPU58.RCU 104597 ± 2% -77.3% 23704 ± 11% softirqs.CPU58.SCHED 312916 ± 4% -80.4% 61418 ± 13% softirqs.CPU58.TIMER 39114 -33.4% 26038 ± 5% softirqs.CPU59.RCU 103394 ± 3% -77.1% 23663 ± 10% softirqs.CPU59.SCHED 313898 ± 4% -80.3% 61940 ± 14% softirqs.CPU59.TIMER 39952 ± 2% -33.2% 26696 ± 6% softirqs.CPU6.RCU 104455 ± 3% -77.3% 23734 ± 11% softirqs.CPU6.SCHED 316951 ± 5% -80.1% 63083 ± 15% softirqs.CPU6.TIMER 38420 -32.7% 25863 ± 5% softirqs.CPU60.RCU 103459 ± 3% -77.2% 23557 ± 11% softirqs.CPU60.SCHED 311837 ± 4% -80.2% 61728 ± 14% softirqs.CPU60.TIMER 38720 -33.1% 25918 ± 5% softirqs.CPU61.RCU 102683 ± 3% -77.0% 23587 ± 11% softirqs.CPU61.SCHED 312631 ± 4% -80.3% 61690 ± 14% softirqs.CPU61.TIMER 38901 ± 2% -34.1% 25649 ± 5% softirqs.CPU62.RCU 104147 ± 2% -77.6% 23308 ± 10% softirqs.CPU62.SCHED 313710 ± 3% -80.2% 61995 ± 13% softirqs.CPU62.TIMER 38666 -33.6% 25658 ± 5% softirqs.CPU63.RCU 103943 ± 3% -77.2% 23665 ± 11% softirqs.CPU63.SCHED 314619 ± 3% -80.3% 61873 ± 14% softirqs.CPU63.TIMER 39046 ± 3% -31.0% 26958 ± 5% softirqs.CPU64.RCU 104056 ± 2% -77.3% 23652 ± 11% softirqs.CPU64.SCHED 309033 ± 5% -80.0% 61939 ± 14% softirqs.CPU64.TIMER 40248 ± 2% -32.1% 27333 ± 4% softirqs.CPU65.RCU 104117 ± 2% -77.7% 23231 ± 14% softirqs.CPU65.SCHED 315140 ± 4% -80.2% 62484 ± 13% softirqs.CPU65.TIMER 40156 -32.4% 27148 ± 5% softirqs.CPU66.RCU 102971 ± 3% -77.1% 23579 ± 11% softirqs.CPU66.SCHED 312230 ± 4% -80.2% 61820 ± 14% softirqs.CPU66.TIMER 39868 -31.1% 27487 ± 7% softirqs.CPU67.RCU 103836 ± 2% -77.5% 23348 ± 11% softirqs.CPU67.SCHED 313111 ± 3% -80.2% 61841 ± 13% softirqs.CPU67.TIMER 39795 -32.4% 26899 ± 6% softirqs.CPU68.RCU 103181 ± 2% -77.1% 23667 ± 11% softirqs.CPU68.SCHED 314497 ± 3% -80.3% 61852 ± 14% softirqs.CPU68.TIMER 39749 -32.6% 26774 ± 6% softirqs.CPU69.RCU 104574 ± 3% -77.4% 23673 ± 10% softirqs.CPU69.SCHED 312780 ± 3% -80.3% 61632 ± 14% softirqs.CPU69.TIMER 38887 -32.5% 26239 ± 6% softirqs.CPU7.RCU 102408 ± 3% -76.9% 23672 ± 11% softirqs.CPU7.SCHED 314851 ± 5% -80.1% 62755 ± 15% softirqs.CPU7.TIMER 39662 -32.0% 26960 ± 6% softirqs.CPU70.RCU 104018 ± 3% -77.4% 23472 ± 9% softirqs.CPU70.SCHED 312736 ± 4% -80.2% 61774 ± 13% softirqs.CPU70.TIMER 39676 -32.3% 26874 ± 6% softirqs.CPU71.RCU 103797 ± 3% -77.2% 23660 ± 11% softirqs.CPU71.SCHED 313160 ± 3% -80.3% 61776 ± 14% softirqs.CPU71.TIMER 37350 -30.8% 25835 ± 7% softirqs.CPU72.RCU 104241 ± 5% -77.1% 23912 ± 10% softirqs.CPU72.SCHED 349237 ± 17% -81.9% 63220 ± 14% softirqs.CPU72.TIMER 37794 -31.4% 25932 ± 5% softirqs.CPU73.RCU 102835 ± 3% -76.7% 23984 ± 9% softirqs.CPU73.SCHED 314821 ± 2% -78.3% 68316 ± 17% softirqs.CPU73.TIMER 37747 -32.5% 25483 ± 6% softirqs.CPU74.RCU 104486 ± 2% -77.3% 23770 ± 10% softirqs.CPU74.SCHED 316070 ± 2% -80.2% 62488 ± 15% softirqs.CPU74.TIMER 37742 -32.3% 25563 ± 6% softirqs.CPU75.RCU 104890 ± 3% -77.2% 23865 ± 11% softirqs.CPU75.SCHED 317034 ± 2% -80.2% 62693 ± 15% softirqs.CPU75.TIMER 37779 -32.2% 25604 ± 6% softirqs.CPU76.RCU 105067 ± 2% -77.3% 23837 ± 11% softirqs.CPU76.SCHED 317236 ± 2% -80.3% 62509 ± 15% softirqs.CPU76.TIMER 38022 ± 2% -32.8% 25548 ± 6% softirqs.CPU77.RCU 104628 ± 2% -77.5% 23576 ± 11% softirqs.CPU77.SCHED 316046 ± 2% -80.2% 62444 ± 15% softirqs.CPU77.TIMER 37612 -32.3% 25469 ± 6% softirqs.CPU78.RCU 105005 ± 2% -77.3% 23831 ± 11% softirqs.CPU78.SCHED 315935 ± 2% -80.2% 62622 ± 15% softirqs.CPU78.TIMER 37667 -32.1% 25559 ± 6% softirqs.CPU79.RCU 103907 ± 2% -77.1% 23800 ± 11% softirqs.CPU79.SCHED 314457 ± 2% -80.2% 62281 ± 15% softirqs.CPU79.TIMER 38653 ± 2% -31.9% 26322 ± 7% softirqs.CPU8.RCU 103998 ± 2% -77.3% 23641 ± 11% softirqs.CPU8.SCHED 315378 ± 5% -80.1% 62892 ± 15% softirqs.CPU8.TIMER 37124 -33.0% 24858 ± 6% softirqs.CPU80.RCU 103803 ± 2% -77.1% 23739 ± 11% softirqs.CPU80.SCHED 315549 ± 2% -80.3% 62103 ± 15% softirqs.CPU80.TIMER 37270 ± 2% -33.2% 24914 ± 6% softirqs.CPU81.RCU 103551 ± 4% -77.1% 23736 ± 10% softirqs.CPU81.SCHED 317088 ± 2% -80.4% 62132 ± 15% softirqs.CPU81.TIMER 37348 -33.2% 24931 ± 6% softirqs.CPU82.RCU 104414 ± 2% -77.2% 23788 ± 10% softirqs.CPU82.SCHED 314482 -80.2% 62256 ± 15% softirqs.CPU82.TIMER 37613 -32.8% 25279 ± 6% softirqs.CPU83.RCU 104932 ± 2% -77.2% 23916 ± 10% softirqs.CPU83.SCHED 316202 ± 2% -80.2% 62632 ± 15% softirqs.CPU83.TIMER 37563 -32.9% 25191 ± 6% softirqs.CPU84.RCU 104718 ± 2% -77.3% 23788 ± 11% softirqs.CPU84.SCHED 315460 ± 2% -80.2% 62432 ± 15% softirqs.CPU84.TIMER 37197 -33.2% 24853 ± 6% softirqs.CPU85.RCU 104180 ± 3% -77.1% 23827 ± 11% softirqs.CPU85.SCHED 315747 ± 2% -80.3% 62245 ± 15% softirqs.CPU85.TIMER 37230 ± 2% -32.0% 25319 ± 8% softirqs.CPU86.RCU 104685 ± 2% -77.4% 23689 ± 11% softirqs.CPU86.SCHED 315886 ± 2% -80.0% 63059 ± 14% softirqs.CPU86.TIMER 37251 -32.7% 25075 ± 6% softirqs.CPU87.RCU 103911 ± 2% -77.1% 23744 ± 11% softirqs.CPU87.SCHED 315595 ± 2% -80.2% 62451 ± 14% softirqs.CPU87.TIMER 37193 -32.0% 25306 ± 7% softirqs.CPU88.RCU 104312 ± 2% -77.1% 23924 ± 11% softirqs.CPU88.SCHED 314873 ± 2% -80.2% 62324 ± 15% softirqs.CPU88.TIMER 37571 -33.3% 25067 ± 6% softirqs.CPU89.RCU 104982 ± 2% -77.0% 24115 ± 10% softirqs.CPU89.SCHED 315543 ± 2% -78.6% 67504 ± 14% softirqs.CPU89.TIMER 38667 ± 2% -32.1% 26261 ± 7% softirqs.CPU9.RCU 103825 ± 3% -77.2% 23708 ± 11% softirqs.CPU9.SCHED 316253 ± 5% -80.1% 63015 ± 15% softirqs.CPU9.TIMER 37570 -32.7% 25266 ± 6% softirqs.CPU90.RCU 105134 ± 2% -77.3% 23895 ± 11% softirqs.CPU90.SCHED 316147 ± 2% -80.2% 62550 ± 15% softirqs.CPU90.TIMER 37218 -32.8% 24996 ± 6% softirqs.CPU91.RCU 104444 ± 2% -77.2% 23824 ± 11% softirqs.CPU91.SCHED 315454 ± 2% -80.3% 62208 ± 15% softirqs.CPU91.TIMER 37356 -33.0% 25021 ± 6% softirqs.CPU92.RCU 104467 ± 3% -77.2% 23824 ± 10% softirqs.CPU92.SCHED 316063 ± 2% -80.2% 62453 ± 15% softirqs.CPU92.TIMER 37322 -33.0% 25023 ± 6% softirqs.CPU93.RCU 104836 ± 3% -77.2% 23879 ± 10% softirqs.CPU93.SCHED 316254 ± 2% -80.3% 62443 ± 15% softirqs.CPU93.TIMER 37447 -33.0% 25085 ± 6% softirqs.CPU94.RCU 104385 ± 3% -77.2% 23820 ± 11% softirqs.CPU94.SCHED 316766 ± 2% -80.2% 62653 ± 15% softirqs.CPU94.TIMER 37578 -32.7% 25296 ± 6% softirqs.CPU95.RCU 103902 ± 2% -81.0% 19731 ± 25% softirqs.CPU95.SCHED 316532 ± 2% -80.3% 62436 ± 15% softirqs.CPU95.TIMER 37920 ± 2% -33.1% 25370 ± 6% softirqs.CPU96.RCU 103993 ± 3% -78.0% 22854 ± 8% softirqs.CPU96.SCHED 319704 ± 5% -80.8% 61317 ± 15% softirqs.CPU96.TIMER 38322 ± 3% -31.2% 26352 ± 5% softirqs.CPU97.RCU 106688 ± 4% -77.9% 23595 ± 11% softirqs.CPU97.SCHED 348032 ± 15% -82.4% 61294 ± 16% softirqs.CPU97.TIMER 38509 -31.9% 26208 ± 9% softirqs.CPU98.RCU 104992 ± 3% -77.1% 23991 ± 10% softirqs.CPU98.SCHED 320751 ± 5% -78.9% 67546 ± 16% softirqs.CPU98.TIMER 38375 ± 2% -32.7% 25839 ± 7% softirqs.CPU99.RCU 106814 ± 3% -77.8% 23763 ± 11% softirqs.CPU99.SCHED 323126 ± 5% -80.8% 61980 ± 15% softirqs.CPU99.TIMER 13390 ± 38% -79.6% 2728 ± 38% softirqs.NET_RX 7416427 -32.7% 4989933 ± 6% softirqs.RCU 20136151 ± 3% -77.4% 4549197 ± 11% softirqs.SCHED 61478762 ± 3% -80.6% 11950741 ± 15% softirqs.TIMER 7385 ± 55% -80.8% 1420 ±159% interrupts.31:PCI-MSI.524289-edge.eth0-TxRx-0 8484 ± 33% -85.9% 1194 ± 82% interrupts.33:PCI-MSI.524291-edge.eth0-TxRx-2 1754 ± 2% -81.8% 319.20 ± 17% interrupts.9:IO-APIC.9-fasteoi.acpi 1041561 +41.0% 1468141 ± 7% interrupts.CAL:Function_call_interrupts 5699 ± 6% +34.8% 7685 ± 7% interrupts.CPU0.CAL:Function_call_interrupts 1755350 ± 2% -81.8% 319088 ± 17% interrupts.CPU0.LOC:Local_timer_interrupts 1128 ± 31% +175.9% 3113 ± 14% interrupts.CPU0.NMI:Non-maskable_interrupts 1128 ± 31% +175.9% 3113 ± 14% interrupts.CPU0.PMI:Performance_monitoring_interrupts 286.60 ± 22% -50.7% 141.20 ± 22% interrupts.CPU0.TLB:TLB_shootdowns 1754 ± 2% -81.8% 319.20 ± 17% interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi 5845 ± 8% +37.6% 8044 ± 9% interrupts.CPU1.CAL:Function_call_interrupts 1755144 ± 2% -81.8% 319068 ± 17% interrupts.CPU1.LOC:Local_timer_interrupts 1384 ± 11% +103.1% 2813 ± 13% interrupts.CPU1.NMI:Non-maskable_interrupts 1384 ± 11% +103.1% 2813 ± 13% interrupts.CPU1.PMI:Performance_monitoring_interrupts 7385 ± 55% -80.8% 1420 ±159% interrupts.CPU10.31:PCI-MSI.524289-edge.eth0-TxRx-0 5418 ± 2% +40.8% 7626 ± 7% interrupts.CPU10.CAL:Function_call_interrupts 1755226 ± 2% -81.8% 319039 ± 17% interrupts.CPU10.LOC:Local_timer_interrupts 252.00 ± 5% +54.4% 389.20 ± 6% interrupts.CPU10.RES:Rescheduling_interrupts 5339 +46.1% 7801 ± 11% interrupts.CPU100.CAL:Function_call_interrupts 1754879 ± 2% -81.8% 319030 ± 17% interrupts.CPU100.LOC:Local_timer_interrupts 1449 ± 4% +101.9% 2927 ± 31% interrupts.CPU100.NMI:Non-maskable_interrupts 1449 ± 4% +101.9% 2927 ± 31% interrupts.CPU100.PMI:Performance_monitoring_interrupts 5284 ± 2% +45.6% 7693 ± 10% interrupts.CPU101.CAL:Function_call_interrupts 1755063 ± 2% -81.8% 319017 ± 17% interrupts.CPU101.LOC:Local_timer_interrupts 1384 ± 9% +131.8% 3208 ± 20% interrupts.CPU101.NMI:Non-maskable_interrupts 1384 ± 9% +131.8% 3208 ± 20% interrupts.CPU101.PMI:Performance_monitoring_interrupts 336.20 ± 5% +12.6% 378.60 ± 5% interrupts.CPU101.RES:Rescheduling_interrupts 5209 +48.1% 7717 ± 10% interrupts.CPU102.CAL:Function_call_interrupts 1754794 ± 2% -81.8% 318938 ± 17% interrupts.CPU102.LOC:Local_timer_interrupts 1548 ± 8% +108.7% 3231 ± 16% interrupts.CPU102.NMI:Non-maskable_interrupts 1548 ± 8% +108.7% 3231 ± 16% interrupts.CPU102.PMI:Performance_monitoring_interrupts 5470 ± 4% +43.2% 7835 ± 10% interrupts.CPU103.CAL:Function_call_interrupts 1755294 ± 2% -81.8% 318978 ± 17% interrupts.CPU103.LOC:Local_timer_interrupts 1572 ± 12% +95.1% 3066 ± 20% interrupts.CPU103.NMI:Non-maskable_interrupts 1572 ± 12% +95.1% 3066 ± 20% interrupts.CPU103.PMI:Performance_monitoring_interrupts 5294 ± 2% +44.7% 7662 ± 7% interrupts.CPU104.CAL:Function_call_interrupts 1755263 ± 2% -81.8% 319010 ± 17% interrupts.CPU104.LOC:Local_timer_interrupts 1436 ± 13% +121.3% 3178 ± 15% interrupts.CPU104.NMI:Non-maskable_interrupts 1436 ± 13% +121.3% 3178 ± 15% interrupts.CPU104.PMI:Performance_monitoring_interrupts 5239 ± 2% +45.3% 7615 ± 9% interrupts.CPU105.CAL:Function_call_interrupts 1755173 ± 2% -81.8% 318998 ± 17% interrupts.CPU105.LOC:Local_timer_interrupts 1551 ± 16% +105.1% 3181 ± 14% interrupts.CPU105.NMI:Non-maskable_interrupts 1551 ± 16% +105.1% 3181 ± 14% interrupts.CPU105.PMI:Performance_monitoring_interrupts 341.40 ± 8% +11.4% 380.20 ± 4% interrupts.CPU105.RES:Rescheduling_interrupts 5368 ± 3% +43.8% 7719 ± 9% interrupts.CPU106.CAL:Function_call_interrupts 1755205 ± 2% -81.8% 319002 ± 17% interrupts.CPU106.LOC:Local_timer_interrupts 1545 ± 6% +86.2% 2878 ± 30% interrupts.CPU106.NMI:Non-maskable_interrupts 1545 ± 6% +86.2% 2878 ± 30% interrupts.CPU106.PMI:Performance_monitoring_interrupts 346.20 ± 5% +12.1% 388.20 ± 7% interrupts.CPU106.RES:Rescheduling_interrupts 5270 +45.3% 7658 ± 9% interrupts.CPU107.CAL:Function_call_interrupts 1755208 ± 2% -81.8% 319004 ± 17% interrupts.CPU107.LOC:Local_timer_interrupts 1486 ± 10% +98.7% 2953 ± 30% interrupts.CPU107.NMI:Non-maskable_interrupts 1486 ± 10% +98.7% 2953 ± 30% interrupts.CPU107.PMI:Performance_monitoring_interrupts 5263 +46.6% 7719 ± 10% interrupts.CPU108.CAL:Function_call_interrupts 1755142 ± 2% -81.8% 319012 ± 17% interrupts.CPU108.LOC:Local_timer_interrupts 337.80 ± 6% +12.0% 378.20 ± 5% interrupts.CPU108.RES:Rescheduling_interrupts 5348 ± 4% +44.0% 7704 ± 9% interrupts.CPU109.CAL:Function_call_interrupts 1755234 ± 2% -81.8% 318993 ± 17% interrupts.CPU109.LOC:Local_timer_interrupts 1617 ± 16% +102.8% 3281 ± 19% interrupts.CPU109.NMI:Non-maskable_interrupts 1617 ± 16% +102.8% 3281 ± 19% interrupts.CPU109.PMI:Performance_monitoring_interrupts 347.20 ± 2% +10.9% 385.00 ± 6% interrupts.CPU109.RES:Rescheduling_interrupts 5392 ± 2% +41.0% 7602 ± 9% interrupts.CPU11.CAL:Function_call_interrupts 1755089 ± 2% -81.8% 319025 ± 17% interrupts.CPU11.LOC:Local_timer_interrupts 237.80 ± 3% +61.3% 383.60 ± 7% interrupts.CPU11.RES:Rescheduling_interrupts 5293 +44.4% 7641 ± 9% interrupts.CPU110.CAL:Function_call_interrupts 1755186 ± 2% -81.8% 319004 ± 17% interrupts.CPU110.LOC:Local_timer_interrupts 1474 ± 11% +114.2% 3158 ± 16% interrupts.CPU110.NMI:Non-maskable_interrupts 1474 ± 11% +114.2% 3158 ± 16% interrupts.CPU110.PMI:Performance_monitoring_interrupts 327.60 ± 5% +17.6% 385.40 ± 5% interrupts.CPU110.RES:Rescheduling_interrupts 5373 ± 2% +45.9% 7838 ± 9% interrupts.CPU111.CAL:Function_call_interrupts 1755274 ± 2% -81.8% 319025 ± 17% interrupts.CPU111.LOC:Local_timer_interrupts 1484 ± 5% +108.0% 3086 ± 20% interrupts.CPU111.NMI:Non-maskable_interrupts 1484 ± 5% +108.0% 3086 ± 20% interrupts.CPU111.PMI:Performance_monitoring_interrupts 5408 ± 3% +44.4% 7808 ± 10% interrupts.CPU112.CAL:Function_call_interrupts 1755242 ± 2% -81.8% 319001 ± 17% interrupts.CPU112.LOC:Local_timer_interrupts 1458 ± 12% +115.5% 3143 ± 16% interrupts.CPU112.NMI:Non-maskable_interrupts 1458 ± 12% +115.5% 3143 ± 16% interrupts.CPU112.PMI:Performance_monitoring_interrupts 5352 ± 3% +46.4% 7837 ± 10% interrupts.CPU113.CAL:Function_call_interrupts 1755302 ± 2% -81.8% 319001 ± 17% interrupts.CPU113.LOC:Local_timer_interrupts 5382 ± 5% +48.1% 7969 ± 14% interrupts.CPU114.CAL:Function_call_interrupts 1755359 ± 2% -81.8% 318999 ± 17% interrupts.CPU114.LOC:Local_timer_interrupts 1273 ± 14% +151.2% 3199 ± 15% interrupts.CPU114.NMI:Non-maskable_interrupts 1273 ± 14% +151.2% 3199 ± 15% interrupts.CPU114.PMI:Performance_monitoring_interrupts 5396 ± 2% +44.6% 7802 ± 10% interrupts.CPU115.CAL:Function_call_interrupts 1755350 ± 2% -81.8% 319009 ± 17% interrupts.CPU115.LOC:Local_timer_interrupts 5386 ± 3% +41.3% 7611 ± 11% interrupts.CPU116.CAL:Function_call_interrupts 1755192 ± 2% -81.8% 319004 ± 17% interrupts.CPU116.LOC:Local_timer_interrupts 338.80 ± 5% +12.2% 380.00 ± 5% interrupts.CPU116.RES:Rescheduling_interrupts 5306 ± 3% +44.7% 7679 ± 9% interrupts.CPU117.CAL:Function_call_interrupts 1755226 ± 2% -81.8% 319012 ± 17% interrupts.CPU117.LOC:Local_timer_interrupts 5276 +50.4% 7934 ± 9% interrupts.CPU118.CAL:Function_call_interrupts 1755337 ± 2% -81.8% 318992 ± 17% interrupts.CPU118.LOC:Local_timer_interrupts 1370 ± 19% +101.0% 2753 ± 15% interrupts.CPU118.NMI:Non-maskable_interrupts 1370 ± 19% +101.0% 2753 ± 15% interrupts.CPU118.PMI:Performance_monitoring_interrupts 5294 ± 3% +46.3% 7744 ± 10% interrupts.CPU119.CAL:Function_call_interrupts 1755057 ± 2% -81.8% 318997 ± 17% interrupts.CPU119.LOC:Local_timer_interrupts 8484 ± 33% -85.9% 1194 ± 82% interrupts.CPU12.33:PCI-MSI.524291-edge.eth0-TxRx-2 5270 ± 2% +46.5% 7722 ± 9% interrupts.CPU12.CAL:Function_call_interrupts 1755109 ± 2% -81.8% 319041 ± 17% interrupts.CPU12.LOC:Local_timer_interrupts 250.60 ± 8% +55.9% 390.60 ± 4% interrupts.CPU12.RES:Rescheduling_interrupts 5617 ± 2% +38.7% 7791 ± 8% interrupts.CPU120.CAL:Function_call_interrupts 1754989 ± 2% -81.8% 319037 ± 17% interrupts.CPU120.LOC:Local_timer_interrupts 1314 ± 17% +105.8% 2704 ± 37% interrupts.CPU120.NMI:Non-maskable_interrupts 1314 ± 17% +105.8% 2704 ± 37% interrupts.CPU120.PMI:Performance_monitoring_interrupts 5508 ± 2% +38.9% 7653 ± 9% interrupts.CPU121.CAL:Function_call_interrupts 1755051 ± 2% -81.8% 318996 ± 17% interrupts.CPU121.LOC:Local_timer_interrupts 1310 ± 29% +101.3% 2638 ± 37% interrupts.CPU121.NMI:Non-maskable_interrupts 1310 ± 29% +101.3% 2638 ± 37% interrupts.CPU121.PMI:Performance_monitoring_interrupts 337.60 ± 6% +17.4% 396.20 ± 9% interrupts.CPU121.RES:Rescheduling_interrupts 5480 ± 4% +37.2% 7518 ± 10% interrupts.CPU122.CAL:Function_call_interrupts 1755172 ± 2% -81.8% 319043 ± 17% interrupts.CPU122.LOC:Local_timer_interrupts 1355 ± 22% +136.5% 3204 ± 16% interrupts.CPU122.NMI:Non-maskable_interrupts 1355 ± 22% +136.5% 3204 ± 16% interrupts.CPU122.PMI:Performance_monitoring_interrupts 5531 ± 5% +34.2% 7421 ± 5% interrupts.CPU123.CAL:Function_call_interrupts 1755178 ± 2% -81.8% 319022 ± 17% interrupts.CPU123.LOC:Local_timer_interrupts 1438 ± 19% +103.1% 2920 ± 33% interrupts.CPU123.NMI:Non-maskable_interrupts 1438 ± 19% +103.1% 2920 ± 33% interrupts.CPU123.PMI:Performance_monitoring_interrupts 5602 ± 4% +35.7% 7600 ± 7% interrupts.CPU124.CAL:Function_call_interrupts 1755072 ± 2% -81.8% 319009 ± 17% interrupts.CPU124.LOC:Local_timer_interrupts 1329 ± 24% +148.3% 3301 ± 17% interrupts.CPU124.NMI:Non-maskable_interrupts 1329 ± 24% +148.3% 3301 ± 17% interrupts.CPU124.PMI:Performance_monitoring_interrupts 5483 ± 5% +38.5% 7592 ± 6% interrupts.CPU125.CAL:Function_call_interrupts 1755219 ± 2% -81.8% 319022 ± 17% interrupts.CPU125.LOC:Local_timer_interrupts 1290 ± 22% +152.7% 3261 ± 21% interrupts.CPU125.NMI:Non-maskable_interrupts 1290 ± 22% +152.7% 3261 ± 21% interrupts.CPU125.PMI:Performance_monitoring_interrupts 5361 ± 4% +42.4% 7636 ± 6% interrupts.CPU126.CAL:Function_call_interrupts 1755153 ± 2% -81.8% 318966 ± 17% interrupts.CPU126.LOC:Local_timer_interrupts 1354 ± 25% +139.0% 3237 ± 18% interrupts.CPU126.NMI:Non-maskable_interrupts 1354 ± 25% +139.0% 3237 ± 18% interrupts.CPU126.PMI:Performance_monitoring_interrupts 5421 ± 2% +42.9% 7748 ± 7% interrupts.CPU127.CAL:Function_call_interrupts 1755182 ± 2% -81.8% 318981 ± 17% interrupts.CPU127.LOC:Local_timer_interrupts 1250 ± 25% +112.1% 2652 ± 40% interrupts.CPU127.NMI:Non-maskable_interrupts 1250 ± 25% +112.1% 2652 ± 40% interrupts.CPU127.PMI:Performance_monitoring_interrupts 341.20 ± 3% +19.0% 406.00 ± 7% interrupts.CPU127.RES:Rescheduling_interrupts 5367 ± 2% +39.6% 7493 ± 8% interrupts.CPU128.CAL:Function_call_interrupts 1755127 ± 2% -81.8% 319008 ± 17% interrupts.CPU128.LOC:Local_timer_interrupts 1183 ± 28% +150.2% 2960 ± 32% interrupts.CPU128.NMI:Non-maskable_interrupts 1183 ± 28% +150.2% 2960 ± 32% interrupts.CPU128.PMI:Performance_monitoring_interrupts 5356 ± 3% +40.6% 7532 ± 8% interrupts.CPU129.CAL:Function_call_interrupts 1755107 ± 2% -81.8% 318981 ± 17% interrupts.CPU129.LOC:Local_timer_interrupts 1149 ± 34% +155.2% 2931 ± 33% interrupts.CPU129.NMI:Non-maskable_interrupts 1149 ± 34% +155.2% 2931 ± 33% interrupts.CPU129.PMI:Performance_monitoring_interrupts 327.00 ± 4% +17.0% 382.60 ± 3% interrupts.CPU129.RES:Rescheduling_interrupts 5410 ± 2% +43.7% 7777 ± 9% interrupts.CPU13.CAL:Function_call_interrupts 1755217 ± 2% -81.8% 319020 ± 17% interrupts.CPU13.LOC:Local_timer_interrupts 5347 ± 3% +40.5% 7514 ± 8% interrupts.CPU130.CAL:Function_call_interrupts 1755124 ± 2% -81.8% 318996 ± 17% interrupts.CPU130.LOC:Local_timer_interrupts 1194 ± 30% +141.9% 2890 ± 30% interrupts.CPU130.NMI:Non-maskable_interrupts 1194 ± 30% +141.9% 2890 ± 30% interrupts.CPU130.PMI:Performance_monitoring_interrupts 5420 ± 2% +37.5% 7453 ± 8% interrupts.CPU131.CAL:Function_call_interrupts 1755225 ± 2% -81.8% 318996 ± 17% interrupts.CPU131.LOC:Local_timer_interrupts 1199 ± 27% +106.1% 2471 ± 22% interrupts.CPU131.NMI:Non-maskable_interrupts 1199 ± 27% +106.1% 2471 ± 22% interrupts.CPU131.PMI:Performance_monitoring_interrupts 5403 ± 4% +40.4% 7585 ± 6% interrupts.CPU132.CAL:Function_call_interrupts 1755090 ± 2% -81.8% 319012 ± 17% interrupts.CPU132.LOC:Local_timer_interrupts 1181 ± 38% +170.3% 3194 ± 16% interrupts.CPU132.NMI:Non-maskable_interrupts 1181 ± 38% +170.3% 3194 ± 16% interrupts.CPU132.PMI:Performance_monitoring_interrupts 5469 ± 2% +37.1% 7501 ± 7% interrupts.CPU133.CAL:Function_call_interrupts 1755199 ± 2% -81.8% 318984 ± 17% interrupts.CPU133.LOC:Local_timer_interrupts 1152 ± 26% +143.3% 2804 ± 14% interrupts.CPU133.NMI:Non-maskable_interrupts 1152 ± 26% +143.3% 2804 ± 14% interrupts.CPU133.PMI:Performance_monitoring_interrupts 5435 ± 4% +41.8% 7710 ± 8% interrupts.CPU134.CAL:Function_call_interrupts 1755075 ± 2% -81.8% 318958 ± 17% interrupts.CPU134.LOC:Local_timer_interrupts 1214 ± 19% +130.2% 2796 ± 13% interrupts.CPU134.NMI:Non-maskable_interrupts 1214 ± 19% +130.2% 2796 ± 13% interrupts.CPU134.PMI:Performance_monitoring_interrupts 340.80 ± 3% +16.4% 396.80 ± 4% interrupts.CPU134.RES:Rescheduling_interrupts 5293 ± 3% +42.1% 7523 ± 8% interrupts.CPU135.CAL:Function_call_interrupts 1755100 ± 2% -81.8% 318897 ± 17% interrupts.CPU135.LOC:Local_timer_interrupts 1244 ± 25% +98.2% 2465 ± 22% interrupts.CPU135.NMI:Non-maskable_interrupts 1244 ± 25% +98.2% 2465 ± 22% interrupts.CPU135.PMI:Performance_monitoring_interrupts 5421 ± 2% +39.4% 7558 ± 9% interrupts.CPU136.CAL:Function_call_interrupts 1755142 ± 2% -81.8% 318930 ± 17% interrupts.CPU136.LOC:Local_timer_interrupts 1240 ± 33% +143.2% 3017 ± 34% interrupts.CPU136.NMI:Non-maskable_interrupts 1240 ± 33% +143.2% 3017 ± 34% interrupts.CPU136.PMI:Performance_monitoring_interrupts 5508 ± 6% +36.5% 7518 ± 8% interrupts.CPU137.CAL:Function_call_interrupts 1755111 ± 2% -81.8% 318983 ± 17% interrupts.CPU137.LOC:Local_timer_interrupts 943.00 ± 26% +165.8% 2506 ± 22% interrupts.CPU137.NMI:Non-maskable_interrupts 943.00 ± 26% +165.8% 2506 ± 22% interrupts.CPU137.PMI:Performance_monitoring_interrupts 5405 ± 3% +39.0% 7514 ± 9% interrupts.CPU138.CAL:Function_call_interrupts 1755057 ± 2% -81.8% 318998 ± 17% interrupts.CPU138.LOC:Local_timer_interrupts 1002 ± 24% +166.3% 2668 ± 40% interrupts.CPU138.NMI:Non-maskable_interrupts 1002 ± 24% +166.3% 2668 ± 40% interrupts.CPU138.PMI:Performance_monitoring_interrupts 5356 ± 3% +42.6% 7638 ± 7% interrupts.CPU139.CAL:Function_call_interrupts 1755134 ± 2% -81.8% 318972 ± 17% interrupts.CPU139.LOC:Local_timer_interrupts 1045 ± 32% +146.0% 2571 ± 26% interrupts.CPU139.NMI:Non-maskable_interrupts 1045 ± 32% +146.0% 2571 ± 26% interrupts.CPU139.PMI:Performance_monitoring_interrupts 5362 ± 3% +43.7% 7708 ± 9% interrupts.CPU14.CAL:Function_call_interrupts 1755189 ± 2% -81.8% 318811 ± 17% interrupts.CPU14.LOC:Local_timer_interrupts 257.40 ± 2% +46.9% 378.20 ± 2% interrupts.CPU14.RES:Rescheduling_interrupts 5596 ± 7% +32.6% 7421 ± 6% interrupts.CPU140.CAL:Function_call_interrupts 1755171 ± 2% -81.8% 318981 ± 17% interrupts.CPU140.LOC:Local_timer_interrupts 1227 ± 28% +135.8% 2894 ± 28% interrupts.CPU140.NMI:Non-maskable_interrupts 1227 ± 28% +135.8% 2894 ± 28% interrupts.CPU140.PMI:Performance_monitoring_interrupts 5265 ± 3% +42.9% 7524 ± 6% interrupts.CPU141.CAL:Function_call_interrupts 1755131 ± 2% -81.8% 318946 ± 17% interrupts.CPU141.LOC:Local_timer_interrupts 1196 ± 26% +169.6% 3225 ± 18% interrupts.CPU141.NMI:Non-maskable_interrupts 1196 ± 26% +169.6% 3225 ± 18% interrupts.CPU141.PMI:Performance_monitoring_interrupts 5322 ± 2% +40.6% 7481 ± 6% interrupts.CPU142.CAL:Function_call_interrupts 1755192 ± 2% -81.8% 319001 ± 17% interrupts.CPU142.LOC:Local_timer_interrupts 1217 ± 24% +111.4% 2573 ± 26% interrupts.CPU142.NMI:Non-maskable_interrupts 1217 ± 24% +111.4% 2573 ± 26% interrupts.CPU142.PMI:Performance_monitoring_interrupts 5282 ± 3% +43.0% 7552 ± 8% interrupts.CPU143.CAL:Function_call_interrupts 1755122 ± 2% -81.8% 319018 ± 17% interrupts.CPU143.LOC:Local_timer_interrupts 1276 ± 19% +133.4% 2978 ± 30% interrupts.CPU143.NMI:Non-maskable_interrupts 1276 ± 19% +133.4% 2978 ± 30% interrupts.CPU143.PMI:Performance_monitoring_interrupts 5756 ± 9% +30.8% 7527 ± 8% interrupts.CPU144.CAL:Function_call_interrupts 1755197 ± 2% -81.8% 319021 ± 17% interrupts.CPU144.LOC:Local_timer_interrupts 1297 ± 26% +133.7% 3032 ± 32% interrupts.CPU144.NMI:Non-maskable_interrupts 1297 ± 26% +133.7% 3032 ± 32% interrupts.CPU144.PMI:Performance_monitoring_interrupts 5516 ± 6% +35.9% 7496 ± 8% interrupts.CPU145.CAL:Function_call_interrupts 1755292 ± 2% -81.8% 319043 ± 17% interrupts.CPU145.LOC:Local_timer_interrupts 5365 ± 2% +39.0% 7458 ± 7% interrupts.CPU146.CAL:Function_call_interrupts 1755394 ± 2% -81.8% 319042 ± 17% interrupts.CPU146.LOC:Local_timer_interrupts 5411 ± 2% +37.0% 7411 ± 7% interrupts.CPU147.CAL:Function_call_interrupts 1755377 ± 2% -81.8% 319041 ± 17% interrupts.CPU147.LOC:Local_timer_interrupts 5461 ± 3% +35.6% 7407 ± 8% interrupts.CPU148.CAL:Function_call_interrupts 1755376 ± 2% -81.8% 319038 ± 17% interrupts.CPU148.LOC:Local_timer_interrupts 1700 ± 11% +92.0% 3266 ± 13% interrupts.CPU148.NMI:Non-maskable_interrupts 1700 ± 11% +92.0% 3266 ± 13% interrupts.CPU148.PMI:Performance_monitoring_interrupts 5283 +39.3% 7360 ± 7% interrupts.CPU149.CAL:Function_call_interrupts 1755332 ± 2% -81.8% 318973 ± 17% interrupts.CPU149.LOC:Local_timer_interrupts 1548 ± 9% +111.8% 3280 ± 14% interrupts.CPU149.NMI:Non-maskable_interrupts 1548 ± 9% +111.8% 3280 ± 14% interrupts.CPU149.PMI:Performance_monitoring_interrupts 5347 +44.3% 7719 ± 9% interrupts.CPU15.CAL:Function_call_interrupts 1755337 ± 2% -81.8% 319027 ± 17% interrupts.CPU15.LOC:Local_timer_interrupts 241.40 ± 6% +64.3% 396.60 ± 5% interrupts.CPU15.RES:Rescheduling_interrupts 5461 ± 4% +40.5% 7672 ± 8% interrupts.CPU150.CAL:Function_call_interrupts 1754662 ± 2% -81.8% 319072 ± 17% interrupts.CPU150.LOC:Local_timer_interrupts 1318 ± 24% +141.3% 3180 ± 16% interrupts.CPU150.NMI:Non-maskable_interrupts 1318 ± 24% +141.3% 3180 ± 16% interrupts.CPU150.PMI:Performance_monitoring_interrupts 5376 ± 2% +38.7% 7457 ± 8% interrupts.CPU151.CAL:Function_call_interrupts 1755338 ± 2% -81.8% 319011 ± 17% interrupts.CPU151.LOC:Local_timer_interrupts 1307 ± 23% +143.7% 3186 ± 16% interrupts.CPU151.NMI:Non-maskable_interrupts 1307 ± 23% +143.7% 3186 ± 16% interrupts.CPU151.PMI:Performance_monitoring_interrupts 5425 ± 3% +34.7% 7309 ± 9% interrupts.CPU152.CAL:Function_call_interrupts 1754836 ± 2% -81.8% 319012 ± 17% interrupts.CPU152.LOC:Local_timer_interrupts 1434 ± 28% +94.1% 2785 ± 14% interrupts.CPU152.NMI:Non-maskable_interrupts 1434 ± 28% +94.1% 2785 ± 14% interrupts.CPU152.PMI:Performance_monitoring_interrupts 5332 ± 2% +39.0% 7411 ± 6% interrupts.CPU153.CAL:Function_call_interrupts 1755331 ± 2% -81.8% 319021 ± 17% interrupts.CPU153.LOC:Local_timer_interrupts 1400 ± 25% +133.6% 3271 ± 17% interrupts.CPU153.NMI:Non-maskable_interrupts 1400 ± 25% +133.6% 3271 ± 17% interrupts.CPU153.PMI:Performance_monitoring_interrupts 316.60 ± 4% +22.0% 386.20 ± 2% interrupts.CPU153.RES:Rescheduling_interrupts 5453 ± 4% +36.0% 7415 ± 7% interrupts.CPU154.CAL:Function_call_interrupts 1755336 ± 2% -81.8% 319010 ± 17% interrupts.CPU154.LOC:Local_timer_interrupts 1545 ± 28% +114.1% 3308 ± 15% interrupts.CPU154.NMI:Non-maskable_interrupts 1545 ± 28% +114.1% 3308 ± 15% interrupts.CPU154.PMI:Performance_monitoring_interrupts 5369 ± 3% +42.0% 7623 ± 6% interrupts.CPU155.CAL:Function_call_interrupts 1755417 ± 2% -81.8% 319032 ± 17% interrupts.CPU155.LOC:Local_timer_interrupts 1420 ± 21% +131.1% 3281 ± 20% interrupts.CPU155.NMI:Non-maskable_interrupts 1420 ± 21% +131.1% 3281 ± 20% interrupts.CPU155.PMI:Performance_monitoring_interrupts 320.00 ± 5% +17.7% 376.60 ± 10% interrupts.CPU155.RES:Rescheduling_interrupts 5459 +35.2% 7378 ± 7% interrupts.CPU156.CAL:Function_call_interrupts 1755363 ± 2% -81.8% 319007 ± 17% interrupts.CPU156.LOC:Local_timer_interrupts 1332 ± 31% +108.3% 2775 ± 12% interrupts.CPU156.NMI:Non-maskable_interrupts 1332 ± 31% +108.3% 2775 ± 12% interrupts.CPU156.PMI:Performance_monitoring_interrupts 5435 ± 4% +38.5% 7526 ± 8% interrupts.CPU157.CAL:Function_call_interrupts 1755339 ± 2% -81.8% 319021 ± 17% interrupts.CPU157.LOC:Local_timer_interrupts 1209 ± 19% +174.2% 3315 ± 17% interrupts.CPU157.NMI:Non-maskable_interrupts 1209 ± 19% +174.2% 3315 ± 17% interrupts.CPU157.PMI:Performance_monitoring_interrupts 5407 ± 4% +35.0% 7300 ± 7% interrupts.CPU158.CAL:Function_call_interrupts 1755375 ± 2% -81.8% 319014 ± 17% interrupts.CPU158.LOC:Local_timer_interrupts 1224 ± 25% +174.2% 3357 ± 16% interrupts.CPU158.NMI:Non-maskable_interrupts 1224 ± 25% +174.2% 3357 ± 16% interrupts.CPU158.PMI:Performance_monitoring_interrupts 324.60 ± 2% +15.6% 375.20 ± 5% interrupts.CPU158.RES:Rescheduling_interrupts 5421 +36.6% 7406 ± 8% interrupts.CPU159.CAL:Function_call_interrupts 1754935 ± 2% -81.8% 318998 ± 17% interrupts.CPU159.LOC:Local_timer_interrupts 1092 ± 18% +161.6% 2857 ± 14% interrupts.CPU159.NMI:Non-maskable_interrupts 1092 ± 18% +161.6% 2857 ± 14% interrupts.CPU159.PMI:Performance_monitoring_interrupts 5401 ± 3% +42.2% 7679 ± 8% interrupts.CPU16.CAL:Function_call_interrupts 1755286 ± 2% -81.8% 319010 ± 17% interrupts.CPU16.LOC:Local_timer_interrupts 261.60 ± 4% +48.4% 388.20 ± 5% interrupts.CPU16.RES:Rescheduling_interrupts 5428 ± 3% +34.9% 7324 ± 8% interrupts.CPU160.CAL:Function_call_interrupts 1755402 ± 2% -81.8% 319017 ± 17% interrupts.CPU160.LOC:Local_timer_interrupts 1272 ± 20% +151.3% 3197 ± 14% interrupts.CPU160.NMI:Non-maskable_interrupts 1272 ± 20% +151.3% 3197 ± 14% interrupts.CPU160.PMI:Performance_monitoring_interrupts 322.00 ± 8% +12.8% 363.20 ± 7% interrupts.CPU160.RES:Rescheduling_interrupts 5433 ± 3% +38.7% 7537 ± 9% interrupts.CPU161.CAL:Function_call_interrupts 1755353 ± 2% -81.8% 318926 ± 17% interrupts.CPU161.LOC:Local_timer_interrupts 1190 ± 23% +169.9% 3211 ± 16% interrupts.CPU161.NMI:Non-maskable_interrupts 1190 ± 23% +169.9% 3211 ± 16% interrupts.CPU161.PMI:Performance_monitoring_interrupts 5382 ± 4% +40.1% 7542 ± 8% interrupts.CPU162.CAL:Function_call_interrupts 1755176 ± 2% -81.8% 318797 ± 17% interrupts.CPU162.LOC:Local_timer_interrupts 1081 ± 19% +165.4% 2870 ± 16% interrupts.CPU162.NMI:Non-maskable_interrupts 1081 ± 19% +165.4% 2870 ± 16% interrupts.CPU162.PMI:Performance_monitoring_interrupts 347.60 ± 8% +13.0% 392.80 ± 7% interrupts.CPU162.RES:Rescheduling_interrupts 5455 ± 2% +36.9% 7470 ± 7% interrupts.CPU163.CAL:Function_call_interrupts 1755226 ± 2% -81.8% 318966 ± 17% interrupts.CPU163.LOC:Local_timer_interrupts 1201 ± 27% +170.6% 3250 ± 18% interrupts.CPU163.NMI:Non-maskable_interrupts 1201 ± 27% +170.6% 3250 ± 18% interrupts.CPU163.PMI:Performance_monitoring_interrupts 5456 ± 3% +34.2% 7321 ± 7% interrupts.CPU164.CAL:Function_call_interrupts 1755343 ± 2% -81.8% 318983 ± 17% interrupts.CPU164.LOC:Local_timer_interrupts 1172 ± 31% +109.1% 2451 ± 26% interrupts.CPU164.NMI:Non-maskable_interrupts 1172 ± 31% +109.1% 2451 ± 26% interrupts.CPU164.PMI:Performance_monitoring_interrupts 5371 ± 2% +39.8% 7508 ± 7% interrupts.CPU165.CAL:Function_call_interrupts 1755240 ± 2% -81.8% 318998 ± 17% interrupts.CPU165.LOC:Local_timer_interrupts 1335 ± 32% +108.6% 2785 ± 14% interrupts.CPU165.NMI:Non-maskable_interrupts 1335 ± 32% +108.6% 2785 ± 14% interrupts.CPU165.PMI:Performance_monitoring_interrupts 316.40 ± 4% +24.1% 392.80 ± 3% interrupts.CPU165.RES:Rescheduling_interrupts 5410 ± 3% +36.9% 7405 ± 8% interrupts.CPU166.CAL:Function_call_interrupts 1755293 ± 2% -81.8% 319003 ± 17% interrupts.CPU166.LOC:Local_timer_interrupts 1108 ± 22% +150.4% 2775 ± 13% interrupts.CPU166.NMI:Non-maskable_interrupts 1108 ± 22% +150.4% 2775 ± 13% interrupts.CPU166.PMI:Performance_monitoring_interrupts 307.80 +22.3% 376.40 ± 3% interrupts.CPU166.RES:Rescheduling_interrupts 5351 ± 4% +38.4% 7405 ± 6% interrupts.CPU167.CAL:Function_call_interrupts 1755251 ± 2% -81.8% 318988 ± 17% interrupts.CPU167.LOC:Local_timer_interrupts 1205 ± 33% +173.9% 3301 ± 20% interrupts.CPU167.NMI:Non-maskable_interrupts 1205 ± 33% +173.9% 3301 ± 20% interrupts.CPU167.PMI:Performance_monitoring_interrupts 5512 ± 3% +41.6% 7806 ± 8% interrupts.CPU168.CAL:Function_call_interrupts 1754827 ± 2% -81.8% 318969 ± 17% interrupts.CPU168.LOC:Local_timer_interrupts 1409 ± 22% +136.8% 3338 ± 15% interrupts.CPU168.NMI:Non-maskable_interrupts 1409 ± 22% +136.8% 3338 ± 15% interrupts.CPU168.PMI:Performance_monitoring_interrupts 322.00 ± 10% +25.5% 404.20 ± 6% interrupts.CPU168.RES:Rescheduling_interrupts 5075 +53.3% 7778 ± 7% interrupts.CPU169.CAL:Function_call_interrupts 1755305 ± 2% -81.8% 318958 ± 17% interrupts.CPU169.LOC:Local_timer_interrupts 1475 ± 11% +114.7% 3166 ± 17% interrupts.CPU169.NMI:Non-maskable_interrupts 1475 ± 11% +114.7% 3166 ± 17% interrupts.CPU169.PMI:Performance_monitoring_interrupts 318.80 ± 4% +27.8% 407.40 ± 10% interrupts.CPU169.RES:Rescheduling_interrupts 5381 +47.3% 7924 ± 8% interrupts.CPU17.CAL:Function_call_interrupts 1755306 ± 2% -81.8% 319105 ± 17% interrupts.CPU17.LOC:Local_timer_interrupts 246.80 ± 4% +62.1% 400.00 ± 12% interrupts.CPU17.RES:Rescheduling_interrupts 5418 ± 4% +44.4% 7822 ± 9% interrupts.CPU170.CAL:Function_call_interrupts 1755203 ± 2% -81.8% 319064 ± 17% interrupts.CPU170.LOC:Local_timer_interrupts 1434 ± 4% +126.5% 3248 ± 17% interrupts.CPU170.NMI:Non-maskable_interrupts 1434 ± 4% +126.5% 3248 ± 17% interrupts.CPU170.PMI:Performance_monitoring_interrupts 316.20 ± 5% +22.7% 388.00 ± 7% interrupts.CPU170.RES:Rescheduling_interrupts 5349 ± 2% +45.2% 7768 ± 8% interrupts.CPU171.CAL:Function_call_interrupts 1755067 ± 2% -81.8% 319004 ± 17% interrupts.CPU171.LOC:Local_timer_interrupts 1549 ± 9% +79.9% 2787 ± 11% interrupts.CPU171.NMI:Non-maskable_interrupts 1549 ± 9% +79.9% 2787 ± 11% interrupts.CPU171.PMI:Performance_monitoring_interrupts 5311 ± 3% +47.2% 7820 ± 6% interrupts.CPU172.CAL:Function_call_interrupts 1755174 ± 2% -81.8% 318984 ± 17% interrupts.CPU172.LOC:Local_timer_interrupts 1266 ± 25% +160.5% 3298 ± 16% interrupts.CPU172.NMI:Non-maskable_interrupts 1266 ± 25% +160.5% 3298 ± 16% interrupts.CPU172.PMI:Performance_monitoring_interrupts 317.00 ± 5% +18.0% 374.00 ± 7% interrupts.CPU172.RES:Rescheduling_interrupts 5184 ± 5% +50.2% 7788 ± 8% interrupts.CPU173.CAL:Function_call_interrupts 1755087 ± 2% -81.8% 318960 ± 17% interrupts.CPU173.LOC:Local_timer_interrupts 1272 ± 26% +156.5% 3264 ± 15% interrupts.CPU173.NMI:Non-maskable_interrupts 1272 ± 26% +156.5% 3264 ± 15% interrupts.CPU173.PMI:Performance_monitoring_interrupts 306.40 ± 5% +20.0% 367.60 ± 7% interrupts.CPU173.RES:Rescheduling_interrupts 5356 ± 4% +43.2% 7671 ± 6% interrupts.CPU174.CAL:Function_call_interrupts 1755171 ± 2% -81.8% 318984 ± 17% interrupts.CPU174.LOC:Local_timer_interrupts 1365 ± 21% +144.8% 3343 ± 18% interrupts.CPU174.NMI:Non-maskable_interrupts 1365 ± 21% +144.8% 3343 ± 18% interrupts.CPU174.PMI:Performance_monitoring_interrupts 5299 +50.3% 7963 ± 8% interrupts.CPU175.CAL:Function_call_interrupts 1755173 ± 2% -81.8% 318930 ± 17% interrupts.CPU175.LOC:Local_timer_interrupts 1292 ± 37% +143.9% 3153 ± 17% interrupts.CPU175.NMI:Non-maskable_interrupts 1292 ± 37% +143.9% 3153 ± 17% interrupts.CPU175.PMI:Performance_monitoring_interrupts 295.20 ± 5% +40.9% 416.00 ± 11% interrupts.CPU175.RES:Rescheduling_interrupts 5396 ± 2% +49.7% 8081 ± 8% interrupts.CPU176.CAL:Function_call_interrupts 1755130 ± 2% -81.8% 318961 ± 17% interrupts.CPU176.LOC:Local_timer_interrupts 1266 ± 20% +117.1% 2749 ± 12% interrupts.CPU176.NMI:Non-maskable_interrupts 1266 ± 20% +117.1% 2749 ± 12% interrupts.CPU176.PMI:Performance_monitoring_interrupts 308.60 ± 2% +32.2% 408.00 ± 8% interrupts.CPU176.RES:Rescheduling_interrupts 5351 ± 4% +44.7% 7744 ± 9% interrupts.CPU177.CAL:Function_call_interrupts 1754992 ± 2% -81.8% 318959 ± 17% interrupts.CPU177.LOC:Local_timer_interrupts 1465 ± 28% +120.5% 3231 ± 19% interrupts.CPU177.NMI:Non-maskable_interrupts 1465 ± 28% +120.5% 3231 ± 19% interrupts.CPU177.PMI:Performance_monitoring_interrupts 5326 ± 3% +45.4% 7744 ± 6% interrupts.CPU178.CAL:Function_call_interrupts 1755214 ± 2% -81.8% 318942 ± 17% interrupts.CPU178.LOC:Local_timer_interrupts 1266 ± 21% +158.9% 3278 ± 17% interrupts.CPU178.NMI:Non-maskable_interrupts 1266 ± 21% +158.9% 3278 ± 17% interrupts.CPU178.PMI:Performance_monitoring_interrupts 319.40 ± 6% +20.9% 386.20 ± 12% interrupts.CPU178.RES:Rescheduling_interrupts 5317 ± 2% +47.6% 7850 ± 8% interrupts.CPU179.CAL:Function_call_interrupts 1755141 ± 2% -81.8% 318949 ± 17% interrupts.CPU179.LOC:Local_timer_interrupts 1385 ± 29% +129.1% 3175 ± 17% interrupts.CPU179.NMI:Non-maskable_interrupts 1385 ± 29% +129.1% 3175 ± 17% interrupts.CPU179.PMI:Performance_monitoring_interrupts 308.60 ± 9% +22.0% 376.40 ± 8% interrupts.CPU179.RES:Rescheduling_interrupts 5340 ± 3% +50.5% 8039 ± 13% interrupts.CPU18.CAL:Function_call_interrupts 1755420 ± 2% -81.8% 319066 ± 17% interrupts.CPU18.LOC:Local_timer_interrupts 1393 ± 13% +134.9% 3272 ± 17% interrupts.CPU18.NMI:Non-maskable_interrupts 1393 ± 13% +134.9% 3272 ± 17% interrupts.CPU18.PMI:Performance_monitoring_interrupts 255.60 ± 15% +60.0% 409.00 ± 4% interrupts.CPU18.RES:Rescheduling_interrupts 5384 ± 3% +45.9% 7855 ± 8% interrupts.CPU180.CAL:Function_call_interrupts 1755077 ± 2% -81.8% 318950 ± 17% interrupts.CPU180.LOC:Local_timer_interrupts 294.40 +37.6% 405.00 ± 13% interrupts.CPU180.RES:Rescheduling_interrupts 5451 ± 5% +43.8% 7840 ± 7% interrupts.CPU181.CAL:Function_call_interrupts 1754398 ± 2% -81.8% 318936 ± 17% interrupts.CPU181.LOC:Local_timer_interrupts 1373 ± 25% +103.6% 2796 ± 13% interrupts.CPU181.NMI:Non-maskable_interrupts 1373 ± 25% +103.6% 2796 ± 13% interrupts.CPU181.PMI:Performance_monitoring_interrupts 5292 ± 4% +47.5% 7804 ± 10% interrupts.CPU182.CAL:Function_call_interrupts 1754726 ± 2% -81.8% 318926 ± 17% interrupts.CPU182.LOC:Local_timer_interrupts 1551 ± 38% +112.8% 3300 ± 18% interrupts.CPU182.NMI:Non-maskable_interrupts 1551 ± 38% +112.8% 3300 ± 18% interrupts.CPU182.PMI:Performance_monitoring_interrupts 294.20 ± 7% +34.3% 395.20 ± 8% interrupts.CPU182.RES:Rescheduling_interrupts 5509 ± 3% +42.5% 7853 ± 7% interrupts.CPU183.CAL:Function_call_interrupts 1754745 ± 2% -81.8% 318944 ± 17% interrupts.CPU183.LOC:Local_timer_interrupts 1391 ± 24% +107.8% 2892 ± 14% interrupts.CPU183.NMI:Non-maskable_interrupts 1391 ± 24% +107.8% 2892 ± 14% interrupts.CPU183.PMI:Performance_monitoring_interrupts 5429 ± 5% +45.3% 7891 ± 8% interrupts.CPU184.CAL:Function_call_interrupts 1754691 ± 2% -81.8% 318948 ± 17% interrupts.CPU184.LOC:Local_timer_interrupts 1214 ± 23% +171.2% 3294 ± 15% interrupts.CPU184.NMI:Non-maskable_interrupts 1214 ± 23% +171.2% 3294 ± 15% interrupts.CPU184.PMI:Performance_monitoring_interrupts 5456 ± 3% +43.8% 7843 ± 10% interrupts.CPU185.CAL:Function_call_interrupts 1754741 ± 2% -81.8% 318915 ± 17% interrupts.CPU185.LOC:Local_timer_interrupts 1293 ± 24% +117.6% 2814 ± 12% interrupts.CPU185.NMI:Non-maskable_interrupts 1293 ± 24% +117.6% 2814 ± 12% interrupts.CPU185.PMI:Performance_monitoring_interrupts 297.20 ± 6% +33.4% 396.40 ± 12% interrupts.CPU185.RES:Rescheduling_interrupts 5407 ± 3% +45.7% 7878 ± 9% interrupts.CPU186.CAL:Function_call_interrupts 1754652 ± 2% -81.8% 318948 ± 17% interrupts.CPU186.LOC:Local_timer_interrupts 1340 ± 22% +143.4% 3262 ± 16% interrupts.CPU186.NMI:Non-maskable_interrupts 1340 ± 22% +143.4% 3262 ± 16% interrupts.CPU186.PMI:Performance_monitoring_interrupts 294.80 ± 7% +29.5% 381.80 ± 8% interrupts.CPU186.RES:Rescheduling_interrupts 5465 ± 4% +46.9% 8027 ± 8% interrupts.CPU187.CAL:Function_call_interrupts 1754637 ± 2% -81.8% 318876 ± 17% interrupts.CPU187.LOC:Local_timer_interrupts 5358 ± 2% +44.5% 7741 ± 8% interrupts.CPU188.CAL:Function_call_interrupts 1754846 ± 2% -81.8% 318936 ± 17% interrupts.CPU188.LOC:Local_timer_interrupts 1351 ± 7% +113.6% 2885 ± 30% interrupts.CPU188.NMI:Non-maskable_interrupts 1351 ± 7% +113.6% 2885 ± 30% interrupts.CPU188.PMI:Performance_monitoring_interrupts 289.20 ± 7% +31.3% 379.80 ± 10% interrupts.CPU188.RES:Rescheduling_interrupts 5331 ± 2% +46.5% 7812 ± 9% interrupts.CPU189.CAL:Function_call_interrupts 1754572 ± 2% -81.8% 318925 ± 17% interrupts.CPU189.LOC:Local_timer_interrupts 293.60 ± 4% +24.6% 365.80 ± 8% interrupts.CPU189.RES:Rescheduling_interrupts 5442 +45.4% 7913 ± 10% interrupts.CPU19.CAL:Function_call_interrupts 1755397 ± 2% -81.8% 319061 ± 17% interrupts.CPU19.LOC:Local_timer_interrupts 1432 ± 7% +124.8% 3221 ± 15% interrupts.CPU19.NMI:Non-maskable_interrupts 1432 ± 7% +124.8% 3221 ± 15% interrupts.CPU19.PMI:Performance_monitoring_interrupts 249.20 ± 9% +57.2% 391.80 ± 8% interrupts.CPU19.RES:Rescheduling_interrupts 5320 ± 2% +48.3% 7888 ± 12% interrupts.CPU190.CAL:Function_call_interrupts 1755171 ± 2% -81.8% 318921 ± 17% interrupts.CPU190.LOC:Local_timer_interrupts 271.80 ± 6% +43.9% 391.00 ± 9% interrupts.CPU190.RES:Rescheduling_interrupts 5248 ± 4% +43.3% 7523 ± 7% interrupts.CPU191.CAL:Function_call_interrupts 1755025 ± 2% -81.8% 318973 ± 17% interrupts.CPU191.LOC:Local_timer_interrupts 1383 ± 16% +110.0% 2905 ± 27% interrupts.CPU191.NMI:Non-maskable_interrupts 1383 ± 16% +110.0% 2905 ± 27% interrupts.CPU191.PMI:Performance_monitoring_interrupts 280.60 ± 10% +35.4% 380.00 ± 11% interrupts.CPU191.RES:Rescheduling_interrupts 160.20 ±128% -82.0% 28.80 ± 20% interrupts.CPU191.TLB:TLB_shootdowns 5623 ± 3% +40.6% 7908 ± 11% interrupts.CPU2.CAL:Function_call_interrupts 1754982 ± 2% -81.8% 319004 ± 17% interrupts.CPU2.LOC:Local_timer_interrupts 1317 ± 29% +141.3% 3178 ± 19% interrupts.CPU2.NMI:Non-maskable_interrupts 1317 ± 29% +141.3% 3178 ± 19% interrupts.CPU2.PMI:Performance_monitoring_interrupts 273.40 ± 4% +47.8% 404.00 ± 4% interrupts.CPU2.RES:Rescheduling_interrupts 5305 +43.1% 7593 ± 9% interrupts.CPU20.CAL:Function_call_interrupts 1755276 ± 2% -81.8% 319057 ± 17% interrupts.CPU20.LOC:Local_timer_interrupts 1346 ± 22% +122.6% 2997 ± 32% interrupts.CPU20.NMI:Non-maskable_interrupts 1346 ± 22% +122.6% 2997 ± 32% interrupts.CPU20.PMI:Performance_monitoring_interrupts 257.20 ± 5% +55.1% 399.00 ± 4% interrupts.CPU20.RES:Rescheduling_interrupts 5435 ± 3% +38.0% 7500 ± 10% interrupts.CPU21.CAL:Function_call_interrupts 1755266 ± 2% -81.8% 319059 ± 17% interrupts.CPU21.LOC:Local_timer_interrupts 5271 ± 2% +45.7% 7683 ± 10% interrupts.CPU22.CAL:Function_call_interrupts 1755381 ± 2% -81.8% 319068 ± 17% interrupts.CPU22.LOC:Local_timer_interrupts 268.80 ± 15% +54.2% 414.60 ± 5% interrupts.CPU22.RES:Rescheduling_interrupts 5265 ± 2% +43.9% 7577 ± 9% interrupts.CPU23.CAL:Function_call_interrupts 1755123 ± 2% -81.8% 319038 ± 17% interrupts.CPU23.LOC:Local_timer_interrupts 281.20 ± 16% +33.9% 376.60 ± 3% interrupts.CPU23.RES:Rescheduling_interrupts 5676 ± 4% +33.8% 7591 ± 9% interrupts.CPU24.CAL:Function_call_interrupts 1755000 ± 2% -81.8% 319038 ± 17% interrupts.CPU24.LOC:Local_timer_interrupts 256.80 ± 5% -53.3% 119.80 ± 24% interrupts.CPU24.TLB:TLB_shootdowns 5851 ± 5% +32.4% 7746 ± 8% interrupts.CPU25.CAL:Function_call_interrupts 1755106 ± 2% -81.8% 319066 ± 17% interrupts.CPU25.LOC:Local_timer_interrupts 1437 ± 20% +132.0% 3333 ± 16% interrupts.CPU25.NMI:Non-maskable_interrupts 1437 ± 20% +132.0% 3333 ± 16% interrupts.CPU25.PMI:Performance_monitoring_interrupts 5591 ± 4% +34.8% 7538 ± 8% interrupts.CPU26.CAL:Function_call_interrupts 1755186 ± 2% -81.8% 319039 ± 17% interrupts.CPU26.LOC:Local_timer_interrupts 1288 ± 28% +152.4% 3252 ± 16% interrupts.CPU26.NMI:Non-maskable_interrupts 1288 ± 28% +152.4% 3252 ± 16% interrupts.CPU26.PMI:Performance_monitoring_interrupts 5465 ± 3% +39.7% 7635 ± 9% interrupts.CPU27.CAL:Function_call_interrupts 1755194 ± 2% -81.8% 319075 ± 17% interrupts.CPU27.LOC:Local_timer_interrupts 1440 ± 27% +122.4% 3202 ± 17% interrupts.CPU27.NMI:Non-maskable_interrupts 1440 ± 27% +122.4% 3202 ± 17% interrupts.CPU27.PMI:Performance_monitoring_interrupts 290.60 ± 4% +29.0% 374.80 ± 9% interrupts.CPU27.RES:Rescheduling_interrupts 5600 ± 3% +36.9% 7668 ± 8% interrupts.CPU28.CAL:Function_call_interrupts 1755121 ± 2% -81.8% 319059 ± 17% interrupts.CPU28.LOC:Local_timer_interrupts 1269 ± 26% +160.7% 3309 ± 20% interrupts.CPU28.NMI:Non-maskable_interrupts 1269 ± 26% +160.7% 3309 ± 20% interrupts.CPU28.PMI:Performance_monitoring_interrupts 295.20 ± 5% +27.8% 377.20 ± 4% interrupts.CPU28.RES:Rescheduling_interrupts 5660 ± 4% +34.1% 7589 ± 7% interrupts.CPU29.CAL:Function_call_interrupts 1755232 ± 2% -81.8% 318939 ± 17% interrupts.CPU29.LOC:Local_timer_interrupts 1231 ± 27% +107.2% 2552 ± 21% interrupts.CPU29.NMI:Non-maskable_interrupts 1231 ± 27% +107.2% 2552 ± 21% interrupts.CPU29.PMI:Performance_monitoring_interrupts 5671 ± 4% +45.7% 8261 ± 11% interrupts.CPU3.CAL:Function_call_interrupts 1754838 ± 2% -81.8% 318900 ± 17% interrupts.CPU3.LOC:Local_timer_interrupts 1282 ± 28% +118.3% 2798 ± 11% interrupts.CPU3.NMI:Non-maskable_interrupts 1282 ± 28% +118.3% 2798 ± 11% interrupts.CPU3.PMI:Performance_monitoring_interrupts 258.00 ± 6% +47.5% 380.60 ± 6% interrupts.CPU3.RES:Rescheduling_interrupts 5469 ± 2% +43.2% 7829 ± 7% interrupts.CPU30.CAL:Function_call_interrupts 1755078 ± 2% -81.8% 319030 ± 17% interrupts.CPU30.LOC:Local_timer_interrupts 1552 ± 6% +110.7% 3271 ± 15% interrupts.CPU30.NMI:Non-maskable_interrupts 1552 ± 6% +110.7% 3271 ± 15% interrupts.CPU30.PMI:Performance_monitoring_interrupts 5505 ± 4% +38.7% 7636 ± 7% interrupts.CPU31.CAL:Function_call_interrupts 1755239 ± 2% -81.8% 319028 ± 17% interrupts.CPU31.LOC:Local_timer_interrupts 1252 ± 32% +157.9% 3229 ± 16% interrupts.CPU31.NMI:Non-maskable_interrupts 1252 ± 32% +157.9% 3229 ± 16% interrupts.CPU31.PMI:Performance_monitoring_interrupts 320.80 ± 6% +19.3% 382.80 ± 7% interrupts.CPU31.RES:Rescheduling_interrupts 5425 ± 3% +41.0% 7647 ± 7% interrupts.CPU32.CAL:Function_call_interrupts 1755153 ± 2% -81.8% 319056 ± 17% interrupts.CPU32.LOC:Local_timer_interrupts 1341 ± 22% +141.5% 3240 ± 16% interrupts.CPU32.NMI:Non-maskable_interrupts 1341 ± 22% +141.5% 3240 ± 16% interrupts.CPU32.PMI:Performance_monitoring_interrupts 304.20 ± 3% +28.7% 391.60 ± 3% interrupts.CPU32.RES:Rescheduling_interrupts 5541 ± 2% +36.4% 7556 ± 6% interrupts.CPU33.CAL:Function_call_interrupts 1755148 ± 2% -81.8% 319050 ± 17% interrupts.CPU33.LOC:Local_timer_interrupts 1279 ± 27% +156.9% 3285 ± 16% interrupts.CPU33.NMI:Non-maskable_interrupts 1279 ± 27% +156.9% 3285 ± 16% interrupts.CPU33.PMI:Performance_monitoring_interrupts 317.40 ± 5% +20.9% 383.80 ± 12% interrupts.CPU33.RES:Rescheduling_interrupts 5494 ± 2% +36.2% 7482 ± 8% interrupts.CPU34.CAL:Function_call_interrupts 1755171 ± 2% -81.8% 319043 ± 17% interrupts.CPU34.LOC:Local_timer_interrupts 1427 ± 17% +76.1% 2512 ± 27% interrupts.CPU34.NMI:Non-maskable_interrupts 1427 ± 17% +76.1% 2512 ± 27% interrupts.CPU34.PMI:Performance_monitoring_interrupts 336.40 ± 6% +25.1% 420.80 ± 13% interrupts.CPU34.RES:Rescheduling_interrupts 5412 +43.7% 7778 ± 8% interrupts.CPU35.CAL:Function_call_interrupts 1755214 ± 2% -81.8% 319053 ± 17% interrupts.CPU35.LOC:Local_timer_interrupts 1528 ± 19% +108.0% 3178 ± 16% interrupts.CPU35.NMI:Non-maskable_interrupts 1528 ± 19% +108.0% 3178 ± 16% interrupts.CPU35.PMI:Performance_monitoring_interrupts 322.20 ± 3% +18.7% 382.60 ± 7% interrupts.CPU35.RES:Rescheduling_interrupts 62.80 ± 93% -84.1% 10.00 ± 68% interrupts.CPU35.TLB:TLB_shootdowns 5415 ± 2% +38.5% 7498 ± 4% interrupts.CPU36.CAL:Function_call_interrupts 1755116 ± 2% -81.8% 319056 ± 17% interrupts.CPU36.LOC:Local_timer_interrupts 1353 ± 24% +116.2% 2925 ± 28% interrupts.CPU36.NMI:Non-maskable_interrupts 1353 ± 24% +116.2% 2925 ± 28% interrupts.CPU36.PMI:Performance_monitoring_interrupts 5482 ± 2% +40.9% 7727 ± 9% interrupts.CPU37.CAL:Function_call_interrupts 1755202 ± 2% -81.8% 319041 ± 17% interrupts.CPU37.LOC:Local_timer_interrupts 5547 ± 2% +36.5% 7572 ± 8% interrupts.CPU38.CAL:Function_call_interrupts 1755108 ± 2% -81.8% 319013 ± 17% interrupts.CPU38.LOC:Local_timer_interrupts 1423 ± 27% +107.7% 2957 ± 30% interrupts.CPU38.NMI:Non-maskable_interrupts 1423 ± 27% +107.7% 2957 ± 30% interrupts.CPU38.PMI:Performance_monitoring_interrupts 5439 ± 2% +38.0% 7505 ± 8% interrupts.CPU39.CAL:Function_call_interrupts 1755126 ± 2% -81.8% 318908 ± 17% interrupts.CPU39.LOC:Local_timer_interrupts 1244 ± 31% +128.4% 2843 ± 31% interrupts.CPU39.NMI:Non-maskable_interrupts 1244 ± 31% +128.4% 2843 ± 31% interrupts.CPU39.PMI:Performance_monitoring_interrupts 5576 ± 7% +43.6% 8005 ± 13% interrupts.CPU4.CAL:Function_call_interrupts 1754892 ± 2% -81.8% 319027 ± 17% interrupts.CPU4.LOC:Local_timer_interrupts 280.60 ± 16% +41.1% 395.80 ± 7% interrupts.CPU4.RES:Rescheduling_interrupts 5453 ± 2% +39.8% 7622 ± 9% interrupts.CPU40.CAL:Function_call_interrupts 1755167 ± 2% -81.8% 318970 ± 17% interrupts.CPU40.LOC:Local_timer_interrupts 1211 ± 30% +141.2% 2921 ± 34% interrupts.CPU40.NMI:Non-maskable_interrupts 1211 ± 30% +141.2% 2921 ± 34% interrupts.CPU40.PMI:Performance_monitoring_interrupts 340.40 ± 5% +16.0% 394.80 ± 8% interrupts.CPU40.RES:Rescheduling_interrupts 5460 ± 3% +36.2% 7437 ± 8% interrupts.CPU41.CAL:Function_call_interrupts 1755014 ± 2% -81.8% 319046 ± 17% interrupts.CPU41.LOC:Local_timer_interrupts 1011 ± 36% +159.2% 2622 ± 39% interrupts.CPU41.NMI:Non-maskable_interrupts 1011 ± 36% +159.2% 2622 ± 39% interrupts.CPU41.PMI:Performance_monitoring_interrupts 5442 ± 3% +37.9% 7502 ± 7% interrupts.CPU42.CAL:Function_call_interrupts 1755085 ± 2% -81.8% 319064 ± 17% interrupts.CPU42.LOC:Local_timer_interrupts 5437 +39.7% 7596 ± 5% interrupts.CPU43.CAL:Function_call_interrupts 1755140 ± 2% -81.8% 319016 ± 17% interrupts.CPU43.LOC:Local_timer_interrupts 1176 ± 29% +118.5% 2571 ± 39% interrupts.CPU43.NMI:Non-maskable_interrupts 1176 ± 29% +118.5% 2571 ± 39% interrupts.CPU43.PMI:Performance_monitoring_interrupts 5394 ± 2% +43.6% 7745 ± 7% interrupts.CPU44.CAL:Function_call_interrupts 1755187 ± 2% -81.8% 319040 ± 17% interrupts.CPU44.LOC:Local_timer_interrupts 1163 ± 29% +183.1% 3294 ± 15% interrupts.CPU44.NMI:Non-maskable_interrupts 1163 ± 29% +183.1% 3294 ± 15% interrupts.CPU44.PMI:Performance_monitoring_interrupts 5352 +39.2% 7452 ± 7% interrupts.CPU45.CAL:Function_call_interrupts 1755140 ± 2% -81.8% 319049 ± 17% interrupts.CPU45.LOC:Local_timer_interrupts 1170 ± 27% +173.9% 3204 ± 17% interrupts.CPU45.NMI:Non-maskable_interrupts 1170 ± 27% +173.9% 3204 ± 17% interrupts.CPU45.PMI:Performance_monitoring_interrupts 5414 ± 5% +42.5% 7718 ± 6% interrupts.CPU46.CAL:Function_call_interrupts 1755217 ± 2% -81.8% 319055 ± 17% interrupts.CPU46.LOC:Local_timer_interrupts 993.40 ± 28% +153.9% 2522 ± 28% interrupts.CPU46.NMI:Non-maskable_interrupts 993.40 ± 28% +153.9% 2522 ± 28% interrupts.CPU46.PMI:Performance_monitoring_interrupts 5403 ± 2% +37.6% 7435 ± 5% interrupts.CPU47.CAL:Function_call_interrupts 1755150 ± 2% -81.8% 319054 ± 17% interrupts.CPU47.LOC:Local_timer_interrupts 1210 ± 31% +121.5% 2681 ± 42% interrupts.CPU47.NMI:Non-maskable_interrupts 1210 ± 31% +121.5% 2681 ± 42% interrupts.CPU47.PMI:Performance_monitoring_interrupts 5708 ± 3% +31.9% 7529 ± 7% interrupts.CPU48.CAL:Function_call_interrupts 1755251 ± 2% -81.8% 319078 ± 17% interrupts.CPU48.LOC:Local_timer_interrupts 1316 ± 18% +128.0% 3002 ± 31% interrupts.CPU48.NMI:Non-maskable_interrupts 1316 ± 18% +128.0% 3002 ± 31% interrupts.CPU48.PMI:Performance_monitoring_interrupts 271.40 ± 13% -53.1% 127.20 ± 19% interrupts.CPU48.TLB:TLB_shootdowns 5593 ± 3% +34.1% 7500 ± 7% interrupts.CPU49.CAL:Function_call_interrupts 1755189 ± 2% -81.8% 319034 ± 17% interrupts.CPU49.LOC:Local_timer_interrupts 1352 ± 23% +135.2% 3180 ± 19% interrupts.CPU49.NMI:Non-maskable_interrupts 1352 ± 23% +135.2% 3180 ± 19% interrupts.CPU49.PMI:Performance_monitoring_interrupts 101.20 ± 47% -67.0% 33.40 ± 23% interrupts.CPU49.TLB:TLB_shootdowns 5504 ± 7% +43.4% 7892 ± 12% interrupts.CPU5.CAL:Function_call_interrupts 1755095 ± 2% -81.8% 319069 ± 17% interrupts.CPU5.LOC:Local_timer_interrupts 1395 ± 28% +98.6% 2772 ± 13% interrupts.CPU5.NMI:Non-maskable_interrupts 1395 ± 28% +98.6% 2772 ± 13% interrupts.CPU5.PMI:Performance_monitoring_interrupts 253.60 ± 10% +46.9% 372.60 ± 4% interrupts.CPU5.RES:Rescheduling_interrupts 5549 ± 3% +34.1% 7442 ± 7% interrupts.CPU50.CAL:Function_call_interrupts 1755394 ± 2% -81.8% 319040 ± 17% interrupts.CPU50.LOC:Local_timer_interrupts 1122 ± 36% +192.4% 3282 ± 15% interrupts.CPU50.NMI:Non-maskable_interrupts 1122 ± 36% +192.4% 3282 ± 15% interrupts.CPU50.PMI:Performance_monitoring_interrupts 5503 ± 2% +32.5% 7294 ± 6% interrupts.CPU51.CAL:Function_call_interrupts 1755384 ± 2% -81.8% 319047 ± 17% interrupts.CPU51.LOC:Local_timer_interrupts 1066 ± 31% +171.0% 2890 ± 13% interrupts.CPU51.NMI:Non-maskable_interrupts 1066 ± 31% +171.0% 2890 ± 13% interrupts.CPU51.PMI:Performance_monitoring_interrupts 5676 ± 5% +31.4% 7460 ± 7% interrupts.CPU52.CAL:Function_call_interrupts 1755432 ± 2% -81.8% 319051 ± 17% interrupts.CPU52.LOC:Local_timer_interrupts 1175 ± 27% +149.3% 2930 ± 13% interrupts.CPU52.NMI:Non-maskable_interrupts 1175 ± 27% +149.3% 2930 ± 13% interrupts.CPU52.PMI:Performance_monitoring_interrupts 5508 ± 3% +34.5% 7408 ± 5% interrupts.CPU53.CAL:Function_call_interrupts 1755391 ± 2% -81.8% 318971 ± 17% interrupts.CPU53.LOC:Local_timer_interrupts 1038 ± 30% +175.9% 2864 ± 15% interrupts.CPU53.NMI:Non-maskable_interrupts 1038 ± 30% +175.9% 2864 ± 15% interrupts.CPU53.PMI:Performance_monitoring_interrupts 5380 +38.9% 7473 ± 8% interrupts.CPU54.CAL:Function_call_interrupts 1754785 ± 2% -81.8% 319030 ± 17% interrupts.CPU54.LOC:Local_timer_interrupts 1216 ± 30% +164.3% 3215 ± 19% interrupts.CPU54.NMI:Non-maskable_interrupts 1216 ± 30% +164.3% 3215 ± 19% interrupts.CPU54.PMI:Performance_monitoring_interrupts 5499 ± 3% +35.3% 7439 ± 8% interrupts.CPU55.CAL:Function_call_interrupts 1755427 ± 2% -81.8% 319050 ± 17% interrupts.CPU55.LOC:Local_timer_interrupts 1054 ± 32% +197.3% 3135 ± 18% interrupts.CPU55.NMI:Non-maskable_interrupts 1054 ± 32% +197.3% 3135 ± 18% interrupts.CPU55.PMI:Performance_monitoring_interrupts 5454 ± 2% +35.0% 7362 ± 7% interrupts.CPU56.CAL:Function_call_interrupts 1754845 ± 2% -81.8% 319054 ± 17% interrupts.CPU56.LOC:Local_timer_interrupts 1465 ± 29% +116.7% 3175 ± 17% interrupts.CPU56.NMI:Non-maskable_interrupts 1465 ± 29% +116.7% 3175 ± 17% interrupts.CPU56.PMI:Performance_monitoring_interrupts 5426 +36.7% 7416 ± 7% interrupts.CPU57.CAL:Function_call_interrupts 1755351 ± 2% -81.8% 318923 ± 17% interrupts.CPU57.LOC:Local_timer_interrupts 1422 ± 29% +132.9% 3312 ± 18% interrupts.CPU57.NMI:Non-maskable_interrupts 1422 ± 29% +132.9% 3312 ± 18% interrupts.CPU57.PMI:Performance_monitoring_interrupts 5398 +36.2% 7351 ± 6% interrupts.CPU58.CAL:Function_call_interrupts 1755357 ± 2% -81.8% 319045 ± 17% interrupts.CPU58.LOC:Local_timer_interrupts 1453 ± 34% +122.4% 3231 ± 12% interrupts.CPU58.NMI:Non-maskable_interrupts 1453 ± 34% +122.4% 3231 ± 12% interrupts.CPU58.PMI:Performance_monitoring_interrupts 5464 +36.5% 7456 ± 6% interrupts.CPU59.CAL:Function_call_interrupts 1755429 ± 2% -81.8% 319040 ± 17% interrupts.CPU59.LOC:Local_timer_interrupts 1471 ± 29% +122.9% 3280 ± 18% interrupts.CPU59.NMI:Non-maskable_interrupts 1471 ± 29% +122.9% 3280 ± 18% interrupts.CPU59.PMI:Performance_monitoring_interrupts 5467 ± 6% +41.7% 7746 ± 8% interrupts.CPU6.CAL:Function_call_interrupts 1754764 ± 2% -81.8% 318979 ± 17% interrupts.CPU6.LOC:Local_timer_interrupts 1548 ± 5% +105.4% 3179 ± 17% interrupts.CPU6.NMI:Non-maskable_interrupts 1548 ± 5% +105.4% 3179 ± 17% interrupts.CPU6.PMI:Performance_monitoring_interrupts 265.20 ± 14% +49.2% 395.80 ± 4% interrupts.CPU6.RES:Rescheduling_interrupts 5446 +32.7% 7229 ± 6% interrupts.CPU60.CAL:Function_call_interrupts 1755386 ± 2% -81.8% 319013 ± 17% interrupts.CPU60.LOC:Local_timer_interrupts 1417 ± 15% +124.3% 3179 ± 19% interrupts.CPU60.NMI:Non-maskable_interrupts 1417 ± 15% +124.3% 3179 ± 19% interrupts.CPU60.PMI:Performance_monitoring_interrupts 5418 ± 2% +34.6% 7293 ± 9% interrupts.CPU61.CAL:Function_call_interrupts 1755355 ± 2% -81.8% 319033 ± 17% interrupts.CPU61.LOC:Local_timer_interrupts 1300 ± 3% +120.9% 2871 ± 14% interrupts.CPU61.NMI:Non-maskable_interrupts 1300 ± 3% +120.9% 2871 ± 14% interrupts.CPU61.PMI:Performance_monitoring_interrupts 5456 ± 2% +37.7% 7513 ± 9% interrupts.CPU62.CAL:Function_call_interrupts 1755397 ± 2% -81.8% 319027 ± 17% interrupts.CPU62.LOC:Local_timer_interrupts 1413 ± 14% +133.2% 3296 ± 13% interrupts.CPU62.NMI:Non-maskable_interrupts 1413 ± 14% +133.2% 3296 ± 13% interrupts.CPU62.PMI:Performance_monitoring_interrupts 5451 ± 5% +35.7% 7399 ± 8% interrupts.CPU63.CAL:Function_call_interrupts 1754923 ± 2% -81.8% 319040 ± 17% interrupts.CPU63.LOC:Local_timer_interrupts 1252 ± 18% +161.0% 3269 ± 20% interrupts.CPU63.NMI:Non-maskable_interrupts 1252 ± 18% +161.0% 3269 ± 20% interrupts.CPU63.PMI:Performance_monitoring_interrupts 5365 +38.1% 7409 ± 7% interrupts.CPU64.CAL:Function_call_interrupts 1755316 ± 2% -81.8% 319037 ± 17% interrupts.CPU64.LOC:Local_timer_interrupts 1393 ± 8% +100.6% 2795 ± 13% interrupts.CPU64.NMI:Non-maskable_interrupts 1393 ± 8% +100.6% 2795 ± 13% interrupts.CPU64.PMI:Performance_monitoring_interrupts 5478 ± 2% +37.6% 7539 ± 8% interrupts.CPU65.CAL:Function_call_interrupts 1755374 ± 2% -81.8% 318998 ± 17% interrupts.CPU65.LOC:Local_timer_interrupts 1144 ± 22% +157.7% 2949 ± 30% interrupts.CPU65.NMI:Non-maskable_interrupts 1144 ± 22% +157.7% 2949 ± 30% interrupts.CPU65.PMI:Performance_monitoring_interrupts 5554 ± 2% +33.5% 7412 ± 7% interrupts.CPU66.CAL:Function_call_interrupts 1755198 ± 2% -81.8% 319029 ± 17% interrupts.CPU66.LOC:Local_timer_interrupts 871.60 ± 42% +273.0% 3251 ± 18% interrupts.CPU66.NMI:Non-maskable_interrupts 871.60 ± 42% +273.0% 3251 ± 18% interrupts.CPU66.PMI:Performance_monitoring_interrupts 5488 ± 3% +37.9% 7566 ± 7% interrupts.CPU67.CAL:Function_call_interrupts 1755233 ± 2% -81.8% 319016 ± 17% interrupts.CPU67.LOC:Local_timer_interrupts 1305 ± 39% +149.4% 3256 ± 14% interrupts.CPU67.NMI:Non-maskable_interrupts 1305 ± 39% +149.4% 3256 ± 14% interrupts.CPU67.PMI:Performance_monitoring_interrupts 5420 ± 4% +35.5% 7343 ± 7% interrupts.CPU68.CAL:Function_call_interrupts 1755361 ± 2% -81.8% 319002 ± 17% interrupts.CPU68.LOC:Local_timer_interrupts 1175 ± 29% +173.5% 3214 ± 16% interrupts.CPU68.NMI:Non-maskable_interrupts 1175 ± 29% +173.5% 3214 ± 16% interrupts.CPU68.PMI:Performance_monitoring_interrupts 5286 ± 2% +40.2% 7414 ± 7% interrupts.CPU69.CAL:Function_call_interrupts 1755311 ± 2% -81.8% 319028 ± 17% interrupts.CPU69.LOC:Local_timer_interrupts 1234 ± 33% +157.3% 3177 ± 19% interrupts.CPU69.NMI:Non-maskable_interrupts 1234 ± 33% +157.3% 3177 ± 19% interrupts.CPU69.PMI:Performance_monitoring_interrupts 5432 ± 2% +47.0% 7984 ± 12% interrupts.CPU7.CAL:Function_call_interrupts 1755318 ± 2% -81.8% 319023 ± 17% interrupts.CPU7.LOC:Local_timer_interrupts 1345 ± 35% +104.8% 2755 ± 12% interrupts.CPU7.NMI:Non-maskable_interrupts 1345 ± 35% +104.8% 2755 ± 12% interrupts.CPU7.PMI:Performance_monitoring_interrupts 276.80 ± 19% +42.1% 393.40 ± 5% interrupts.CPU7.RES:Rescheduling_interrupts 5391 ± 2% +39.3% 7512 ± 7% interrupts.CPU70.CAL:Function_call_interrupts 1755314 ± 2% -81.8% 319081 ± 17% interrupts.CPU70.LOC:Local_timer_interrupts 1369 ± 22% +109.5% 2868 ± 28% interrupts.CPU70.NMI:Non-maskable_interrupts 1369 ± 22% +109.5% 2868 ± 28% interrupts.CPU70.PMI:Performance_monitoring_interrupts 5598 ± 6% +34.5% 7529 ± 7% interrupts.CPU71.CAL:Function_call_interrupts 1755309 ± 2% -81.8% 319063 ± 17% interrupts.CPU71.LOC:Local_timer_interrupts 1382 ± 19% +131.5% 3200 ± 20% interrupts.CPU71.NMI:Non-maskable_interrupts 1382 ± 19% +131.5% 3200 ± 20% interrupts.CPU71.PMI:Performance_monitoring_interrupts 5524 ± 3% +44.4% 7979 ± 7% interrupts.CPU72.CAL:Function_call_interrupts 1754859 ± 2% -81.8% 318960 ± 17% interrupts.CPU72.LOC:Local_timer_interrupts 1416 ± 22% +133.0% 3300 ± 18% interrupts.CPU72.NMI:Non-maskable_interrupts 1416 ± 22% +133.0% 3300 ± 18% interrupts.CPU72.PMI:Performance_monitoring_interrupts 282.40 ± 13% -55.1% 126.80 ± 44% interrupts.CPU72.TLB:TLB_shootdowns 5532 ± 3% +38.4% 7656 ± 8% interrupts.CPU73.CAL:Function_call_interrupts 1755278 ± 2% -81.8% 319034 ± 17% interrupts.CPU73.LOC:Local_timer_interrupts 1315 ± 28% +112.6% 2795 ± 13% interrupts.CPU73.NMI:Non-maskable_interrupts 1315 ± 28% +112.6% 2795 ± 13% interrupts.CPU73.PMI:Performance_monitoring_interrupts 5507 ± 2% +41.7% 7803 ± 9% interrupts.CPU74.CAL:Function_call_interrupts 1755170 ± 2% -81.8% 319063 ± 17% interrupts.CPU74.LOC:Local_timer_interrupts 1253 ± 22% +163.0% 3296 ± 15% interrupts.CPU74.NMI:Non-maskable_interrupts 1253 ± 22% +163.0% 3296 ± 15% interrupts.CPU74.PMI:Performance_monitoring_interrupts 5414 ± 3% +39.1% 7530 ± 7% interrupts.CPU75.CAL:Function_call_interrupts 1755047 ± 2% -81.8% 318955 ± 17% interrupts.CPU75.LOC:Local_timer_interrupts 1407 ± 22% +131.0% 3252 ± 16% interrupts.CPU75.NMI:Non-maskable_interrupts 1407 ± 22% +131.0% 3252 ± 16% interrupts.CPU75.PMI:Performance_monitoring_interrupts 5500 ± 4% +45.1% 7980 ± 7% interrupts.CPU76.CAL:Function_call_interrupts 1755174 ± 2% -81.8% 318986 ± 17% interrupts.CPU76.LOC:Local_timer_interrupts 1336 ± 26% +121.4% 2958 ± 30% interrupts.CPU76.NMI:Non-maskable_interrupts 1336 ± 26% +121.4% 2958 ± 30% interrupts.CPU76.PMI:Performance_monitoring_interrupts 5371 ± 2% +44.2% 7744 ± 10% interrupts.CPU77.CAL:Function_call_interrupts 1755056 ± 2% -81.8% 318966 ± 17% interrupts.CPU77.LOC:Local_timer_interrupts 1295 ± 25% +107.0% 2681 ± 39% interrupts.CPU77.NMI:Non-maskable_interrupts 1295 ± 25% +107.0% 2681 ± 39% interrupts.CPU77.PMI:Performance_monitoring_interrupts 5466 ± 3% +41.5% 7736 ± 6% interrupts.CPU78.CAL:Function_call_interrupts 1755141 ± 2% -81.8% 319001 ± 17% interrupts.CPU78.LOC:Local_timer_interrupts 342.80 ± 3% +16.0% 397.60 ± 10% interrupts.CPU78.RES:Rescheduling_interrupts 5467 +42.1% 7767 ± 7% interrupts.CPU79.CAL:Function_call_interrupts 1755134 ± 2% -81.8% 318991 ± 17% interrupts.CPU79.LOC:Local_timer_interrupts 5590 ± 11% +36.7% 7644 ± 9% interrupts.CPU8.CAL:Function_call_interrupts 1755151 ± 2% -81.8% 319074 ± 17% interrupts.CPU8.LOC:Local_timer_interrupts 1286 ± 27% +121.2% 2845 ± 30% interrupts.CPU8.NMI:Non-maskable_interrupts 1286 ± 27% +121.2% 2845 ± 30% interrupts.CPU8.PMI:Performance_monitoring_interrupts 248.60 ± 11% +61.0% 400.20 ± 5% interrupts.CPU8.RES:Rescheduling_interrupts 5395 +45.0% 7821 ± 9% interrupts.CPU80.CAL:Function_call_interrupts 1755125 ± 2% -81.8% 318990 ± 17% interrupts.CPU80.LOC:Local_timer_interrupts 1289 ± 23% +131.9% 2990 ± 31% interrupts.CPU80.NMI:Non-maskable_interrupts 1289 ± 23% +131.9% 2990 ± 31% interrupts.CPU80.PMI:Performance_monitoring_interrupts 350.20 ± 5% +18.4% 414.60 ± 8% interrupts.CPU80.RES:Rescheduling_interrupts 5367 ± 2% +47.0% 7891 ± 10% interrupts.CPU81.CAL:Function_call_interrupts 1754991 ± 2% -81.8% 318991 ± 17% interrupts.CPU81.LOC:Local_timer_interrupts 5322 ± 4% +46.5% 7796 ± 9% interrupts.CPU82.CAL:Function_call_interrupts 1755214 ± 2% -81.8% 318992 ± 17% interrupts.CPU82.LOC:Local_timer_interrupts 5350 +46.8% 7855 ± 8% interrupts.CPU83.CAL:Function_call_interrupts 1755169 ± 2% -81.8% 318991 ± 17% interrupts.CPU83.LOC:Local_timer_interrupts 5404 ± 2% +41.9% 7670 ± 7% interrupts.CPU84.CAL:Function_call_interrupts 1755110 ± 2% -81.8% 318986 ± 17% interrupts.CPU84.LOC:Local_timer_interrupts 1266 ± 24% +129.3% 2904 ± 32% interrupts.CPU84.NMI:Non-maskable_interrupts 1266 ± 24% +129.3% 2904 ± 32% interrupts.CPU84.PMI:Performance_monitoring_interrupts 5539 ± 3% +41.6% 7842 ± 7% interrupts.CPU85.CAL:Function_call_interrupts 1754435 ± 2% -81.8% 318973 ± 17% interrupts.CPU85.LOC:Local_timer_interrupts 1392 ± 18% +110.6% 2932 ± 32% interrupts.CPU85.NMI:Non-maskable_interrupts 1392 ± 18% +110.6% 2932 ± 32% interrupts.CPU85.PMI:Performance_monitoring_interrupts 5440 ± 4% +41.8% 7711 ± 9% interrupts.CPU86.CAL:Function_call_interrupts 1754725 ± 2% -81.8% 318995 ± 17% interrupts.CPU86.LOC:Local_timer_interrupts 5402 ± 3% +41.7% 7655 ± 9% interrupts.CPU87.CAL:Function_call_interrupts 1754744 ± 2% -81.8% 318982 ± 17% interrupts.CPU87.LOC:Local_timer_interrupts 1611 ± 16% +82.5% 2941 ± 27% interrupts.CPU87.NMI:Non-maskable_interrupts 1611 ± 16% +82.5% 2941 ± 27% interrupts.CPU87.PMI:Performance_monitoring_interrupts 5435 ± 4% +42.9% 7765 ± 6% interrupts.CPU88.CAL:Function_call_interrupts 1754726 ± 2% -81.8% 318982 ± 17% interrupts.CPU88.LOC:Local_timer_interrupts 1370 ± 13% +113.2% 2922 ± 30% interrupts.CPU88.NMI:Non-maskable_interrupts 1370 ± 13% +113.2% 2922 ± 30% interrupts.CPU88.PMI:Performance_monitoring_interrupts 5347 ± 3% +43.7% 7682 ± 6% interrupts.CPU89.CAL:Function_call_interrupts 1754752 ± 2% -81.8% 319006 ± 17% interrupts.CPU89.LOC:Local_timer_interrupts 1400 ± 12% +112.8% 2979 ± 32% interrupts.CPU89.NMI:Non-maskable_interrupts 1400 ± 12% +112.8% 2979 ± 32% interrupts.CPU89.PMI:Performance_monitoring_interrupts 348.80 ± 2% +17.7% 410.40 ± 8% interrupts.CPU89.RES:Rescheduling_interrupts 5123 ± 3% +45.7% 7466 ± 7% interrupts.CPU9.CAL:Function_call_interrupts 1755185 ± 2% -81.8% 319009 ± 17% interrupts.CPU9.LOC:Local_timer_interrupts 1288 ± 26% +130.0% 2964 ± 31% interrupts.CPU9.NMI:Non-maskable_interrupts 1288 ± 26% +130.0% 2964 ± 31% interrupts.CPU9.PMI:Performance_monitoring_interrupts 250.80 ± 3% +55.9% 391.00 ± 5% interrupts.CPU9.RES:Rescheduling_interrupts 5370 ± 3% +48.5% 7975 ± 11% interrupts.CPU90.CAL:Function_call_interrupts 1754701 ± 2% -81.8% 318942 ± 17% interrupts.CPU90.LOC:Local_timer_interrupts 5489 ± 6% +46.4% 8038 ± 8% interrupts.CPU91.CAL:Function_call_interrupts 1754714 ± 2% -81.8% 318897 ± 17% interrupts.CPU91.LOC:Local_timer_interrupts 5357 ± 2% +43.9% 7709 ± 7% interrupts.CPU92.CAL:Function_call_interrupts 1754857 ± 2% -81.8% 318947 ± 17% interrupts.CPU92.LOC:Local_timer_interrupts 1208 ± 26% +112.6% 2570 ± 35% interrupts.CPU92.NMI:Non-maskable_interrupts 1208 ± 26% +112.6% 2570 ± 35% interrupts.CPU92.PMI:Performance_monitoring_interrupts 5463 ± 5% +42.0% 7756 ± 9% interrupts.CPU93.CAL:Function_call_interrupts 1754602 ± 2% -81.8% 318970 ± 17% interrupts.CPU93.LOC:Local_timer_interrupts 1327 ± 28% +138.7% 3168 ± 18% interrupts.CPU93.NMI:Non-maskable_interrupts 1327 ± 28% +138.7% 3168 ± 18% interrupts.CPU93.PMI:Performance_monitoring_interrupts 340.20 +16.3% 395.80 ± 5% interrupts.CPU93.RES:Rescheduling_interrupts 5252 ± 2% +48.5% 7801 ± 12% interrupts.CPU94.CAL:Function_call_interrupts 1755185 ± 2% -81.8% 318958 ± 17% interrupts.CPU94.LOC:Local_timer_interrupts 1415 ± 22% +128.9% 3240 ± 14% interrupts.CPU94.NMI:Non-maskable_interrupts 1415 ± 22% +128.9% 3240 ± 14% interrupts.CPU94.PMI:Performance_monitoring_interrupts 338.00 ± 3% +11.7% 377.40 ± 7% interrupts.CPU94.RES:Rescheduling_interrupts 5398 ± 5% +44.1% 7777 ± 8% interrupts.CPU95.CAL:Function_call_interrupts 1755057 ± 2% -81.8% 318957 ± 17% interrupts.CPU95.LOC:Local_timer_interrupts 1269 ± 22% +112.1% 2693 ± 42% interrupts.CPU95.NMI:Non-maskable_interrupts 1269 ± 22% +112.1% 2693 ± 42% interrupts.CPU95.PMI:Performance_monitoring_interrupts 5477 ± 2% +40.4% 7688 ± 10% interrupts.CPU96.CAL:Function_call_interrupts 1755228 ± 2% -81.8% 319021 ± 17% interrupts.CPU96.LOC:Local_timer_interrupts 1189 ± 37% +139.6% 2848 ± 30% interrupts.CPU96.NMI:Non-maskable_interrupts 1189 ± 37% +139.6% 2848 ± 30% interrupts.CPU96.PMI:Performance_monitoring_interrupts 345.40 ± 4% +12.7% 389.20 ± 7% interrupts.CPU96.RES:Rescheduling_interrupts 5512 +41.3% 7791 ± 9% interrupts.CPU97.CAL:Function_call_interrupts 1755138 ± 2% -81.8% 319041 ± 17% interrupts.CPU97.LOC:Local_timer_interrupts 1298 ± 30% +125.1% 2922 ± 29% interrupts.CPU97.NMI:Non-maskable_interrupts 1298 ± 30% +125.1% 2922 ± 29% interrupts.CPU97.PMI:Performance_monitoring_interrupts 5433 +41.2% 7673 ± 9% interrupts.CPU98.CAL:Function_call_interrupts 1754957 ± 2% -81.8% 319031 ± 17% interrupts.CPU98.LOC:Local_timer_interrupts 5391 +40.3% 7561 ± 10% interrupts.CPU99.CAL:Function_call_interrupts 1754878 ± 2% -81.8% 318928 ± 17% interrupts.CPU99.LOC:Local_timer_interrupts 1420 ± 18% +98.3% 2817 ± 28% interrupts.CPU99.NMI:Non-maskable_interrupts 1420 ± 18% +98.3% 2817 ± 28% interrupts.CPU99.PMI:Performance_monitoring_interrupts 1.00 +6440.0% 65.40 ± 95% interrupts.IWI:IRQ_work_interrupts 3.37e+08 ± 2% -81.8% 61248458 ± 17% interrupts.LOC:Local_timer_interrupts 384.00 -100.0% 0.00 interrupts.MCP:Machine_check_polls 257000 ± 3% +122.3% 571373 ± 16% interrupts.NMI:Non-maskable_interrupts 257000 ± 3% +122.3% 571373 ± 16% interrupts.PMI:Performance_monitoring_interrupts 7131 ± 25% -50.5% 3529 ± 27% interrupts.TLB:TLB_shootdowns aim7.jobs-per-min 10000 +-------------------------------------------------------------------+ | O | 9000 |-+ O O O O O O | 8000 |-+ O O | | O | 7000 |-+ O | 6000 |-+ O | | | 5000 |-+ | 4000 |-+ | | | 3000 |-+ | 2000 |-+ | |....+... ..+...+....+...+....+...+....+...+....+... ..+...+....| 1000 +-------------------------------------------------------------------+ aim7.time.system_time 20000 +-------------------------------------------------------------------+ | | 18000 |.... ..+....+... ..+...+.... ..+....+...+.... ..+....+...+....| 16000 |-+ +. +.. +. +. | | | 14000 |-+ | | | 12000 |-+ | | | 10000 |-+ | 8000 |-+ | | O O | 6000 |-+ O O O O | | O O O O O O | 4000 +-------------------------------------------------------------------+ aim7.time.elapsed_time 1000 +--------------------------------------------------------------------+ | .+.... ..+.... | 900 |.... .. +... ..+....+...+....+...+.... ..+. +...+....| 800 |-+ + +.. +.. | | | 700 |-+ | 600 |-+ | | | 500 |-+ | 400 |-+ | | | 300 |-+ | 200 |-+ O | | O O O O O O O O O O | 100 +--------------------------------------------------------------------+ aim7.time.elapsed_time.max 1000 +--------------------------------------------------------------------+ | .+.... ..+.... | 900 |.... .. +... ..+....+...+....+...+.... ..+. +...+....| 800 |-+ + +.. +.. | | | 700 |-+ | 600 |-+ | | | 500 |-+ | 400 |-+ | | | 300 |-+ | 200 |-+ O | | O O O O O O O O O O | 100 +--------------------------------------------------------------------+ aim7.time.minor_page_faults 130000 +------------------------------------------------------------------+ | ..+... ..+... ..+.. ..+.. | 120000 |-..+.. +....+. . ..+.. . ..+...+.. . ..+...| 110000 |.+ +. +.. +.. | | | 100000 |-+ | 90000 |-+ | | | 80000 |-+ | 70000 |-+ | | | 60000 |-+ O | 50000 |-+ O O O O | | O O O O O O | 40000 +------------------------------------------------------------------+ aim7.time.voluntary_context_switches 4e+07 +-----------------------------------------------------------------+ | O O O O O O | | O | 3.5e+07 |-+ O | | | | O | 3e+07 |-+ O | | O | 2.5e+07 |-+ | | | | | 2e+07 |-+ | | | | | 1.5e+07 +-----------------------------------------------------------------+ aim7.time.involuntary_context_switches 45000 +-------------------------------------------------------------------+ |.... ..+.... ..+... ..+....+... | 40000 |-+ +. +...+....+...+....+...+.. +....+. +....| | | 35000 |-+ | | | 30000 |-+ | | | 25000 |-+ | | | 20000 |-+ O O O | | O O O | 15000 |-+ O O O O O O | | | 10000 +-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

4 months, 4 weeks

1
0
0 / 0

[serial] ecb4041314: BUG:spinlock_trylock_failure_on_UP_on_CPU

by kernel test robot

Greeting, FYI, we noticed the following commit (built with clang-12): commit: ecb4041314661988a1ba3135d17306f170424b03 ("serial: 8250: implement write_atomic") https://git.kernel.org/cgit/linux/kernel/git/rt/linux-rt-devel.git linux-5.9.y-rt-rebase in testcase: boot on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-----------------------------------------------------------------------------+------------+------------+ | | 76649952a9 | ecb4041314 | +-----------------------------------------------------------------------------+------------+------------+ | boot_successes | 591 | 1 | | boot_failures | 95 | 687 | | BUG:sleeping_function_called_from_invalid_context_at_mm/slab.h | 5 | 63 | | BUG:sleeping_function_called_from_invalid_context_at_kernel/locking/mutex.c | 12 | 8 | | WARNING:at_kernel/softirq.c:#__local_bh_enable_ip | 10 | | | RIP:__local_bh_enable_ip | 10 | | | BUG:kernel_reboot-without-warning_in_boot_stage | 13 | | | initcall_print_ICs_returned_with_disabled_interrupts | 50 | | | WARNING:at_init/main.c:#do_one_initcall | 65 | 65 | | RIP:do_one_initcall | 65 | 85 | | initcall_sdhci_drv_init_returned_with_disabled_interrupts | 2 | | | initcall_raw_init_returned_with_disabled_interrupts | 1 | | | initcall_ledtrig_cpu_init_returned_with_disabled_interrupts | 1 | | | BUG:kernel_hang_in_boot_stage | 4 | 5 | | initcall_kmemleak_late_init_returned_with_disabled_interrupts | 2 | | | initcall_sched_clock_init_late_returned_with_disabled_interrupts | 1 | | | WARNING:at_kernel/workqueue.c:#__queue_work | 2 | | | RIP:__queue_work | 2 | | | WARNING:at_kernel/rcu/tree_plugin.h:#call_rcu | 3 | 3 | | RIP:call_rcu | 3 | 2 | | WARNING:at_kernel/rcu/tree_plugin.h:#rcu_nocb_lock | 3 | | | RIP:rcu_nocb_lock | 3 | | | WARNING:at_kernel/rcu/tree_plugin.h:#rcu_lockdep_assert_cblist_protected | 3 | | | RIP:rcu_lockdep_assert_cblist_protected | 3 | | | WARNING:at_kernel/rcu/tree_plugin.h:#rcu_nocb_bypass_lock | 3 | | | RIP:rcu_nocb_bypass_lock | 3 | | | WARNING:at_kernel/rcu/tree_plugin.h:#rcu_nocb_bypass_unlock | 3 | | | RIP:rcu_nocb_bypass_unlock | 3 | | | WARNING:at_kernel/rcu/tree_plugin.h:#rcu_nocb_unlock_irqrestore | 3 | | | RIP:rcu_nocb_unlock_irqrestore | 3 | | | initcall_i8042_init_returned_with_disabled_interrupts | 1 | | | initcall_init_p9_returned_with_disabled_interrupts | 1 | | | initcall_gb_bootrom_driver_init_returned_with_disabled_interrupts | 1 | | | initcall_init_btrfs_fs_returned_with_disabled_interrupts | 2 | | | IP-Config:Auto-configuration_of_network_failed | 1 | | | initcall_mousedev_init_returned_with_disabled_interrupts | 1 | | | initcall_i2c_dev_init_returned_with_disabled_interrupts | 1 | | | initcall_gb_lights_driver_init_returned_with_disabled_interrupts | 1 | | | WARNING:at_kernel/rcu/tree_plugin.h:#rcu_note_context_switch | 1 | | | RIP:rcu_note_context_switch | 1 | | | BUG:sleeping_function_called_from_invalid_context_at_kernel/locking/rwsem.c | 1 | 9 | | initcall_e1000_init_module_returned_with_disabled_interrupts | 2 | | | BUG:spinlock_trylock_failure_on_UP_on_CPU | 0 | 682 | | kernel_BUG_at_mm/slab.c | 0 | 16 | | invalid_opcode:#[##] | 0 | 17 | | RIP:do_tune_cpucache | 0 | 7 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 14 | | initcall_pci_subsys_init_returned_with_disabled_interrupts | 0 | 8 | | WARNING:CPU:#PID:#at_init/main.c:#do_one_initcall | 0 | 2 | | initcall_init_hw_perf_events_returned_with_disabled_interrupts | 0 | 7 | | WARNING:CPU:#PID:#at_init/main.c | 0 | 5 | | initcall_acpi_init_returned_with_disabled_interrupts | 0 | 22 | | initcall_pci_subsys_init_returned_with_disabled | 0 | 1 | | initcall_dquot_init_returned_with_disabled_interrupts | 0 | 1 | | initcall_acpi_init_returned_with_disabled_interru | 0 | 1 | | WARNING:CPU:#PID:#at_init/main.c:#do | 0 | 1 | | initcall_raid#_select_algo_returned_with_disa | 0 | 1 | | WARNING:CPU:#PID:#at_init/main.c:#do_on | 0 | 1 | | BUG:sleeping_function_called | 0 | 1 | | initcall_calibrate_xor_blocks_returned_with_disabled_interrupts | 0 | 2 | | BUG:sleeping_function_called_from_invalid_context_at_mm/sla | 0 | 1 | | RIP:__kmem_cache_shrink | 0 | 9 | | WARNING:CPU:#PID:#at_i | 0 | 2 | | initcall_pinctrl_init_returned_with_disabled_interrupts | 0 | 3 | | WARNING:CPU:#PID:#at_init/main.c:#do_one_init | 0 | 1 | | initcall_pcibios_assign_resources_returned_with_disabled_interrupts | 0 | 1 | | calltrace:copy_process | 0 | 1 | | initcall_pci_apply_final_quirks_returned_with_disabled_interrupts | 0 | 1 | | BUG:sleeping_function_called_from_invalid_context | 0 | 1 | | BUG:sleeping_function_called_from_invalid_context_at | 0 | 2 | | initcall_init_mmap_min_addr_returned_with_disabled_interrupts | 0 | 3 | | WARNING:CPU:#PID:#at_init/main.c:#do_one_initcall+ | 0 | 2 | | initcall_pci_apply_final_quirks_returned_with_disab | 0 | 1 | | initcall_pnpacpi_init_returned_with_disabled_interrupts | 0 | 5 | | initcall_pci_arch_init_returned_with_disabled_interrupts | 0 | 1 | | Kernel_panic-not_syncing:Fata | 0 | 1 | | BUG:sleeping_function_called_from_invalid_context_at_lib/random32.c | 0 | 5 | | WARNING:CPU:#PID:#at_init/main.c:#do_one_initca | 0 | 2 | | WARNING:CPU:#PID:#at_init/main.c:#d | 0 | 3 | | WARNING:CPU:#PID:#at_init/main.c:#do_one_initcal | 0 | 1 | | initcall_init_sunrpc_returned_with_disabled_interrupts | 0 | 2 | | initcall_gpiolib_dev_init_returned_with_disabled_interrupts | 0 | 1 | | Kernel_panic-not_syncing:Fatal_e | 0 | 1 | | initcall_vga_arb_device_init_returned_with_disabled_inter | 0 | 3 | | WARNING:CPU:#PID:#at_init/main | 0 | 1 | | RIP:do_one_initcall/0x | 0 | 2 | | initcall_af_unix_init_returned_with_disabled_interrupts | 0 | 1 | | initcall_teo_governor_init_returned_with_disabled_interrupts | 0 | 1 | | BUG:sleeping_function_called_from | 0 | 1 | | initcall_srcu_bootup_announce_returned_with_disa | 0 | 1 | | initcall_pci_arch_init_returned_with_disabled_interrupt | 0 | 1 | | BUG:sleeping_function_called_f | 0 | 1 | | initcall_prandom_init_returned_with_disabled_interrupts | 0 | 2 | | initcall_thermal_init_returned_with_disabled_interrupts | 0 | 2 | | initcall_futex_init_returned_with_disabled_interrupts | 0 | 1 | | initcall_init_sunrpc_returned_with_disabled_inte | 0 | 1 | | initcall_cryptd_init_returned_with_disabled_interrupts | 0 | 2 | | WARNING:CPU:#PID:#at_init/main.c:#do_one | 0 | 1 | | WARNING:CPU:#PID:#at_in | 0 | 1 | | WARNING:CPU:#PID:#at_init/main.c:#do_one_in | 0 | 1 | | initcall_acpi_init_returned_with_disabled_interr | 0 | 1 | | BUG:sleeping_function_c | 0 | 1 | | BUG:sleeping_function_called_from_invalid_context_at_kernel | 0 | 1 | | RIP:call_rcu/0x | 0 | 1 | | initcall_hugetlb_init_returned_with_disabled_interrup | 0 | 1 | | initcall_prandom_init_returned_with_disabled | 0 | 1 | | WARNING:CPU:#PID:#at_init/main.c:#do_one_i | 0 | 1 | | BUG:sleeping_function_called_from_invalid | 0 | 1 | | initcall_acpi_init_returned_with_disabled_inter | 0 | 1 | | initcall_raid#_select_algo_returned_with_disab | 0 | 1 | | BUG:sleeping_function_called_from_invalid_conte | 0 | 1 | | initcall_acpi_pci_init_returned_with_disabl | 0 | 1 | | initcall_prandom_init_returned_with_d | 0 | 1 | +-----------------------------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 3.409337] 000: BUG: spinlock trylock failure on UP on CPU#0, swapper/1 [ 3.410119] 000: lock: serial8250_ports+0x0/0xea0, .magic: dead4ead, .owner: swapper/1, .owner_cpu: 0 [ 3.411202] 000: CPU: 0 PID: 1 Comm: swapper Not tainted 5.9.0-rc8-00021-gecb40413146619 #1 [ 3.412148] 000: Call Trace: [ 3.412511] 000: dump_stack+0x1c/0x2c [ 3.412971] 000: spin_bug+0xd4/0xd9 [ 3.413464] 000: do_raw_spin_trylock+0x57/0x64 [ 3.414029] 000: _raw_spin_trylock+0x1c/0x6a [ 3.414516] 000: serial8250_console_write_atomic+0x47/0x11b [ 3.415144] 000: univ8250_console_write_atomic+0x34/0x39 [ 3.415745] 000: ? univ8250_console_write+0x39/0x39 [ 3.416314] 000: vprintk_emit+0x33f/0x4d6 [ 3.416796] 000: printk+0x7f/0x9f [ 3.417080] 000: ? kvm_clock_read+0x13/0x22 [ 3.417080] 000: kcsan_setup_watchpoint+0x356/0x5ef [ 3.417080] 000: io_serial_in+0x26/0x34 [ 3.417080] 000: wait_for_xmitr+0x2f/0x147 [ 3.417080] 000: ? serial8250_console_write_atomic+0x11b/0x11b [ 3.417080] 000: serial8250_console_putchar_locked+0x11/0x2d [ 3.417080] 000: uart_console_write+0x4b/0x59 [ 3.417080] 000: serial8250_console_write_atomic+0xab/0x11b [ 3.417080] 000: univ8250_console_write_atomic+0x34/0x39 [ 3.417080] 000: ? univ8250_console_write+0x39/0x39 [ 3.417080] 000: vprintk_emit+0x33f/0x4d6 [ 3.417080] 000: printk+0x7f/0x9f [ 3.417080] 000: ? mv_hsic_phy_driver_init+0xf/0xf [ 3.417080] 000: ? mv_hsic_phy_driver_init+0xf/0xf [ 3.417080] 000: pinctrl_init+0xce/0xe7 [ 3.417080] 000: do_one_initcall+0x1f7/0x455 [ 3.409325] 000: KCSAN: watching read, size: 8, addr: ffffffffb0998108 [slot: 24, encoded: 10ffffb0998108] e: failed to create debugfs directory [ 3.417196] 000: KCSAN: watching write, size: 4, addr: ffff8882379bba58 [slot: 59, encoded: 80088882379bba58] [ 3.418413] 000: KCSAN: watching write, size: 8, addr: ffff888237a19270 [slot: 25, encoded: 8010888237a19270] [ 3.419739] 000: KCSAN: watching read, size: 4, addr: ffff8882379bba7c [slot: 59, encoded: 88882379bba7c] [ 3.420991] 000: KCSAN: watching read, size: 8, addr: ffffffffae865a38 [slot: 37, encoded: 10ffffae865a38] [ 3.422273] 000: KCSAN: watching write, size: 4, addr: ffff8882379bb9cc [slot: 59, encoded: 80088882379bb9cc] [ 3.423534] 000: KCSAN: watching read, size: 4, addr: ffff8882379bb998 [slot: 59, encoded: 88882379bb998] [ 3.424752] 000: KCSAN: watching read, size: 4, addr: ffffffffaf937470 [slot: 55, encoded: 8ffffaf937470] [ 3.426000] 000: KCSAN: watching write, size: 8, addr: ffff888237a21d58 [slot: 33, encoded: 8010888237a21d58] [ 3.427211] 000: KCSAN: watching read, size: 4, addr: ffff8882379bb570 [slot: 59, encoded: 88882379bb570] [ 3.428435] 000: KCSAN: watching read, size: 4, addr: ffff8882379bb5b0 [slot: 59, encoded: 88882379bb5b0] [ 3.429597] 000: KCSAN: watching write, size: 1, addr: ffff888237a25ad4 [slot: 37, encoded: 8002888237a25ad4] [ 3.430791] 000: KCSAN: watching write, size: 8, addr: ffff888237a25588 [slot: 37, encoded: 8010888237a25588] [ 3.432035] 000: KCSAN: watching write, size: 8, addr: ffff888237a26470 [slot: 38, encoded: 8010888237a26470] [ 3.433296] 000: KCSAN: watching write, size: 4, addr: ffffffffae8ee2dc [slot: 46, encoded: 8008ffffae8ee2dc] [ 3.434506] 000: KCSAN: watching read, size: 4, addr: ffff8882379bba6c [slot: 59, encoded: 88882379bba6c] [ 3.435810] 000: KCSAN: watching read, size: 1, addr: ffffffffae2cc383 [slot: 12, encoded: 2ffffae2cc383] [ 3.437032] 000: KCSAN: watching write, size: 4, addr: ffff8882379bbb90 [slot: 59, encoded: 80088882379bbb90] [ 3.437208] 000: KCSAN: watching read, size: 8, addr: ffff8882378ef848 [slot: 47, encoded: 108882378ef848] [ 3.438406] 000: KCSAN: watching read, size: 4, addr: ffff8882374027c4 [slot: 2, encoded: 88882374027c4] [ 3.439720] 000: KCSAN: watching read, size: 4, addr: ffff8882379bbbe8 [slot: 59, encoded: 88882379bbbe8] [ 3.440991] 000: KCSAN: watching read, size: 4, addr: ffff8882379bbb00 [slot: 59, encoded: 88882379bbb00] [ 3.442206] 000: KCSAN: watching write, size: 4, addr: ffff888237a6a148 [slot: 42, encoded: 8008888237a6a148] [ 3.443382] 000: KCSAN: watching write, size: 4, addr: ffff8882379bbbe8 [slot: 59, encoded: 80088882379bbbe8] [ 3.444650] 000: KCSAN: watching write, size: 4, addr: ffff888237a38650 [slot: 56, encoded: 8008888237a38650] [ 3.445900] 000: KCSAN: watching read, size: 1, addr: ffff8882379b4509 [slot: 52, encoded: 28882379b4509] [ 3.447139] 000: KCSAN: watching read, size: 4, addr: ffff8882379bbc2c [slot: 59, encoded: 88882379bbc2c] [ 3.448299] 000: KCSAN: watching read, size: 1, addr: ffff88823fff2dba [slot: 50, encoded: 288823fff2dba] [ 3.449478] 000: KCSAN: watching read, size: 1, addr: ffff8882379a0802 [slot: 32, encoded: 28882379a0802] [ 3.450634] 000: KCSAN: watching read, size: 1, addr: ffff8882379a0818 [slot: 32, encoded: 28882379a0818] [ 3.451851] 000: KCSAN: watching read, size: 1, addr: ffff8882379a0827 [slot: 32, encoded: 28882379a0827] [ 3.452923] 000: KCSAN: watching read, size: 1, addr: ffffffffae096ee0 [slot: 22, encoded: 2ffffae096ee0] [ 3.454047] 000: KCSAN: watching read, size: 1, addr: ffff8882379a08c3 [slot: 32, encoded: 28882379a08c3] [ 3.455206] 000: KCSAN: watching read, size: 1, addr: ffff8882379a08cf [slot: 32, encoded: 28882379a08cf] [ 3.456344] 000: KCSAN: watching read, size: 1, addr: ffff8882379a08fa [slot: 32, encoded: 28882379a08fa] [ 3.457122] 000: KCSAN: watching read, size: 8, addr: ffffffffae3ca570 [slot: 10, encoded: 10ffffae3ca570] [ 3.458289] 000: KCSAN: watching read, size: 1, addr: ffff8882379a0925 [slot: 32, encoded: 28882379a0925] [ 3.459439] 000: KCSAN: watching read, size: 1, addr: ffff8882379a0957 [slot: 32, encoded: 28882379a0957] [ 3.460589] 000: KCSAN: watching read, size: 1, addr: ffff8882379a0957 [slot: 32, encoded: 28882379a0957] [ 3.461707] 000: KCSAN: watching read, size: 8, addr: ffffffffae3c8cc0 [slot: 8, encoded: 10ffffae3c8cc0] [ 3.462835] 000: KCSAN: watching read, size: 8, addr: ffffffffae3ca7c8 [slot: 10, encoded: 10ffffae3ca7c8] [ 3.463912] 000: KCSAN: watching read, size: 1, addr: ffff8882379a09f8 [slot: 32, encoded: 28882379a09f8] To reproduce: # build kernel cd linux cp config-5.9.0-rc8-00021-gecb40413146619 .config make HOSTCC=clang-12 CC=clang-12 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

5 months

1
0
0 / 0

[tty] bca62799c5: WARNING:at_kernel/events/core.c:#perf_swevent_add

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: bca62799c56b75a89e27e9d20dd6eb7d04a5bf29 ("tty: vt, make vc_visible_origin u16 *") https://git.kernel.org/cgit/linux/kernel/git/jirislaby/linux.git devel in testcase: trinity version: trinity-static-i386-x86_64-f93256fb_2019-08-28 with following parameters: runtime: 300s test-description: Trinity is a linux system call fuzz tester. test-url: http://codemonkey.org.uk/projects/trinity/ on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +---------------------------------------------------+------------+------------+ | | 9ff1918034 | bca62799c5 | +---------------------------------------------------+------------+------------+ | boot_successes | 38 | 38 | | boot_failures | 0 | 2 | | WARNING:at_kernel/events/core.c:#perf_swevent_add | 0 | 2 | | EIP:perf_swevent_add | 0 | 2 | +---------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 22.031389] WARNING: CPU: 0 PID: 622 at kernel/events/core.c:9157 perf_swevent_add+0xa8/0xc0 [ 22.032826] Modules linked in: [ 22.033346] CPU: 0 PID: 622 Comm: trinity-main Not tainted 5.9.0-rc8-next-20201006-00043-gbca62799c56b #1 [ 22.034909] EIP: perf_swevent_add+0xa8/0xc0 [ 22.035551] Code: 26 00 8b 83 80 01 00 00 8b 93 84 01 00 00 89 83 88 01 00 00 89 d8 89 93 8c 01 00 00 e8 c1 fc ff ff eb 83 8d b4 26 00 00 00 00 <0f> 0b 5b b8 ea ff ff ff 5e 5f 5d c3 8d b4 26 00 00 00 00 8d 74 26 [ 22.038342] EAX: 00000001 EBX: dbcb0008 ECX: 00000000 EDX: 00000000 [ 22.039361] ESI: 00000009 EDI: f5113c80 EBP: deec5d00 ESP: deec5cf4 [ 22.040377] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 EFLAGS: 00010046 [ 22.041487] CR0: 80050033 CR2: 09a79000 CR3: 1eec0000 CR4: 000406b0 [ 22.042502] Call Trace: [ 22.042919] event_sched_in+0xe7/0x240 [ 22.043632] ? sched_clock+0x8/0x20 [ 22.044240] ? sched_clock_cpu+0x1e/0x160 [ 22.044911] merge_sched_in+0x148/0x380 [ 22.045568] visit_groups_merge+0x17d/0x4c0 [ 22.046481] ? sched_clock+0x8/0x20 [ 22.047085] ctx_sched_in+0x106/0x1c0 [ 22.047713] ? perf_event_idx_default+0x20/0x20 [ 22.048479] perf_event_sched_in+0x5b/0xa0 [ 22.049205] ctx_resched+0x6f/0xc0 [ 22.049792] __perf_install_in_context+0x1c6/0x220 [ 22.050595] ? bpf_fd_reuseport_array_update_elem+0x1a0/0x1a0 [ 22.051502] remote_function+0x3d/0x60 [ 22.052119] generic_exec_single+0x61/0xa0 [ 22.052803] ? bpf_fd_reuseport_array_update_elem+0x1a0/0x1a0 [ 22.053742] smp_call_function_single+0xcf/0x120 [ 22.054511] ? bpf_fd_reuseport_array_update_elem+0x1a0/0x1a0 [ 22.055453] task_function_call+0x4d/0x60 [ 22.056126] ? ctx_resched+0xc0/0xc0 [ 22.056728] perf_install_in_context+0xa4/0x1c0 [ 22.057483] ? perf_event__header_size+0x3d/0x60 [ 22.058272] __do_sys_perf_event_open+0x356/0xf40 [ 22.059053] ? handle_mm_fault+0x3b/0x9e0 [ 22.059719] __ia32_sys_perf_event_open+0x21/0x40 [ 22.060406] do_int80_syscall_32+0x2c/0x40 [ 22.061033] entry_INT80_32+0x10a/0x10a [ 22.061674] EIP: 0x8097522 [ 22.062146] Code: 89 c8 c3 90 8d 74 26 00 85 c0 c7 01 01 00 00 00 75 d8 a1 cc 3c ad 08 eb d1 66 90 66 90 66 90 66 90 66 90 66 90 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 10 a3 f4 3c ad 08 85 [ 22.065059] EAX: ffffffda EBX: 09a78f18 ECX: 00000000 EDX: ffffffff [ 22.066034] ESI: 0000011e EDI: 00000001 EBP: 00000005 ESP: bf923e68 [ 22.066997] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000282 [ 22.068055] CPU: 0 PID: 622 Comm: trinity-main Not tainted 5.9.0-rc8-next-20201006-00043-gbca62799c56b #1 [ 22.069483] Call Trace: [ 22.069872] dump_stack+0x54/0x68 [ 22.070428] __warn.cold+0x24/0x3e [ 22.070992] ? perf_swevent_add+0xa8/0xc0 [ 22.071657] ? perf_swevent_add+0xa8/0xc0 [ 22.072292] report_bug+0x9e/0xe0 [ 22.072828] ? exc_overflow+0x60/0x60 [ 22.073404] handle_bug+0x28/0x60 [ 22.073924] exc_invalid_op+0x26/0x80 [ 22.074493] handle_exception+0x11e/0x11e [ 22.075155] EIP: perf_swevent_add+0xa8/0xc0 [ 22.075829] Code: 26 00 8b 83 80 01 00 00 8b 93 84 01 00 00 89 83 88 01 00 00 89 d8 89 93 8c 01 00 00 e8 c1 fc ff ff eb 83 8d b4 26 00 00 00 00 <0f> 0b 5b b8 ea ff ff ff 5e 5f 5d c3 8d b4 26 00 00 00 00 8d 74 26 [ 22.078873] EAX: 00000001 EBX: dbcb0008 ECX: 00000000 EDX: 00000000 [ 22.079954] ESI: 00000009 EDI: f5113c80 EBP: deec5d00 ESP: deec5cf4 [ 22.081051] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 EFLAGS: 00010046 [ 22.082203] ? exc_overflow+0x60/0x60 [ 22.082789] ? exc_overflow+0x60/0x60 [ 22.083383] ? perf_swevent_add+0xa8/0xc0 [ 22.084044] event_sched_in+0xe7/0x240 [ 22.084735] ? sched_clock+0x8/0x20 [ 22.085306] ? sched_clock_cpu+0x1e/0x160 [ 22.085909] merge_sched_in+0x148/0x380 [ 22.086504] visit_groups_merge+0x17d/0x4c0 [ 22.087284] ? sched_clock+0x8/0x20 [ 22.087816] ctx_sched_in+0x106/0x1c0 [ 22.088385] ? perf_event_idx_default+0x20/0x20 [ 22.089081] perf_event_sched_in+0x5b/0xa0 [ 22.089669] ctx_resched+0x6f/0xc0 [ 22.090205] __perf_install_in_context+0x1c6/0x220 [ 22.090947] ? bpf_fd_reuseport_array_update_elem+0x1a0/0x1a0 [ 22.091872] remote_function+0x3d/0x60 [ 22.092486] generic_exec_single+0x61/0xa0 [ 22.093104] ? bpf_fd_reuseport_array_update_elem+0x1a0/0x1a0 [ 22.093962] smp_call_function_single+0xcf/0x120 [ 22.094709] ? bpf_fd_reuseport_array_update_elem+0x1a0/0x1a0 [ 22.095538] task_function_call+0x4d/0x60 [ 22.096158] ? ctx_resched+0xc0/0xc0 [ 22.096704] perf_install_in_context+0xa4/0x1c0 [ 22.097369] ? perf_event__header_size+0x3d/0x60 [ 22.098058] __do_sys_perf_event_open+0x356/0xf40 [ 22.098748] ? handle_mm_fault+0x3b/0x9e0 [ 22.099337] __ia32_sys_perf_event_open+0x21/0x40 [ 22.100025] do_int80_syscall_32+0x2c/0x40 [ 22.100625] entry_INT80_32+0x10a/0x10a [ 22.101186] EIP: 0x8097522 [ 22.101587] Code: 89 c8 c3 90 8d 74 26 00 85 c0 c7 01 01 00 00 00 75 d8 a1 cc 3c ad 08 eb d1 66 90 66 90 66 90 66 90 66 90 66 90 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 10 a3 f4 3c ad 08 85 [ 22.104271] EAX: ffffffda EBX: 09a78f18 ECX: 00000000 EDX: ffffffff [ 22.105181] ESI: 0000011e EDI: 00000001 EBP: 00000005 ESP: bf923e68 [ 22.106139] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000282 [ 22.107226] ---[ end trace 84fbf3f86859ff4c ]--- To reproduce: # build kernel cd linux cp config-5.9.0-rc8-next-20201006-00043-gbca62799c56b .config make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

5 months

1
0
0 / 0

2021

2020

2019

2018

2017

2016

2015

2014

2013

LKP October 2020