Skip to content

version 7.0-rc5#662

Draft
marmarek wants to merge 3 commits intoQubesOS:masterfrom
marmarek:test-rc
Draft

version 7.0-rc5#662
marmarek wants to merge 3 commits intoQubesOS:masterfrom
marmarek:test-rc

Conversation

@marmarek
Copy link
Copy Markdown
Member

@marmarek marmarek commented Oct 21, 2022

Release candidate build for testing

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Oct 22, 2022

openQArun

@qubesos-bot
Copy link
Copy Markdown

qubesos-bot commented Oct 23, 2022 •
edited
Loading

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=202603192240-4.3&flavor=kernel

Test run included the following:

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=202602070257-4.3&flavor=kernel

  • system_tests_suspend@hw5

    • suspend: unnamed test (unknown)

    • suspend: Failed (test died)
      # Test died: no candidate needle with tag(s) 'xscreensaver-prompt-w...

    • suspend: wait_serial (wait serial expected)
      # wait_serial expected: "lspci; echo 2E8vz-\$?-"...

    • suspend: wait_serial (wait serial expected)
      # wait_serial expected: qr/2E8vz-\d+-/...

Failed tests

4 failures
  • system_tests_suspend@hw5

    • suspend: unnamed test (unknown)

    • suspend: Failed (test died)
      # Test died: no candidate needle with tag(s) 'xscreensaver-prompt-w...

    • suspend: wait_serial (wait serial expected)
      # wait_serial expected: "lspci; echo 2E8vz-\$?-"...

    • suspend: wait_serial (wait serial expected)
      # wait_serial expected: qr/2E8vz-\d+-/...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/166490#dependencies

2 fixed

  • system_tests_wifi@hw5

    • usbvm: Failed (test died)
      # Test died: command 'grep "^qubes.InputMouse[[:space:]].*sys-usb.*...

  • system_tests_suspend@hw5

    • usbvm: Failed (test died)
      # Test died: command 'grep "^qubes.InputMouse[[:space:]].*sys-usb.*...

Unstable tests

Details

  • system_tests_gui_interactive@hw6

    collect_logs/Failed (1/5 times with errors)
    • job 169132 # Test died: command 'curl --form upload=@journalctl.log --form upn...
    collect_logs/wait_serial (1/5 times with errors)
    • job 169132 # wait_serial expected: qr/GJUz8-\d+-/...
    collect_logs/wait_serial (1/5 times with errors)
    • job 169132 # wait_serial expected: qr/EAW0M-\d+-/...

  • system_tests_gui_interactive@hw8

    collect_logs/Failed (1/5 times with errors)
    • job 169132 # Test died: command 'curl --form upload=@journalctl.log --form upn...
    collect_logs/wait_serial (1/5 times with errors)
    • job 169132 # wait_serial expected: qr/GJUz8-\d+-/...
    collect_logs/wait_serial (1/5 times with errors)
    • job 169132 # wait_serial expected: qr/EAW0M-\d+-/...

  • system_tests_gui_interactive@hw5

    collect_logs/Failed (1/5 times with errors)
    • job 169132 # Test died: command 'curl --form upload=@journalctl.log --form upn...
    collect_logs/wait_serial (1/5 times with errors)
    • job 169132 # wait_serial expected: qr/GJUz8-\d+-/...
    collect_logs/wait_serial (1/5 times with errors)
    • job 169132 # wait_serial expected: qr/EAW0M-\d+-/...

Performance Tests

Performance degradation:

No issues

Remaining performance tests:

No remaining performance tests

@marmarek marmarek force-pushed the test-rc branch 2 times, most recently from b4348ff to e9dee7f Compare November 28, 2022 12:50
@marmarek marmarek changed the title version 6.1-rc1 version 6.1-rc7 Nov 28, 2022
@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Nov 29, 2022

openQArun

1 similar comment
@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Dec 2, 2022

openQArun

@marmarek marmarek mentioned this pull request Dec 4, 2022
Closed
@marmarek marmarek force-pushed the test-rc branch 3 times, most recently from 6965d44 to 6168303 Compare January 24, 2023 11:12
@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Jan 25, 2023

openQArun

@marmarek marmarek force-pushed the test-rc branch 2 times, most recently from 15c2e0b to 51b22ca Compare February 4, 2023 23:09
@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Feb 5, 2023

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Feb 5, 2023

openQArun

@marmarek marmarek force-pushed the test-rc branch 2 times, most recently from 0602f07 to 1817cf8 Compare March 30, 2023 07:57
@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Mar 30, 2023

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Apr 7, 2023

openQArun

@marmarek marmarek changed the title version 6.1-rc7 version 6.4-rc1 May 12, 2023
@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented May 12, 2023

openQArun

@marmarek marmarek changed the title version 6.4-rc1 version 6.4-rc2 May 22, 2023
@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Feb 24, 2025

openQArun

18 similar comments
@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Mar 10, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Apr 9, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Apr 24, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Apr 28, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Jun 16, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Jun 26, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Jul 17, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Aug 24, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Aug 27, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Sep 8, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Nov 1, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Nov 10, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Nov 24, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Dec 26, 2025

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Jan 4, 2026

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Jan 6, 2026

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Feb 7, 2026

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Feb 23, 2026

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Feb 24, 2026 •
edited
Loading

With 7.0-rc1, sys-usb crashes (OOM caused by uvcvideo driver) when attaching a camera using qubes-video-companion. It works fine with 6.18.12. sys-usb has 300MB memory in both cases. Happened at least on hw6 and hw8.

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Feb 25, 2026

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Feb 26, 2026

7.0-rc1:

  1. graphics on hw1 doesn't work after suspend: https://openqa.qubes-os.org/tests/168288
Details 

[  446.288853] amdgpu 0000:05:00.0: [drm] PCIE GART of 1024M enabled.
[  446.288859] amdgpu 0000:05:00.0: [drm] PTB located at 0x000000F41FC00000
[  446.288881] amdgpu 0000:05:00.0: PSP is resuming...
[  446.288958] amdgpu 0000:05:00.0: reserve 0x400000 from 0xf41f800000 for PSP TMR
[  446.378435] amdgpu 0000:05:00.0: RAS: optional ras ta ucode is not available
[  446.390241] amdgpu 0000:05:00.0: RAP: optional rap ta ucode is not available
[  446.390245] amdgpu 0000:05:00.0: SECUREDISPLAY: optional securedisplay ta ucode is not available
[  446.390250] amdgpu 0000:05:00.0: SMU is resuming...
[  446.390765] amdgpu 0000:05:00.0: dpm has been disabled
[  446.391856] amdgpu 0000:05:00.0: SMU is resumed successfully!
[  446.393234] amdgpu 0000:05:00.0: kiq ring mec 2 pipe 1 q 0
[  446.397937] amdgpu 0000:05:00.0: [drm] DMUB hardware initialized: version=0x0101002B
[  446.398036] ------------[ cut here ]------------
[  446.398039] WARNING: drivers/gpu/drm/amd/amdgpu/../display/dc/hubbub/dcn20/dcn20_hubbub.c:587 at hubbub2_get_dchub_ref_freq+0x9c/0xc0 [amdgpu], CPU#2: kworker/u24:18/5851
[  446.399034] Modules linked in: snd_seq_dummy snd_hrtimer snd_sof_amd_acp70 snd_sof_amd_acp63 snd_sof_amd_vangogh snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils snd_pci_ps vfat snd_soc_acpi_amd_match fat snd_soc_acpi_amd_sdca_quirks snd_amd_sdw_acpi soundwire_amd soundwire_generic_allocation snd_ctl_led soundwire_bus snd_hda_codec_alc269 snd_hda_codec_realtek_lib snd_soc_sdca snd_hda_scodec_component snd_hda_codec_atihdmi snd_hda_codec_generic snd_hda_codec_hdmi snd_soc_core snd_hda_intel snd_compress hp_bioscfg ac97_bus snd_pcm_dmaengine snd_hda_codec snd_rpl_pci_acp6x firmware_attributes_class snd_acp_pci snd_hda_core snd_amd_acpi_mach snd_acp_legacy_common snd_intel_dspcfg amd_atl snd_intel_sdw_acpi snd_pci_acp6x iwlwifi snd_hwdep intel_rapl_msr snd_pci_acp5x snd_seq intel_rapl_common hp_wmi snd_rn_pci_acp3x sparse_keymap i2c_piix4 pcspkr wmi_bmof platform_profile snd_acp_config k10temp snd_seq_device i2c_smbus snd_soc_acpi snd_pci_acp3x cfg80211 snd_pcm
[  446.399114]  snd_timer r8169 rfkill snd soundcore realtek hp_accel wireless_hotkey lis3lv02d joydev xenfs fuse loop nfnetlink vsock_loopback vmw_vsock_virtio_transport_common vmw_vsock_vmci_transport vsock zram vmw_vmci lz4hc_compress lz4_compress dm_thin_pool dm_persistent_data dm_bio_prison dm_crypt amdgpu amdxcp i2c_algo_bit drm_ttm_helper ttm drm_exec drm_panel_backlight_quirks gpu_sched drm_suballoc_helper rtsx_pci_sdmmc drm_buddy ucsi_acpi mmc_core xhci_pci drm_display_helper typec_ucsi hid_multitouch typec ghash_clmulni_intel sp5100_tco xhci_hcd i2c_hid_acpi cec video rtsx_pci i2c_hid thunderbolt wmi serio_raw xen_acpi_processor xen_privcmd xen_pciback xen_blkback xen_gntalloc xen_gntdev xen_evtchn scsi_dh_rdac scsi_dh_emc scsi_dh_alua uinput i2c_dev
[  446.399198] CPU: 2 UID: 0 PID: 5851 Comm: kworker/u24:18 Tainted: G        W           7.0.0-0.rc1.1.qubes.1001.fc41.x86_64 #1 PREEMPT(full) 
[  446.399205] Tainted: [W]=WARN
[  446.399207] Hardware name: HP HP ProBook 445 G7/8730, BIOS S79 Ver. 01.19.00 11/22/2024
[  446.399211] Workqueue: async async_run_entry_fn
[  446.399221] RIP: e030:hubbub2_get_dchub_ref_freq+0x9c/0xc0 [amdgpu]
[  446.400147] Code: 8d 83 c0 63 ff ff 3d 20 4e 00 00 77 21 89 5d 00 48 8b 44 24 08 65 48 2b 05 c9 3e 70 c2 75 24 48 83 c4 10 5b 5d e9 74 74 95 c0 <0f> 0b eb df 0f 0b eb db d1 eb 8d 83 c0 63 ff ff 3d 20 4e 00 00 76
[  446.400151] RSP: e02b:ffffc9004a2cfc18 EFLAGS: 00010246
[  446.400155] RAX: 0000000000001000 RBX: 000000000000bb80 RCX: 0000000000000000
[  446.400158] RDX: ffffc9004a2cfc1c RSI: 00000000000039df RDI: ffff888118080000
[  446.400161] RBP: ffff88810ff563f8 R08: ffffc9004a2cfc18 R09: 000000000000000c
[  446.400163] R10: 0000000000000000 R11: fefefefefefefeff R12: ffff88810ff56000
[  446.400165] R13: ffff88810233c400 R14: ffff888100d88200 R15: 0000000000000000
[  446.400179] FS:  0000000000000000(0000) GS:ffff8881ad9ee000(0000) knlGS:0000000000000000
[  446.400182] CS:  e030 DS: 0000 ES: 0000 CR0: 0000000080050033
[  446.400185] CR2: 00006207bfde5596 CR3: 000000000242e000 CR4: 0000000000050660
[  446.400190] Call Trace:
[  446.400196]  <TASK>
[  446.400203]  dcn10_init_hw+0x186/0x560 [amdgpu]
[  446.401178]  dc_set_power_state+0xd1/0x150 [amdgpu]
[  446.402006]  dm_resume+0x127/0xc80 [amdgpu]
[  446.402904]  amdgpu_ip_block_resume+0x27/0x40 [amdgpu]
[  446.403527]  amdgpu_device_ip_resume_phase3+0x8a/0x100 [amdgpu]
[  446.404047]  amdgpu_device_resume+0xb9/0x370 [amdgpu]
[  446.404561]  amdgpu_pmops_resume+0x4a/0x80 [amdgpu]
[  446.405079]  ? __pfx_pci_pm_resume+0x10/0x10
[  446.405085]  dpm_run_callback+0x4f/0x160
[  446.405092]  device_resume+0x15d/0x250
[  446.405098]  async_resume+0x1d/0x30
[  446.405102]  async_run_entry_fn+0x34/0x150
[  446.405108]  process_one_work+0x18d/0x380
[  446.405114]  worker_thread+0x196/0x300
[  446.405118]  ? __pfx_worker_thread+0x10/0x10
[  446.405122]  kthread+0xe3/0x120
[  446.405127]  ? __pfx_kthread+0x10/0x10
[  446.405132]  ret_from_fork+0x19e/0x260
[  446.405138]  ? __pfx_kthread+0x10/0x10
[  446.405142]  ret_from_fork_asm+0x1a/0x30
[  446.405151]  </TASK>
[  446.405153] ---[ end trace 0000000000000000 ]---

  1. panic on suspend on hw7: https://openqa.qubes-os.org/tests/168362
Details 

[  436.849614] ------------[ cut here ]------------
[  436.849669] kernel BUG at arch/x86/include/asm/xen/hypervisor.h:78!
[  436.849693] Oops: invalid opcode: 0000 [#1] SMP NOPTI
[  436.849710] CPU: 3 UID: 0 PID: 4021 Comm: kworker/u25:1 Not tainted 7.0.0-0.rc1.1.qubes.1001.fc41.x86_64 #1 PREEMPT(full) 
[  436.849729] Hardware name: Star Labs StarBook/StarBook, BIOS 8.97 10/03/2023
[  436.849743] Workqueue: i915_flip intel_atomic_commit_work [i915]
[  436.850226] RIP: e030:xen_enter_lazy_mmu+0x24/0x30
[  436.850245] Code: 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 65 8b 05 b8 e5 02 03 85 c0 75 10 65 c7 05 a9 e5 02 03 01 00 00 00 c3 cc cc cc cc <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90
[  436.850270] RSP: e02b:ffffc90045727a68 EFLAGS: 00010202
[  436.850283] RAX: 0000000000000001 RBX: ffff8881042fa6d0 RCX: 000fffffffe00000
[  436.850296] RDX: 0000000000000001 RSI: ffff88810a5a2980 RDI: 0000000000000000
[  436.850308] RBP: ffffc90049eda000 R08: ffffc90049edc000 R09: ffffc90049edc000
[  436.850320] R10: ffffc90049edc000 R11: ffffc90049edbfff R12: ffffc90049edc000
[  436.850332] R13: ffffc90045727bb0 R14: ffffc90045727b28 R15: 800000000000006b
[  436.850356] FS:  0000000000000000(0000) GS:ffff888201e6e000(0000) knlGS:0000000000000000
[  436.850371] CS:  e030 DS: 0000 ES: 0000 CR0: 0000000080050033
[  436.850383] CR2: 00006543dbade250 CR3: 0000000115ef1000 CR4: 0000000000050660
[  436.850401] Call Trace:
[  436.850410]  <TASK>
[  436.850420]  vmap_pages_pud_range+0x47c/0x530
[  436.850439]  vmap_small_pages_range_noflush+0x1f1/0x2b0
[  436.850451]  ? __get_vm_area_node+0x10a/0x170
[  436.850465]  vmap+0x79/0xd0
[  436.850476]  i915_gem_object_map_page+0x13b/0x210 [i915]
[  436.850812]  i915_gem_object_pin_map+0x1e2/0x210 [i915]
[  436.851123]  i915_gem_object_pin_map_unlocked+0x2d/0xa0 [i915]
[  436.851424]  intel_dsb_buffer_create+0xed/0x1a0 [i915]
[  436.851778]  intel_dsb_prepare+0xca/0x1a0 [i915]
[  436.852110]  intel_atomic_dsb_finish+0x92/0x350 [i915]
[  436.852456]  intel_atomic_commit_tail+0x326/0xd40 [i915]
[  436.852769]  process_one_work+0x18d/0x380
[  436.852779]  worker_thread+0x196/0x300
[  436.852787]  ? __pfx_worker_thread+0x10/0x10
[  436.852796]  kthread+0xe3/0x120
[  436.852805]  ? __pfx_kthread+0x10/0x10
[  436.852815]  ret_from_fork+0x19e/0x260
[  436.852824]  ? __pfx_kthread+0x10/0x10
[  436.852832]  ret_from_fork_asm+0x1a/0x30
[  436.852842]  </TASK>
[  436.852847] Modules linked in: snd_seq_dummy snd_hrtimer snd_hda_codec_intelhdmi snd_hda_codec_hdmi snd_hda_codec_alc269 snd_hda_codec_realtek_lib snd_hda_scodec_component snd_hda_codec_generic snd_hda_intel snd_sof_pci_intel_tgl snd_sof_pci_intel_cnl snd_sof_intel_hda_generic soundwire_intel snd_sof_intel_hda_sdw_bpt snd_sof_intel_hda_common snd_soc_hdac_hda snd_sof_intel_hda_mlink snd_sof_intel_hda soundwire_cadence snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils snd_soc_acpi_intel_match snd_soc_acpi_intel_sdca_quirks soundwire_generic_allocation snd_soc_sdw_utils snd_soc_acpi crc8 intel_rapl_msr soundwire_bus intel_rapl_common snd_soc_sdca snd_soc_avs snd_soc_hda_codec snd_hda_ext_core snd_hda_codec vfat intel_uncore_frequency_common fat snd_hda_core snd_intel_dspcfg snd_intel_sdw_acpi snd_hwdep intel_powerclamp snd_soc_core iwlwifi snd_compress spi_nor iTCO_wdt ac97_bus intel_pmc_bxt ee1004 mtd snd_pcm_dmaengine snd_seq cfg80211 snd_seq_device pcspkr spi_intel_pci snd_pcm rfkill spi_intel snd_timer snd
[  436.852939]  i2c_i801 soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_hid intel_pmc_ssram_telemetry intel_scu_pltdrv sparse_keymap joydev loop fuse xenfs nfnetlink vsock_loopback vmw_vsock_virtio_transport_common vmw_vsock_vmci_transport vsock zram vmw_vmci lz4hc_compress lz4_compress dm_thin_pool dm_persistent_data dm_bio_prison dm_crypt xe drm_ttm_helper drm_suballoc_helper gpu_sched drm_gpuvm drm_exec drm_gpusvm_helper i915 i2c_algo_bit drm_buddy hid_multitouch i2c_hid_acpi ghash_clmulni_intel video nvme wmi ttm i2c_hid nvme_core nvme_keyring drm_display_helper nvme_auth xhci_pci pinctrl_tigerlake thunderbolt hkdf cec xhci_hcd intel_vsec serio_raw xen_acpi_processor xen_privcmd xen_pciback xen_blkback xen_gntalloc xen_gntdev xen_evtchn scsi_dh_rdac scsi_dh_emc scsi_dh_alua uinput i2c_dev
[  436.853183] ---[ end trace 0000000000000000 ]---
[  436.853198] RIP: e030:xen_enter_lazy_mmu+0x24/0x30
[  436.853210] Code: 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 65 8b 05 b8 e5 02 03 85 c0 75 10 65 c7 05 a9 e5 02 03 01 00 00 00 c3 cc cc cc cc <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90
[  436.853230] RSP: e02b:ffffc90045727a68 EFLAGS: 00010202
[  436.853239] RAX: 0000000000000001 RBX: ffff8881042fa6d0 RCX: 000fffffffe00000
[  436.853250] RDX: 0000000000000001 RSI: ffff88810a5a2980 RDI: 0000000000000000
[  436.853259] RBP: ffffc90049eda000 R08: ffffc90049edc000 R09: ffffc90049edc000
[  436.853269] R10: ffffc90049edc000 R11: ffffc90049edbfff R12: ffffc90049edc000
[  436.853278] R13: ffffc90045727bb0 R14: ffffc90045727b28 R15: 800000000000006b
[  436.853297] FS:  0000000000000000(0000) GS:ffff888201e6e000(0000) knlGS:0000000000000000
[  436.853308] CS:  e030 DS: 0000 ES: 0000 CR0: 0000000080050033
[  436.853317] CR2: 00006543dbade250 CR3: 0000000115ef1000 CR4: 0000000000050660
[  436.853331] Kernel panic - not syncing: Fatal exception
[  436.853360] Kernel Offset: disabled
(XEN) Hardware Dom0 crashed: rebooting machine in 5 seconds.

  1. Similar panic during vm_qrexec_gui tests on hw6: https://openqa.qubes-os.org/tests/168289#step/system_tests/31 (QR code!)
Details 

[  548.736884] ------------[ cut here ]------------
[  548.736907] kernel BUG at arch/x86/include/asm/xen/hypervisor.h:85!
[  548.736923] Oops: invalid opcode: 0000 [#1] SMP NOPTI
[  548.736935] CPU: 0 UID: 0 PID: 206 Comm: kworker/0:2 Not tainted 7.0.0-0.rc1.1.qubes.1001.fc41.x86_64 #1 PREEMPT(full) 
[  548.736949] Hardware name: LENOVO 2347A45/2347A45, BIOS CBET4000 Nitrokey-v0.2.0-2608-ga649597 01/01/1970
[  548.736962] Workqueue: events delayed_vfree_work
[  548.736976] RIP: e030:xen_leave_lazy_mmu+0x44/0x50
[  548.736989] Code: 02 03 83 f8 01 75 23 65 c7 05 6c e4 02 03 00 00 00 00 65 ff 0d 7d b8 02 03 74 05 c3 cc cc cc cc e8 61 5d fd ff c3 cc cc cc cc <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90
[  548.737010] RSP: e02b:ffffc90040607cf0 EFLAGS: 00010297
[  548.737018] RAX: 0000000000000000 RBX: ffff888164a70408 RCX: 0000000000000000
[  548.737029] RDX: 0000000000000000 RSI: 000ffffffffff000 RDI: ffff8881069c0000
[  548.737039] RBP: ffffc90049681000 R08: ffffc90049681000 R09: 0000000000000027
[  548.737050] R10: 0000000000000027 R11: fefefefefefefeff R12: ffffc90049681000
[  548.737060] R13: ffff8881002fd258 R14: 0000000000000000 R15: ffffc90040607dac
[  548.737079] FS:  0000000000000000(0000) GS:ffff8881f88ee000(0000) knlGS:0000000000000000
[  548.737090] CS:  e030 DS: 0000 ES: 0000 CR0: 0000000080050033
[  548.737099] CR2: 000055576c2e6058 CR3: 000000010d47b000 CR4: 0000000000050660
[  548.737115] Call Trace:
[  548.737123]  <TASK>
[  548.737128]  vunmap_pmd_range.isra.0+0x1f1/0x2e0
[  548.737142]  vunmap_p4d_range+0x17d/0x290
[  548.737151]  __vunmap_range_noflush+0x182/0x1d0
[  548.737161]  ? _raw_spin_unlock+0xe/0x30
[  548.737171]  remove_vm_area+0x40/0x70
[  548.737180]  vfree.part.0+0x1b/0x290
[  548.737189]  delayed_vfree_work+0x35/0x50
[  548.737198]  process_one_work+0x18d/0x380
[  548.737207]  worker_thread+0x196/0x300
[  548.737215]  ? __pfx_worker_thread+0x10/0x10
[  548.737224]  kthread+0xe3/0x120
[  548.737233]  ? __pfx_kthread+0x10/0x10
[  548.737242]  ret_from_fork+0x19e/0x260
[  548.737250]  ? __pfx_kthread+0x10/0x10
[  548.737258]  ret_from_fork_asm+0x1a/0x30
[  548.737269]  </TASK>
[  548.737274] Modules linked in: vfat fat snd_seq_dummy snd_hrtimer ath9k ath9k_common snd_hda_codec_intelhdmi snd_hda_codec_hdmi ath9k_hw snd_hda_codec_alc269 snd_hda_codec_realtek_lib snd_hda_scodec_component snd_hda_codec_generic snd_hda_intel snd_hda_codec mac80211 snd_hda_core snd_intel_dspcfg snd_intel_sdw_acpi snd_hwdep ath snd_seq snd_seq_device snd_ctl_led cfg80211 snd_pcm at24 thinkpad_acpi intel_rapl_msr i2c_i801 snd_timer sparse_keymap iTCO_wdt intel_rapl_common platform_profile intel_powerclamp intel_pmc_bxt pcspkr i2c_smbus rfkill libarc4 snd soundcore mei_me e1000e mei joydev lpc_ich loop fuse xenfs nfnetlink vsock_loopback vmw_vsock_virtio_transport_common vmw_vsock_vmci_transport vsock zram vmw_vmci lz4hc_compress lz4_compress dm_thin_pool dm_persistent_data dm_bio_prison dm_crypt i915 i2c_algo_bit drm_buddy ghash_clmulni_intel ttm sdhci_pci drm_display_helper sdhci_uhs2 sdhci video xhci_pci cqhci wmi cec xhci_hcd ehci_pci mmc_core ehci_hcd serio_raw xen_acpi_processor xen_privcmd xen_pciback
[  548.737348]  xen_blkback xen_gntalloc xen_gntdev xen_evtchn scsi_dh_rdac scsi_dh_emc scsi_dh_alua uinput i2c_dev
[  548.737469] ---[ end trace 0000000000000000 ]---
[  548.737479] RIP: e030:xen_leave_lazy_mmu+0x44/0x50
[  548.737489] Code: 02 03 83 f8 01 75 23 65 c7 05 6c e4 02 03 00 00 00 00 65 ff 0d 7d b8 02 03 74 05 c3 cc cc cc cc e8 61 5d fd ff c3 cc cc cc cc <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90
[  548.737510] RSP: e02b:ffffc90040607cf0 EFLAGS: 00010297
[  548.737518] RAX: 0000000000000000 RBX: ffff888164a70408 RCX: 0000000000000000
[  548.737528] RDX: 0000000000000000 RSI: 000ffffffffff000 RDI: ffff8881069c0000
[  548.737539] RBP: ffffc90049681000 R08: ffffc90049681000 R09: 0000000000000027
[  548.737549] R10: 0000000000000027 R11: fefefefefefefeff R12: ffffc90049681000
[  548.737559] R13: ffff8881002fd258 R14: 0000000000000000 R15: ffffc90040607dac
[  548.737578] FS:  0000000000000000(0000) GS:ffff8881f88ee000(0000) knlGS:0000000000000000
[  548.737588] CS:  e030 DS: 0000 ES: 0000 CR0: 0000000080050033
[  548.737598] CR2: 000055576c2e6058 CR3: 000000010d47b000 CR4: 0000000000050660
[  548.737614] Kernel panic - not syncing: Fatal exception
[  548.737629] Kernel Offset: disabled

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Mar 18, 2026

openQArun

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Mar 19, 2026

7.0-rc4:

  1. graphics on hw1 doesn't work after suspend: https://openqa.qubes-os.org/tests/168288

seems to be fixed

2. panic on suspend on hw7: https://openqa.qubes-os.org/tests/168362

seems to be fixed

3. Similar panic during vm_qrexec_gui tests on hw6: https://openqa.qubes-os.org/tests/168289#step/system_tests/31 (QR code!)

still happens: https://openqa.qubes-os.org/tests/170253#step/system_tests/34
and similar panic on boot on hw5: https://openqa.qubes-os.org/tests/170250#step/startup/20

With 7.0-rc1, sys-usb crashes (OOM caused by uvcvideo driver) when attaching a camera using qubes-video-companion. It works fine with 6.18.12. sys-usb has 300MB memory in both cases. Happened at least on hw6 and hw8.

Looks to still happen, maybe even more:

Reported at https://lore.kernel.org/linux-media/abtAylIlW3I8s1T-@mail-itl/T/#u

There is also unspecified dom0 crash on hw1 during performance tests (no crash message): https://openqa.qubes-os.org/tests/170181#step/system_tests/32

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Mar 19, 2026

PipelineRefresh

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Mar 19, 2026

PipelineRetry

@marmarek
Copy link
Copy Markdown
Member Author

marmarek commented Mar 19, 2026

openQArun MACHINE=hw5,hw6,hw8

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@marmarek @qubesos-bot