function traceon/off triggers in ftace from ubuntu_kernel_selftests failed on ARM64 / B-hwe P9

Bug #1837040 reported by Po-Hsu Lin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ubuntu-kernel-tests
New
Undecided
Unassigned
linux (Ubuntu)
Confirmed
Undecided
Unassigned
Disco
Invalid
Undecided
Unassigned
Hirsute
Won't Fix
Undecided
Unassigned
Impish
Won't Fix
Undecided
Unassigned

Bug Description

Test failed with the disco master-next branch, issue spotted on Thunder X ARM64 (passed with Moonshot ARM64):

TAP version 13
selftests: ftrace: ftracetest
========================================
=== Ftrace unit tests ===
[1] Basic trace file check [PASS]
[2] Basic test for tracers [PASS]
[3] Basic trace clock test [PASS]
[4] Basic event tracing check [PASS]
[5] Change the ringbuffer size [PASS]
[6] Snapshot and tracing setting [PASS]
[7] trace_pipe and trace_marker [PASS]
[8] Generic dynamic event - add/remove kprobe events [PASS]
[9] Generic dynamic event - add/remove synthetic events [PASS]
[10] Generic dynamic event - selective clear (compatibility) [PASS]
[11] Generic dynamic event - generic clear event [PASS]
[12] event tracing - enable/disable with event level files [PASS]
[13] event tracing - restricts events based on pid [PASS]
[14] event tracing - enable/disable with subsystem level files [PASS]
[15] event tracing - enable/disable with top level files [PASS]
[16] Test trace_printk from module [PASS]
[17] ftrace - function graph filters with stack tracer [PASS]
[18] ftrace - function graph filters [PASS]
[19] ftrace - function glob filters [PASS]
[20] ftrace - function pid filters [PASS]
[21] ftrace - stacktrace filter command [PASS]
[22] ftrace - function trace with cpumask [PASS]
[23] ftrace - test for function event triggers [PASS]
[24] ftrace - function trace on module [PASS]
[25] ftrace - function profiling [PASS]
[26] ftrace - function profiler with function tracing [PASS]
[27] ftrace - test reading of set_ftrace_filter [PASS]
[28] ftrace - Max stack tracer [PASS]
[29] ftrace - test for function traceon/off triggers [FAIL]
[30] Test creation and deletion of trace instances while setting an event [PASS]
[31] Test creation and deletion of trace instances [PASS]
[32] Kprobe dynamic event - adding and removing [PASS]
[33] Kprobe dynamic event - busy event check [PASS]
[34] Kprobe dynamic event with arguments [PASS]
[35] Kprobe event with comm arguments [PASS]
[36] Kprobe event string type argument [PASS]
[37] Kprobe event symbol argument [PASS]
[38] Kprobe event argument syntax [PASS]
[39] Kprobes event arguments with types [PASS]
[40] Kprobe event auto/manual naming [PASS]
[41] Kprobe dynamic event with function tracer [PASS]
[42] Kprobe dynamic event - probing module [PASS]
[43] Kretprobe dynamic event with arguments [PASS]
[44] Kretprobe dynamic event with maxactive [PASS]
[45] Register/unregister many kprobe events [PASS]
[46] Kprobe events - probe points [PASS]
[47] Kprobe dynamic event - adding and removing [PASS]
[48] test for the preemptirqsoff tracer [UNSUPPORTED]
[49] Test wakeup tracer [PASS]
[50] Test wakeup RT tracer [PASS]
[51] event trigger - test extended error support [PASS]
[52] event trigger - test field variable support [PASS]
[53] event trigger - test inter-event combined histogram trigger [PASS]
[54] event trigger - test multiple actions on hist trigger [PASS]
[55] event trigger - test inter-event histogram trigger onmatch action [PASS]
[56] event trigger - test inter-event histogram trigger onmatch-onmax action [PASS]
[57] event trigger - test inter-event histogram trigger onmax action [PASS]
[58] event trigger - test synthetic event create remove [PASS]
[59] event trigger - test synthetic_events syntax parser [PASS]
[60] event trigger - test event enable/disable trigger [PASS]
[61] event trigger - test trigger filter [PASS]
[62] event trigger - test histogram modifiers [PASS]
[63] event trigger - test histogram trigger [PASS]
[64] event trigger - test multiple histogram triggers [PASS]
[65] event trigger - test snapshot-trigger [PASS]
[66] event trigger - test stacktrace-trigger [PASS]
[67] trace_marker trigger - test histogram trigger [PASS]
[68] trace_marker trigger - test snapshot trigger [PASS]
[69] trace_marker trigger - test histogram with synthetic event against kernel event [PASS]
[70] trace_marker trigger - test histogram with synthetic event [PASS]
[71] event trigger - test traceon/off trigger [PASS]
[72] (instance) Basic test for tracers [PASS]
[73] (instance) Basic trace clock test [PASS]
[74] (instance) Change the ringbuffer size [PASS]
[75] (instance) Snapshot and tracing setting [PASS]
[76] (instance) trace_pipe and trace_marker [PASS]
[77] (instance) event tracing - enable/disable with event level files [PASS]
[78] (instance) event tracing - restricts events based on pid [PASS]
[79] (instance) event tracing - enable/disable with subsystem level files [PASS]
[80] (instance) ftrace - stacktrace filter command [PASS]
[81] (instance) ftrace - test for function event triggers [PASS]
[82] (instance) ftrace - test for function traceon/off triggers [PASS]
[83] (instance) event trigger - test event enable/disable trigger [PASS]
[84] (instance) event trigger - test trigger filter [PASS]
[85] (instance) event trigger - test histogram modifiers [PASS]
[86] (instance) event trigger - test histogram trigger [PASS]
[87] (instance) event trigger - test multiple histogram triggers [PASS]
[88] (instance) trace_marker trigger - test histogram trigger [PASS]
[89] (instance) trace_marker trigger - test snapshot trigger [PASS]

# of passed: 87
# of failed: 1
# of unresolved: 0
# of untested: 0
# of unsupported: 1
# of xfailed: 0
# of undefined(test bug): 0
not ok 1..1 selftests: ftrace: ftracetest [FAIL]

However it can pass with the upstream tree:
# [28] ftrace - Max stack tracer [PASS]
# [29] ftrace - test for function traceon/off triggers [PASS]
# [30] ftrace - test tracing error log support [FAIL]
# [31] Test creation and deletion of trace instances while setting an event [PASS]
# [32] Test creation and deletion of trace instances [PASS]

So it looks like a test case issue in our kernel tree from this point.

ProblemType: Bug
DistroRelease: Ubuntu 19.04
Package: linux-image-5.0.0-20-generic 5.0.0-20.21
ProcVersionSignature: User Name 5.0.0-20.21-generic 5.0.8
Uname: Linux 5.0.0-20-generic aarch64
AlsaDevices:
 total 0
 crw-rw---- 1 root audio 116, 1 Jul 18 04:23 seq
 crw-rw---- 1 root audio 116, 33 Jul 18 04:23 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay': 'aplay'
ApportVersion: 2.20.10-0ubuntu27.1
Architecture: arm64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord': 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
Date: Thu Jul 18 12:03:43 2019
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig': 'iwconfig'
MachineType: Cavium ThunderX CRB
PciMultimedia:

ProcFB:
 0 EFI VGA
 1 astdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-5.0.0-20-generic root=UUID=d4e5f461-24ef-47d8-a67f-42c82ff1efe8 ro
RelatedPackageVersions:
 linux-restricted-modules-5.0.0-20-generic N/A
 linux-backports-modules-5.0.0-20-generic N/A
 linux-firmware 1.178.2
RfKill: Error: [Errno 2] No such file or directory: 'rfkill': 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 12/12/2012
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: 5.11
dmi.board.asset.tag: To be filled by O.E.M.
dmi.board.name: To be filled by O.E.M.
dmi.board.vendor: To be filled by O.E.M.
dmi.board.version: To be filled by O.E.M.
dmi.chassis.asset.tag: To be filled by O.E.M.
dmi.chassis.type: 0
dmi.chassis.vendor: Cavium
dmi.chassis.version: To be filled by O.E.M.
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr5.11:bd12/12/2012:svnCavium:pnThunderXCRB:pvrTobefilledbyO.E.M.:rvnTobefilledbyO.E.M.:rnTobefilledbyO.E.M.:rvrTobefilledbyO.E.M.:cvnCavium:ct0:cvrTobefilledbyO.E.M.:
dmi.product.family: Default string
dmi.product.name: ThunderX CRB
dmi.product.sku: Default string
dmi.product.version: To be filled by O.E.M.
dmi.sys.vendor: Cavium

Revision history for this message
Po-Hsu Lin (cypressyew) wrote :
description: updated
Po-Hsu Lin (cypressyew)
tags: added: 5.0 sru-20190701 ubuntu-kernel-selftests
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote : Status changed to Confirmed

This change was made by a bot.

Changed in linux (Ubuntu):
status: New → Confirmed
Changed in linux (Ubuntu Disco):
status: New → Confirmed
Po-Hsu Lin (cypressyew)
description: updated
Po-Hsu Lin (cypressyew)
summary: function traceon/off triggers in ftace from ubuntu_kernel_selftests
- failed on Disco ARM64
+ failed on Disco ARM64 / B-hwe P9
Revision history for this message
Po-Hsu Lin (cypressyew) wrote : Re: function traceon/off triggers in ftace from ubuntu_kernel_selftests failed on Disco ARM64 / B-hwe P9

Issue found on B-hwe 5.0 P9 as well.

The first attempt on B-hwe 5.0 P9 does not report failure on the traceon/off trigger.
It's the second attempt complaining it.

Will test again to see what's going on here.

Brad Figg (brad-figg)
tags: added: ubuntu-certified
Revision history for this message
Po-Hsu Lin (cypressyew) wrote :

In this cycle with Bionic kernel (4.15.0-72.81), this has passed with ThunderX (starmie-kernel) but failed on Moonshot (ms10-34-mcdivittB0-kernel)

Sean Feole (sfeole)
Changed in ubuntu-kernel-tests:
status: New → Triaged
tags: added: sru-20200106
Revision history for this message
Sean Feole (sfeole) wrote :
Download full text (10.6 KiB)

On Eoan, we no longer see the failure for traceon/off triggers ; however,

[45] Register/unregister many kprobe events [FAIL]

Is failing, on arm64. Giving there are so many ftracetests open in the project that are stale, i'm going to close this bug as its originally intended to target against Disco, and re-open a new one for the new failure on Eoan, if in fact is does not align with any of the already existing bugs.

04/12 21:49:30 DEBUG| utils:0153| [stdout] 1..1
04/12 21:49:30 DEBUG| utils:0153| [stdout] # selftests: ftrace: ftracetest
04/12 21:49:30 DEBUG| utils:0153| [stdout] # === Ftrace unit tests ===
04/12 21:49:34 DEBUG| utils:0153| [stdout] # [1] Basic trace file check [PASS]
04/12 21:50:35 DEBUG| utils:0153| [stdout] # [2] Basic test for tracers [PASS]
04/12 21:51:46 DEBUG| utils:0153| [stdout] # [3] Basic trace clock test [PASS]
04/12 21:51:50 DEBUG| utils:0153| [stdout] # [4] Basic event tracing check [PASS]
04/12 21:51:54 DEBUG| utils:0153| [stdout] # [5] Change the ringbuffer size [PASS]
04/12 21:52:02 DEBUG| utils:0153| [stdout] # [6] Snapshot and tracing setting [PASS]
04/12 21:52:09 DEBUG| utils:0153| [stdout] # [7] trace_pipe and trace_marker [PASS]
04/12 21:52:17 DEBUG| utils:0153| [stdout] # [8] Generic dynamic event - add/remove kprobe events [PASS]
04/12 21:52:24 DEBUG| utils:0153| [stdout] # [9] Generic dynamic event - add/remove synthetic events [PASS]
04/12 21:52:28 DEBUG| utils:0153| [stdout] # [10] Generic dynamic event - selective clear (compatibility) [PASS]
04/12 21:52:32 DEBUG| utils:0153| [stdout] # [11] Generic dynamic event - generic clear event [PASS]
04/12 21:52:44 DEBUG| utils:0153| [stdout] # [12] event tracing - enable/disable with event level files [PASS]
04/12 21:52:59 DEBUG| utils:0153| [stdout] # [13] event tracing - restricts events based on pid [PASS]
04/12 21:53:10 DEBUG| utils:0153| [stdout] # [14] event tracing - enable/disable with subsystem level files [PASS]
04/12 21:53:21 DEBUG| utils:0153| [stdout] # [15] event tracing - enable/disable with top level files [PASS]
04/12 21:53:26 DEBUG| utils:0153| [stdout] # [16] Test trace_printk from module [PASS]
04/12 21:53:48 DEBUG| utils:0153| [stdout] # [17] ftrace - function graph filters with stack tracer [PASS]
04/12 21:54:04 DEBUG| utils:0153| [stdout] # [18] ftrace - function graph filters [PASS]
04/12 21:54:42 DEBUG| utils:0153| [stdout] # [19] ftrace - function pid filters [PASS]
04/12 21:54:50 DEBUG| utils:0153| [stdout] # [20] ftrace - stacktrace filter command [PASS]
04/12 21:55:06 DEBUG| utils:0153| [stdout] # [21] ftrace - function trace with cpumask [PASS]
04/12 21:55:24 DEBUG| utils:0153| [stdout] # [22] ftrace - test for function event triggers [PASS]
04/12 21:55:28 DEBUG| utils:0153| [stdout] # [23] ftrace - function trace on module [PASS]
04/12 21:55:34 DEBUG| utils:0153| [stdout] # [24] ftrace - function profiling [PASS]
04/12 21:55:53 DEBUG| utils:0153| [stdout] # [25] ftrace - function profiler with function tracing [PASS]
04/12 21:56:02 DEBUG| utils:0153| [stdout] # [26] ftrace - test reading of set_ftrace_filter ...

Changed in ubuntu-kernel-tests:
status: Triaged → Invalid
Changed in linux (Ubuntu Disco):
status: Confirmed → Invalid
Changed in linux (Ubuntu):
status: Confirmed → Invalid
Revision history for this message
Kelsey Steele (kelsey-steele) wrote :

Spotted on Bionic aws : 4.15.0-1084.88 : amd64 on m5.xlarge

tags: added: 4.15 aws bionic sru-20200921
Revision history for this message
Kelsey Steele (kelsey-steele) wrote :

Spotted on Bionic azure : 4.15.0-1106.118 : amd64

tags: added: azure sru-20210104
tags: added: sru-20210315
Revision history for this message
Kleber Sacilotto de Souza (kleber-souza) wrote :

Re-openning bug report.

Spotted with hirsute/linux 5.11.0-26.28, flavor generic-64k, on dazzle arm64.

# [94] (instance) ftrace - test for function traceon/off triggers [FAIL]

Changed in ubuntu-kernel-tests:
status: Invalid → New
Changed in linux (Ubuntu):
status: Invalid → New
tags: added: 5.11 generic-64k hirsute sru-20210719
summary: function traceon/off triggers in ftace from ubuntu_kernel_selftests
- failed on Disco ARM64 / B-hwe P9
+ failed on ARM64 / B-hwe P9
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote : Status changed to Confirmed

This change was made by a bot.

Changed in linux (Ubuntu):
status: New → Confirmed
Changed in linux (Ubuntu Hirsute):
status: New → Confirmed
Revision history for this message
Marcelo Cerri (mhcerri) wrote :

Spotted with hirsute/linux-azure 5.11.0-1017.18 on a single instance.

tags: added: sru-20210906
Revision history for this message
Kelsey Steele (kelsey-steele) wrote :

spotted on impish 5.13.0-23.23 amd64 kili

Revision history for this message
Brian Murray (brian-murray) wrote :

The Hirsute Hippo has reached End of Life, so this bug will not be fixed for that release.

Changed in linux (Ubuntu Hirsute):
status: Confirmed → Won't Fix
Changed in linux (Ubuntu Impish):
status: New → Confirmed
Revision history for this message
Po-Hsu Lin (cypressyew) wrote :

This is flaky for J-hwe-5.19.0-18.18~22.04.3 as well

Spotted on ARM64 nodes, there is the test matrix:
* Generic ARM64
  + appleton-kernel (1st attempt) failed with:
    - [33] ftrace - test for function traceon/off triggers [FAIL]
    - [98] (instance) ftrace - test for function traceon/off triggers [FAIL]
  + appleton-kernel (2nd attempt) failed with:
    - [33] ftrace - test for function traceon/off triggers [FAIL]
  + kuzzle failed with:
    - [33] ftrace - test for function traceon/off triggers [FAIL]
* Generic 64K
  + appleton-kernel: OK
  + dazzle failed with:
    - [98] (instance) ftrace - test for function traceon/off triggers [FAIL]

tags: added: 5.19 jammy
Revision history for this message
Brian Murray (brian-murray) wrote :

Ubuntu 21.10 (Impish Indri) has reached end of life, so this bug will not be fixed for that specific release.

Changed in linux (Ubuntu Impish):
status: Confirmed → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.