ubuntu-kernel-tests

func_traceonoff_triggers.tc from ubuntu_kselftests_ftrace flaky (Tracing file is still changing)

Bug #1876687 reported by Po-Hsu Lin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ubuntu-kernel-tests
New
Undecided
Unassigned
linux (Ubuntu)
Incomplete
Undecided
Unassigned

Bug Description

Issue found on Focal 5.4.0-29.33 with node amaura (passed on rizzo, rizzo failed with other failures)
Running './ftracetest -vvv test.d/ftrace/func_traceonoff_triggers.tc'
[stdout] === Ftrace unit tests ===
[stderr] + initialize_ftrace
[stderr] + disable_tracing
[stderr] + echo 0
[stderr] + reset_tracer
[stderr] + echo nop
[stderr] + reset_trigger
[stderr] + [ -d events/synthetic ]
(long output skipped)
[stderr] + read line
(long output skipped)
[stderr] + read line
(long output skipped)
[stderr] + reset_events_filter
[stderr] + read line
(long output skipped)
[stderr] + reset_ftrace_filter
[stderr] + [ ! -f set_ftrace_filter ]
[stderr] + echo
[stderr] + grep -v ^# set_ftrace_filter
[stderr] + read t
[stderr] + disable_events
[stderr] + echo 0
[stderr] + [ -f set_event_pid ]
[stderr] + echo
[stderr] + [ -f set_ftrace_pid ]
[stdout] [1] ftrace - test for function traceon/off triggers
[stderr] + echo
[stderr] + [ -f set_ftrace_notrace ]
[stderr] + echo
[stderr] + [ -f set_graph_function ]
[stderr] + tee set_graph_function set_graph_notrace
[stderr] + echo
[stderr] + [ -f stack_trace_filter ]
[stderr] + echo
[stderr] + [ -f kprobe_events ]
[stderr] + echo
[stderr] + [ -f uprobe_events ]
[stderr] + echo
[stderr] + [ -f synthetic_events ]
[stderr] + echo
[stderr] + [ -f snapshot ]
[stderr] + echo 0
[stderr] + clear_trace
[stdout] Testing function probes with enabling disabling tracing:
[stdout] ** DISABLE TRACING
[stderr] + echo
[stderr] + enable_tracing
[stderr] + echo 1
[stderr] + . /home/ubuntu/autotest/client/tmp/ubuntu_kselftests_ftrace/src/linux/tools/testing/selftests/ftrace/test.d/ftrace/func_traceonoff_triggers.tc
[stderr] + [ ! -f set_ftrace_filter ]
[stderr] + SLEEP_TIME=.1
[stderr] + echo Testing function probes with enabling disabling tracing:
[stderr] + echo ** DISABLE TRACING
[stderr] + disable_tracing
[stderr] + echo 0
[stderr] + clear_trace
[stderr] + echo
[stderr] + cnt_trace
[stderr] + + grep -v ^# trace
[stderr] wc -l
[stdout] ** ENABLE EVENTS
[stderr] + cnt=0
[stderr] + [ 0 -ne 0 ]
[stderr] + echo ** ENABLE EVENTS
[stderr] + echo 1
[stdout] ** ENABLE TRACING
[stderr] + echo ** ENABLE TRACING
[stderr] + enable_tracing
[stderr] + echo 1
[stderr] + cnt_trace
[stderr] + wc -l
[stderr] + grep -v ^# trace
[stderr] + cnt=4077
[stderr] + [ 4077 -eq 0 ]
[stderr] + func=schedule
[stderr] + available_file=available_filter_functions
[stderr] + [ -d ../../instances -a -f ../../available_filter_functions ]
[stderr] + grep ^\.schedule$ available_filter_functions
[stderr] + wc -l
[stdout] ** SET TRACEOFF
[stderr] + x=0
[stderr] + [ 0 -eq 1 ]
[stderr] + echo ** SET TRACEOFF
[stderr] + echo schedule:traceoff
[stderr] + [ -d ../../instances ]
[stderr] + + wc -l
[stderr] grep schedule set_ftrace_filter
[stderr] + cnt=1
[stderr] + [ 1 -ne 1 ]
[stderr] + cnt_trace
[stderr] + wc -l
[stderr] + grep -v ^# trace
[stderr] + cnt=21814
[stderr] + sleep .1
[stderr] + cnt_trace
[stderr] + grep+ wc -v ^# trace
[stderr] -l
[stderr] + cnt2=21814
[stderr] + [ 21814 -ne 21814 ]
[stderr] + cat tracing_on
[stderr] + on=0
[stderr] + [ 0 != 0 ]
[stderr] + md5sum trace
[stderr] + csum1=c6e4ee60fb108d69d9bbfe7e1db1063e trace
[stderr] + sleep .1
[stderr] + md5sum trace
[stderr] + csum2=e4031c9f7b2a802822472087feacd82f trace
[stderr] + [ c6e4ee60fb108d69d9bbfe7e1db1063e trace != e4031c9f7b2a802822472087feacd82f trace ]
[stderr] + fail Tracing file is still changing
[stderr] + echo Tracing file is still changing
[stderr] + exit_fail
[stderr] + exit 1
[stdout] Tracing file is still changing
[stdout] [FAIL]
[stderr] + initialize_ftrace
[stderr] + disable_tracing
[stderr] + echo 0
[stderr] + reset_tracer
[stderr] + echo nop
[stderr] + reset_trigger
[stderr] + [ -d events/synthetic ]
(long output skipped)
[stderr] + read line
(long output skipped)
[stderr] + read line
(long output skipped)
[stderr] + reset_events_filter
[stderr] + read line
(long output skipped)
[stderr] + reset_ftrace_filter
[stderr] + [ ! -f set_ftrace_filter ]
[stderr] + echo
[stderr] + read t
[stderr] + grep -v ^# set_ftrace_filter
[stderr] + disable_events
[stderr] + echo 0
[stderr] + [ -f set_event_pid ]
[stderr] + echo
[stderr] + [ -f set_ftrace_pid ]
[stderr] + echo
[stderr] + [ -f set_ftrace_notrace ]
[stderr] + echo
[stderr] + [ -f set_graph_function ]
[stderr] + [ -f stack_trace_filter ]
[stderr] + [ -f kprobe_events ]
[stderr] + [ -f uprobe_events ]
[stderr] + [ -f synthetic_events ]
[stderr] + [ -f snapshot ]
[stderr] + echo 0
[stderr] + clear_trace
[stdout] [2] (instance) ftrace - test for function traceon/off triggersTesting function probes with enabling disabling tracing:
[stdout] ** DISABLE TRACING
[stderr] + echo
[stderr] + enable_tracing
[stderr] + echo 1
[stderr] + . /home/ubuntu/autotest/client/tmp/ubuntu_kselftests_ftrace/src/linux/tools/testing/selftests/ftrace/test.d/ftrace/func_traceonoff_triggers.tc
[stderr] + [ ! -f set_ftrace_filter ]
[stderr] + SLEEP_TIME=.1
[stderr] + echo Testing function probes with enabling disabling tracing:
[stderr] + echo ** DISABLE TRACING
[stderr] + disable_tracing
[stderr] + echo 0
[stderr] + clear_trace
[stderr] + echo
[stderr] + cnt_trace
[stderr] + wc -l
[stderr] + grep -v ^# trace
[stdout] ** ENABLE EVENTS
[stdout] ** ENABLE TRACING
[stderr] + cnt=0
[stderr] + [ 0 -ne 0 ]
[stderr] + echo ** ENABLE EVENTS
[stderr] + echo 1
[stderr] + echo ** ENABLE TRACING
[stderr] + enable_tracing
[stderr] + echo 1
[stderr] + cnt_trace
[stderr] + wc -l
[stderr] + grep -v ^# trace
[stderr] + cnt=6780
[stderr] + [ 6780 -eq 0 ]
[stderr] + func=schedule
[stderr] + available_file=available_filter_functions
[stderr] + [ -d ../../instances -a -f ../../available_filter_functions ]
[stderr] + available_file=../../available_filter_functions
[stderr] + grep ^\.schedule$ available_filter_functions
[stderr] + wc -l
[stderr] grep: available_filter_functions: No such file or directory
[stderr] + x=0
[stderr] + [ 0 -eq 1 ]
[stderr] + echo ** SET TRACEOFF
[stderr] + echo schedule:traceoff
[stdout] ** SET TRACEOFF
[stderr] + [ -d ../../instances ]
[stderr] + cat set_ftrace_filter
[stderr] + cur=#### all functions enabled ####
[stderr] schedule:traceoff:unlimited
[stderr] + cat ../../set_ftrace_filter
[stderr] + top=#### all functions enabled ####
[stderr] schedule:traceoff:unlimited
[stderr] + [ #### all functions enabled ####
[stderr] schedule:traceoff:unlimited = #### all functions enabled ####
[stderr] schedule:traceoff:unlimited ]
[stderr] + echo This kernel is too old to support per instance filter
[stdout] This kernel is too old to support per instance filter
[stderr] + reset_ftrace_filter
[stderr] + [ ! -f set_ftrace_filter ]
[stderr] + echo
[stderr] + grep -v+ ^#read t
[stderr] set_ftrace_filter
[stderr] + echo schedule:traceoff:unlimited
[stderr] + cut -d: -f2
[stderr] + tr=traceoff
[stderr] + [ traceoff = ]
[stderr] + grep -q schedule:traceoff:unlimited set_ftrace_filter
[stderr] + echo schedule:traceoff:unlimited
[stderr] + cut -d: -f1
[stderr] + cut -d -f1
[stderr] + name=schedule
[stderr] + [ traceoff = enable_event -o traceoff = disable_event ]
[stderr] + cut -d: -f2
[stderr] + echo schedule:traceoff:unlimited
[stderr] + tr=traceoff
[stderr] + cut -d: -f3
[stderr] + echo schedule:traceoff:unlimited
[stderr] + limit=unlimited
[stderr] + [ unlimited != unlimited ]
[stderr] + echo !schedule:traceoff
[stderr] + read t
[stderr] + exit_unsupported
[stderr] + kill -s 40 23805
[stderr] + exit 0
[stdout] [UNSUPPORTED]
[stdout]
[stdout]
[stdout] # of passed: 0
[stdout] # of failed: 1
[stdout] # of unresolved: 0
[stdout] # of untested: 0
[stdout] # of unsupported: 1
[stdout] # of xfailed: 0
[stdout] # of undefined(test bug): 0

See original description
Revision history for this message
Po-Hsu Lin (cypressyew) wrote :

Please find attachment for the complete test log.

tags: added: 5.4 focal sru-20200427 ubuntu-kernel-selftests
Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote : Missing required logs.

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1876687

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

Changed in linux (Ubuntu):
status: New → Incomplete
Revision history for this message
Po-Hsu Lin (cypressyew) wrote : Re: function traceon/off triggers in ftace from ubuntu_kernel_selftests failed on Focal

BTW this test did not fail with the Focal lowlatency kernel on this node amaura (and rizzo passed as well)

Po-Hsu Lin (cypressyew)
tags: added: sru-20200608
Po-Hsu Lin (cypressyew)
tags: added: 5.3 arm64 aws sru-20200720
summary: function traceon/off triggers in ftace from ubuntu_kernel_selftests
- failed on Focal
+ failed on Focal / B-AWS-5.3
summary: function traceon/off triggers in ftace from ubuntu_kernel_selftests
- failed on Focal / B-AWS-5.3
+ failed on Focal
tags: removed: 5.3 arm64 aws sru-20200720
Revision history for this message
Kelsey Steele (kelsey-steele) wrote :

found on bionic 4.15.0-141.145 generic i386 host pepe

tags: added: 4.15 bionic sru-20210315
Kelsey Steele (kelsey-steele)
tags: added: hwe
Guilherme G. Piccoli (gpiccoli)
tags: added: sru-20210412
Revision history for this message
Francis Ginther (fginther) wrote (last edit ): Re: function traceon/off triggers in ftace from ubuntu_kernel_selftests failed on B/F

Failed on bionic:linux generic amd64 host spitfire sru-20210621.

summary: function traceon/off triggers in ftace from ubuntu_kernel_selftests
- failed on Focal
+ failed on B/F
tags: added: sru-20210621
Revision history for this message
Stefan Bader (smb) wrote :

Seen for 5.11.0-34.36~20.04.1 (focal:linux-hwe-5.11) on dazzle(arm64) for SRU cycle 2021.08.16

tags: added: 5.11 sru-20210816
Kleber Sacilotto de Souza (kleber-souza)
tags: added: sru-20210906
Revision history for this message
Ian May (ian-may) wrote :

Found on bionic/linux-gcp-fips: 4.15.0-2020.22 - n1-highcpu-4

tags: added: gcp sru-20210927
Revision history for this message
Po-Hsu Lin (cypressyew) wrote :

The actual test case is test.d/ftrace/func_traceonoff_triggers.tc
I will modify the content and title accordingly.

summary: - function traceon/off triggers in ftace from ubuntu_kernel_selftests
- failed on B/F
+ func_traceonoff_triggers.tc from ubuntu_kselftests_ftrace flaky
summary: - func_traceonoff_triggers.tc from ubuntu_kselftests_ftrace flaky
+ func_traceonoff_triggers.tc from ubuntu_kselftests_ftrace flaky (Tracing
+ file is still changing)
Po-Hsu Lin (cypressyew)
description: updated
Revision history for this message
Po-Hsu Lin (cypressyew) wrote :
description: updated
description: updated
Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

Found on bionic/linux-aws-5.4: 5.4.0-1109

Revision history for this message
Magali Lemes do Sacramento (magalilemes) wrote :

Seen on f/aws-fips with version 5.4.0-1112.121+fips1 during cycle s2023.09.04 on the m5a.large instance.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.