LAVA Validation Lab

Lava Android tests : "mmtest" and "cts" failed on vexpress/snowball daily Android builds

Bug #1006234 reported by Abhishek Paliwal
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
LAVA Validation Lab
Won't Fix
Medium
Yongqin Liu
LAVA Validation Lab 2011.09
Linaro Android
Won't Fix
Undecided
Unassigned
Tags: lava-found
Abhishek Paliwal (abhishek-paliwal)
summary: - Lava tests : "mmtest" and "cts" fails on vexpress android image build
+ Lava tests : "mmtest" and "cts" fails on vexpress Android build
+ https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-
+ gcc47-armlt-tracking-open/#build=41
Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote : Re: Lava tests : "mmtest" and "cts" fails on vexpress Android build https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=41
Download full text (23.6 KiB)

Also observed on build:
https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=46

Logs: (http://validation.linaro.org/lava-server/scheduler/job/21305)
-----
LAVA: (stdout) push: samplemedia.linaro.org/samplemedia.linaro.org/MPEG4/big_buck_bunny_1080p_MPEG4_MP3_25fps_7600K.AVI -> /dERROR: Test execution error: Run step 'push samplemedia.linaro.org /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org' failed. 1 : ['push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/shields_ter_720p_2M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/shields_ter_720p_2M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/mobcal_ter_720p_2M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/mobcal_ter_720p_2M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/mobcal_ter_720p_5M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/mobcal_ter_720p_5M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/park_joy_420_720p_2M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/park_joy_420_720p_2M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/shields_ter_720p_5M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/shields_ter_720p_5M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/ducks_take_off_420_720p_5M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/ducks_take_off_420_720p_5M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/park_joy_420_720p_5M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/park_joy_420_720p_5M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/ducks_take_off_420_720p_2M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV8/ducks_take_off_420_720p_2M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV9/shields_ter_720p_2M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV9/shields_ter_720p_2M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV9/mobcal_ter_720p_2M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV9/mobcal_ter_720p_2M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV9/mobcal_ter_720p_5M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/Real/RV9/mobcal_ter_720p_5M.rmvb\n', 'push: samplemedia.linaro.org/samplemedia.linaro.org/Real/RV9/park_joy_420_720p_2M.rmvb -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/R...

Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

Tests: mmtest cts failed on
https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=48

Andy Doan (doanac)
Changed in lava-lab:
milestone: none → 2012.06
Yongqin Liu (liuyq0307)
Changed in lava-lab:
assignee: nobody → Yongqin Liu (liuyq0307)
Revision history for this message
Yongqin Liu (liuyq0307) wrote :

About the above failures, the confirm result as following:

Build ID: #41
Lava Job ID: #20816
Board Used: vexpress-a902
Problems:
1. When pushing test files to android at mmtest, "protocol failure" error occurred.
    And there is such information "mmcblk0: error -5 transferring data, sector 19310016, nr 24, cmd response 0x900, card status 0xc00".
   Not know if it has any relations.
2. When running the CTS test, the adb connection lost

Build ID: #46
Lava Job ID: #21305
Board Used: vexpress-a902
Problems:
1. When pushing test files to android at mmtest, "protocol failure" error occurred.
    And there is such information "mmcblk0: error -5 transferring data, sector 19310016, nr 24, cmd response 0x900, card status 0xc00".
   Not know if it has any relations.
2. When running the CTS test, the adb connection lost

Build ID: #48
Lava Job ID: #21466
Board Used: vexpress-a902
Problems:
1. When running the CTS test, the adb connection lost

Changed in lava-lab:
status: New → Confirmed
importance: Undecided → Medium
Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

cts and mmtest fails to run on:
https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=54

Revision history for this message
Yongqin Liu (liuyq0307) wrote :

Build ID: vexpress-ics-gcc47-armlt-tracking-open/#build=54
JOB ID: 22187
Board Used: vexpress-a902
Problems：
1. when running the mmtest, shortMsg=Process crashed. adb connection lost
2. When running the CTS test, the adb connection lost

Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

LAVA test mmtest fails due to device not available(adb connection lost !) on build:
https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=332

Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

LAVA test cts also fails due issue 'device not available' (adb connection lost !) on build:
https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=332

Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

On Build:
https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=338
adb connection lost issue is still observed

Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

On Build:
https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=339
mmtest and cts tests failed to run.

Logs: mmtest
-------
LAVA: Begin to execute command: adb -s 192.168.1.82:5555 push samplemedia.linaro.org /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org
LAVA: (stdout) error: device not found

<LAVA_DISPATCHER>2012-06-22 11:48:26 AM INFO: Execute adb command on host: adb disconnect 192.168.1.82

No such device 192.168.1.82:5555

<LAVA_DISPATCHER>2012-06-22 11:48:26 AM WARNING: [ACTION-E] lava_android_test_run is finished with error (Failed to run test case(mmtest) on device(192.168.1.82:5555) with return value: 1).
-----------

summary: - Lava tests : "mmtest" and "cts" fails on vexpress Android build
- https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-
- gcc47-armlt-tracking-open/#build=41
+ Lava Android tests : "mmtest" and "cts" failed on vexpress/snowball
+ daily Android builds
Revision history for this message
Yongqin Liu (liuyq0307) wrote :

The CTS test/mmtest mainly failed because the adb connection lost the same as Bug #1006215.
And the adb connection lost should be investigated from android side.

Fathi Boudra (fboudra)
Changed in lava-lab:
milestone: 2012.06 → 2012.07
Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

mmtest also failed on : https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=349

Revision history for this message
Amit Khare (amit-khare) wrote :
Download full text (4.4 KiB)

CTS and MONKEY test fails on build #350

Android-build : https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=350
Job id : http://validation.linaro.org/lava-server/scheduler/job/24164
log file : http://validation.linaro.org/lava-server/scheduler/job/24164/log_file

cts test:

From logs:
---------
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: android.core.tests.libcore.package.org package complete: Passed 0, Failed 0, Not Executed 1907
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: -----------------------------------------
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: Test package android.core.tests.libcore.package.sun started
LAVA: (stdout) 07-0WARNING: Could not read cpu information
WARNING: Could not read board information
WARNING: Could not read memory information
ERROR: Test execution error: The result (cts1341320569.0) is not existed.
3 13:28:15 I/192.168.1.243:5555: -----------------------------------------
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: android.core.tests.libcore.package.sun package complete: Passed 0, Failed 0, Not Executed 2
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: -----------------------------------------
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: Test package android.core.tests.libcore.package.tests started
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: -----------------------------------------
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: android.core.tests.libcore.package.tests package complete: Passed 0, Failed 0, Not Executed 2643
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: -----------------------------------------
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: Test package android.core.vm-tests-tf started
LAVA: (stdout) 07-03 13:28:15 I/192.168.1.243:5555: -----------------------------------------
LAVA: (stdout) 07-03 13:28:16 I/192.168.1.243:5555: android.core.vm-tests-tf package complete: Passed 0, Failed 0, Not Executed 3098
LAVA: (stdout) 07-03 13:28:16 I/192.168.1.243:5555: -----------------------------------------
LAVA: (stdout) 07-03 13:28:16 I/192.168.1.243:5555: Test package android.tests.appsecurity started
LAVA: (stdout) 07-03 13:28:16 I/192.168.1.243:5555: -----------------------------------------
LAVA: (stdout) 07-03 13:28:18 I/192.168.1.243:5555: Saved log device_logcat_7706288674799225125.zip
LAVA: (stdout) 07-03 13:28:18 I/192.168.1.243:5555: Saved log host_log_2059514123584845667.zip
LAVA: (stdout) 07-03 13:28:18 I/192.168.1.243:5555: android.tests.appsecurity package complete: Passed 0, Failed 0, Not Executed 6
LAVA: (stdout) 07-03 13:28:18 I/192.168.1.243:5555: Created xml report file at file:///tmp/lava-android-test/tmpbOb6eE/./android-cts/tools/../../android-cts/repository/results/2012.07.03_13.06.45/testResult.xml
LAVA: (stdout) 07-03 13:28:19 I/192.168.1.243:5555: XML test result file generated at 2012.07.03_13.06.45. Passed 1, Failed 0, Not Executed 17150
LAVA: (stdout) 07-03 13:28:19 I/192.168.1.243:5555: Time: 21m 33s
LAVA: (stdout) 07-03 13:28:23 W/DeviceManager: Freed device 192.168.1.243:5555 is unavailable. Removing from use.
LAVA: (stdout) 07-03 13:28:23 I/CommandSchedu...

Read more...

Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

mmtest and cts and even 0xbench failed on vexpress:
Build: https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=74
Job id: http://validation.linaro.org/lava-server/scheduler/job/24248

Error message from logs for all failure's is :
No such device 192.168.1.71:5555
(ADB disconnection may be the cause for this)

Revision history for this message
Amit Khare (amit-khare) wrote :

MMTEST and CTS test fails on snowball on build #351
android-build: https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=352
Job-id: http://validation.linaro.org/lava-server/scheduler/job/24382
Log file: http://validation.linaro.org/lava-server/scheduler/job/24382/log_file

MMTEST: fails because of system crash
From Logs:

LAVA: (stdout)
LAVA: (stdout) INSTRUMENTATION_STATUS: test=big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM
LAVA: (stdout) INSTRUMENTATION_STATUS_CODE: -2
LAVA: (stdout) INSTRUMENTATION_STATUS: id=InstrumentationTestRunner
LAVA: (stdout) INSTRUMENTATION_STATUS: current=120
LAVA: (stdout) INSTRUMENTATION_STATUS: class=com.android.mediaframeworktest.MediaFrameworkTestRunner$1
LAVA: (stdout) INSTRUMENTATION_STATUS: stream=
LAVA: (stdout) INSTRUMENTATION_STATUS: numtests=123
LAVA: (stdout) INSTRUMENTATION_STATUS: test=big_buck_bunny_480p_VP8_VORBIS_25fps_1900K.WebM
LAVA: (stdout) INSTRUMENTATION_STATUS_CODE: 1
LAVA: (stdout) INSTRUMENTATION_ABORTED: System has crashed.
LAVA: Begin to execute command: adb -s 192.168.1.81:5555 shell rm -r /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org
ANDROID TEST RUN COMPLETE: Result id is 'mmtest1341492750.0'
LAVA: --End Operation: Run test (mmtest) on device(192.168.1.81:5555)

*******************
CTS Test:
From Logs:

root@linaro: netcfg eth0 up
root@linaro: netcfg eth0 dhcp
root@linaro: ifconfig eth0
eth0: ip 192.168.1.81 mask 255.255.255.0 flags [up broadcast running multicast]

root@linaro: <LAVA_DISPATCHER>2012-07-05 08:18:42 PM INFO: Enable adb over TCPIP

echo 0>/sys/class/android_usb/android0/enable

root@linaro: setprop service.adb.tcp.port 5555
root@linaro: stop adbd

[ 78.422332] adb_release
root@linaro: start adbd

root@linaro: <LAVA_DISPATCHER>2012-07-05 08:18:55 PM WARNING: [ACTION-E] lava_android_test_run is finished with error (The test case(cts) on device(192.168.1.81:5555) times out).

Revision history for this message
Amit Khare (amit-khare) wrote :
Download full text (4.8 KiB)

MMTEST and CTS test fails on snowball on build #356
android-build: https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=356
Job-id: http://validation.linaro.org/lava-server/scheduler/job/24769
Log file: http://validation.linaro.org/lava-server/scheduler/job/24769/log_file

MMTEST: fails because of system crash
From Logs:

LAVA: (stdout)
LAVA: (stdout) INSTRUMENTATION_STATUS: test=big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K.WebM
LAVA: (stdout) INSTRUMENTATION_STATUS_CODE: -2
LAVA: (stdout) INSTRUMENTATION_STATUS: id=InstrumentationTestRunner
LAVA: (stdout) INSTRUMENTATION_STATUS: current=119
LAVA: (stdout) INSTRUMENTATION_STATUS: class=com.android.mediaframeworktest.MediaFrameworkTestRunner$1
LAVA: (stdout) INSTRUMENTATION_STATUS: stream=
LAVA: (stdout) INSTRUMENTATION_STATUS: numtests=123
LAVA: (stdout) INSTRUMENTATION_STATUS: test=big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM
LAVA: (stdout) INSTRUMENTATION_STATUS_CODE: 1
LAVA: (stdout) INSTRUMENTATION_STATUS: id=InstrumentationTestRunner
LAVA: (stdout) INSTRUMENTATION_STATUS: current=119
LAVA: (stdout) INSTRUMENTATION_STATUS: class=com.android.mediaframeworktest.MediaFrameworkTestRunner$1
LAVA: (stdout) INSTRUMENTATION_STATUS: stream=
LAVA: (stdout) Failure in big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM:
LAVA: (stdout) junit.framework.AssertionFailedError: testSubPlay:/data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/VP8/big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM
LAVA: (stdout) at com.android.mediaframeworktest.functional.MediaSamplesTest.testSubPlay(MediaSamplesTest.java:53)
LAVA: (stdout) at com.android.mediaframeworktest.MediaFrameworkTestRunner$1.runTest(MediaFrameworkTestRunner.java:148)
LAVA: (stdout) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
LAVA: (stdout) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
LAVA: (stdout) at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:545)
LAVA: (stdout) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1551)
LAVA: (stdout)
LAVA: (stdout) INSTRUMENTATION_STATUS: numtests=123
LAVA: (stdout) INSTRUMENTATION_STATUS: stack=junit.framework.AssertionFailedError: testSubPlay:/data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/VP8/big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM
LAVA: (stdout) at com.android.mediaframeworktest.functional.MediaSamplesTest.testSubPlay(MediaSamplesTest.java:53)
LAVA: (stdout) at com.android.mediaframeworktest.MediaFrameworkTestRunner$1.runTest(MediaFrameworkTestRunner.java:148)
LAVA: (stdout) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
LAVA: (stdout) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
LAVA: (stdout) at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:545)
LAVA: (stdout) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1551)
LAVA: (stdout)
LAVA: (stdout) INSTRUMENTATION_STATUS: test=big_buck_bunny_1080p_VP8_VORBIS...

Read more...

Revision history for this message
Amit Khare (amit-khare) wrote :
Download full text (3.6 KiB)

MMtest and CTS test failure observed on Panda build #77 too

android-build: https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=77
job-id: http://validation.linaro.org/lava-server/scheduler/job/24658
log-file: http://validation.linaro.org/lava-server/scheduler/job/24658/log_file

MMtest:

LAVA: (stdout) push: samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_720p_H264_AAC_25fps_3400K.MP4 -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_720p_H264_AAC_25fps_3400K.MP4
LAVA: (stdout) push: samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_720p_H264_AAC_25fps_3400K_short.MP4 -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_720p_H264_AAC_25fps_3400K_short.MP4
LAVA: (stdout) push: samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_1080p_H264_AAC_25fps_7200K_short.MP4 -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_1080p_H264_AAC_25fps_7200K_short.MP4
LAVA: (stdout) push: samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_480p_H264_AAC_25fps_1800K_short.MP4 -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_480p_H264_AAC_25fps_1800K_short.MP4
LAVA: (stdout) push: samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_480p_H264_AAC_25fps_1800K.MP4 -> /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/H264/big_buck_bunny_480p_H264_AAC_25fps_1800K.MP4
LAVA: (stdout) protocol failure

<LAVA_DISPATCHER>2012-07-08 12:45:50 PM INFO: Execute adb command on host: adb disconnect 192.168.1.107

No such device 192.168.1.107:5555

*****************

CTS:

ERROR: Test execution error: The result (cts1341751564.0) is not existed.
 13:31:09 I/192.168.1.107:5555: android.core.vm-tests-tf package complete: Passed 0, Failed 0, Not Executed 3098
LAVA: (stdout) 07-08 13:31:09 I/192.168.1.107:5555: -----------------------------------------
LAVA: (stdout) 07-08 13:31:09 I/192.168.1.107:5555: Test package android.tests.appsecurity started
LAVA: (stdout) 07-08 13:31:09 I/192.168.1.107:5555: -----------------------------------------
LAVA: (stdout) 07-08 13:31:13 I/192.168.1.107:5555: Saved log device_logcat_2613016145540333023.zip
LAVA: (stdout) 07-08 13:31:14 I/192.168.1.107:5555: Saved log host_log_9117391048626038129.zip
LAVA: (stdout) 07-08 13:31:14 I/192.168.1.107:5555: android.tests.appsecurity package complete: Passed 0, Failed 0, Not Executed 6
LAVA: (stdout) 07-08 13:31:14 I/192.168.1.107:5555: Created xml report file at file:///tmp/lava-android-test/tmpW9ndGV/./android-cts/tools/../../android-cts/repository/results/2012.07.08_12.47.44/testResult.xml
LAVA: (stdout) 07-08 13:31:15 I/192.168.1.107:5555: XML test result file generated at 2012.07.08_12.47.44. Passed 2048, Failed 70, Not Executed 15033
LAVA: (stdout) 07-08 13:31:15 I/192.168.1.107:5555: Time: 43m 30s
LAVA: (stdout) 07-08 13:31:19 W/DeviceManager: Fr...

Read more...

Revision history for this message
Amit Khare (amit-khare) wrote :
Download full text (6.2 KiB)

MMtest and CTS test failure observed on Snowball build #359 too

Android-build: https://android-build.linaro.org/builds/~linaro-android/snowball-ics-gcc46-igloo-stable-blob/#build=359

MMtest:

LAVA: (stdout) Failure in big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM:
LAVA: (stdout) junit.frameWARNING: Could not read cpu information
WARNING: Could not read board information
WARNING: Could not read memory information
ERROR: Test execution error: The result (mmtest1342054931.0) is not existed.
work.AssertionFailedError: testSubPlay:/data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/VP8/big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM
LAVA: (stdout) at com.android.mediaframeworktest.functional.MediaSamplesTest.testSubPlay(MediaSamplesTest.java:53)
LAVA: (stdout) at com.android.mediaframeworktest.MediaFrameworkTestRunner$1.runTest(MediaFrameworkTestRunner.java:148)
LAVA: (stdout) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
LAVA: (stdout) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
LAVA: (stdout) at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:545)
LAVA: (stdout) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1551)
LAVA: (stdout)
LAVA: (stdout) INSTRUMENTATION_STATUS: numtests=123
LAVA: (stdout) INSTRUMENTATION_STATUS: stack=junit.framework.AssertionFailedError: testSubPlay:/data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org/samplemedia.linaro.org/VP8/big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM
LAVA: (stdout) at com.android.mediaframeworktest.functional.MediaSamplesTest.testSubPlay(MediaSamplesTest.java:53)
LAVA: (stdout) at com.android.mediaframeworktest.MediaFrameworkTestRunner$1.runTest(MediaFrameworkTestRunner.java:148)
LAVA: (stdout) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169)
LAVA: (stdout) at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154)
LAVA: (stdout) at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:545)
LAVA: (stdout) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1551)
LAVA: (stdout)
LAVA: (stdout) INSTRUMENTATION_STATUS: test=big_buck_bunny_1080p_VP8_VORBIS_25fps_7800K_short.WebM
LAVA: (stdout) INSTRUMENTATION_STATUS_CODE: -2
LAVA: (stdout) INSTRUMENTATION_STATUS: id=InstrumentationTestRunner
LAVA: (stdout) INSTRUMENTATION_STATUS: current=120
LAVA: (stdout) INSTRUMENTATION_STATUS: class=com.android.mediaframeworktest.MediaFrameworkTestRunner$1
LAVA: (stdout) INSTRUMENTATION_STATUS: stream=
LAVA: (stdout) INSTRUMENTATION_STATUS: numtests=123
LAVA: (stdout) INSTRUMENTATION_STATUS: test=big_buck_bunny_480p_VP8_VORBIS_25fps_1900K.WebM
LAVA: (stdout) INSTRUMENTATION_STATUS_CODE: 1
LAVA: (stdout) INSTRUMENTATION_ABORTED: System has crashed.
LAVA: Begin to execute command: adb -s 192.168.1.241:5555 shell rm -r /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org
ANDROID TEST RUN COMPLETE: Result id is 'mmtest1342054931.0'

<LAVA_DISPATCHER>2012-07-12 03:02:20 AM INFO: Execute adb command o...

Read more...

Revision history for this message
Amit Khare (amit-khare) wrote :

MMtest and CTS test failure observed on Vexpress build #81 too

android-build: https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=81

Error message from logs for all failure's is :
No such device 192.168.1.71:5555
(ADB disconnection may be the cause for this)

Revision history for this message
Amit Khare (amit-khare) wrote :

MMtest and CTS test failure observed on Vexpress build #82 too

https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=82

Error message from logs for all failure's are same as previous build :
No such device 192.168.1.71:5555
(ADB disconnection may be the cause for this)

Revision history for this message
Amit Khare (amit-khare) wrote :

MMtest and CTS test failure observed on Vexpress build #83 too

https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=83

MMtest:

LAVA: (stdout) INSTRUMENTATION_ABORTED: System has crashed.

CTS:

No such device 192.168.1.71:5555

Andy Doan (doanac)
Changed in lava-lab:
milestone: 2012.07 → 2012.08
Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

On Vexpress build:
https://android-build.linaro.org/builds/~linaro-android/vexpress-ics-gcc47-armlt-tracking-open/#build=97

MMTest Failed:
Error message: LAVA: (stdout) INSTRUMENTATION_RESULT: shortMsg=Process crashed.

Logs: (from http://validation.linaro.org/lava-server/scheduler/job/26939/log_file)
-------
LAVA: (stdout) 123 files pushed. 0 files skipped.
LAVA: (stdout) 461 KB/s (1368206255 bytes in 2897.264s)
LAVA: Begin to execute command: adb -s 192.168.1.71:5555 shell am instrument -r -e targetDir /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org -w com.android.mediaframeworktest/.MediaFrameworkTestRunner
LAVA: (stdout) INSTRUMENTATION_RESULT: shortMsg=Process crashed.
LAVA: (stdout) INSTRUMENTATION_CODE: 0
LAVA: Begin to execute command: adb -s 192.168.1.71:5555 shell rm -r /data/lava-android-test/share/installed-tests/mmtest/samplemedia.linaro.org
LAVA: try to reconnect the device(192.168.1.71:5555) 1/5 times
LAVA: Begin to execute command: adb disconnect 192.168.1.71:5555
LAVA: (stdout) No such device 192.168.1.71:5555
LAVA: Begin to execute command: adb connect 192.168.1.71:5555
LAVA: (stdout) connected to 192.168.1.71:5555
ANDROID TEST RUN COMPLETE: Result id is 'mmtest1343553619.0'

Revision history for this message
Dave Pigott (dpigott) wrote :

This looks to me to be a problem with Android, and the android tests, not LAVA, or am I missing something?

LAVA is the infrastructure that allows people to run tests on various flavours of Linux. If those tests fail, then it should point at a problem with either the platform (e.g. vexpress) or the OS (e.g. Android) and the bug should be pushed at the appropriate working group or landing team.

In the event that the tests are failing because LAVA is doing something incorrectly, then this would be a LAVA bug. I don't quite see that this is the case here, Or, as I said, maybe I'm missing something.

Revision history for this message
Abhishek Paliwal (abhishek-paliwal) wrote :

Adding linaro-android project to this bug report for more analyses.

Fathi Boudra (fboudra)
Changed in lava-lab:
milestone: 2012.08 → 2011.09
Alan Bennett (akbennett)
Changed in lava-lab:
status: Confirmed → Won't Fix
Revision history for this message
Milosz Wasilewski (mwasilew) wrote :

ICS is not supported. Closing.

Changed in linaro-android:
status: New → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Related blueprints

Remote bug watches

Bug watches keep track of this bug in other bug trackers.