97748bab29
android: Run upload results script from the parent of src/
...
Matches other ports.
BUG=310981
TBR=dpranke
Review URL: https://codereview.chromium.org/40253002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@230730 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-24 15:57:36 +00:00
407ef245a9
Fix handling of tests that fail two different ways in run-webkit-tests (buildbot side).
...
This is a follow-on to r159630. It turns out I wasn't covering the
case where a test fails two different ways, and the second failure
is actually an expected failure.
TBR=ilevy@chromium.org , ojan@chromium.org
BUG=307277
Review URL: https://codereview.chromium.org/26110008
git-svn-id: http://src.chromium.org/svn/trunk/src/build@230204 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-22 21:13:16 +00:00
09c667ae6d
android: Re-enable pixel test on GPU bot now that we can take screenshots
...
BUG=285932
TBR=navabi@chromium.org
Review URL: https://codereview.chromium.org/34953002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@230147 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-22 16:40:53 +00:00
dbaa3f9c8d
Build support for WebRTC Chromium tests on Android.
...
In addition to the native APK tests for WebRTC, we
want to build and test the content_browsertests test
for each revision of WebRTC in our Chromium WebRTC FYI
waterfall.
This CL adds the needed configurations for that, that are used
by the buildbots in: https://codereview.chromium.org/26702005/
NOTRY=True
TEST=presubmit
BUG=305749
Review URL: https://codereview.chromium.org/26738003
git-svn-id: http://src.chromium.org/svn/trunk/src/build@229758 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-21 08:18:29 +00:00
f7719915b6
Add option to restart usb on device status check before performing check.
...
Restart USB has been known to bring back offline devices. Add option to device
status check to restart usb ports before performing the check. This requires
restart_usb to be installed (see
https://code.google.com/p/chromium/issues/detail?id=305769 ). Prints warning if
the utility has not been installed on the host.
We will add this first to perf bots. Restarting usb has fixed device issues on these bots. If we find it works and does not have unseen consequences, we will deploy on all bots (i.e. make default of --restart-usb to True).
BUG=299891
Review URL: https://codereview.chromium.org/26747004
git-svn-id: http://src.chromium.org/svn/trunk/src/build@229553 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-19 13:44:02 +00:00
a2333e634c
Fix error message values in bb_device_steps.py after r229193 (Build fix).
...
TBR=peter@chromium.org
BUG=
Review URL: https://codereview.chromium.org/29653003
git-svn-id: http://src.chromium.org/svn/trunk/src/build@229472 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-18 21:07:33 +00:00
cc3a5861d1
Add better error messages to the webkit_tests step in the android buildbot code.
...
R=ilevy@google.com , ilevy@chromium.org , peter@chromium.org
BUG=
Review URL: https://codereview.chromium.org/27197012
git-svn-id: http://src.chromium.org/svn/trunk/src/build@229193 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-17 18:57:15 +00:00
078e2a160f
Commented out Pixel tests for Android bot.
...
They can't run properly until the snapshot code is properly hooked up to the android-content-shell.
BUG=285932
R=ccameron@chromium.org
TBR=Sami, cmp
Review URL: https://codereview.chromium.org/27580002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@228986 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-16 21:59:53 +00:00
f6f8d8cb59
Run WebGL conformance tests on Android GPU bot
...
BUG=306462
TBR=navabi@chromium.org
Review URL: https://codereview.chromium.org/27201003
git-svn-id: http://src.chromium.org/svn/trunk/src/build@228671 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-15 12:53:19 +00:00
0dd3f89579
More swapped arg fixes after r227967.
...
Some days I can't code my way out of a paper bag :(. Now the list of
failures was swapped w/ the list of flaky tests.
TBR=ilevy@chromium.org
BUG=293920
Review URL: https://codereview.chromium.org/26311004
git-svn-id: http://src.chromium.org/svn/trunk/src/build@228509 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-14 19:43:45 +00:00
b518ae76cc
fix swapped passes, failures in parsing layout test results
...
Also, make the step fail if the fulL_results.json file is missing, and
make the step warn if we get unexpected flakes or passes.
TBR=ilevy@chromium.org
BUG=293920
Review URL: https://codereview.chromium.org/26841003
git-svn-id: http://src.chromium.org/svn/trunk/src/build@227967 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-10 18:47:14 +00:00
92413b7695
Print actual list of failing tests on Android layout test steps
...
This changes the Android bots to mimic the behavior of the non-Android bots
and to print the actual list of failing/flaky/unexpected passing tests
as part of the step text.
R=ilevy@chromium.org
BUG=293920
Review URL: https://codereview.chromium.org/26330004
git-svn-id: http://src.chromium.org/svn/trunk/src/build@227850 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-10 01:11:26 +00:00
a025a93e1c
[Android Buildbot] Revert forking in adb_logcat_monitor.py.
...
This essentially reverts the changes made in
https://codereview.chromium.org/24456002/ as they were found not
to be useful.
NOTRY=True
Review URL: https://codereview.chromium.org/25965002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@227084 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-04 20:53:04 +00:00
10040db6a7
[Android] Fork a detached child process from adb_logcat_monitor.py.
...
This way, we can invoke adb_logcat_monitor.py directly from
recipes. We cannot spawn a process which runs
adb_logcat_monitor.py (like we have been via
buildbot/bb_device_steps.py) from recipes as we cannot import
subprocess et al. from recipes.
BUG=286509
Review URL: https://codereview.chromium.org/24456002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@226151 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-10-01 05:20:31 +00:00
741a3da0d7
[android] Remove unnecessary install of AndroidWebViewTest.apk on bots.
...
BUG=None
TEST=None
NOTRY=True
Review URL: https://chromiumcodereview.appspot.com/24076020
git-svn-id: http://src.chromium.org/svn/trunk/src/build@225033 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-24 17:59:42 +00:00
6f95e68f16
[chromedriver] Fix typo in android chromedriver buildbot script.
...
TBR=navabi@chromium.org
BUG=None
TEST=None
NOTRY=True
Review URL: https://chromiumcodereview.appspot.com/24198012
git-svn-id: http://src.chromium.org/svn/trunk/src/build@224485 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-20 21:02:39 +00:00
053e56197a
[chromedriver] Fixes for android tests gating chromedriver release.
...
Previously the revision was not passed. Also fixes a bug where downstream would have also updated the android test results log.
BUG=None
TEST=None
NOTRY=True
Review URL: https://chromiumcodereview.appspot.com/24224006
git-svn-id: http://src.chromium.org/svn/trunk/src/build@224410 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-20 17:15:28 +00:00
77e02055f7
Sigh. Lower-case the "k" in ChromiumWebkit for the layout tests upload for Android.
...
One more change after r223770. Hopefully this one's the ticket.
(Build fix).
TBR=ojan@chromium.org , ilevy@chromium.org
BUG=293928
Review URL: https://codereview.chromium.org/23452044
git-svn-id: http://src.chromium.org/svn/trunk/src/build@223912 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-18 19:24:43 +00:00
b234618b7d
Escape the builder name when archiving the layout test results.
...
Failing to do so leads to incorrect URLs being linked to in the
test results :).
TBR=ilevy@chromium.org
BUG=293928
Review URL: https://codereview.chromium.org/23496069
git-svn-id: http://src.chromium.org/svn/trunk/src/build@223803 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-18 05:13:10 +00:00
0cadafcd6a
Fix master name for uploading test results from android bots.
...
We need to pass the value "ChromiumWebKit" to test-results.appspot.com,
not "chromium.webkit". The non-Android bots get this string from
chromium_utils.GetActiveMaster(), but it's not obvious how to get this
in the build/android/buildot code, so I'm hard-coding it for now.
TBR=ilevy@chromium.org
BUG=293928
Review URL: https://codereview.chromium.org/23496068
git-svn-id: http://src.chromium.org/svn/trunk/src/build@223770 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-18 02:13:10 +00:00
d5c4ca89f3
Add links to results.html, zip file for Android layout test results.
...
TBR=mbulach@chromium.org , ilevy@chromium.org
BUG=289883
Review URL: https://codereview.chromium.org/23537061
git-svn-id: http://src.chromium.org/svn/trunk/src/build@223766 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-18 01:46:32 +00:00
5bfe67c8b4
[android] Remove deprecated package constants.
...
NOTE: Do not land before corresponding downstream patch.
BUG=260494
TEST=None
NOTRY=True
Review URL: https://chromiumcodereview.appspot.com/23811008
git-svn-id: http://src.chromium.org/svn/trunk/src/build@223670 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-17 20:17:08 +00:00
181fedbfd3
[Android] Make UploadCoverageData generic to upload any html artifact.
...
BUG=278634
R=cmp@chromium.org
Review URL: https://codereview.chromium.org/23591055
git-svn-id: http://src.chromium.org/svn/trunk/src/build@223643 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-17 18:32:12 +00:00
eee5a78441
[Android Buildbot] Install ContentShell.apk before running GPU tests.
...
BUG=256576
Review URL: https://chromiumcodereview.appspot.com/23936010
git-svn-id: http://src.chromium.org/svn/trunk/src/build@223230 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-14 05:36:25 +00:00
0a1fe589d1
Sigh. Adjust path to the *other* parameter to archive_layout_test_results.py.
...
This will hopefully be the last thing needed to actually make the
archiving of results for webkit_tests work on Android bots. This is
another follow-on to r222092.
TBR=ilevy@chromium.org
BUG=276076
Review URL: https://codereview.chromium.org/23684043
git-svn-id: http://src.chromium.org/svn/trunk/src/build@222109 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-09 22:25:52 +00:00
7cc2e57059
Fix path to bucket in googlestorage for archiving webkit_tests results.
...
TBR=ilevy@chromium.org
BUG=276076
Review URL: https://codereview.chromium.org/23621028
git-svn-id: http://src.chromium.org/svn/trunk/src/build@222092 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-09 21:21:25 +00:00
f25ed86da9
Attempt #3 at archiving the layout test results from the android bots.
...
This re-lands the changes in r220393 and r220374 (which were reverted in
r220434) with the change that we will upload to googlestorage rather than
attempting to scp the files across.
R=ilevy@chromium.org
BUG=276076
Review URL: https://chromiumcodereview.appspot.com/23455032
git-svn-id: http://src.chromium.org/svn/trunk/src/build@221909 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-07 07:18:14 +00:00
04584a083b
[Android Buildbot] Add a GPU builder cum tester.
...
BUG=256576
Review URL: https://chromiumcodereview.appspot.com/23601004
git-svn-id: http://src.chromium.org/svn/trunk/src/build@221610 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-09-06 06:42:24 +00:00
f954133c17
Stop trying to archive results from the bots on chromium.webkit android bots.
...
We need to switch to googlestorage first.
This change reverts r220393 and r220374.
TBR=ilevy@chromium.org
BUG=276076
Review URL: https://codereview.chromium.org/23647005
git-svn-id: http://src.chromium.org/svn/trunk/src/build@220434 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-29 23:43:30 +00:00
0ce20df6d5
Remove unneeded/unrecognized --target flag from archive_layout_tests wrapper.
...
TBR=ilevy@chromium.org
BUG=276076
Review URL: https://codereview.chromium.org/23444023
git-svn-id: http://src.chromium.org/svn/trunk/src/build@220393 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-29 22:03:52 +00:00
da95baee99
Re-land r22016 "Archive webkit_tests results on android bots if requested"
...
(With a fix; the prior version had the wrong path to the archive tool).
Original review was in https://codereview.chromium.org/22825016/ .
TBR=ilevy@chromium.org
BUG=276076
Review URL: https://codereview.chromium.org/23444021
git-svn-id: http://src.chromium.org/svn/trunk/src/build@220374 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-29 21:21:09 +00:00
c87e426d43
Revert 220166 "Archive webkit_tests results on android bots if r..."
...
Android bot throws an exception since this change.
< cat /b/build/slave/WebKit_Android__Nexus4_/build/src/out/Release/test_logs/unit_test.log
An instance of host heart beart running... will kill
Traceback (most recent call last):
File "build/android/buildbot/bb_device_steps.py", line 469, in <module>
sys.exit(main(sys.argv))
File "build/android/buildbot/bb_device_steps.py", line 465, in main
MainTestWrapper(options)
File "build/android/buildbot/bb_device_steps.py", line 402, in MainTestWrapper
bb_utils.RunSteps(options.test_filter, GetTestStepCmds(), options)
File "/b/build/slave/WebKit_Android__Nexus4_/build/src/build/android/buildbot/bb_utils.py", line 97, in RunSteps
cmd(options)
File "build/android/buildbot/bb_device_steps.py", line 257, in RunWebkitLayoutTests
'--builder-name', options.build_properties.get('buildername', '')])
File "/b/build/slave/WebKit_Android__Nexus4_/build/src/build/android/buildbot/bb_utils.py", line 56, in RunCmd
code = SpawnCmd(command, stdout, cwd).wait()
File "/b/build/slave/WebKit_Android__Nexus4_/build/src/build/android/buildbot/bb_utils.py", line 49, in SpawnCmd
return subprocess.Popen(command, cwd=cwd, stdout=stdout)
File "/usr/lib/python2.7/subprocess.py", line 679, in __init__
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1249, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
> Archive webkit_tests results on android bots if requested.
>
> R=ilevy@chromium.org , bulach@chromium.org , peter@chromium.org
> BUG=276076
>
> Review URL: https://chromiumcodereview.appspot.com/22825016
TBR=dpranke@chromium.org
Review URL: https://codereview.chromium.org/23601007
git-svn-id: http://src.chromium.org/svn/trunk/src/build@220210 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-29 05:15:30 +00:00
d604177c65
Archive webkit_tests results on android bots if requested.
...
R=ilevy@chromium.org , bulach@chromium.org , peter@chromium.org
BUG=276076
Review URL: https://chromiumcodereview.appspot.com/22825016
git-svn-id: http://src.chromium.org/svn/trunk/src/build@220166 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-29 03:08:32 +00:00
b9d1acba1a
[Android] Add a cleanup option to generate_emma_html.py.
...
This gets rid of any old *.em/*.ec files.
BUG=278365
NOTRY=True
Review URL: https://chromiumcodereview.appspot.com/23506003
git-svn-id: http://src.chromium.org/svn/trunk/src/build@219839 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-27 22:02:43 +00:00
b89f2a3e8d
[Android] Adds directory cleanup/creation for code coverage
...
NOTRY=True
BUG=
R=craigdh@chromium.org , ilevy@chromium.org
Review URL: https://codereview.chromium.org/23189022
git-svn-id: http://src.chromium.org/svn/trunk/src/build@219592 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-26 19:54:15 +00:00
c6f4e062f9
[Android] Add 'official_build' option for running an instrumentation suite.
...
BUG=249997
Review URL: https://chromiumcodereview.appspot.com/20545002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@219401 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-24 01:36:24 +00:00
c0a498bf16
Fixes TestContentProvider issues in AndroidWebView
...
NOTRY=True
BUG=278326
Review URL: https://chromiumcodereview.appspot.com/23346011
git-svn-id: http://src.chromium.org/svn/trunk/src/build@219347 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-23 21:42:04 +00:00
98292043d7
[Android] Fixes getting the revision from build_properties
...
NOTRY=True
BUG=255644
Review URL: https://chromiumcodereview.appspot.com/23361017
git-svn-id: http://src.chromium.org/svn/trunk/src/build@219223 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-23 05:27:08 +00:00
2ca47b2d70
[Android] Buildbot changes for EMMA code coverage
...
One piece of the overall java code coverage change.
See: https://codereview.chromium.org/20210002/
NOTRY=True
BUG=255644
Review URL: https://chromiumcodereview.appspot.com/23345003
git-svn-id: http://src.chromium.org/svn/trunk/src/build@219083 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-22 19:56:33 +00:00
64778e480a
[chromedriver] Run tests on stable and beta channel chrome.
...
BUG=274681
TEST=Ran locally
Review URL: https://chromiumcodereview.appspot.com/23125011
git-svn-id: http://src.chromium.org/svn/trunk/src/build@219079 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-22 19:46:02 +00:00
cf3268efe0
Make failing webkit_tests fail android build.
...
Now that r156332 has landed in theory, the webkit_tests step should pass
(since we're only running one test), and we should start trying to figure
out how reliable the bots actually are.
This change flips the bot config so that a failing webkit_tests step will
cause the build to be red. If this turns out to be premature, I'll revert
this change, but we should start gathering real data on what does and doesn't
work now.
R=ilevy@chromium.org , mbulach@chromium.org
BUG=232044
Review URL: https://chromiumcodereview.appspot.com/23242008
git-svn-id: http://src.chromium.org/svn/trunk/src/build@218489 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-20 14:36:59 +00:00
c641e3bc8f
Android: uses taskset when starting adb.
...
Workaround for some adb issues.
While at it, print the step name before doing any action.
BUG=268450
Review URL: https://chromiumcodereview.appspot.com/22857005
git-svn-id: http://src.chromium.org/svn/trunk/src/build@217959 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-16 07:22:16 +00:00
7d1c122e3b
[Android] Changes python_test_root to host-driven-root
...
NOTRY=True
BUG=271802
Review URL: https://chromiumcodereview.appspot.com/22982007
git-svn-id: http://src.chromium.org/svn/trunk/src/build@217587 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-14 18:09:08 +00:00
b452774040
Add WebRTC test configurations for Android testing.
...
BUG=webrtc:1882
TEST=From a recent WebRTC checkout:
source build/android/envsetup.sh
gclient runhooks
ninja -C out/Debug
build/android/run_test.py -s webrtc
I also successful ran builder and tester with the buildbot
configuration in https://codereview.chromium.org/17390019
using a locally patched checkout.
Review URL: https://chromiumcodereview.appspot.com/17466002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@216920 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-12 05:00:52 +00:00
db7c9d502b
Converts host driven tests to common test_dispatcher
...
Also renames several files in pylib/host_driven to match the general file
naming scheme.
This change will break existing host-driven tests downstream which are run
though scripts other than test_runner.
NOTRY=True
BUG=176323
Review URL: https://chromiumcodereview.appspot.com/19537004
git-svn-id: http://src.chromium.org/svn/trunk/src/build@215944 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-06 19:10:13 +00:00
a95cc35c5e
Put cleanup steps in finally block so cleanup happens after halt on failure.
...
The device_status_check hangs because there are still processes launched by the
buildbot script that are not cleaned up. E.g.
https://chromegw.corp.google.com/i/clank/builders/manta-sharded-official-perf-clankium/builds/2359
This makes sure the post commands are executed after halt on failure.
BUG=265578
Review URL: https://chromiumcodereview.appspot.com/21261006
git-svn-id: http://src.chromium.org/svn/trunk/src/build@215365 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-08-02 21:08:06 +00:00
1e6a6f874f
[Android] Dedup content_browsertests test setup from gtests.
...
- This also changes the command for running content_browsertests
to be in line with other gtest targets
- Additional cleanup: get rid of --exe option and fall back
to using exe if apk is not found
TEST=test_runner.py gtest -s content_browsertests
BUG=261950
R=bulach@chromium.org , craigdh@chromium.org
Review URL: https://codereview.chromium.org/20649002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@214421 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-07-30 20:14:36 +00:00
7fea276a3d
[android] Instumentation tests determine whether to install the test apk based on Md5Sum.
...
This deprecates the -I switch to instrumention tests.
BUG=260084
TEST=None
NOTRY=True
Review URL: https://chromiumcodereview.appspot.com/19799003
git-svn-id: http://src.chromium.org/svn/trunk/src/build@213956 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-07-26 18:31:20 +00:00
32797d4294
[Android Buildbot] Add option to run only host driven Python tests.
...
BUG=263624
NOTRY=True
Review URL: https://chromiumcodereview.appspot.com/20073002
git-svn-id: http://src.chromium.org/svn/trunk/src/build@213558 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-07-25 00:23:56 +00:00
3a46cf7cdf
[Android Buildbot] Make flakiness dashboard server configurable.
...
BUG=263071
NOTRY=True
Review URL: https://chromiumcodereview.appspot.com/19931004
git-svn-id: http://src.chromium.org/svn/trunk/src/build@213475 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
2013-07-24 18:41:58 +00:00
thakis@chromium.org
dpranke@chromium.org
skyostil@chromium.org
kjellander@chromium.org
navabi@google.com
bajones@chromium.org
sivachandra@chromium.org
craigdh@chromium.org
frankf@chromium.org
tkent@chromium.org
gkanwar@chromium.org
bulach@chromium.org