aboutsummaryrefslogtreecommitdiff
path: root/tcwg-buildfarm.yaml
AgeCommit message (Collapse)Author
2017-09-18tcwg-buildfarm: Workaround interference from --override option for ILP32.Maxim Kuvyrkov
The order of --extraconfigdir options is important to ABE, since it is processing them (and applying config changes) in order on the command line. Since TCWG jenkins jobs pass "--extraconfigdir ../config/gccN" in --override option, we need to position "$target_opt" after --override option to get "--extraconfigdir ../config/gccN --extraconfigdir ../config/ilp32-dev" instead of the other way around. Change-Id: I7d0db29e84671cc86a8917397c8b8045b946d706
2017-09-12tcwg-abe-test, tcwg-binutils, tcwg-buildfarm: Remove schroot support.Christophe Lyon
We don't use schroot anymore for these jobs. Change-Id: I5c1ceefcfa675f9259f4534e035ad8b4aa8d3719
2017-09-09tcwg-buildfarm: Clone jenkins-scripts repo using scm-git pluginMaxim Kuvyrkov
... to allow SHA1 specification for $scripts_branch. Change-Id: Ibd55421d4680add8649baf05e41d7adab56c0486
2017-09-09tcwg-buildfarm: Increase amount of RAM for qemu test containers.Maxim Kuvyrkov
QEMU VM get 2/3 of the container RAM allocation. With weight "2" this is 2/3 * (2 * 750MB) == ~1GB. Change-Id: I71a9221218ce4daaf488e41b944b7762c3343e24
2017-09-09tcwg-buildfarm: Use xenial distro for qemu containersMaxim Kuvyrkov
As mentioned in https://review.linaro.org/#/c/21330/, nfs-kernel-server does not install in trusty non-x86_64 containers. Therefore, xenial. Change-Id: I3370934181f33748383f9368422bbe5c96c85a68
2017-09-08tcwg-buildfarm: Fix again.Maxim Kuvyrkov
Change-Id: Ib124fdd7332793e4ed6778073c865819a8823024
2017-09-08tcwg-buildfarm: Fix ILP32 build.Maxim Kuvyrkov
Change-Id: I628a058367da17ebcbb218059f9b18ab5902dea8
2017-09-08tcwg-buildfarm: Enable aarch64-linux-gnu_ilp32 target.Maxim Kuvyrkov
Change-Id: I2003596c6dd74b6d3be2f3029b0729b27f4388ce
2017-06-06tcwg-*: Switch abe:stable to abe:tested.Yvan Roux
Change-Id: Idf5e3e4e69975b28a0643b5bb5947783367fcd76
2017-05-04tcwg-*: Switch all matrix and multijob jobs to tcwg-coordinatorMaxim Kuvyrkov
This change makes all TCWG matrix and multijob "coordination" jobs to run on tcwg-coordinator label. The "coordination" jobs do not consume significant resources and just wait for other jobs to finish. In case of matrix jobs these are "flyweight" jobs, and all TCWG multijobs behave similarly. Another benefit from this change is that git checkouts for "coordination" jobs will no longer be mixed with workspaces of matrix sub-builds of the same jobs, if sub-builds happen to start on the same node as coordination job. This has been auto-generated with the following script $ cat > tcwg-coordinator.sh <<EOF for f in tcwg-*.yaml; do type=$(grep "project-type" $f | sed -e "s/.*: //") case $f in tcwg-bkk16-buildfarm-benchmark.yaml) continue ;; esac case $type in freestyle) continue ;; matrix|multijob) sed -e "s/ node:.*/ node: tcwg-coordinator/" -i $f ;; *) echo "ERROR: Wrong job type: $type"; exit 1 ;; esac done EOF Change-Id: I216abbf903537da2c2bfd3f6d5a1fbf6b8fe4877
2017-05-03tcwg-buildfarm: Fix cleanup warning about missing test_container_stopMaxim Kuvyrkov
... by using new functions to stop/cleanup all created containers. Change-Id: Ib425bc552feacc61d9289c2ccb89f3a81b3c792c
2017-05-03tcwg-buildfarm: Cleanup workspace on success.Yvan Roux
Change-Id: I9d4d6a6381df5171d2e1867e8cb60a1036f5d566
2017-04-26tcwg-buildfarm: Stop containers for failed buildsMaxim Kuvyrkov
... rather then keep them running. Running containers consume resources, and, for tcwg-*-test nodes, can skew board usage statistic, which print_node_with_least_containers relies on. Change-Id: I79bee15e59897ec49ce33c1fbcd00a071d010360
2017-04-25Revert "Revert "tcwg-buildfarm: remove use of find.""Charles Baylis
This reverts commit a2ea910538bd40ca40b954993c48d7d6012dd174, and reinstates commit f0fcf93947626bba8e4485ff740afef07a29931b. Change-Id: Idec70c918874cf6a0f949a43f45d744843d3af6b
2017-04-25tcwg-abe-extended, tcwg-buildfarm: Simplify handling of build and test ↵Maxim Kuvyrkov
containers Switch tcwg-abe-extended to use docker containers for build and cross-test. Simplify hanlding of containers in tcwg-buildfarm to avoid increasing complexity of tcwg-abe-extended. Change-Id: I09c4fa6d024b25f66495ef9ee81b46c7382cc5c2
2017-04-25tcwg-buildfarm: Update to match jenkins.shMaxim Kuvyrkov
Change-Id: I9565b6a37fa1c70e10a90b8ac05a9cf30fb3fcd1
2017-04-20tcwg-buildfarm: Update to use v2 interface for container use / cleanupMaxim Kuvyrkov
Change-Id: I6edd36cbaa0c900758f2a3579f51005772fc89e5
2017-04-20tcwg-*: Remove ssh-agent workaroundMaxim Kuvyrkov
Change-Id: Ia54509e922fcf067897833133f40eb4a8c75d0ae
2017-04-20tcwg-buildfarm: Simplify handling of runtest.Maxim Kuvyrkov
Change-Id: I591d063a0f4badc3ad18653e84b891d53049ccba
2017-04-20tcwg-buildfarm: Move code to jenkins-helpers.shMaxim Kuvyrkov
Change-Id: I96700922c912509674b5e5a90a1d66c8290899d9
2017-04-19tcwg-bkk16-trigger-extended-native, tcwg-buildfarm: Restore defaultsMaxim Kuvyrkov
... after the recent rework of tcwg-buildfarm. Change-Id: I39abe7a1f90e794b1a266101ef9a0f7d6096e3f1
2017-04-19tcwg-buildfarm: Try another filterMaxim Kuvyrkov
Change-Id: I41a4f61e99030ac43039e2ec4f7c374f3dca974d
2017-04-19tcwg-buildfarm: And another combination-filterMaxim Kuvyrkov
Change-Id: Iddacc31b9a8c1a4a4a1ff400c5a4f3174b92652e
2017-04-19tcwg-buildfarm: Try another combination-filterMaxim Kuvyrkov
Change-Id: I56e721636f5bf1c59499b2bb846a07157f026746
2017-04-19tcwg-buildfarm: Fix combination-filterMaxim Kuvyrkov
Change-Id: Ia8e59c1482ab183b6f89af690250314d1c659ad7
2017-04-19tcwg-buildfarm: Fix a typoMaxim Kuvyrkov
Change-Id: Ic9ce163db191c9f4052e1c82e1ed81ec4d48275a
2017-04-19tcwg-buildfarm: Rework to use dynamic slave and target axes.Maxim Kuvyrkov
Change-Id: Ib5571449544f8c451a780a7947cca5781273d590
2017-04-19tcwg-buildfarm: Fix typo.Maxim Kuvyrkov
Change-Id: Ifa0e2e6b28b2b0fb030f06602547cf94234c8809
2017-04-19tcwg-buildfarm: Remove workaround for aarch64-linux-gnu 48-bit VA testingMaxim Kuvyrkov
We no longer need it as we are testing on TX1s, which run 42-bit VA. Change-Id: I9a1d092d4c7a046c392a5bababe597dcd57746ff
2017-04-19tcwg-buildfarm: Move code to jenkins-helpers.shMaxim Kuvyrkov
Change-Id: I547af54ef702f7d950422f873128a5543f2135c4
2017-04-18tcwg-buildfarm: Restore tcwg-buidslave credentials with ssh-agent pluginChristophe Lyon
No ssh-agent is started otherwise, since we now call start-container-docker.sh with --no-ssh-agent, which makes the build fail. Change-Id: I3eb25eaa5d3d0093b18bf1fe911a489a5c62b443
2017-04-18tcwg-buildfarm: Call start-container-docker.sh with --no-ssh-agent.Christophe Lyon
Since Jenkins' ssh-agent plugin was updated, we hope that this workaround is not needed anymore. Try with this option before actually removing the workaround from start-container-docker.sh itself. The expected impact is on tk1/tx1 slaves. Other jobs could use the same flag, but let's try with this one first. Change-Id: I48a0b2d3cf37e5ea70d76dcc51191befec43b601
2017-04-18tcwg-*: Update names of tcwg-aarch64-* nodes and labelsMaxim Kuvyrkov
tcwg-aarch64-build-01 -> tcwg-apm-01 tcwg-aarch64-build-02 -> tcwg-apm-02 tcwg-aarch64-test-01 -> tcwg-apm-03 tcwg-aarch64-test-02 -> tcwg-apm-04 tcwg-aarch64-build -> tcwg-apm_64-build tcwg-aarch64-test -> tcwg-apm_64-test Change-Id: Ibf77b821efa7fd83e4240b09419510d3a1fdd6eb
2017-04-14Revert "tcwg-buildfarm: remove use of find."Maxim Kuvyrkov
This reverts commit f0fcf93947626bba8e4485ff740afef07a29931b. Change-Id: I534719914c6fd480cd24b265fd056062a3c4b258
2017-04-14tcwg-buildfarm: remove use of find.Charles Baylis
Use the artifact lists which are created by jenkins.sh to eliminate the need to use 'find' to determine the location of the manifest. Change-Id: I7430458d45ae3e718e722f682dc39cb5c27a55c7
2017-04-11tcwg-buildfarm: Add displaytag parameter.Christophe Lyon
The goal is to make it easier to understand what a buildfarm run is related to in the Jenkins dashboard. tcwg-backport-multijob, tcwg-backport, tcwg-bkk16-trigger-extended, tcwg-buildfarm-cmp, tcwg-buildfarm-startcontainer, tcwg-regression-detection, tcwg-trigger-gcc-linaro-5, tcwg-trigger-gcc-linaro-6, tcwg-trigger-gcc-trunk-ubsan, tcwg-upstream-monitoring: Set the new parameter. Change-Id: Ib123aeca2365606df113a0756a3304be19a39e68
2017-04-11tcwg-buildfarm: Do not remove containers if the build failed.Christophe Lyon
So that we can investigate the causes of failure. Change-Id: Id38b7368267d5bb104825053e588f144221ad65f
2017-03-22tcwg-abe-extended: Replace label tcwg-x86_64-cam with tcwg-x86_64-build.Christophe Lyon
This is the new label we should use. A side effect of this change is that we'll stop using build-0[16] which do not belong to the new label. We plan to repurpose/deprecate these builders. tcwg-abe-extended/builders.sh: Likewise. tcwg-abe-manifest-test: Likewise. tcwg-abe-test-gerrit-cambridge-christophe: Likewise. tcwg-abe-test-gerrit-cambridge: Likewise. tcwg-abe-test-yvan: Likewise. tcwg-backup-files: Likewise. tcwg-binutils-docker: Likewise. tcwg-binutils: Likewise. tcwg-bkk16-buildfarm-benchmark-christophe: Likewise. tcwg-bkk16-buildfarm-benchmark: Likewise. tcwg-bkk16-buildfarm: Likewise. tcwg-bkk16-trigger-extended: Likewise. tcwg-buildapp: Likewise. tcwg-buildbench: Likewise. tcwg-buildfarm-christophe: Likewise. tcwg-buildfarm-cmp: Likewise. tcwg-buildfarm-maxim: Likewise. tcwg-buildfarm-startcontainer: Likewise. tcwg-buildfarm: Likewise. tcwg-cleanup-stale-containers: Likewise. tcwg-cleanup-stale-dormant-containers: Likewise. tcwg-cleanup-stale-schroot-sessions: Likewise. tcwg-cleanup-stale-tcwg-test-schroot-sessions: Likewise. tcwg-cleanup-stale-workspaces: Likewise. tcwg-container-christophe: Likewise. tcwg-gcc-bisect: Likewise. tcwg-gcc-idle: Likewise. tcwg-llvm-build-christophe: Likewise. tcwg-llvm-build: Likewise. tcwg-make-release-christophe: Likewise. tcwg-make-release: Likewise. tcwg-race-bernie: Likewise. tcwg-test-release-christophe: Likewise. tcwg-validate-abetests: Likewise. Change-Id: I37601fcb7a2a39e17ac6594185995fbbc8f5bbab
2017-03-21tcwg-buildfarm: Update description of targets field.Christophe Lyon
Replace native_armv8 with "native_aarch32 native_aarch64". tcwg-backport-multijob: Likewise. tcwg-buildfarm-cmp: Likewise. tcwg-buildfarm-startcontainer: Likewise. Change-Id: I99961ebb39952c28bd094413b30f53c896196ae5
2017-03-17tcwg-buildfarm: Merge with tcwg-buildfarm-startcontainer.Christophe Lyon
Use the start-container-* scripts to start the build container in the job, instead of relying on jenkins. When relevant, start a (remote) test container. tcwg-bkk16-trigger-extended, tcwg-buildfarm-cmp: update matrix restriction to use the new label names used by tcwg-buildfarm Change-Id: Ib367df525846a81c688d92ab7106768d5de0fcd5
2017-02-17tcwg-buildfarm: Use jenkins.sh from jenkins-scripts repo.Christophe Lyon
tcwg-abe-test-gerrit-cambridge: Likewise. tcwg-bkk16-buildfarm-benchmark: Likewise. Change-Id: Ibb9e1b98181394d7c455b3c5f3f558d700c5328b
2016-12-20tcwg-buildfarm: Workaround docker service hang on test-armv8-02.tcwglabMaxim Kuvyrkov
Fallback to test-armv8-01.tcwglab while https://projects.linaro.org/browse/TICKET-591 is being investigated. Change-Id: Ib4445dd849cced3c9be68a8a182b9f6df62d06e0
2016-12-02tcwg-buildfarm, tcwg-buildfarm-maxim: Update abe-extraconfigs path.Christophe Lyon
The abe-extraconfigs.git repo moved, so update the jobs that use it. Change-Id: If98711482e5aec891afc04ef5eedd4098c639e1f
2016-11-17Revert "tcwg-buildfarm: Workaround docker startup issues on ci.l.o."Maxim Kuvyrkov
This reverts commit 4aead62c2983bdcb487debcd39c132251415a5ee. Change-Id: I54ecfab3122e63766effb07d87295da645662f9c
2016-11-15tcwg-buildfarm: Workaround docker startup issues on ci.l.o.Maxim Kuvyrkov
Change-Id: If3bdcfb31f88f851f8ef98fed12228af273e6760
2016-11-15tcwg-buildfarm: Silence harmless error messageMaxim Kuvyrkov
PXZ can fail sometimes in 32-bit environments due to lack of RAM / VA space. Don't output error (that we handle) to the logs. Change-Id: Ib6aa5de9fa81d9a319e438e02eeea2be5a77def2
2016-11-08tcwg-buildfarm: Update from tcwg-buildfarm-maximMaxim Kuvyrkov
This is a major update to switch buildfarm to docker. Builds are done in docker containers. Cross-tests are done on test-armv8-01.tcwglab for gcc-5 (and, temporarily, aarch64-linux-gnu gcc-6), and inside container on test-armv8-02.tcwglab for aarch32 linux toolchains. The updates to tcwg-backport-multijob.yaml and tcwg-bkk16-trigger-extended.yaml jobs preserve intended semantics of build matrix configuration. Change-Id: I9bd024ac988dc883ce80e637fb124fcc3c04c8b4
2016-10-17tcwg-buildfarm: Increase NumToKeep to 100.Christophe Lyon
Change-Id: I4fc46911770fff1c80218bd09ae577a40ba1c9f2
2016-10-14tcwg-*: Use build-discarder instead of logrotate.Christophe Lyon
Change-Id: I864b319706660d9fef1daa7b213c5488a7039d8e
2016-09-01tcwg-buildfarm: Fix combination filter.Yvan Roux
Change-Id: I22514722196e4ba16abb5fa934120f47cf29e8cd