Difference between revisions of "Test definition files Note"
(14 intermediate revisions by the same user not shown) | |||
Line 3: | Line 3: | ||
!description | !description | ||
!Fuego | !Fuego | ||
− | !Linaro | + | !Linaro/LAVA |
!Yocto | !Yocto | ||
− | !0day | + | !0day !! CKI |
− | !CKI | ||
− | |||
!Jenkins | !Jenkins | ||
!SLAV | !SLAV | ||
Line 14: | Line 12: | ||
|shell variables, lines or functions | |shell variables, lines or functions | ||
|yes - fuego_test.sh | |yes - fuego_test.sh | ||
− | + | |yes - busybox.sh | |
− | |||
− | |yes - | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
|no | |no | ||
+ | |yes - tests/iozone, pack/iozone, pkg/iozone/PKGBUILD || yes - runtest.sh | ||
+ | |yes - inside config.xml | ||
|no? | |no? | ||
|- | |- | ||
Line 36: | Line 22: | ||
|yes - test.yaml | |yes - test.yaml | ||
|yes - busybox.yaml | |yes - busybox.yaml | ||
− | | | + | |no |
− | |yes - iozone.yaml | + | |yes - jobs/iozone.yaml || no |
− | | | + | |no |
− | | | + | |yes? - libteec.yml, test1.yml? |
− | |? | ||
− | |||
|- | |- | ||
|json | |json | ||
Line 48: | Line 32: | ||
|no | |no | ||
|rarely? - manual/kernel-dev.json (has metadata), testresults.json (has analysis string mapping?) | |rarely? - manual/kernel-dev.json (has metadata), testresults.json (has analysis string mapping?) | ||
− | | | + | |no || no |
− | | | + | |no |
− | | | + | |no? |
− | | | ||
− | |? | ||
|- | |- | ||
|xml | |xml | ||
Line 59: | Line 41: | ||
|no | |no | ||
|no | |no | ||
− | |no | + | |no || no |
− | | | ||
− | |no | ||
|yes - config.xml | |yes - config.xml | ||
|no | |no | ||
Line 69: | Line 49: | ||
|yes - parser.py | |yes - parser.py | ||
|rarely - gst_validate_lava_parse.py | |rarely - gst_validate_lava_parse.py | ||
− | |yes - | + | |yes - buildlzip.py |
− | | | + | |no || sometimes - 3.10.0-0.py |
− | | | + | |no |
− | | | + | |no |
− | | | + | |- |
− | | | + | |ruby |
+ | |ruby language | ||
+ | |no | ||
+ | |no | ||
+ | |no | ||
+ | |yes - stat/netperf || no | ||
+ | |no | ||
+ | |no | ||
+ | |- | ||
+ | |makefile (language) | ||
+ | |language interpreted by Make | ||
+ | |no | ||
+ | |no | ||
+ | |no | ||
+ | |no || yes - Makefile | ||
+ | |no | ||
+ | |no | ||
|- | |- | ||
|custom | |custom | ||
|custom file format or configuration language | |custom file format or configuration language | ||
|rarely - reference.log | |rarely - reference.log | ||
− | |? | + | |no? |
− | |? | + | |no? |
− | |? | + | |no || yes - PURPOSE, README.md? |
− | | | + | |yes - pipelines (declarative language) |
− | |? | + | |no? |
− | | | + | |- |
− | | | + | |other |
+ | | some other file format or language | ||
+ | |no | ||
+ | |no | ||
+ | |no | ||
+ | |no || no | ||
+ | |yes - groovy? | ||
+ | |yes - go, haskell | ||
+ | |} | ||
+ | |||
+ | |||
+ | == Condensed table == | ||
+ | {| class="wikitable" | ||
+ | !File type | ||
+ | !description | ||
+ | !Fuego | ||
+ | !Linaro/LAVA | ||
+ | !Yocto | ||
+ | !0day !! CKI | ||
+ | !Jenkins | ||
+ | !SLAV | ||
+ | |- | ||
+ | |shell script or shell snippet | ||
+ | |shell variables, lines or functions | ||
+ | |yes | ||
+ | |yes | ||
+ | |no | ||
+ | |yes || yes | ||
+ | |yes | ||
+ | |no | ||
+ | |- | ||
+ | |yaml | ||
+ | |Yet another markup language | ||
+ | |yes | ||
+ | |yes | ||
+ | |no | ||
+ | |yes || no | ||
+ | |no | ||
+ | |yes | ||
+ | |- | ||
+ | |json | ||
+ | |Javascript object notation | ||
+ | |yes | ||
+ | |no | ||
+ | |rarely | ||
+ | |no || no | ||
+ | |no | ||
+ | |no | ||
+ | |- | ||
+ | |python | ||
+ | |python code or fragments | ||
+ | |yes | ||
+ | |rarely | ||
+ | |yes | ||
+ | |no || rarely | ||
+ | |no | ||
+ | |no | ||
+ | |- | ||
+ | |custom | ||
+ | |custom file format or configuration language | ||
+ | |no | ||
+ | |no | ||
+ | |no | ||
+ | |no || yes | ||
+ | |yes | ||
+ | |no | ||
+ | |- | ||
+ | |other | ||
+ | | some other file format or language | ||
+ | |no | ||
+ | |no | ||
+ | |no | ||
+ | |ruby || make | ||
+ | |xml, pipeline language, groovy | ||
+ | |go, haskell | ||
|} | |} |
Latest revision as of 15:16, 14 October 2019
File type | description | Fuego | Linaro/LAVA | Yocto | 0day | CKI | Jenkins | SLAV |
---|---|---|---|---|---|---|---|---|
shell script or shell snippet | shell variables, lines or functions | yes - fuego_test.sh | yes - busybox.sh | no | yes - tests/iozone, pack/iozone, pkg/iozone/PKGBUILD | yes - runtest.sh | yes - inside config.xml | no? |
yaml | Yet another markup language | yes - test.yaml | yes - busybox.yaml | no | yes - jobs/iozone.yaml | no | no | yes? - libteec.yml, test1.yml? |
json | Javascript object notation | yes - spec.json, pass_criteria.json, run.json | no | rarely? - manual/kernel-dev.json (has metadata), testresults.json (has analysis string mapping?) | no | no | no | no? |
xml | eXtensible Markup Language | no | no | no | no | no | yes - config.xml | no |
python | python code or fragments | yes - parser.py | rarely - gst_validate_lava_parse.py | yes - buildlzip.py | no | sometimes - 3.10.0-0.py | no | no |
ruby | ruby language | no | no | no | yes - stat/netperf | no | no | no |
makefile (language) | language interpreted by Make | no | no | no | no | yes - Makefile | no | no |
custom | custom file format or configuration language | rarely - reference.log | no? | no? | no | yes - PURPOSE, README.md? | yes - pipelines (declarative language) | no? |
other | some other file format or language | no | no | no | no | no | yes - groovy? | yes - go, haskell |
Condensed table
File type | description | Fuego | Linaro/LAVA | Yocto | 0day | CKI | Jenkins | SLAV |
---|---|---|---|---|---|---|---|---|
shell script or shell snippet | shell variables, lines or functions | yes | yes | no | yes | yes | yes | no |
yaml | Yet another markup language | yes | yes | no | yes | no | no | yes |
json | Javascript object notation | yes | no | rarely | no | no | no | no |
python | python code or fragments | yes | rarely | yes | no | rarely | no | no |
custom | custom file format or configuration language | no | no | no | no | yes | yes | no |
other | some other file format or language | no | no | no | ruby | make | xml, pipeline language, groovy | go, haskell |