Difference between revisions of "Test definition files Note"

From eLinux.org
Jump to: navigation, search
 
(17 intermediate revisions by the same user not shown)
Line 3: Line 3:
 
!description
 
!description
 
!Fuego
 
!Fuego
!Linaro
+
!Linaro/LAVA
 
!Yocto
 
!Yocto
!0day
+
!0day !! CKI
!CKI
 
!LAVA
 
 
!Jenkins
 
!Jenkins
 
!SLAV
 
!SLAV
Line 14: Line 12:
 
|shell variables, lines or functions
 
|shell variables, lines or functions
 
|yes - fuego_test.sh
 
|yes - fuego_test.sh
|yes
+
|yes - busybox.sh
|yes
 
|yes - iozone
 
|yes
 
|yes - in config.xml
 
|?
 
|-
 
|makefile (language)
 
|language interpreted by Make
 
|no
 
|no
 
|no
 
|no
 
|yes - Makefile
 
|no
 
 
|no
 
|no
 +
|yes - tests/iozone, pack/iozone, pkg/iozone/PKGBUILD || yes - runtest.sh
 +
|yes - inside config.xml
 
|no?
 
|no?
 
|-
 
|-
Line 36: Line 22:
 
|yes - test.yaml
 
|yes - test.yaml
 
|yes - busybox.yaml
 
|yes - busybox.yaml
|?
+
|no
|yes - iozone.yaml
+
|yes - jobs/iozone.yaml || no
|C?
+
|no
|?
+
|yes? - libteec.yml, test1.yml?
|?
 
|?
 
 
|-
 
|-
 
|json
 
|json
Line 47: Line 31:
 
|yes - spec.json, pass_criteria.json, run.json
 
|yes - spec.json, pass_criteria.json, run.json
 
|no
 
|no
|?
+
|rarely? - manual/kernel-dev.json (has metadata), testresults.json (has analysis string mapping?)
|?
+
|no                    || no
|C?
+
|no
|?
+
|no?
|?
 
|?
 
 
|-
 
|-
 
|xml
 
|xml
Line 59: Line 41:
 
|no
 
|no
 
|no
 
|no
 +
|no                    || no
 +
|yes - config.xml
 +
|no
 +
|-
 +
|python
 +
|python code or fragments
 +
|yes - parser.py
 +
|rarely - gst_validate_lava_parse.py
 +
|yes - buildlzip.py
 +
|no                    || sometimes - 3.10.0-0.py
 +
|no
 +
|no
 +
|-
 +
|ruby
 +
|ruby language
 +
|no
 +
|no
 +
|no
 +
|yes - stat/netperf    || no
 +
|no
 +
|no
 +
|-
 +
|makefile (language)
 +
|language interpreted by Make
 +
|no
 +
|no
 +
|no
 +
|no                    || yes - Makefile
 +
|no
 +
|no
 +
|-
 +
|custom
 +
|custom file format or configuration language
 +
|rarely - reference.log
 +
|no?
 +
|no?
 +
|no                    || yes - PURPOSE, README.md?
 +
|yes - pipelines (declarative language)
 
|no?
 
|no?
|Cno?
+
|-
 +
|other
 +
| some other file format or language
 +
|no
 +
|no
 +
|no
 +
|no                    || no
 +
|yes - groovy?
 +
|yes - go, haskell
 +
|}
 +
 
 +
 
 +
== Condensed table ==
 +
{| class="wikitable"
 +
!File type
 +
!description
 +
!Fuego
 +
!Linaro/LAVA
 +
!Yocto
 +
!0day !! CKI
 +
!Jenkins
 +
!SLAV
 +
|-
 +
|shell script or shell snippet
 +
|shell variables, lines or functions
 +
|yes
 +
|yes
 +
|no
 +
|yes                  || yes
 +
|yes
 +
|no
 +
|-
 +
|yaml
 +
|Yet another markup language
 +
|yes
 +
|yes
 +
|no
 +
|yes                    || no
 +
|no
 +
|yes
 +
|-
 +
|json
 +
|Javascript object notation
 +
|yes
 +
|no
 +
|rarely
 +
|no                    || no
 
|no
 
|no
|yes - config.xml
 
 
|no
 
|no
 
|-
 
|-
 
|python
 
|python
 
|python code or fragments
 
|python code or fragments
|yes - parser.py
+
|yes
 +
|rarely
 +
|yes
 +
|no                    || rarely
 +
|no
 
|no
 
|no
|yes - <testname>.py
 
|?
 
|C?
 
|?
 
|?
 
|?
 
 
|-
 
|-
 
|custom
 
|custom
 
|custom file format or configuration language
 
|custom file format or configuration language
|yes - reference.log, base-board.fuegoclass
+
|no
|?
+
|no
|?
+
|no
|?
+
|no                    || yes
|C?
+
|yes
|?
+
|no
|?
+
|-
|?
+
|other
 +
| some other file format or language
 +
|no
 +
|no
 +
|no
 +
|ruby                    || make
 +
|xml, pipeline language, groovy
 +
|go, haskell
 
|}
 
|}

Latest revision as of 14:16, 14 October 2019

File type description Fuego Linaro/LAVA Yocto 0day CKI Jenkins SLAV
shell script or shell snippet shell variables, lines or functions yes - fuego_test.sh yes - busybox.sh no yes - tests/iozone, pack/iozone, pkg/iozone/PKGBUILD yes - runtest.sh yes - inside config.xml no?
yaml Yet another markup language yes - test.yaml yes - busybox.yaml no yes - jobs/iozone.yaml no no yes? - libteec.yml, test1.yml?
json Javascript object notation yes - spec.json, pass_criteria.json, run.json no rarely? - manual/kernel-dev.json (has metadata), testresults.json (has analysis string mapping?) no no no no?
xml eXtensible Markup Language no no no no no yes - config.xml no
python python code or fragments yes - parser.py rarely - gst_validate_lava_parse.py yes - buildlzip.py no sometimes - 3.10.0-0.py no no
ruby ruby language no no no yes - stat/netperf no no no
makefile (language) language interpreted by Make no no no no yes - Makefile no no
custom custom file format or configuration language rarely - reference.log no? no? no yes - PURPOSE, README.md? yes - pipelines (declarative language) no?
other some other file format or language no no no no no yes - groovy? yes - go, haskell


Condensed table

File type description Fuego Linaro/LAVA Yocto 0day CKI Jenkins SLAV
shell script or shell snippet shell variables, lines or functions yes yes no yes yes yes no
yaml Yet another markup language yes yes no yes no no yes
json Javascript object notation yes no rarely no no no no
python python code or fragments yes rarely yes no rarely no no
custom custom file format or configuration language no no no no yes yes no
other some other file format or language no no no ruby make xml, pipeline language, groovy go, haskell