Automated Testing

This page has information about issues and initiatives for automated testing of embedded Linux.

As of November 2018, there are a number of automated testing frameworks and tools for Linux.

= Test Systems = See the Test Systems page for information about different test systems and frameworks for Linux.

In Fall of 2018, there was a Test Stack Survey conducted, which tried to characterize the features, attributes and terminology of several different test systems. Please see the responses on that page for some information about the different systems.

= Board Farms = See the Board Farm page for information about hardware and software related to running and managing a collection of devices being tested.

= Working Groups = Working Groups are self-formed groups to solve specific goals. Joining a WG is open to anyone interested in the topic.

= Test Standards = We have a Test Glossary under development.

See also Test Standards for a list of different areas of standardization for testing.

= Our community = The only online points of coordination between different test frameworks that I am aware of is this wiki and the following e-mail list:

Mailing list
Discussions on this topic held on the "Automated Testing" mailing list of the Yocto Project
 * See https://lists.yoctoproject.org/listinfo/automated-testing

Conference call
We hold a conference call meeting monthly, on the second Thursday of each month, at 2:00 pm BST, 6:00 am Pacific Daylight time. It is open to all interested parties.

Meeting minutes:

This google doc covers the meetings from 2019-08-08 and onwards.

This google doc covers all meetings up to 2019-07-11.

These are available for all to comment.

Dial-in information: Join Zoom Meeting:

https://zoom.us/j/757476323

Meeting ID: 757 476 323

Find your local number: https://zoom.us/u/a5pAkeO9S

One tap mobile: +17207072699,,757476323# US  +16465588656,,757476323# US (New York)

If you want a formal invitation or have any issues with the conference call, please contact: Maria Högberg 

Automated Testing Summit 2018 (ELCE 2018/OSSE 2018)
The first event specifically dedicated to automated testing of Linux was the Automated Testing Summit 2018 (ATS), held for the first time in October of 2018. This was co-located with Embedded Linux Conference Europe and Open Source Summit Europe, held in Edinburgh Scotland.

FOSDEM 2019
Some people are planning to do an unofficial meeting at FOSDEM 2019.

Linaro Connect 2019 meeting
There was a Testing microsummit at Linaro Connect 2019 in Bangkok. The microsummit was held April 4, 2019. See the link for some of the items discussed.

Plumbers 2019 Testing and Fuzzing microconference
There are plans to hold a testing and fuzzing microconference at Plumbers 2019, in Lisbon Portugal in September.

Automated Testing Summit (ATS) 2019
We hope to have another event in Lyon, France, in October of 2019. Please see Automated Testing Summit 2019 for the planning page for that event.

= More information = Presentations and other resources are available on the Testing page.