Difference between revisions of "Automated Testing"

From eLinux.org
Jump to: navigation, search
(Adding details for the monthly conference call.)
(Conference call: simplify minutes link)
(22 intermediate revisions by 3 users not shown)
Line 29: Line 29:
 
== Mailing list ==
 
== Mailing list ==
 
Discussions on this topic held on the "Automated Testing" mailing list of the Yocto Project
 
Discussions on this topic held on the "Automated Testing" mailing list of the Yocto Project
* See https://lists.yoctoproject.org/listinfo/automated-testing
+
* See https://lists.yoctoproject.org/g/automated-testing
 +
 
 +
To send an e-mail to the list, send it to [mailto:automated-testing@lists.yoctoproject.org automated-testing@lists.yoctoproject.org]
  
 
== Conference call ==
 
== Conference call ==
We hold a conference call meeting monthly, on the second Thursday of each month, at 2:00 pm BST,
+
We hold a conference call meeting monthly, on the second Thursday of each month, at 15:00 UTC time. Join using your computer: https://zoom.us/j/757476323 Meeting ID: 757 476 323 or find your local number: https://zoom.us/u/a5pAkeO9S If you want to be invited, please contact <anmar (at) linaro.org>. It's open to all.
8:00 am Pacific Daylight time. It is open to all interested parties.
 
 
 
Dial-in information:
 
 
 
Join Zoom Meeting:
 
https://zoom.us/j/757476323
 
 
 
Meeting ID: 757 476 323
 
 
 
Find your local number: https://zoom.us/u/a5pAkeO9S
 
  
One tap mobile:
+
Minutes for all calls are in a single Google doc:
  +17207072699,,757476323# US
+
* https://docs.google.com/document/d/1VgyvwSiIJS1BhoKgu_XF10caMhin8yrakH1sSGgr178
  +16465588656,,757476323# US (New York)
 
  
If you want a formal invitation or have any issues with the conference call, please contact:
+
See sections inside the document for the minutes for particular weeks.
Maria Högberg <maria.hogberg (at) linaro.org>
 
  
 
== Events ==
 
== Events ==
Line 55: Line 45:
 
=== Automated Testing Summit 2018 (ELCE 2018/OSSE 2018) ===
 
=== Automated Testing Summit 2018 (ELCE 2018/OSSE 2018) ===
 
The first event specifically dedicated to automated testing of Linux was the
 
The first event specifically dedicated to automated testing of Linux was the
[[Automated Testing Summit]] (ATS), held for the first time in October of 2018.
+
[[Automated Testing Summit 2018]] (ATS), held for the first time in October of 2018.
 
This was co-located with Embedded Linux Conference Europe and Open Source Summit Europe,
 
This was co-located with Embedded Linux Conference Europe and Open Source Summit Europe,
 
held in Edinburgh Scotland.
 
held in Edinburgh Scotland.
Line 62: Line 52:
 
Some people are planning to do an [[Automated_Testing_FOSDEM2019|unofficial meeting]] at FOSDEM 2019.
 
Some people are planning to do an [[Automated_Testing_FOSDEM2019|unofficial meeting]] at FOSDEM 2019.
  
=== ELC-E 2019 ===
+
=== Linaro Connect 2019 meeting ===
We hope to have another event in Lyon, France, in October of 2019.
+
There was a [[Automated_Testing_microsummit_Linaro_Connect_BKK19|Testing microsummit at Linaro Connect 2019]] in Bangkok.
 +
The microsummit was held April 4, 2019. See the link for some of the items discussed.
 +
 
 +
=== Plumbers 2019 Testing and Fuzzing microconference ===
 +
There are plans to hold a testing and fuzzing microconference at Plumbers 2019, in Lisbon Portugal in September.
 +
 
 +
=== CKI Hackfest ===
 +
There was a meeting with representatives from several CI frameworks in Lisbon, Portugal on September 12 and 13.
 +
The meeting was hosted by RedHat.  Meeting agenda is at: https://cki-project.org/posts/hackfest-agenda/
 +
Meeting notes are [https://docs.google.com/document/d/1EIU-GEJpChfB2TLzi3ebXQqUnXQ1CQ2gyl48FE-dfQI/edit?usp=sharing here]
 +
 
 +
=== Automated Testing Summit (ATS) 2019 ===
 +
We are having our second Automated Testing Summit in Lyon, France on October 31st, 2019.
 +
 
 +
Please see the [https://events.linuxfoundation.org/events/ats-2019/ Linux Foundation Event page] for details.
 +
 
 +
This page: [[Automated Testing Summit 2019]] was used for some of the planning for that event.
  
 
= More information =
 
= More information =
 
Presentations and other resources are available on the [[Testing]] page.
 
Presentations and other resources are available on the [[Testing]] page.

Revision as of 05:51, 13 May 2021

This page has information about issues and initiatives for automated testing of embedded Linux.

As of November 2018, there are a number of automated testing frameworks and tools for Linux.

Test Systems

See the Test Systems page for information about different test systems and frameworks for Linux.

In Fall of 2018, there was a Test Stack Survey conducted, which tried to characterize the features, attributes and terminology of several different test systems. Please see the responses on that page for some information about the different systems.

Board Farms

See the Board Farm page for information about hardware and software related to running and managing a collection of devices being tested.

Working Groups

Working Groups are self-formed groups to solve specific goals. Joining a WG is open to anyone interested in the topic.

Test Standards

We have a Test Glossary under development.

See also Test Standards for a list of different areas of standardization for testing.

Our community

The only online points of coordination between different test frameworks that I am aware of is this wiki and the following e-mail list:

Mailing list

Discussions on this topic held on the "Automated Testing" mailing list of the Yocto Project

To send an e-mail to the list, send it to automated-testing@lists.yoctoproject.org

Conference call

We hold a conference call meeting monthly, on the second Thursday of each month, at 15:00 UTC time. Join using your computer: https://zoom.us/j/757476323 Meeting ID: 757 476 323 or find your local number: https://zoom.us/u/a5pAkeO9S If you want to be invited, please contact <anmar (at) linaro.org>. It's open to all.

Minutes for all calls are in a single Google doc:

See sections inside the document for the minutes for particular weeks.

Events

Automated Testing Summit 2018 (ELCE 2018/OSSE 2018)

The first event specifically dedicated to automated testing of Linux was the Automated Testing Summit 2018 (ATS), held for the first time in October of 2018. This was co-located with Embedded Linux Conference Europe and Open Source Summit Europe, held in Edinburgh Scotland.

FOSDEM 2019

Some people are planning to do an unofficial meeting at FOSDEM 2019.

Linaro Connect 2019 meeting

There was a Testing microsummit at Linaro Connect 2019 in Bangkok. The microsummit was held April 4, 2019. See the link for some of the items discussed.

Plumbers 2019 Testing and Fuzzing microconference

There are plans to hold a testing and fuzzing microconference at Plumbers 2019, in Lisbon Portugal in September.

CKI Hackfest

There was a meeting with representatives from several CI frameworks in Lisbon, Portugal on September 12 and 13. The meeting was hosted by RedHat. Meeting agenda is at: https://cki-project.org/posts/hackfest-agenda/ Meeting notes are here

Automated Testing Summit (ATS) 2019

We are having our second Automated Testing Summit in Lyon, France on October 31st, 2019.

Please see the Linux Foundation Event page for details.

This page: Automated Testing Summit 2019 was used for some of the planning for that event.

More information

Presentations and other resources are available on the Testing page.