Difference between revisions of "Testing Presentations"

From eLinux.org
Jump to: navigation, search
(add syzkaller talk from ELCE 2020)
 
(51 intermediate revisions by 4 users not shown)
Line 1: Line 1:
= '''Upstream Kernel Testing''' =
+
='''Kernel CI'''=
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2019] ==
+
== Let’s Test with KernelCI [ELCE 2020] ==
 +
'''Presenter:''' Khouloud Touil, Baylibre<br>
 +
'''Summary:'''
 +
This talk gives an introduction to KernelCI, and shows
 +
how to set up the environment, and make and run a test.
 +
 
 +
* [[Media:Lets_Test_with_KernelCI.pdf | PDF]] | [https://www.youtube.com/watch?v=HgkPqAzq_Kg Video]
 +
 
 +
== Bootstraping a Local KernelCI [ELC 2019] ==
 +
'''Presenter:''' Michał Gałka, Collabora <br>
 +
'''Summary:'''
 +
This presentation will go through the process of setting up a minimal <br>
 +
local development/testing environment that's suitable for running the <br>
 +
KernelCI phases of build, boot, test and results collection. <br>
 +
 
 +
* [[Media:Bootstraping_Local_KernelCI.pdf | PDF]] | [https://www.youtube.com/watch?v=ApoTzhc1IY0 VIDEO]
 +
 
 +
== BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]==
 +
'''Presenter:''' Kevin Hilman, BayLibre <br>
 +
'''Summary:'''
 +
This BoF will provide a very brief overview and current status of kernelci<br>
 +
 
 +
* [[Media:Hilman.pdf | PDF]] | [https://youtu.be/37t-U0PGNlw VIDEO]
 +
 
 +
== Kernelci.org Needs YOU!  [ELCE 2016] ==
 +
'''Presenters:''' Mark Brown, Linaro & Kevin Hilman, BayLibre<br>
 +
'''Summary:'''
 +
This presentation provides information about kernelci.org, <br>
 +
Lab setup, and LAVA v2 installations. <br>
  
 +
* [[Media:Brown.pdf | PDF]] | [https://youtu.be/xaQuNM01YNo?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
 +
 +
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]==
 
'''Presenter:''' Kevin Hilman, Linaro <br>
 
'''Presenter:''' Kevin Hilman, Linaro <br>
 
'''Summary:'''
 
'''Summary:'''
This presentation provides information about build failing, boot failing and display build status. <br>
+
This BoF will provide a very brief overview on Kernel upstreaming as <br>
 +
part of KernelCI project. <br>
  
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF] | [https://elinux.org/images/f/ff/Kernelci.pdf VIDEO]
+
* [[Media:Kernelci.pdf | PDF]]
  
 
= '''FUEGO''' =
 
= '''FUEGO''' =
 +
 +
Also, see more talks at: http://fuegotest.org/wiki/Presentations
  
 
== Fuego test sytem [ELC 2019] ==
 
== Fuego test sytem [ELC 2019] ==
Line 24: Line 58:
  
 
* [https://elinux.org/images/8/88/ELC-jsmoeller-2017-02-TESTING-VULCANOES-LAVA-FUEGO.pdf PDF] | [https://youtu.be/IA6cBIGuHm4 VIDEO]
 
* [https://elinux.org/images/8/88/ELC-jsmoeller-2017-02-TESTING-VULCANOES-LAVA-FUEGO.pdf PDF] | [https://youtu.be/IA6cBIGuHm4 VIDEO]
 +
 +
== Enhance Fuego Test Efficiency by Applying Additional Software & Hardware Solutions [OSSJ 2017] ==
 +
'''Presenter:''' Khiem Nguyen, Renesas Corporation <br>
 +
'''Summary:'''
 +
This presentation provides information about integrating more software services and hardware solutions (controller for development boards)
 +
to enhance the test automation efficiency. <br>
 +
 +
* [https://elinux.org/images/1/13/OSSJ_Renesas_Fuego_enhancement_KhiemNguyen_20170531_Rev1.0.pdf PDF]
 +
 +
== Introduction to the Fuego Test System [ELC 2016] ==
 +
'''Presenter:''' Tim Bird, Sony Mobile<br>
 +
'''Summary:'''
 +
Gives a basic introduction to the Fuego test system.  Fuego is geared towards testing
 +
embedded products, with a host-target architecture and many pre-packaged tests.
 +
 +
* [[Media:Introduction-to-Fuego-ELC-2016.pdf|PDF]] | [https://youtu.be/AueBSRN4wLk VIDEO]
 +
 +
= '''LAVA''' =
 +
== From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017] ==
 +
'''Presenter:''' Pawel Wieczorek, Samsung R&D Institute Poland
 +
'''Summary:'''
 +
This talk presents an introduction to LAVA - how to set it up and execute tests in
 +
your own lab.
 +
 +
* [[Media:From_zero_to_first_test_in_your_own_LAVA_laboratory.pdf|PDF]] | [https://www.youtube.com/g4Hw5I2sk3A VIDEO]
 +
 +
= '''Syzkaller''' =
 +
== Fuzzing Linux Drivers with Syzkaller [ELCE 2020] ==
 +
'''Presenter:''' Ricardo Canuelo, Collabora<br>
 +
'''Summary:'''
 +
This talk provides a basic introduction to the 'Syzkaller' test framework, which is a fuzzing
 +
tool designed for use with the Linux kernel.
 +
 +
* [[Media:ELCE_2020_Syzkaller.pdf | PDF]] | [https://www.youtube.com/watch?v=dRoRJ4B2Nvc Video]
  
 
= '''Automation''' =
 
= '''Automation''' =
Line 36: Line 104:
  
 
== Automated Flashing and Testing for Continuous Integration [ELC 2015] ==
 
== Automated Flashing and Testing for Continuous Integration [ELC 2015] ==
 
 
'''Presenter:''' Igor Stoppa, Intel <br>
 
'''Presenter:''' Igor Stoppa, Intel <br>
 
'''Summary:'''
 
'''Summary:'''
Line 45: Line 112:
  
 
== Automated Testing with ktest.pl (Embedded Edition) [ELC 2012] ==
 
== Automated Testing with ktest.pl (Embedded Edition) [ELC 2012] ==
 
 
'''Presenter:''' Steven Rostedt, Red Hat<br>
 
'''Presenter:''' Steven Rostedt, Red Hat<br>
 
'''Summary:'''
 
'''Summary:'''
Line 53: Line 119:
  
 
== Distributed Cross Platform Test Automation [ELC 2006] ==
 
== Distributed Cross Platform Test Automation [ELC 2006] ==
 
 
'''Presenter:''' William Marone <br>
 
'''Presenter:''' William Marone <br>
 
'''Summary:'''
 
'''Summary:'''
Line 59: Line 124:
 
and kernels.  <br>
 
and kernels.  <br>
  
* [http://DistributedCrossPlatformTest.pdf PDF]
+
* [https://elinux.org/images/a/af/DistributedCrossPlatformTest.pdf PDF]
  
= '''Others''' =
+
= '''Automation/Farm Hardware''' =
 +
 
 +
== Automated Testing for Embedded Development: Next Generation Board Farming [ELC 2021] ==
 +
'''Presenter:'''Chris Fiege, Pengutronix e.K.<br>
 +
'''Summary:'''
 +
This talk presents the benefits and challenges of managing boards in a board farm.
 +
Using USB for the majority of the hardware connections in a farm presents problems.
 +
A new "Test Automation Controller" is introduced, which connects to the farm
 +
infrastructure via a single network connection, and to the board via various hardware
 +
connections.
 +
 
 +
* [[Media:cfi_Automated-Testing.pdf | PDF]]
  
== Testing Laboratory Layers [ELC 2019] ==
+
== Fully Automated Power Measurement Solution Coupled with IC Temperature Control [ELCE 2019] ==
'''Presenter:''' Paweł Wieczorek, Samsung R&D Institute Poland <br>
+
'''Presenter:''' Jerome Neanne, BayLibre & Pascal Mareau, NXP<br>
 
'''Summary:'''
 
'''Summary:'''
These slides cover API design decisions for testing laboratories focusing on the SLAV test lab stack case and shifting to a user-centric perspective and possible outcome of such process.
+
This talks describes thermal power testing hardware (based on the Baylibre ACME board), and an
 +
automated testing framework to control it, for doing automated testing of embedded board
 +
response to varying thermal conditions.  It also discusses the rationale for thermal response
 +
testing.
  
* [https://elinux.org/images/3/3c/Test_Lab_API.pdf PDF] | [https://www.youtube.com/watch?v=gWVp9JqVTog VIDEO]
+
* [[Media:Thermo-Regulated Power Management Platform_ELC2019.pdf | PDF]] | [https://youtu.be/l-S4ZRslgRY VIDEO]
  
== Tips for Writing Good Tests for Linux [ELC 2018] ==
+
== Introducing the "Lab in a Box" Concept [ELC 2018] ==
'''Presenter:''' Tim Bird, Sony Corporation <br>
+
'''Presenter:''' Patrick Titiano & Kevin Hillman, Baylibre <br>
 
'''Summary:'''
 
'''Summary:'''
This talk will review and compare different test writing frameworks, <br>
+
This presentation provides information about the quality <br>
including kself-test, LTP and Fuego, and describe each one's strengths <br>
+
level without the leveraging CI and test automation. <br>
and weaknesses. A basic introduction to writing a test in each one will be given.<br>
 
  
* [https://elinux.org/images/6/60/Tips-for-Writing-Good-Tests-for-Linux-2018-03-ELC.pdf PDF] | [https://www.youtube.com/watch?v=NzJFwCUGJtc VIDEO]
+
* [[Media:Introducing_The_%E2%80%9CLab_in_a_Box%E2%80%9D_Concept_%28ELC-2018-Portland%29.pdf | PDF]] | [https://www.youtube.com/watch?v=aavoHUpzBGU VIDEO]
  
 
== Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018] ==
 
== Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018] ==
Line 87: Line 165:
 
* [https://elinux.org/images/4/42/Piece_of_cake.pdf PDF] | [https://www.youtube.com/watch?v=Hx9MEhR05cU VIDEO]
 
* [https://elinux.org/images/4/42/Piece_of_cake.pdf PDF] | [https://www.youtube.com/watch?v=Hx9MEhR05cU VIDEO]
  
== Linux Integrated System Analysis (LISA) & Friends [ELC 2016] ==
+
== Grabbing Audio and Video on a Board Farm [ELCE 2018] ==
 +
'''Presenter:''' Krzysztof Opasiak, Samsung R&D Institute Poland <br>
 +
'''Summary:'''
 +
This presentation provides information about audio and video capture  <br>
 +
capabilities and unified remote access to any Single Board Computer. <br>
 +
 
 +
* [[Media:Kopasiak_grabbing_a_v_on_a_farm.pdf | PDF]] | [https://youtu.be/mw79nfp7ARE  VIDEO]
 +
 
 +
 
 +
= '''Board Farms''' =
 +
 
 +
== Board Farm APIs for Automated Testing of Embedded Linux - An Update [ELC 2021] ==
 +
'''Presenters:''' Tim Bird, Sony Electronics & Harish Bansal, Timesys
 +
'''Summary:'''
 +
This talk give an update on a proposed REST API for controlling
 +
boards and resources in an automated testing lab.  A generic
 +
resource model, and data capture APIs are highlighted.
 +
 
 +
* [[Media:ELC-2021-Board-Farm-Update-Bansal-Bird.pdf | PDF]]
 +
 
 +
== Board FARM APIs for Automated Testing of Embedded Linux [ELCE 2020] ==
 +
'''Presenters:''' Tim Bird, Sony & Harish Bansal, Timesys
 +
'''Summary:'''
 +
This talk presents an API for abstracting control
 +
of resources in a board farm. A REST API is presented, along
 +
with demos and details of the implementation.
 +
 
 +
* [[Media:ELC-Board-Farm-API-Sony-Timesys-2020-10-27.pdf | PDF]] | [https://www.youtube.com/watch?v=ePYHuWyb0uk Video]
 +
 
 +
== Testing Laboratory Layers [ELC 2019] ==
 +
'''Presenter:''' Paweł Wieczorek, Samsung R&D Institute Poland <br>
 +
'''Summary:'''
 +
These slides cover API design decisions for testing laboratories <br>
 +
focusing on the SLAV test lab stack case and shifting to a user-centric <br>
 +
perspective and possible outcome of such process. <br>
 +
 
 +
* [[Media:Test_Lab_API.pdf | PDF]] | [https://www.youtube.com/watch?v=gWVp9JqVTog VIDEO]
  
'''Presenter:''' Patrick Bellasi, ARM Ltd <br>
+
== Farming together [ELCE 2017] ==
 +
'''Presenter: '''Andrew Murray, Witekio <br>
 
'''Summary:'''
 
'''Summary:'''
This presentation provides information about the new Linux integrated system analysis framework for easier development and ideal <br>
+
This presentation will provide an overview of the Witekio farm<br>  
for detailed debug scenarios. <br>
+
highlighting the challenges faced - both in hardware challenges<br>
 +
(connecting boards to farms) and software challenges.
 +
 
 +
* [https://elinux.org/images/5/52/BoF-FarmingTogether.pdf PDF] | [https://youtu.be/-oO9y2HnoYs VIDEO]
  
* [https://elinux.org/images/1/12/Bellasi.pdf PDF] | [https://youtu.be/m949uduHHsw VIDEO]
+
== Building a Bards Farm: Continuous Integration and Remote Control [ELCE 2016] ==
 +
'''Presenter: ''' Antoine Tenart & Quentin Schulz, Free Electrons<br>
 +
'''Summary:'''
 +
This talk will describe the Kernel CI goals and infrastructure<br>
 +
and how it communicates with our farm using LAVA. It gives a feedback<br>
 +
on how boards farm designed and present its second use case: remote<br>
 +
control of boards.
  
== Linux Kernel Selftest Framework - Quality Control for New Releases [ELC 2015] ==
+
* [https://elinux.org/images/0/09/Building_a_Bards_Farm.pdf PDF] | [https://youtu.be/sJvusc6jz4w?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
  
 +
== Herd Your Boards, Become a Farmer [ELCE 2016] ==
 +
'''Presenter:''' Geert Uytterhoeven, Glider bvba  <br>
 +
'''Summary:'''
 +
This presentation provides information about development boards <br>
 +
on a board farm and overcomes the issues related to control, <br>
 +
power, monitor and automating boards in your farm. <br>
 +
 +
* [https://elinux.org/images/b/b5/Herd_Your_Boards.pdf PDF] | [https://youtu.be/kwqmjeqAx-E VIDEO]
 +
 +
= '''Test Suites''' =
 +
== FOSS Static Analysis Tools for Embedded Systems and How to Use Them [ELCE 2020] ==
 +
'''Presenter:''' Jan-Simon Moller, The Linux Foundation<br>
 +
'''Summary:'''
 +
This talk presents a variety of static analysis tools that can be used to
 +
perform static analysis on the source code base for an embedded product.
 +
Two tools with lots of sub-tools are 'meta-sca' and 'meta-codechecker'.
 +
The tools and their capabilities for testing are introduced.
 +
 +
* [[Media:ELCE FOSS Static Analysis Tools for Embedded Systems and How to Use Them.pdf | PDF]] | [https://www.youtube.com/watch?v=aluDoi5p8h8 Video]
 +
 +
== Stress Testing and Micro Benchmarking Kernels with Stress-ng (Stress-ng) [ELCE 2019] ==
 +
'''Presenter:''' Colin Ian King, Canonical<br>
 +
'''Summary:'''
 +
This talk gives a great overview of stress-ng and how it can be used to perform a
 +
variety of tests on a Linux platform.  There are many examples of different sub-tests
 +
and options (with command line arguments), as well as output and tracing options.
 +
 +
* [[Media:Lyon-stress-ng-presentation-oct-2019.pdf | PDF]] | [https://youtu.be/8QaXStKfq3A Video]
 +
 +
== Impact of Platform Firmware on Linux Kernel (LUV Test Suite) [ELC 2018] ==
 +
'''Presenter:''' Megha Dey & Sal Praneeth Prakhya, Intel <br>
 +
'''Summary:'''
 +
This presentation introduces LUV (Linux UEFI Validation); a unified <br>
 +
framework of several open-source test-suites packaged into a cohesive <br>
 +
and easy-to-use product that aims to help firmware developers uncover <br>
 +
bugs in the implementation of UEFI firmware at critical levels of the s/w stack. <br>
 +
 +
* [https://elinux.org/images/b/b7/Impact_of_platform_firmware_on_linux_kernel.pdf PDF] | [https://www.youtube.com/watch?v=7aME1lxY71Q VIDEO]
 +
 +
== Kselftest ==
 +
=== Kernel Validation with Kselftest (Kselftest) [LF mentorship 2021] ===
 +
'''Presenter:''' Shuah Khan, Linux Foundation
 +
'''Summary:'''
 +
Presents an overview of kselftest and kernel  testing in general, with details
 +
about how to run the included tests.
 +
 +
* [[Media:Mentorship-Session_-Kernel-Validation-With-Kselftest.pdf|PDF]] | [https://www.youtube.com/watch?v=mpO_iDEMqWQ VIDEO]
 +
 +
=== KSelftest Running in Test Rings - Where Are We? (Kselftest) [ELCE 2020/OSS 2020] ===
 +
'''Presenter:''' Shuah Khan, Linux Foundation
 +
'''Summary:'''
 +
Discusses the current status of kselftest, and in particular how it is being used
 +
with KernelCI, and what additional features are needed for improved KernelCI integration.
 +
 +
* [[Media:Kselftest_Running_in_Test_Rings_-_Where_Are_We-ELC-2020.pdf | PDF]] | [https://youtu.be/qvvPSgwyYwg VIDEO]
 +
 +
=== Linux Kernel Selftest Framework - Quality Control for New Releases (Kselftest) [ELC 2015] ===
 
'''Presenter:''' Shuah Khan, Samsung <br>
 
'''Presenter:''' Shuah Khan, Samsung <br>
 
'''Summary:'''
 
'''Summary:'''
This presentation provides information about running the kselftest,kselftest git, installation of the self-test, and run test from <br>
+
This presentation provides information about running the kselftest,kselftest <br>
the install location.  <br>
+
git, installation of the self-test, and run test from the install location.  <br>
  
 
* [https://elinux.org/images/6/61/Linux_Kernel_Selftest_Framework_-_Quality_Control_for_New_Releases.pdf PDF]
 
* [https://elinux.org/images/6/61/Linux_Kernel_Selftest_Framework_-_Quality_Control_for_New_Releases.pdf PDF]
 +
 +
= '''Standards''' =
 +
 +
== Automated Testing Summmit Industry Standards discussion [ATS 2018] ==
 +
'''Presenters:''' Tim Bird, Sony and Kevin Hilman, Baylibre<br>
 +
'''Summary:'''
 +
The first Automated Testing Summit held discussions about a number of potential areas
 +
for standardization of automated testing, including test definitions, dependencies,
 +
test execution, test artifacts (storing, presenting, analysis), and farm hardware
 +
standards.
 +
 +
* [[Media:ATS2018-Intro-and-Discussion-Topics.pdf|PDF]] | [https://www.youtube.com/playlist?list=PLKZSArYQptsPGftWXdlTI7vPCc42FXksD VIDEO playlist]
 +
* Minutes from the discussion: [[ATS_2018_Minutes]]
 +
 +
= '''Others''' =
 +
 +
== Tips for Writing Good Tests for Linux [ELC 2018] ==
 +
'''Presenter:''' Tim Bird, Sony Corporation <br>
 +
'''Summary:'''
 +
This talk will review and compare different test writing frameworks, <br>
 +
including kself-test, LTP and Fuego, and describe each one's strengths <br>
 +
and weaknesses. A basic introduction to writing a test in each one will be given.<br>
 +
 +
* [https://elinux.org/images/6/60/Tips-for-Writing-Good-Tests-for-Linux-2018-03-ELC.pdf PDF] | [https://www.youtube.com/watch?v=NzJFwCUGJtc VIDEO]
  
 
== Kernel Testing Tools and Techniques [ELC 2013] ==
 
== Kernel Testing Tools and Techniques [ELC 2013] ==
 
 
'''Presenter:''' Matt Porter, Texas Instruments, Inc <br>
 
'''Presenter:''' Matt Porter, Texas Instruments, Inc <br>
 
'''Summary:'''
 
'''Summary:'''

Latest revision as of 15:08, 3 November 2021

Contents

Kernel CI

Let’s Test with KernelCI [ELCE 2020]

Presenter: Khouloud Touil, Baylibre
Summary: This talk gives an introduction to KernelCI, and shows how to set up the environment, and make and run a test.

Bootstraping a Local KernelCI [ELC 2019]

Presenter: Michał Gałka, Collabora
Summary: This presentation will go through the process of setting up a minimal
local development/testing environment that's suitable for running the
KernelCI phases of build, boot, test and results collection.

BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]

Presenter: Kevin Hilman, BayLibre
Summary: This BoF will provide a very brief overview and current status of kernelci

Kernelci.org Needs YOU! [ELCE 2016]

Presenters: Mark Brown, Linaro & Kevin Hilman, BayLibre
Summary: This presentation provides information about kernelci.org,
Lab setup, and LAVA v2 installations.

BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]

Presenter: Kevin Hilman, Linaro
Summary: This BoF will provide a very brief overview on Kernel upstreaming as
part of KernelCI project.

FUEGO

Also, see more talks at: http://fuegotest.org/wiki/Presentations

Fuego test sytem [ELC 2019]

Presenter: Hirotaka Motai, Mitsubishi Electric Corp.
Summary: This presentation provides information about the run-time logger in Fuego by showing the actual use cases and functional checking.

Testing with Volcanoes - Fuego+LAVA Going Distributed [ELC 2017]

Presenter: Jan-Simon Moeller, The Linux Foundation
Summary: This presentation provides information about the features of the combined infrastructure and highlights the tools and work done
to integrate both tools.

Enhance Fuego Test Efficiency by Applying Additional Software & Hardware Solutions [OSSJ 2017]

Presenter: Khiem Nguyen, Renesas Corporation
Summary: This presentation provides information about integrating more software services and hardware solutions (controller for development boards) to enhance the test automation efficiency.

Introduction to the Fuego Test System [ELC 2016]

Presenter: Tim Bird, Sony Mobile
Summary: Gives a basic introduction to the Fuego test system. Fuego is geared towards testing embedded products, with a host-target architecture and many pre-packaged tests.

LAVA

From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland Summary: This talk presents an introduction to LAVA - how to set it up and execute tests in your own lab.

Syzkaller

Fuzzing Linux Drivers with Syzkaller [ELCE 2020]

Presenter: Ricardo Canuelo, Collabora
Summary: This talk provides a basic introduction to the 'Syzkaller' test framework, which is a fuzzing tool designed for use with the Linux kernel.

Automation

Automated Testing Laboratory for Embedded Linux Distributions [ELC 2016]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This talk provides information about problems faced while building automatic testing infrastructure for Tizen operating
system images.

Automated Flashing and Testing for Continuous Integration [ELC 2015]

Presenter: Igor Stoppa, Intel
Summary: This presentation provides information about verifying a software image on an appropriate target hardware device and
hardware configuration.

Automated Testing with ktest.pl (Embedded Edition) [ELC 2012]

Presenter: Steven Rostedt, Red Hat
Summary: This presentation provides information about write to build, install, boot, and test kernel remotely.

Distributed Cross Platform Test Automation [ELC 2006]

Presenter: William Marone
Summary: This presentation provides information about test AXFS functionality, quickly build, run test, and across multiple architectures
and kernels.

Automation/Farm Hardware

Automated Testing for Embedded Development: Next Generation Board Farming [ELC 2021]

Presenter:Chris Fiege, Pengutronix e.K.
Summary: This talk presents the benefits and challenges of managing boards in a board farm. Using USB for the majority of the hardware connections in a farm presents problems. A new "Test Automation Controller" is introduced, which connects to the farm infrastructure via a single network connection, and to the board via various hardware connections.

Fully Automated Power Measurement Solution Coupled with IC Temperature Control [ELCE 2019]

Presenter: Jerome Neanne, BayLibre & Pascal Mareau, NXP
Summary: This talks describes thermal power testing hardware (based on the Baylibre ACME board), and an automated testing framework to control it, for doing automated testing of embedded board response to varying thermal conditions. It also discusses the rationale for thermal response testing.

Introducing the "Lab in a Box" Concept [ELC 2018]

Presenter: Patrick Titiano & Kevin Hillman, Baylibre
Summary: This presentation provides information about the quality
level without the leveraging CI and test automation.

Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This talk covers a fresh open hardware approach at providing remote access to embedded devices and the new Tizen GNU/Linux
distribution's testing laboratory.

Grabbing Audio and Video on a Board Farm [ELCE 2018]

Presenter: Krzysztof Opasiak, Samsung R&D Institute Poland
Summary: This presentation provides information about audio and video capture
capabilities and unified remote access to any Single Board Computer.


Board Farms

Board Farm APIs for Automated Testing of Embedded Linux - An Update [ELC 2021]

Presenters: Tim Bird, Sony Electronics & Harish Bansal, Timesys Summary: This talk give an update on a proposed REST API for controlling boards and resources in an automated testing lab. A generic resource model, and data capture APIs are highlighted.

Board FARM APIs for Automated Testing of Embedded Linux [ELCE 2020]

Presenters: Tim Bird, Sony & Harish Bansal, Timesys Summary: This talk presents an API for abstracting control of resources in a board farm. A REST API is presented, along with demos and details of the implementation.

Testing Laboratory Layers [ELC 2019]

Presenter: Paweł Wieczorek, Samsung R&D Institute Poland
Summary: These slides cover API design decisions for testing laboratories
focusing on the SLAV test lab stack case and shifting to a user-centric
perspective and possible outcome of such process.

Farming together [ELCE 2017]

Presenter: Andrew Murray, Witekio
Summary: This presentation will provide an overview of the Witekio farm
highlighting the challenges faced - both in hardware challenges
(connecting boards to farms) and software challenges.

Building a Bards Farm: Continuous Integration and Remote Control [ELCE 2016]

Presenter: Antoine Tenart & Quentin Schulz, Free Electrons
Summary: This talk will describe the Kernel CI goals and infrastructure
and how it communicates with our farm using LAVA. It gives a feedback
on how boards farm designed and present its second use case: remote
control of boards.

Herd Your Boards, Become a Farmer [ELCE 2016]

Presenter: Geert Uytterhoeven, Glider bvba
Summary: This presentation provides information about development boards
on a board farm and overcomes the issues related to control,
power, monitor and automating boards in your farm.

Test Suites

FOSS Static Analysis Tools for Embedded Systems and How to Use Them [ELCE 2020]

Presenter: Jan-Simon Moller, The Linux Foundation
Summary: This talk presents a variety of static analysis tools that can be used to perform static analysis on the source code base for an embedded product. Two tools with lots of sub-tools are 'meta-sca' and 'meta-codechecker'. The tools and their capabilities for testing are introduced.

Stress Testing and Micro Benchmarking Kernels with Stress-ng (Stress-ng) [ELCE 2019]

Presenter: Colin Ian King, Canonical
Summary: This talk gives a great overview of stress-ng and how it can be used to perform a variety of tests on a Linux platform. There are many examples of different sub-tests and options (with command line arguments), as well as output and tracing options.

Impact of Platform Firmware on Linux Kernel (LUV Test Suite) [ELC 2018]

Presenter: Megha Dey & Sal Praneeth Prakhya, Intel
Summary: This presentation introduces LUV (Linux UEFI Validation); a unified
framework of several open-source test-suites packaged into a cohesive
and easy-to-use product that aims to help firmware developers uncover
bugs in the implementation of UEFI firmware at critical levels of the s/w stack.

Kselftest

Kernel Validation with Kselftest (Kselftest) [LF mentorship 2021]

Presenter: Shuah Khan, Linux Foundation Summary: Presents an overview of kselftest and kernel testing in general, with details about how to run the included tests.

KSelftest Running in Test Rings - Where Are We? (Kselftest) [ELCE 2020/OSS 2020]

Presenter: Shuah Khan, Linux Foundation Summary: Discusses the current status of kselftest, and in particular how it is being used with KernelCI, and what additional features are needed for improved KernelCI integration.

Linux Kernel Selftest Framework - Quality Control for New Releases (Kselftest) [ELC 2015]

Presenter: Shuah Khan, Samsung
Summary: This presentation provides information about running the kselftest,kselftest
git, installation of the self-test, and run test from the install location.

Standards

Automated Testing Summmit Industry Standards discussion [ATS 2018]

Presenters: Tim Bird, Sony and Kevin Hilman, Baylibre
Summary: The first Automated Testing Summit held discussions about a number of potential areas for standardization of automated testing, including test definitions, dependencies, test execution, test artifacts (storing, presenting, analysis), and farm hardware standards.

Others

Tips for Writing Good Tests for Linux [ELC 2018]

Presenter: Tim Bird, Sony Corporation
Summary: This talk will review and compare different test writing frameworks,
including kself-test, LTP and Fuego, and describe each one's strengths
and weaknesses. A basic introduction to writing a test in each one will be given.

Kernel Testing Tools and Techniques [ELC 2013]

Presenter: Matt Porter, Texas Instruments, Inc
Summary: This presentation provides information about frameworks, lab tools, techniques of the open test, autotest, Jenkins, ktest.