Testing Presentations

=Kernel CI=

Let’s Test with KernelCI [ELCE 2020]
Presenter: Khouloud Touil, Baylibre Summary: This talk gives an introduction to KernelCI, and shows how to set up the environment, and make and run a test.


 * [[Media:Lets_Test_with_KernelCI.pdf | PDF]] | Video

Bootstraping a Local KernelCI [ELC 2019]
Presenter: Michał Gałka, Collabora Summary: This presentation will go through the process of setting up a minimal local development/testing environment that's suitable for running the KernelCI phases of build, boot, test and results collection.


 * [[Media:Bootstraping_Local_KernelCI.pdf | PDF]] | VIDEO

BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]
Presenter: Kevin Hilman, BayLibre Summary: This BoF will provide a very brief overview and current status of kernelci


 * [[Media:Hilman.pdf | PDF]] | VIDEO

Kernelci.org Needs YOU! [ELCE 2016]
Presenters: Mark Brown, Linaro & Kevin Hilman, BayLibre Summary: This presentation provides information about kernelci.org, Lab setup, and LAVA v2 installations.


 * [[Media:Brown.pdf | PDF]] | VIDEO

BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]
Presenter: Kevin Hilman, Linaro Summary: This BoF will provide a very brief overview on Kernel upstreaming as part of KernelCI project.


 * [[Media:Kernelci.pdf | PDF]]

= FUEGO =

Also, see more talks at: http://fuegotest.org/wiki/Presentations

Fuego test sytem [ELC 2019]
Presenter: Hirotaka Motai, Mitsubishi Electric Corp. Summary: This presentation provides information about the run-time logger in Fuego by showing the actual use cases and functional checking.


 * PDF | VIDEO

Testing with Volcanoes - Fuego+LAVA Going Distributed [ELC 2017]
Presenter: Jan-Simon Moeller, The Linux Foundation Summary: This presentation provides information about the features of the combined infrastructure and highlights the tools and work done to integrate both tools.


 * PDF | VIDEO

Enhance Fuego Test Efficiency by Applying Additional Software & Hardware Solutions [OSSJ 2017]
Presenter: Khiem Nguyen, Renesas Corporation Summary: This presentation provides information about integrating more software services and hardware solutions (controller for development boards) to enhance the test automation efficiency.


 * PDF

Introduction to the Fuego Test System [ELC 2016]
Presenter: Tim Bird, Sony Mobile Summary: Gives a basic introduction to the Fuego test system. Fuego is geared towards testing embedded products, with a host-target architecture and many pre-packaged tests.


 * [[Media:Introduction-to-Fuego-ELC-2016.pdf|PDF]] | VIDEO

= LAVA =

From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017]
Presenter: Pawel Wieczorek, Samsung R&D Institute Poland Summary: This talk presents an introduction to LAVA - how to set it up and execute tests in your own lab.


 * [[Media:From_zero_to_first_test_in_your_own_LAVA_laboratory.pdf|PDF]] | VIDEO

= Syzkaller =

Fuzzing Linux Drivers with Syzkaller [ELCE 2020]
Presenter: Ricardo Canuelo, Collabora Summary: This talk provides a basic introduction to the 'Syzkaller' test framework, which is a fuzzing tool designed for use with the Linux kernel.


 * [[Media:ELCE_2020_Syzkaller.pdf | PDF]] | Video

= Automation =

Automated Testing Laboratory for Embedded Linux Distributions [ELC 2016]
Presenter: Pawel Wieczorek, Samsung R&D Institute Poland Summary: This talk provides information about problems faced while building automatic testing infrastructure for Tizen operating system images.


 * PDF | VIDEO

Automated Flashing and Testing for Continuous Integration [ELC 2015]
Presenter: Igor Stoppa, Intel Summary: This presentation provides information about verifying a software image on an appropriate target hardware device and hardware configuration.


 * PDF

Automated Testing with ktest.pl (Embedded Edition) [ELC 2012]
Presenter: Steven Rostedt, Red Hat Summary: This presentation provides information about write to build, install, boot, and test kernel remotely.


 * PDF

Distributed Cross Platform Test Automation [ELC 2006]
Presenter: William Marone Summary: This presentation provides information about test AXFS functionality, quickly build, run test, and across multiple architectures and kernels.


 * PDF

= Automation/Farm Hardware =

Automated Testing for Embedded Development: Next Generation Board Farming [ELC 2021]
Presenter:Chris Fiege, Pengutronix e.K. Summary: This talk presents the benefits and challenges of managing boards in a board farm. Using USB for the majority of the hardware connections in a farm presents problems. A new "Test Automation Controller" is introduced, which connects to the farm infrastructure via a single network connection, and to the board via various hardware connections.


 * [[Media:cfi_Automated-Testing.pdf | PDF]]

Fully Automated Power Measurement Solution Coupled with IC Temperature Control [ELCE 2019]
Presenter: Jerome Neanne, BayLibre & Pascal Mareau, NXP Summary: This talks describes thermal power testing hardware (based on the Baylibre ACME board), and an automated testing framework to control it, for doing automated testing of embedded board response to varying thermal conditions. It also discusses the rationale for thermal response testing.


 * [[Media:Thermo-Regulated Power Management Platform_ELC2019.pdf | PDF]] | VIDEO

Introducing the "Lab in a Box" Concept [ELC 2018]
Presenter: Patrick Titiano & Kevin Hillman, Baylibre Summary: This presentation provides information about the quality level without the leveraging CI and test automation.


 * [[Media:Introducing_The_%E2%80%9CLab_in_a_Box%E2%80%9D_Concept_%28ELC-2018-Portland%29.pdf | PDF]] | VIDEO

Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018]
Presenter: Pawel Wieczorek, Samsung R&D Institute Poland Summary: This talk covers a fresh open hardware approach at providing remote access to embedded devices and the new Tizen GNU/Linux distribution's testing laboratory.


 * PDF | VIDEO

Grabbing Audio and Video on a Board Farm [ELCE 2018]
Presenter: Krzysztof Opasiak, Samsung R&D Institute Poland Summary: This presentation provides information about audio and video capture capabilities and unified remote access to any Single Board Computer.


 * [[Media:Kopasiak_grabbing_a_v_on_a_farm.pdf | PDF]] | VIDEO

= Board Farms =

Board Farm APIs for Automated Testing of Embedded Linux - An Update [ELC 2021]
Presenters: Tim Bird, Sony Electronics & Harish Bansal, Timesys Summary: This talk give an update on a proposed REST API for controlling boards and resources in an automated testing lab. A generic resource model, and data capture APIs are highlighted.


 * [[Media:ELC-2021-Board-Farm-Update-Bansal-Bird.pdf | PDF]]

Board FARM APIs for Automated Testing of Embedded Linux [ELCE 2020]
Presenters: Tim Bird, Sony & Harish Bansal, Timesys Summary: This talk presents an API for abstracting control of resources in a board farm. A REST API is presented, along with demos and details of the implementation.


 * [[Media:ELC-Board-Farm-API-Sony-Timesys-2020-10-27.pdf | PDF]] | Video

Testing Laboratory Layers [ELC 2019]
Presenter: Paweł Wieczorek, Samsung R&D Institute Poland Summary: These slides cover API design decisions for testing laboratories focusing on the SLAV test lab stack case and shifting to a user-centric perspective and possible outcome of such process.


 * [[Media:Test_Lab_API.pdf | PDF]] | VIDEO

Farming together [ELCE 2017]
Presenter: Andrew Murray, Witekio Summary: This presentation will provide an overview of the Witekio farm highlighting the challenges faced - both in hardware challenges (connecting boards to farms) and software challenges.


 * PDF | VIDEO

Building a Bards Farm: Continuous Integration and Remote Control [ELCE 2016]
Presenter:  Antoine Tenart & Quentin Schulz, Free Electrons Summary: This talk will describe the Kernel CI goals and infrastructure and how it communicates with our farm using LAVA. It gives a feedback on how boards farm designed and present its second use case: remote control of boards.


 * PDF | VIDEO

Herd Your Boards, Become a Farmer [ELCE 2016]
Presenter: Geert Uytterhoeven, Glider bvba Summary: This presentation provides information about development boards on a board farm and overcomes the issues related to control, power, monitor and automating boards in your farm.


 * PDF | VIDEO

= Test Suites =

FOSS Static Analysis Tools for Embedded Systems and How to Use Them [ELCE 2020]
Presenter: Jan-Simon Moller, The Linux Foundation Summary: This talk presents a variety of static analysis tools that can be used to perform static analysis on the source code base for an embedded product. Two tools with lots of sub-tools are 'meta-sca' and 'meta-codechecker'. The tools and their capabilities for testing are introduced.


 * [[Media:ELCE FOSS Static Analysis Tools for Embedded Systems and How to Use Them.pdf | PDF]] | Video

Stress Testing and Micro Benchmarking Kernels with Stress-ng (Stress-ng) [ELCE 2019]
Presenter: Colin Ian King, Canonical Summary: This talk gives a great overview of stress-ng and how it can be used to perform a variety of tests on a Linux platform. There are many examples of different sub-tests and options (with command line arguments), as well as output and tracing options.


 * [[Media:Lyon-stress-ng-presentation-oct-2019.pdf | PDF]] | Video

Impact of Platform Firmware on Linux Kernel (LUV Test Suite) [ELC 2018]
Presenter: Megha Dey & Sal Praneeth Prakhya, Intel Summary: This presentation introduces LUV (Linux UEFI Validation); a unified framework of several open-source test-suites packaged into a cohesive and easy-to-use product that aims to help firmware developers uncover bugs in the implementation of UEFI firmware at critical levels of the s/w stack.


 * PDF | VIDEO

Kernel Validation with Kselftest (Kselftest) [LF mentorship 2021]
Presenter: Shuah Khan, Linux Foundation Summary: Presents an overview of kselftest and kernel testing in general, with details about how to run the included tests.


 * [[Media:Mentorship-Session_-Kernel-Validation-With-Kselftest.pdf|PDF]] | VIDEO

KSelftest Running in Test Rings - Where Are We? (Kselftest) [ELCE 2020/OSS 2020]
Presenter: Shuah Khan, Linux Foundation Summary: Discusses the current status of kselftest, and in particular how it is being used with KernelCI, and what additional features are needed for improved KernelCI integration.


 * [[Media:Kselftest_Running_in_Test_Rings_-_Where_Are_We-ELC-2020.pdf | PDF]] | VIDEO

Linux Kernel Selftest Framework - Quality Control for New Releases (Kselftest) [ELC 2015]
Presenter: Shuah Khan, Samsung Summary: This presentation provides information about running the kselftest,kselftest git, installation of the self-test, and run test from the install location.


 * PDF

= Standards =

Automated Testing Summmit Industry Standards discussion [ATS 2018]
Presenters: Tim Bird, Sony and Kevin Hilman, Baylibre Summary: The first Automated Testing Summit held discussions about a number of potential areas for standardization of automated testing, including test definitions, dependencies, test execution, test artifacts (storing, presenting, analysis), and farm hardware standards.


 * [[Media:ATS2018-Intro-and-Discussion-Topics.pdf|PDF]] | VIDEO playlist
 * Minutes from the discussion: ATS_2018_Minutes

= Others =

Tips for Writing Good Tests for Linux [ELC 2018]
Presenter: Tim Bird, Sony Corporation Summary: This talk will review and compare different test writing frameworks, including kself-test, LTP and Fuego, and describe each one's strengths and weaknesses. A basic introduction to writing a test in each one will be given.


 * PDF | VIDEO

Kernel Testing Tools and Techniques [ELC 2013]
Presenter: Matt Porter, Texas Instruments, Inc Summary: This presentation provides information about frameworks, lab tools, techniques of the open test, autotest, Jenkins, ktest.


 * PDF | VIDEO