Testing Presentations

From eLinux.org
Revision as of 14:08, 3 November 2021 by Tim Bird (talk | contribs) (add syzkaller talk from ELCE 2020)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Contents

Kernel CI

Let’s Test with KernelCI [ELCE 2020]

Presenter: Khouloud Touil, Baylibre
Summary: This talk gives an introduction to KernelCI, and shows how to set up the environment, and make and run a test.

Bootstraping a Local KernelCI [ELC 2019]

Presenter: Michał Gałka, Collabora
Summary: This presentation will go through the process of setting up a minimal
local development/testing environment that's suitable for running the
KernelCI phases of build, boot, test and results collection.

BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]

Presenter: Kevin Hilman, BayLibre
Summary: This BoF will provide a very brief overview and current status of kernelci

Kernelci.org Needs YOU! [ELCE 2016]

Presenters: Mark Brown, Linaro & Kevin Hilman, BayLibre
Summary: This presentation provides information about kernelci.org,
Lab setup, and LAVA v2 installations.

BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]

Presenter: Kevin Hilman, Linaro
Summary: This BoF will provide a very brief overview on Kernel upstreaming as
part of KernelCI project.

FUEGO

Also, see more talks at: http://fuegotest.org/wiki/Presentations

Fuego test sytem [ELC 2019]

Presenter: Hirotaka Motai, Mitsubishi Electric Corp.
Summary: This presentation provides information about the run-time logger in Fuego by showing the actual use cases and functional checking.

Testing with Volcanoes - Fuego+LAVA Going Distributed [ELC 2017]

Presenter: Jan-Simon Moeller, The Linux Foundation
Summary: This presentation provides information about the features of the combined infrastructure and highlights the tools and work done
to integrate both tools.

Enhance Fuego Test Efficiency by Applying Additional Software & Hardware Solutions [OSSJ 2017]

Presenter: Khiem Nguyen, Renesas Corporation
Summary: This presentation provides information about integrating more software services and hardware solutions (controller for development boards) to enhance the test automation efficiency.

Introduction to the Fuego Test System [ELC 2016]

Presenter: Tim Bird, Sony Mobile
Summary: Gives a basic introduction to the Fuego test system. Fuego is geared towards testing embedded products, with a host-target architecture and many pre-packaged tests.

LAVA

From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland Summary: This talk presents an introduction to LAVA - how to set it up and execute tests in your own lab.

Syzkaller

Fuzzing Linux Drivers with Syzkaller [ELCE 2020]

Presenter: Ricardo Canuelo, Collabora
Summary: This talk provides a basic introduction to the 'Syzkaller' test framework, which is a fuzzing tool designed for use with the Linux kernel.

Automation

Automated Testing Laboratory for Embedded Linux Distributions [ELC 2016]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This talk provides information about problems faced while building automatic testing infrastructure for Tizen operating
system images.

Automated Flashing and Testing for Continuous Integration [ELC 2015]

Presenter: Igor Stoppa, Intel
Summary: This presentation provides information about verifying a software image on an appropriate target hardware device and
hardware configuration.

Automated Testing with ktest.pl (Embedded Edition) [ELC 2012]

Presenter: Steven Rostedt, Red Hat
Summary: This presentation provides information about write to build, install, boot, and test kernel remotely.

Distributed Cross Platform Test Automation [ELC 2006]

Presenter: William Marone
Summary: This presentation provides information about test AXFS functionality, quickly build, run test, and across multiple architectures
and kernels.

Automation/Farm Hardware

Automated Testing for Embedded Development: Next Generation Board Farming [ELC 2021]

Presenter:Chris Fiege, Pengutronix e.K.
Summary: This talk presents the benefits and challenges of managing boards in a board farm. Using USB for the majority of the hardware connections in a farm presents problems. A new "Test Automation Controller" is introduced, which connects to the farm infrastructure via a single network connection, and to the board via various hardware connections.

Fully Automated Power Measurement Solution Coupled with IC Temperature Control [ELCE 2019]

Presenter: Jerome Neanne, BayLibre & Pascal Mareau, NXP
Summary: This talks describes thermal power testing hardware (based on the Baylibre ACME board), and an automated testing framework to control it, for doing automated testing of embedded board response to varying thermal conditions. It also discusses the rationale for thermal response testing.

Introducing the "Lab in a Box" Concept [ELC 2018]

Presenter: Patrick Titiano & Kevin Hillman, Baylibre
Summary: This presentation provides information about the quality
level without the leveraging CI and test automation.

Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This talk covers a fresh open hardware approach at providing remote access to embedded devices and the new Tizen GNU/Linux
distribution's testing laboratory.

Grabbing Audio and Video on a Board Farm [ELCE 2018]

Presenter: Krzysztof Opasiak, Samsung R&D Institute Poland
Summary: This presentation provides information about audio and video capture
capabilities and unified remote access to any Single Board Computer.


Board Farms

Board Farm APIs for Automated Testing of Embedded Linux - An Update [ELC 2021]

Presenters: Tim Bird, Sony Electronics & Harish Bansal, Timesys Summary: This talk give an update on a proposed REST API for controlling boards and resources in an automated testing lab. A generic resource model, and data capture APIs are highlighted.

Board FARM APIs for Automated Testing of Embedded Linux [ELCE 2020]

Presenters: Tim Bird, Sony & Harish Bansal, Timesys Summary: This talk presents an API for abstracting control of resources in a board farm. A REST API is presented, along with demos and details of the implementation.

Testing Laboratory Layers [ELC 2019]

Presenter: Paweł Wieczorek, Samsung R&D Institute Poland
Summary: These slides cover API design decisions for testing laboratories
focusing on the SLAV test lab stack case and shifting to a user-centric
perspective and possible outcome of such process.

Farming together [ELCE 2017]

Presenter: Andrew Murray, Witekio
Summary: This presentation will provide an overview of the Witekio farm
highlighting the challenges faced - both in hardware challenges
(connecting boards to farms) and software challenges.

Building a Bards Farm: Continuous Integration and Remote Control [ELCE 2016]

Presenter: Antoine Tenart & Quentin Schulz, Free Electrons
Summary: This talk will describe the Kernel CI goals and infrastructure
and how it communicates with our farm using LAVA. It gives a feedback
on how boards farm designed and present its second use case: remote
control of boards.

Herd Your Boards, Become a Farmer [ELCE 2016]

Presenter: Geert Uytterhoeven, Glider bvba
Summary: This presentation provides information about development boards
on a board farm and overcomes the issues related to control,
power, monitor and automating boards in your farm.

Test Suites

FOSS Static Analysis Tools for Embedded Systems and How to Use Them [ELCE 2020]

Presenter: Jan-Simon Moller, The Linux Foundation
Summary: This talk presents a variety of static analysis tools that can be used to perform static analysis on the source code base for an embedded product. Two tools with lots of sub-tools are 'meta-sca' and 'meta-codechecker'. The tools and their capabilities for testing are introduced.

Stress Testing and Micro Benchmarking Kernels with Stress-ng (Stress-ng) [ELCE 2019]

Presenter: Colin Ian King, Canonical
Summary: This talk gives a great overview of stress-ng and how it can be used to perform a variety of tests on a Linux platform. There are many examples of different sub-tests and options (with command line arguments), as well as output and tracing options.

Impact of Platform Firmware on Linux Kernel (LUV Test Suite) [ELC 2018]

Presenter: Megha Dey & Sal Praneeth Prakhya, Intel
Summary: This presentation introduces LUV (Linux UEFI Validation); a unified
framework of several open-source test-suites packaged into a cohesive
and easy-to-use product that aims to help firmware developers uncover
bugs in the implementation of UEFI firmware at critical levels of the s/w stack.

Kselftest

Kernel Validation with Kselftest (Kselftest) [LF mentorship 2021]

Presenter: Shuah Khan, Linux Foundation Summary: Presents an overview of kselftest and kernel testing in general, with details about how to run the included tests.

KSelftest Running in Test Rings - Where Are We? (Kselftest) [ELCE 2020/OSS 2020]

Presenter: Shuah Khan, Linux Foundation Summary: Discusses the current status of kselftest, and in particular how it is being used with KernelCI, and what additional features are needed for improved KernelCI integration.

Linux Kernel Selftest Framework - Quality Control for New Releases (Kselftest) [ELC 2015]

Presenter: Shuah Khan, Samsung
Summary: This presentation provides information about running the kselftest,kselftest
git, installation of the self-test, and run test from the install location.

Standards

Automated Testing Summmit Industry Standards discussion [ATS 2018]

Presenters: Tim Bird, Sony and Kevin Hilman, Baylibre
Summary: The first Automated Testing Summit held discussions about a number of potential areas for standardization of automated testing, including test definitions, dependencies, test execution, test artifacts (storing, presenting, analysis), and farm hardware standards.

Others

Tips for Writing Good Tests for Linux [ELC 2018]

Presenter: Tim Bird, Sony Corporation
Summary: This talk will review and compare different test writing frameworks,
including kself-test, LTP and Fuego, and describe each one's strengths
and weaknesses. A basic introduction to writing a test in each one will be given.

Kernel Testing Tools and Techniques [ELC 2013]

Presenter: Matt Porter, Texas Instruments, Inc
Summary: This presentation provides information about frameworks, lab tools, techniques of the open test, autotest, Jenkins, ktest.