Difference between revisions of "Testing Presentations"

From eLinux.org
Jump to: navigation, search
 
(9 intermediate revisions by 3 users not shown)
Line 1: Line 1:
= '''Upstream Kernel Testing''' =
+
='''Kernel CI'''=
 +
 
 +
== Bootstraping a Local KernelCI [ELC 2019] ==
 +
'''Presenter:''' Michał Gałka, Collabora <br>
 +
'''Summary:'''
 +
This presentation will go through the process of setting up a minimal <br>
 +
local development/testing environment that's suitable for running the <br>
 +
KernelCI phases of build, boot, test and results collection. <br>
 +
 
 +
* [https://elinux.org/images/8/86/Bootstraping_Local_KernelCI.pdf PDF] | [https://www.youtube.com/watch?v=ApoTzhc1IY0 VIDEO]
 +
 
 
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2019] ==
 
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2019] ==
 +
'''Presenter:''' Kevin Hilman, Linaro <br>
 +
'''Summary:'''
 +
This presentation provides information about build failing, <br>
 +
boot failing and display build status. <br>
 +
 +
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF] | [https://elinux.org/images/f/ff/Kernelci.pdf VIDEO]
 +
 +
== Introducing the "Lab in a Box" Concept [ELC 2018] ==
 +
'''Presenter:''' Patrick Titiano & Kevin Hillman, Baylibre <br>
 +
'''Summary:'''
 +
This presentation provides information about the quality <br>
 +
level without the leveraging CI and test automation. <br>
 +
 +
* [https://elinux.org/images/b/b4/Introducing_The_%E2%80%9CLab_in_a_Box%E2%80%9D_Concept_%28ELC-2018-Portland%29.pdf PDF] | [https://www.youtube.com/watch?v=aavoHUpzBGU VIDEO]
 +
 +
== BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]==
 +
'''Presenter:''' Kevin Hilman, BayLibre <br>
 +
'''Summary:'''
 +
This BoF will provide a very brief overview and current status of kernelci<br>
 +
 +
* [https://elinux.org/images/f/f6/Hilman.pdf PDF] | [https://youtu.be/37t-U0PGNlw VIDEO]
 +
 +
== Mark Brown, Linaro & Kevin Hilman, BayLibre [ELCE 2016] ==
 +
'''Presenter:''' Kernelci.org Needs YOU! <br>
 +
'''Summary:'''
 +
This presentation provides information about kernelci.org, <br>
 +
Lab setup, and LAVA v2 installations. <br>
  
 +
* [https://elinux.org/images/b/b9/Brown.pdf PDF] | [https://youtu.be/xaQuNM01YNo?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
 +
 +
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]==
 
'''Presenter:''' Kevin Hilman, Linaro <br>
 
'''Presenter:''' Kevin Hilman, Linaro <br>
 
'''Summary:'''
 
'''Summary:'''
This presentation provides information about build failing, boot failing and display build status. <br>
+
This BoF will provide a very brief overview on Kernel upstreaming as <br>
 +
part of KernelCI project. <br>
  
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF] | [https://elinux.org/images/f/ff/Kernelci.pdf VIDEO]
+
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF]
 +
 
 +
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]==
 +
'''Presenter:''' Kevin Hilman, Linaro <br>
 +
'''Summary:'''
 +
This BoF will provide a very brief overview on Kernel upstreaming as <br>
 +
part of KernelCI project. <br>
 +
 
 +
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF]
 +
 
 +
==BoFs: kernelci.org [ELCE 2015] ==
 +
'''Presenter:''' Kevin Hilman, Linaro <br>
 +
'''Summary:'''
 +
This presentation provides information about the upstream kernel CI <br>
 +
and the current state of the upstream tree. <br>
 +
 
 +
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF] | [https://www.youtube.com/watch?v=F66Ff93503E VIDEO]
  
 
= '''FUEGO''' =
 
= '''FUEGO''' =
Line 24: Line 81:
  
 
* [https://elinux.org/images/8/88/ELC-jsmoeller-2017-02-TESTING-VULCANOES-LAVA-FUEGO.pdf PDF] | [https://youtu.be/IA6cBIGuHm4 VIDEO]
 
* [https://elinux.org/images/8/88/ELC-jsmoeller-2017-02-TESTING-VULCANOES-LAVA-FUEGO.pdf PDF] | [https://youtu.be/IA6cBIGuHm4 VIDEO]
 +
 +
== Enhance Fuego Test Efficiency by Applying Additional Software & Hardware Solutions [OSSJ 2017] ==
 +
'''Presenter:''' Khiem Nguyen, Renesas Corporation <br>
 +
'''Summary:'''
 +
This presentation provides information about integrating more software services and hardware solutions (controller for development boards)
 +
to enhance the test automation efficiency. <br>
 +
 +
* [https://elinux.org/images/1/13/OSSJ_Renesas_Fuego_enhancement_KhiemNguyen_20170531_Rev1.0.pdf PDF]
  
 
= '''Automation''' =
 
= '''Automation''' =
Line 36: Line 101:
  
 
== Automated Flashing and Testing for Continuous Integration [ELC 2015] ==
 
== Automated Flashing and Testing for Continuous Integration [ELC 2015] ==
 
 
'''Presenter:''' Igor Stoppa, Intel <br>
 
'''Presenter:''' Igor Stoppa, Intel <br>
 
'''Summary:'''
 
'''Summary:'''
Line 45: Line 109:
  
 
== Automated Testing with ktest.pl (Embedded Edition) [ELC 2012] ==
 
== Automated Testing with ktest.pl (Embedded Edition) [ELC 2012] ==
 
 
'''Presenter:''' Steven Rostedt, Red Hat<br>
 
'''Presenter:''' Steven Rostedt, Red Hat<br>
 
'''Summary:'''
 
'''Summary:'''
Line 53: Line 116:
  
 
== Distributed Cross Platform Test Automation [ELC 2006] ==
 
== Distributed Cross Platform Test Automation [ELC 2006] ==
 
 
'''Presenter:''' William Marone <br>
 
'''Presenter:''' William Marone <br>
 
'''Summary:'''
 
'''Summary:'''
Line 61: Line 123:
 
* [http://DistributedCrossPlatformTest.pdf PDF]
 
* [http://DistributedCrossPlatformTest.pdf PDF]
  
= '''Others''' =
+
= '''Board Farms''' =
  
 
== Testing Laboratory Layers [ELC 2019] ==
 
== Testing Laboratory Layers [ELC 2019] ==
 
'''Presenter:''' Paweł Wieczorek, Samsung R&D Institute Poland <br>
 
'''Presenter:''' Paweł Wieczorek, Samsung R&D Institute Poland <br>
 
'''Summary:'''
 
'''Summary:'''
These slides cover API design decisions for testing laboratories focusing on the SLAV test lab stack case and shifting to a user-centric perspective and possible outcome of such process.
+
These slides cover API design decisions for testing laboratories <br>
 +
focusing on the SLAV test lab stack case and shifting to a user-centric <br>
 +
perspective and possible outcome of such process. <br>
  
 
* [https://elinux.org/images/3/3c/Test_Lab_API.pdf PDF] | [https://www.youtube.com/watch?v=gWVp9JqVTog VIDEO]
 
* [https://elinux.org/images/3/3c/Test_Lab_API.pdf PDF] | [https://www.youtube.com/watch?v=gWVp9JqVTog VIDEO]
 +
 +
== Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018] ==
 +
'''Presenter:''' Pawel Wieczorek, Samsung R&D Institute Poland <br>
 +
'''Summary:'''
 +
This talk covers a fresh open hardware approach at providing remote access to embedded devices and the new Tizen GNU/Linux <br>
 +
distribution's testing laboratory. <br>
 +
 +
* [https://elinux.org/images/4/42/Piece_of_cake.pdf PDF] | [https://www.youtube.com/watch?v=Hx9MEhR05cU VIDEO]
 +
 +
== Grabbing Audio and Video on a Board Farm [ELCE 2018] ==
 +
'''Presenter:''' Krzysztof Opasiak, Samsung R&D Institute Poland <br>
 +
'''Summary:'''
 +
This presentation provides information about audio and video capture  <br>
 +
capabilities and unified remote access to any Single Board Computer. <br>
 +
 +
* [https://youtu.be/mw79nfp7ARE  VIDEO]
 +
 +
== From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017] ==
 +
'''Presenter:''' Pawel Wieczorek, Samsung R&D Institute Poland <br>
 +
'''Summary:'''
 +
This presentation talks about setting up one's own Test Lab using LAVA <br>
 +
 +
* [https://elinux.org/images/8/84/From_zero_to_first_test_in_your_own_LAVA_laboratory.pdf PDF] | [https://www.youtube.com/g4Hw5I2sk3A VIDEO]
 +
 +
== Farming together [ELCE 2017] ==
 +
'''Presenter: '''Andrew Murray, Witekio <br>
 +
'''Summary:'''
 +
This presentation will provide an overview of the Witekio farm<br>
 +
highlighting the challenges faced - both in hardware challenges<br>
 +
(connecting boards to farms) and software challenges.
 +
 +
* [https://elinux.org/images/5/52/BoF-FarmingTogether.pdf PDF] | [https://youtu.be/-oO9y2HnoYs VIDEO]
 +
 +
== Building a Bards Farm: Continuous Integration and Remote Control [ELCE 2016] ==
 +
'''Presenter: ''' Antoine Tenart & Quentin Schulz, Free Electrons<br>
 +
'''Summary:'''
 +
This talk will describe the Kernel CI goals and infrastructure<br>
 +
and how it communicates with our farm using LAVA. It gives a feedback<br>
 +
on how boards farm designed and present its second use case: remote<br>
 +
control of boards.
 +
 +
* [https://elinux.org/images/0/09/Building_a_Bards_Farm.pdf PDF] | [https://youtu.be/sJvusc6jz4w?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
 +
 +
== Herd Your Boards, Become a Farmer [ELCE 2016] ==
 +
'''Presenter:''' Geert Uytterhoeven, Glider bvba  <br>
 +
'''Summary:'''
 +
This presentation provides information about development boards <br>
 +
on a board farm and overcomes the issues related to control, <br>
 +
power, monitor and automating boards in your farm. <br>
 +
 +
* [https://elinux.org/images/b/b5/Herd_Your_Boards.pdf PDF] | [https://youtu.be/kwqmjeqAx-E?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
 +
 +
= '''Test Suites''' =
 +
 +
== Linux Kernel Selftest Framework - Quality Control for New Releases [ELC 2015] ==
 +
'''Presenter:''' Shuah Khan, Samsung <br>
 +
'''Summary:'''
 +
This presentation provides information about running the kselftest,kselftest <br>
 +
git, installation of the self-test, and run test from the install location.  <br>
 +
 +
* [https://elinux.org/images/6/61/Linux_Kernel_Selftest_Framework_-_Quality_Control_for_New_Releases.pdf PDF]
 +
 +
= '''Others''' =
  
 
== Tips for Writing Good Tests for Linux [ELC 2018] ==
 
== Tips for Writing Good Tests for Linux [ELC 2018] ==
Line 79: Line 206:
 
* [https://elinux.org/images/6/60/Tips-for-Writing-Good-Tests-for-Linux-2018-03-ELC.pdf PDF] | [https://www.youtube.com/watch?v=NzJFwCUGJtc VIDEO]
 
* [https://elinux.org/images/6/60/Tips-for-Writing-Good-Tests-for-Linux-2018-03-ELC.pdf PDF] | [https://www.youtube.com/watch?v=NzJFwCUGJtc VIDEO]
  
== Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018] ==
+
== Impact of Platform Firmware on Linux Kernel [ELC 2018] ==
'''Presenter:''' Pawel Wieczorek, Samsung R&D Institute Poland <br>
+
'''Presenter:''' Megha Dey & Sal Praneeth Prakhya, Intel <br>
 +
'''Summary:'''
 +
This presentation introduces LUV (Linux UEFI Validation); a unified <br>
 +
framework of several open-source test-suites packaged into a cohesive <br>
 +
and easy-to-use product that aims to help firmware developers uncover <br>
 +
bugs in the implementation of UEFI firmware at critical levels of the s/w stack. <br>
 +
 
 +
* [https://elinux.org/images/b/b7/Impact_of_platform_firmware_on_linux_kernel.pdf PDF] | [https://www.youtube.com/watch?v=7aME1lxY71Q VIDEO]
 +
 
 +
== Keynote: The Maintainer's Paradox [ELC 2018] ==
 +
'''Presenter:''' Tim Bird, Sr. Software Engineer, Sony <br>
 +
'''Summary:'''
 +
The overall goal is to improve Linux for use in consumer electronics <br>
 +
products, by improving Linux system testing, directing technical initiatives <br>
 +
of the Linux Foundation and encouraging companies to participate in the open <br>
 +
source community. <br>
 +
 
 +
* [https://elinux.org/images/4/4e/The-Maintainers-Paradox-2018-ELC-Tim-Bird.pdf PDF] | [https://www.youtube.com/watch?v=7aME1lxY71Q VIDEO]
 +
 
 +
== Herd Your Boards, Become a Farmer [ELCE 2016] ==
 +
'''Presenter:''' Geert Uytterhoeven, Glider bvba <br>
 
'''Summary:'''
 
'''Summary:'''
This talk covers a fresh open hardware approach at providing remote access to embedded devices and the new Tizen GNU/Linux <br>
+
This presentation provides information about organizing development boards in a board farm, and about board farm requirements and challenges.<br>
distribution's testing laboratory. <br>
+
It offers practical solutions for overcoming issues related to controlling, powering, monitoring, and automating boards in your farm.
  
* [https://elinux.org/images/4/42/Piece_of_cake.pdf PDF] | [https://www.youtube.com/watch?v=Hx9MEhR05cU VIDEO]
+
* [[Media:Herd Your Boards.pdf|PDF]] | [https://youtu.be/kwqmjeqAx-E?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
  
 
== Linux Integrated System Analysis (LISA) & Friends [ELC 2016] ==
 
== Linux Integrated System Analysis (LISA) & Friends [ELC 2016] ==
 
 
'''Presenter:''' Patrick Bellasi, ARM Ltd <br>
 
'''Presenter:''' Patrick Bellasi, ARM Ltd <br>
 
'''Summary:'''
 
'''Summary:'''
Line 95: Line 241:
  
 
* [https://elinux.org/images/1/12/Bellasi.pdf PDF] | [https://youtu.be/m949uduHHsw VIDEO]
 
* [https://elinux.org/images/1/12/Bellasi.pdf PDF] | [https://youtu.be/m949uduHHsw VIDEO]
 
== Linux Kernel Selftest Framework - Quality Control for New Releases [ELC 2015] ==
 
 
'''Presenter:''' Shuah Khan, Samsung <br>
 
'''Summary:'''
 
This presentation provides information about running the kselftest,kselftest git, installation of the self-test, and run test from <br>
 
the install location.  <br>
 
 
* [https://elinux.org/images/6/61/Linux_Kernel_Selftest_Framework_-_Quality_Control_for_New_Releases.pdf PDF]
 
  
 
== Kernel Testing Tools and Techniques [ELC 2013] ==
 
== Kernel Testing Tools and Techniques [ELC 2013] ==
 
 
'''Presenter:''' Matt Porter, Texas Instruments, Inc <br>
 
'''Presenter:''' Matt Porter, Texas Instruments, Inc <br>
 
'''Summary:'''
 
'''Summary:'''

Latest revision as of 19:37, 5 November 2020

Contents

Kernel CI

Bootstraping a Local KernelCI [ELC 2019]

Presenter: Michał Gałka, Collabora
Summary: This presentation will go through the process of setting up a minimal
local development/testing environment that's suitable for running the
KernelCI phases of build, boot, test and results collection.

BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2019]

Presenter: Kevin Hilman, Linaro
Summary: This presentation provides information about build failing,
boot failing and display build status.

Introducing the "Lab in a Box" Concept [ELC 2018]

Presenter: Patrick Titiano & Kevin Hillman, Baylibre
Summary: This presentation provides information about the quality
level without the leveraging CI and test automation.

BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]

Presenter: Kevin Hilman, BayLibre
Summary: This BoF will provide a very brief overview and current status of kernelci

Mark Brown, Linaro & Kevin Hilman, BayLibre [ELCE 2016]

Presenter: Kernelci.org Needs YOU!
Summary: This presentation provides information about kernelci.org,
Lab setup, and LAVA v2 installations.

BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]

Presenter: Kevin Hilman, Linaro
Summary: This BoF will provide a very brief overview on Kernel upstreaming as
part of KernelCI project.

BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]

Presenter: Kevin Hilman, Linaro
Summary: This BoF will provide a very brief overview on Kernel upstreaming as
part of KernelCI project.

BoFs: kernelci.org [ELCE 2015]

Presenter: Kevin Hilman, Linaro
Summary: This presentation provides information about the upstream kernel CI
and the current state of the upstream tree.

FUEGO

Fuego test sytem [ELC 2019]

Presenter: Hirotaka Motai, Mitsubishi Electric Corp.
Summary: This presentation provides information about the run-time logger in Fuego by showing the actual use cases and functional checking.

Testing with Volcanoes - Fuego+LAVA Going Distributed [ELC 2017]

Presenter: Jan-Simon Moeller, The Linux Foundation
Summary: This presentation provides information about the features of the combined infrastructure and highlights the tools and work done
to integrate both tools.

Enhance Fuego Test Efficiency by Applying Additional Software & Hardware Solutions [OSSJ 2017]

Presenter: Khiem Nguyen, Renesas Corporation
Summary: This presentation provides information about integrating more software services and hardware solutions (controller for development boards) to enhance the test automation efficiency.

Automation

Automated Testing Laboratory for Embedded Linux Distributions [ELC 2016]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This talk provides information about problems faced while building automatic testing infrastructure for Tizen operating
system images.

Automated Flashing and Testing for Continuous Integration [ELC 2015]

Presenter: Igor Stoppa, Intel
Summary: This presentation provides information about verifying a software image on an appropriate target hardware device and
hardware configuration.

Automated Testing with ktest.pl (Embedded Edition) [ELC 2012]

Presenter: Steven Rostedt, Red Hat
Summary: This presentation provides information about write to build, install, boot, and test kernel remotely.

Distributed Cross Platform Test Automation [ELC 2006]

Presenter: William Marone
Summary: This presentation provides information about test AXFS functionality, quickly build, run test, and across multiple architectures
and kernels.

Board Farms

Testing Laboratory Layers [ELC 2019]

Presenter: Paweł Wieczorek, Samsung R&D Institute Poland
Summary: These slides cover API design decisions for testing laboratories
focusing on the SLAV test lab stack case and shifting to a user-centric
perspective and possible outcome of such process.

Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This talk covers a fresh open hardware approach at providing remote access to embedded devices and the new Tizen GNU/Linux
distribution's testing laboratory.

Grabbing Audio and Video on a Board Farm [ELCE 2018]

Presenter: Krzysztof Opasiak, Samsung R&D Institute Poland
Summary: This presentation provides information about audio and video capture
capabilities and unified remote access to any Single Board Computer.

From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This presentation talks about setting up one's own Test Lab using LAVA

Farming together [ELCE 2017]

Presenter: Andrew Murray, Witekio
Summary: This presentation will provide an overview of the Witekio farm
highlighting the challenges faced - both in hardware challenges
(connecting boards to farms) and software challenges.

Building a Bards Farm: Continuous Integration and Remote Control [ELCE 2016]

Presenter: Antoine Tenart & Quentin Schulz, Free Electrons
Summary: This talk will describe the Kernel CI goals and infrastructure
and how it communicates with our farm using LAVA. It gives a feedback
on how boards farm designed and present its second use case: remote
control of boards.

Herd Your Boards, Become a Farmer [ELCE 2016]

Presenter: Geert Uytterhoeven, Glider bvba
Summary: This presentation provides information about development boards
on a board farm and overcomes the issues related to control,
power, monitor and automating boards in your farm.

Test Suites

Linux Kernel Selftest Framework - Quality Control for New Releases [ELC 2015]

Presenter: Shuah Khan, Samsung
Summary: This presentation provides information about running the kselftest,kselftest
git, installation of the self-test, and run test from the install location.

Others

Tips for Writing Good Tests for Linux [ELC 2018]

Presenter: Tim Bird, Sony Corporation
Summary: This talk will review and compare different test writing frameworks,
including kself-test, LTP and Fuego, and describe each one's strengths
and weaknesses. A basic introduction to writing a test in each one will be given.

Impact of Platform Firmware on Linux Kernel [ELC 2018]

Presenter: Megha Dey & Sal Praneeth Prakhya, Intel
Summary: This presentation introduces LUV (Linux UEFI Validation); a unified
framework of several open-source test-suites packaged into a cohesive
and easy-to-use product that aims to help firmware developers uncover
bugs in the implementation of UEFI firmware at critical levels of the s/w stack.

Keynote: The Maintainer's Paradox [ELC 2018]

Presenter: Tim Bird, Sr. Software Engineer, Sony
Summary: The overall goal is to improve Linux for use in consumer electronics
products, by improving Linux system testing, directing technical initiatives
of the Linux Foundation and encouraging companies to participate in the open
source community.

Herd Your Boards, Become a Farmer [ELCE 2016]

Presenter: Geert Uytterhoeven, Glider bvba
Summary: This presentation provides information about organizing development boards in a board farm, and about board farm requirements and challenges.
It offers practical solutions for overcoming issues related to controlling, powering, monitoring, and automating boards in your farm.

Linux Integrated System Analysis (LISA) & Friends [ELC 2016]

Presenter: Patrick Bellasi, ARM Ltd
Summary: This presentation provides information about the new Linux integrated system analysis framework for easier development and ideal
for detailed debug scenarios.

Kernel Testing Tools and Techniques [ELC 2013]

Presenter: Matt Porter, Texas Instruments, Inc
Summary: This presentation provides information about frameworks, lab tools, techniques of the open test, autotest, Jenkins, ktest.