SAN19-112 - Intelligent Linux test suite

Session Abstract

Every Linux release is a collaboration of various developers, maintainers and sub-system, containing lots of patches and codes and community try their best to ascertain the stability as much as possible.
But considering that the changes can impact various areas/subsystems/use-cases/architectures, it is not very easy and rather impossible to guarantee a stable release. Even ensuring regressions is not a straightforward thing.

Any organization which is considering to up-rev their Linux always has susceptibility to risk. Despite the best work being done by community of testers, maintainers and developers, how many or how severe bugs will get introduced in the re-based Linux is a question not easy to answer.
This susceptibility/risk can be reduced with good number of test cases; these tests could be specific tests related to organization in terms of the architectures they use and the use-cases they support, and various test cases inherited from open source. And to have very low risk level, there would be a need to run hundreds/thousands of test cases.
Here execution of test cases may take time from hours to days.
Other problem with test cases that they are static and never get evolved with past learning and experiences.

We are proposing a AI based tool which will help to provide a set of test cases (sub set of hundreds/thousands of test cases) which are intelligently picked based
on past learning of driver or sub-system or area. This past learning is created based on result of test cases run in various previous releases. This subset of test cases can be run
to check the stability of Linux and the risk level of an up-rev. This is definitely a huge time saving and at the same time will try to identify the problem areas more efficiently.
This tool would also publish the list of test cases run and their pass/fail result.

Any organization can then look through the test report, check the failed test cases assess the severity of the failures, and decide whether they should go for fix or wait for new release.
This tool can be run on every Linux release to provide stability level. Other than stability, this tool can also tell area/subsystem which are stable or which are very dynamic in nature, helping maintainers focus.

Aim is to place this tool on any open web portal which is easily accessible by the community. Also community can help with more test cases to enhance tool learning and hence good sub-set of test cases.

Session Speakers

Poonam Aggrwal

Platform Software Architect (NXP Semiconductor Ltd)

I am computer Science Engineering graduate with almost 18 years of continuous experience in Embedded systems, Linux BSP, Unix, operating system internals, device drivers, boot loaders, Flash, DDR, Ethernet, SATA, USB, wireless, networking, etc, and open source software. Very good hold on PowerPC and ARM architectures. Representing NXP in various open source projects of ARM ecosystem, distros and CIs like Linaro(LSK), Preempt RT, Yocto, SUSE..

I have been involved in various bring up, BSP code development and open source up-streaming of these BSPs for various NXP SoCs of QorIQ, Qonverge and Layerscape series. This includes MPC8323, MPC8360, P1020, P1010, P2020, BSC9131, BSC9132, B4860, T1040, LS2088A, LS1012A, LS1088A for u-boot and Linux. I have been working as software IP owner for various areas like TDM, ethernet, DDR, Flash controller, heterogenous systems, multicore, AMP, etc.

Currently playing the role of System Software architect which involves SoC feasibility and laying out the BSP software architecture for the NXP devices for wireless, networking and IoT use cases. Key areas include Platform software, u-boot, linux and device drivers.

Poonam Aggrwal

Prabhakar Kushwaha

Platform Software Architect (NXP Semiconductor Ltd)

I am a computer science and engineering Graduate with ~13 years of continuous experience in Linux/RTOS based Embedded software/firmware in multi-core technologies and having very good exposure of Linux, FreeRTOS, u-boot, device drivers, boot loaders, flash technologies etc.

I have been involved in various bring up, BSP code development and open source up-streaming of these BSP for various NXP SoCs including BSC9131, BSC9132, B4860, T1040, LS2085A, LS1012A, LS1088A for u-boot and Linux. I am software IP owner for IFC (Integrated flash controller) for u-boot, Linux. i am also working as u-boot upstream maintainer for NXP.

comments powered by Disqus

Other Posts

Sign up. Receive Updates. Stay informed.

Sign up to our mailing list to receive updates on the latest Linaro Connect news!