Commit Graph

22 Commits

Author SHA1 Message Date
Gyorgy Sarvari
03328f6c73
tinyproxy: add ptest support
It takes <10s to execute.

Sample output:

root@qemux86-64:~# ptest-runner
START: ptest-runner
2025-12-23T17:45
BEGIN: /usr/lib/tinyproxy/ptest
starting web server... done (listening on 127.0.0.3:32123)
starting tinyproxy... done (listening on 127.0.0.2:12321)
waiting for 1 seconds.. done
checking direct connection to web server... ok
testing connection through tinyproxy... ok
requesting statspage via stathost url... ok
signaling tinyproxy to reload config...ok
checking direct connection to web server... ok
testing connection through tinyproxy... ok
requesting statspage via stathost url... ok
checking bogus request... ok, got expected error code 400
testing connection to filtered domain... ok, got expected error code 403
requesting connect method to denied port... ok, got expected error code 403
testing unavailable backend... ok, got expected error code 502
0 errors
killing tinyproxy... ok
killing webserver... ok
done
PASS: run_tests.sh
DURATION: 1
END: /usr/lib/tinyproxy/ptest
2025-12-23T17:45
STOP: ptest-runner
TOTAL: 1 FAIL: 0

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-12-24 13:18:25 -08:00
Gyorgy Sarvari
70a2b417c6
unbound: complete ptest support
The recipe had already an almost working ptest config which
wasn't enabled, it just needed some small fixes to make it work:
correct the output of the run-ptest script, and install some
extra testdata.

Execution is quick, single digit seconds:

root@qemux86-64:/usr/lib/unbound/ptest/tests# ptest-runner
START: ptest-runner
2025-12-16T11:53
BEGIN: /usr/lib/unbound/ptest
Start of unbound 1.24.2 unit test.
test authzone functions
test negative cache functions
test ub_random functions
[...many lines...]
PASS: ./testdata/val_unsecds_negcache.rpl
PASS: ./testdata/val_unsecds_qtypeds.rpl
PASS: ./testdata/val_wild_pos.rpl
PASS: ./testdata/version_bind.rpl
PASS: ./testdata/version_bind_hide.rpl
PASS: ./testdata/views.rpl
DURATION: 4
END: /usr/lib/unbound/ptest
2025-12-16T11:53
STOP: ptest-runner
TOTAL: 1 FAIL: 0

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-12-16 19:57:34 -08:00
Gyorgy Sarvari
237efae216 python3-scapy: fix ptests
1. Install missing test files
2. Enable network access by setting a nameserver in resolv.conf
   because some tests require this
3. One test tries to ping Google through IPv6 - this test requires
   ipv6 DISTRO_FEATURE. In case ipv6 is not enabled, skip this test
   from the run-ptest script.

NB: the last mentioned test to work  also requires IPv6 support from
your ISP. My ISP is IPv4-only, and I couldn't try it out. The above
comes from my reading of the testcode.

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-10-28 23:31:28 -07:00
Gyorgy Sarvari
020d38d39a lksctp-tools: move ptest from problem-list to slow-list
The tests execute and pass successfully - I managed to run them
successfully, without a change on x86-64 and aarch64.

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-10-28 23:31:28 -07:00
Gyorgy Sarvari
227dca8861 net-snmp: fix ptests
Add missing dependencies.

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-10-28 23:31:28 -07:00
Yoann Congal
bf400cd73f
reproducibility: move known non-repro list to layer.conf
The current include file that stores the known non-reproducible packages
is layer dependent and that forces the user of the layers to maintain
the list of the files (for example, see AB config[0]).

By moving the exclude list to each layer.conf and extending the common
OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES variable, the known non-reproducible
packages will be automatically excluded for each layer used in the
reproducibility test without any special knowledge in the test
environment.

NB: the empty list for meta-initramfs was just removed not moved.

[0]: https://git.yoctoproject.org/yocto-autobuilder-helper/tree/config.json?id=7d8933e75bdf7fb821a25617cb2dcabf1f3f8700#n322

Suggested-by: Quentin Schulz <quentin.schulz@cherry.de>
Co-Developed-by: Guillaume Swaenepoel <guillaume.swaenepoel@smile.fr>
Signed-off-by: Guillaume Swaenepoel <guillaume.swaenepoel@smile.fr>
Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-06-20 10:34:11 -07:00
Khem Raj
34b4c40f47
ptest-packagelists-meta-networking: Adjust ptests as per pass status
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-04-12 10:06:29 -07:00
Yoann Congal
26dab6c956
reproducibility: Mark phytool{,-dbg} as known non-reproducible
From AB run:
https://autobuilder.yoctoproject.org/valkyrie/#/builders/87/builds/36/steps/28/logs/stdio

Diffoscope output is at:
https://valkyrie.yocto.io/pub/repro-fail-openembedded/meta-networking/oe-reproducible-20250315-xxydi74w/packages/diff-html/

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-15 23:05:31 -07:00
Yoann Congal
d7cef19fcc
reproducibility: update known non-reproducible packages
Those reproducible failures are from AB runs:
* https://autobuilder.yoctoproject.org/valkyrie/#/builders/87/builds/34
* https://autobuilder.yoctoproject.org/valkyrie/#/builders/87/builds/35

https://valkyrie.yocto.io/pub/repro-fail-openembedded/

NB: diffoscope output can be found in
Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-11 19:34:55 -07:00
Sofiane HAMAM
06a5e82a83 Wolfssl: add ptest
Add ptest for Wolfssl package.
Set IMAGE_ROOTFS_EXTRA_SPACE:virtclass-mcextend-wolfssl to 700M
enough to avoid a "No space left on device".

BEGIN: /usr/lib/wolfssl/ptest
Wolfssl ptest logs are stored in /tmp/wolfss_temp.qvuQ9h/ptest.log
Test script returned: 0
unit_test: Success for all configured tests.
PASS: Wolfssl
DURATION: 7
END: /usr/lib/wolfssl/ptest

Signed-off-by: Sofiane HAMAM <sofiane.hamam@smile.fr>
Reviewed-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-06 06:58:00 -08:00
Jiaying Song
bea74f838b
openvpn: add ptest support
All test cases PASS.
Add openvpn to PTESTS_SLOW because test duration longer than 30s Below is parts of the run log:
[==========] xkey provider tests: Running 3 test(s).
[ RUN      ] xkey_provider_test_fetch
[       OK ] xkey_provider_test_fetch
[ RUN      ] xkey_provider_test_mgmt_sign_cb
[       OK ] xkey_provider_test_mgmt_sign_cb
[ RUN      ] xkey_provider_test_generic_sign_cb
[       OK ] xkey_provider_test_generic_sign_cb
[==========] xkey provider tests: 3 test(s) run.
[  PASSED  ] 3 test(s).
PASS: provider_testdriver

The files t_client.sh.in and t_cltsrv.sh were not added because they
require specific environment configuration files. It is recommended that
users configure these based on their environment before testing.

Since the recipe enables iproute2, the condition for t_net.sh based on
HAVE_SITNL is not met, so t_net.sh will not be included in the build.

Signed-off-by: Jiaying Song <jiaying.song.cn@windriver.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-11-19 22:26:45 -08:00
Yoann Congal
7fe2259571
non-repro-meta-networking: update known non-reproducible list
Add ncp, ncp-dbg: symbols are not sorted the same way

from: https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/46/steps/28/logs/stdio

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-10-07 08:08:26 -07:00
Yoann Congal
1b3738d85c
non-repro-meta-networking: update known non-reproducible list
Add:
* ntopng: date in version
* opensaf: build host hostname in /etc/ files

from: https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/45/steps/28/logs/stdio

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-10-02 19:49:53 -07:00
Yoann Congal
22677f96c2
non-repro-meta-networking: update known non-reproducible list
Remove packages seen reproducible in the last 3 completed tests:
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/44/steps/28/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/43/steps/28/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/41/steps/28/logs/stdio

Add babeld & babeld-dbg from:
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/44/steps/28/logs/stdio

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-09-23 09:47:34 -07:00
Yoann Congal
af469bd2a5
non-repro-meta-networking: exclude packages that failed previously
Those are the non-reproducible packages from:
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/43

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-09-14 08:43:56 -07:00
Yoann Congal
d161de0b00
mdio-tools: fix mdio-netlink kernel module reproducibility
mdio-netlink source make reference to ${S}/.. which breaks
-fdebug-prefix-map and results in the full TMPDIR path being present in
the -dbg package and, also, change a related CRC in the main package.

This changes ${S} to enclose the whole SRC_URI repo and adapt relative paths to
build (MODULES_MODULE_SYMVERS_LOCATION)

This make mdio-netlink reproducible and fixes this warning:
WARNING: mdio-netlink-1.3.1-r0 do_package_qa: QA Issue: File /lib/modules/6.6.29-yocto-standard/updates/.debug/mdio-netlink.ko in package mdio-netlink-dbg contains reference to TMPDIR [buildpaths]

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Reviewed-by: Alexandre Truong <alexandre.truong@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-05-21 14:15:10 -07:00
Yoann Congal
d3751ce994
reproducibility: move repro excludes from AB config.json to meta-oe
For now, the known non-reproducible packages list is stored inside the
autobuilder config.json file. This is not ideal. Let's move this list
into each layers of meta-openembedded.

These lists can be used with, in local.conf:
  include conf/include/non-repro-meta-oe.inc
  OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES = "${KNOWN_NON_REPRO_META_OE}"

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Acked-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-04-29 11:11:51 -07:00
Khem Raj
47ccb88d94
freediameter: Upgrade to latest on master 1.5.0+
This also fixes all ptests, therefore move freediameter
out of PTESTS_PROBLEMS_META_NETWORKING to PTESTS_FAST_META_NETWORKING

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-04-15 21:01:12 -07:00
Khem Raj
2b416eb0d6
squid: Add missing bash dependency for ptest package
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-02-26 08:13:21 -08:00
Khem Raj
c9844a43e0
openhpi: Fix ptest run time failures
It needs make and build tools in order to run

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-02-26 08:13:21 -08:00
Khem Raj
7aff0f399b
ptest-packagelists-meta-networking: firewalld hangs therefore disabled
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-02-26 08:13:21 -08:00
Khem Raj
b757ba3028 meta-networking-image-ptest: Add images to enable BBCLASSEXTEND parallel execution
In line with other layers like meta-oe, meta-python add capability to
run recipe ptests

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-02-22 19:24:00 -08:00