manual compliance: remove bits done at runtime

(From OE-Core rev: 434618bec47efdda90981d248bc481f45da093b4)

Signed-off-by: Armin Kuster <akuster808@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
This commit is contained in:
Armin Kuster 2019-04-22 06:35:08 -06:00 committed by Richard Purdie
parent b49916c252
commit 37af0d00f0

View File

@ -1,92 +1,4 @@
[
{
"test": {
"@alias": "compliance-test.compliance-test.LTP_subset_test_suite",
"author": [
{
"email": "corneliux.stoicescu@intel.com",
"name": "corneliux.stoicescu@intel.com"
}
],
"execution": {
"1": {
"action": "For real hardware, run following component, \nsyscalls \nfs \nfsx \ndio \nio \nmm \nipc \nsched \nmath \nnptl \npty \nadmin_tools \ntimers \ncommands \n\nFor QEMU, run following component \nsyscalls \nmm \nipc \nsched \nmath \nnptl \npty \nadmin_tools \ncommands \n\nRun Instructions: \nLTP download: http://sourceforge.net/projects/ltp/files/LTP%20Source/ltp-20120401/ltp-full-20120401.bz2/download \n\n(link is outdated, always use the last version released or the one found in the image) \n\n\n\nbuild steps: refer to http://ltp.sourceforge.net \n\nRun steps:",
"expected_results": ""
},
"2": {
"action": "Build LTP with toolchain or in sdk image. Or use a sato-sdk image which has LTP already included in /opt/ltp",
"expected_results": ""
},
"3": {
"action": "For QEMU, create the qemu target with \"-m 512\", which makes some memory stress cases pass. For some issues, we could only set 128M for qemuarm and 256M for qemumips.",
"expected_results": ""
},
"4": {
"action": "Copy LTP folder into target, for example, /opt/ltp if you have built it yourself. Modify the default scenario file \"scenario_groups/default\", remove test suites not to be tested",
"expected_results": ""
},
"5": {
"action": "Comment runtests/sched: hackbench, which is not suitable to run in emulators. Reminder (comment it also for Sugarbay Devices).",
"expected_results": ""
},
"6": {
"action": "Comment oom01, oom02, oom03, oom04 in runtest/mm, which consume lots of memory",
"expected_results": ""
},
"7": {
"action": "From /opt/ltp run: ./runltp -p -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/ltp/tmp &> result-M2-20101218.fulllog \n\n",
"expected_results": "Check the result on wiki, https://wiki.yoctoproject.org/wiki/LTP_result, there should be no regression failure met."
}
},
"summary": "LTP_subset_test_suite"
}
},
{
"test": {
"@alias": "compliance-test.compliance-test.POSIX_subset_test_suite",
"author": [
{
"email": "corneliux.stoicescu@intel.com",
"name": "corneliux.stoicescu@intel.com"
}
],
"execution": {
"1": {
"action": "In a sato-sdk image go to /opt/ltp or get latest LTP sourcecode, download location is http://sourceforge.net/projects/ltp/files/LTP%20Source/ and install it.",
"expected_results": ""
},
"2": {
"action": "Go into the folder of LTP, and posix_testsuite is under testcases/open_posix_testsuite/",
"expected_results": ""
},
"3": {
"action": "Run connmand: make generate-makefiles",
"expected_results": ""
},
"4": {
"action": "Run connmand: make conformance-all",
"expected_results": ""
},
"5": {
"action": "Run connmand: make conformance-test (this step may show errors, ignore them)",
"expected_results": ""
},
"6": {
"action": "Run connmand: make tools-all",
"expected_results": ""
},
"7": {
"action": "Run connmand: sh posix.sh > posix.log, posix.sh as below: \n \n#!/bin/sh \n./bin/run-posix-option-group-test.sh AIO \n./bin/run-posix-option-group-test.sh MEM \n./bin/run-posix-option-group-test.sh MSG \n./bin/run-posix-option-group-test.sh SEM \n./bin/run-posix-option-group-test.sh SIG \n./bin/run-posix-option-group-test.sh THR \n./bin/run-posix-option-group-test.sh TMR \n./bin/run-posix-option-group-test.sh TPS \n \n",
"expected_results": ""
},
"8": {
"action": "Check the posix.log after testing is finished",
"expected_results": "Compare the test result on wiki, https://wiki.yoctoproject.org/wiki/Posix_result, there should be no more regression failures met."
}
},
"summary": "POSIX_subset_test_suite"
}
},
{
"test": {
"@alias": "compliance-test.compliance-test.LSB_subset_test_suite",
@ -191,4 +103,4 @@
"summary": "stress_test_-_-ltp_-Beaglebone"
}
}
]
]