Skip to content

ci(tests): Add linpack FPU tests #3165

ci(tests): Add linpack FPU tests

ci(tests): Add linpack FPU tests #3165

GitHub Actions / Test Results failed Oct 1, 2024 in 0s

1 fail, 25 pass in 1h 3m 14s

43 files   -  84  43 suites   - 84   1h 3m 14s ⏱️ - 39m 53s
26 tests  -   1  25 ✅ ±  0  0 💤 ±0  1 ❌  - 1 
56 runs   - 229  53 ✅  - 230  0 💤 ±0  3 ❌ +1 

Results for commit e284cbe. ± Comparison against earlier commit bca566b.

Annotations

Check warning on line 0 in performance.linpack_double.test_linpack_double

See this annotation in the file changed.

@github-actions github-actions / Test Results

3 out of 5 runs failed: test_linpack_double (performance.linpack_double.test_linpack_double)

./artifacts/parent-artifacts/results/hw/performance/linpack_double/esp32/linpack_double.xml [took 20s]
./artifacts/parent-artifacts/results/hw/performance/linpack_double/esp32c6/linpack_double.xml [took 15s]
./artifacts/parent-artifacts/results/hw/performance/linpack_double/esp32s2/linpack_double.xml [took 17s]
Raw output
AssertionError: Invalid run number
assert 12 == 122
dut = <pytest_embedded_serial.dut.SerialDut object at 0x7f974f1113f0>
request = <FixtureRequest for <Function test_linpack_double>>

    def test_linpack_double(dut, request):
        LOGGER = logging.getLogger(__name__)
    
        # Match "Runs: %d"
        res = dut.expect(r"Runs: (\d+)", timeout=60)
        runs = int(res.group(0).decode("utf-8").split(" ")[1])
        LOGGER.info("Number of runs: {}".format(runs))
        assert runs > 0, "Invalid number of runs"
    
        # Match "Type: %s"
        res = dut.expect(r"Type: (\w+)", timeout=60)
        data_type = res.group(0).decode("utf-8").split(" ")[1]
        LOGGER.info("Data type: {}".format(data_type))
        assert data_type == "double", "Invalid data type"
    
        for i in range(runs):
            # Match "Run %d"
            res = dut.expect(r"Run (\d+)", timeout=120)
            run = int(res.group(0).decode("utf-8").split(" ")[1])
            LOGGER.info("Run {}".format(run))
>           assert run == i, "Invalid run number"
E           AssertionError: Invalid run number
E           assert 12 == 122

tests/performance/linpack_double/test_linpack_double.py:26: AssertionError

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Test Results

26 tests found

There are 26 tests, see "Raw output" for the full list of tests.
Raw output
basic_transmission_test
begin_when_running_test
change_baudrate_test
change_cpu_frequency_test
change_pins_test
disabled_uart_calls_test
enabled_uart_calls_test
end_when_stopped_test
performance.coremark.test_coremark ‑ test_coremark
performance.fibonacci.test_fibonacci ‑ test_fibonacci
performance.linpack_double.test_linpack_double ‑ test_linpack_double
performance.linpack_float.test_linpack_float ‑ test_linpack_float
performance.psramspeed.test_psramspeed ‑ test_psramspeed
performance.ramspeed.test_ramspeed ‑ test_ramspeed
performance.superpi.test_superpi ‑ test_superpi
periman_test
resize_buffers_test
test_fail
test_pass
timer_clock_select_test
timer_divider_test
timer_interrupt_test
timer_read_test
validation.hello_world.test_hello_world ‑ test_hello_world
validation.nvs.test_nvs ‑ test_nvs
validation.periman.test_periman ‑ test_periman