Re: [Discuss-gnuradio] make test errors

[Josh Blum]

On 06/11/2013 07:34 PM, Botany Dave wrote:
> ./volk/lib/test-all completes with no errors found.
> 
> Any other suggestions would be very much appreciated.
> 
> 
> 

:-(

Well, having the volk qa fail would have nicely narrowed it down. I
guess that now its potentially ambiguous to blame volk. The good news, I
think those tests are related.

Can you report the OS name version, 32/64 bit?
The version of gnuradio where the tests failed?

-josh

> ________________________________
>  From: Josh Blum-2 [via GnuRadio] <address@hidden>
> To: Botany Dave <address@hidden> 
> Sent: Monday, June 10, 2013 7:13 PM
> Subject: Re: make test errors
>  
> 
> 
> Run volk/lib/test_all from the build dir 
> 
> If a kernel fails, it will tell you which one, start commenting out its 
> implementations in the source dir volk/kernels/volk/volk_*.h until the 
> test works. We narrow down suspect implementation and fix. 
> 
> -josh 
> 
> On 06/10/2013 09:57 PM, Dave L wrote: 
> 
>> The CPU on the laptop is an Intel i3-2350M (64 bit). 
>>
>> What steps should I take (or where can I learn how) to resolve the problem 
>> with Volk? 
>>
>> Dave 
>>
>>
>>
>>
>> ________________________________ 
>>  From: Tom Rondeau <[hidden email]> 
>> To: Botany Dave <[hidden email]> 
>> Sent: Monday, June 10, 2013 6:41 AM 
>> Subject: Re: [Discuss-gnuradio] make test errors 
>>   
>>
>> On Thu, Jun 6, 2013 at 11:52 PM, Botany Dave <[hidden email]> wrote: 
>>> I'm new to this, and I'm sure it will show... 
>>>
>>> I am trying to install and run Gnu Radio in an Ubuntu 12.10 environment. I 
>>> followed the instructions at 
>>> http://gnuradio.org/redmine/projects/gnuradio/wiki/UbuntuInstall#Installation-Overview
>>> and am getting errors on four modules when I run make test. They are: 
>>>
>>> 86 - qa_fir_filter 
>>> 91 - qa_freq__xlating_fir_filter 
>>> 150 - qa_constellation_receiver 
>>> 169 - qa_codec2_vocoder 
>>>
>>> Here is the output of ctest -V -R qa for each of those modules. I'd really 
>>> appreciate any guidance on how to resolve these failures. 
>>>
>>> 86: Test command: /bin/sh 
>>> "/home/dave/gnuradio/build/gr-filter/python/qa_fir_filter_test.sh" 
>>> 86: Test timeout computed to be: 9.99988e+06 
>>> 86: .........FF 
>>> 86: ====================================================================== 
>>> 86: FAIL: test_fir_filter_scc_001 (__main__.test_filter) 
>>> 86: ---------------------------------------------------------------------- 
>>> 86: Traceback (most recent call last): 
>>> 86:   File "/home/dave/gnuradio/gr-filter/python/qa_fir_filter.py", line 
>>> 262, in test_fir_filter_scc_001 
>>> 86:     self.assertComplexTuplesAlmostEqual(expected_data, result_data, 5) 
>>> 86:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 74, in assertComplexTuplesAlmostEqual 
>>> 86:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>> 86:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 47, in assertComplexAlmostEqual 
>>> 86:     (msg or '%s != %s within %s places' % (`first`, `second`, `places` 
>>> )) 
>>> 86: AssertionError: (0.5+1j) != (nan+nanj) within 5 places 
>>> 86: 
>>> 86: ====================================================================== 
>>> 86: FAIL: test_fir_filter_scc_002 (__main__.test_filter) 
>>> 86: ---------------------------------------------------------------------- 
>>> 86: Traceback (most recent call last): 
>>> 86: Using Volk machine: avx_32_mmx 
>>> 86:   File "/home/dave/gnuradio/gr-filter/python/qa_fir_filter.py", line 
>>> 281, in test_fir_filter_scc_002 
>>> 86:     self.assertComplexTuplesAlmostEqual(expected_data, result_data, 5) 
>>> 86:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 74, in assertComplexTuplesAlmostEqual 
>>> 86:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>> 86:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 47, in assertComplexAlmostEqual 
>>> 86:     (msg or '%s != %s within %s places' % (`first`, `second`, `places` 
>>> )) 
>>> 86: AssertionError: (0.5+1j) != (nan+nanj) within 5 places 
>>> 86: 
>>> 86: ---------------------------------------------------------------------- 
>>> 86: Ran 11 tests in 0.035s 
>>> 86: 
>>> 86: FAILED (failures=2) 
>>> 1/1 Test #86: qa_fir_filter ....................***Failed    0.30 sec 
>>>
>>> 0% tests passed, 1 tests failed out of 1 
>>>
>>> Total Test time (real) =   0.31 sec 
>>>
>>> The following tests FAILED: 
>>>       86 - qa_fir_filter (Failed) 
>>> Errors while running CTest 
>>>
>>>
>>> 91: Test command: /bin/sh 
>>> "/home/dave/gnuradio/build/gr-filter/python/qa_freq_xlating_fir_filter_test.sh"
>>>  
>>> 91: Test timeout computed to be: 9.99988e+06 
>>> 91: ........FFFF 
>>> 91: ====================================================================== 
>>> 91: FAIL: test_fir_filter_scc_001 (__main__.test_freq_xlating_filter) 
>>> 91: ---------------------------------------------------------------------- 
>>> 91: Traceback (most recent call last): 
>>> 91:   File 
>>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", line 
>>> 412, in test_fir_filter_scc_001 
>>> 91:     self.assertComplexTuplesAlmostEqual(expected_data, 
>>> result_data[-20:], 5) 
>>> 91:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 74, in assertComplexTuplesAlmostEqual 
>>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>> 91:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 47, in assertComplexAlmostEqual 
>>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, `places` 
>>> )) 
>>> 91: AssertionError: (-0.00775564694777+0.0437113791704j) != (nan+nanj) 
>>> within 5 places 
>>> 91: 
>>> 91: ====================================================================== 
>>> 91: Using Volk machine: avx_32_mmx 
>>> 91: FAIL: test_fir_filter_scc_002 (__main__.test_freq_xlating_filter) 
>>> 91: ---------------------------------------------------------------------- 
>>> 91: Traceback (most recent call last): 
>>> 91:   File 
>>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", line 
>>> 442, in test_fir_filter_scc_002 
>>> 91:     self.assertComplexTuplesAlmostEqual(expected_data, 
>>> result_data[-20:], 5) 
>>> 91:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 74, in assertComplexTuplesAlmostEqual 
>>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>> 91:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 47, in assertComplexAlmostEqual 
>>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, `places` 
>>> )) 
>>> 91: AssertionError: (-0.0080680437386-0.00158522999845j) != (nan+nanj) 
>>> within 5 places 
>>> 91: 
>>> 91: ====================================================================== 
>>> 91: FAIL: test_fir_filter_scf_001 (__main__.test_freq_xlating_filter) 
>>> 91: ---------------------------------------------------------------------- 
>>> 91: Traceback (most recent call last): 
>>> 91:   File 
>>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", line 
>>> 352, in test_fir_filter_scf_001 
>>> 91:     self.assertComplexTuplesAlmostEqual(expected_data, 
>>> result_data[-20:], 5) 
>>> 91:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 74, in assertComplexTuplesAlmostEqual 
>>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>> 91:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 47, in assertComplexAlmostEqual 
>>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, `places` 
>>> )) 
>>> 91: AssertionError: (-0.0330070219934+0.101965591311j) != (nan+nanj) within 
>>> 5 places 
>>> 91: 
>>> 91: ====================================================================== 
>>> 91: FAIL: test_fir_filter_scf_002 (__main__.test_freq_xlating_filter) 
>>> 91: ---------------------------------------------------------------------- 
>>> 91: Traceback (most recent call last): 
>>> 91:   File 
>>> "/home/dave/gnuradio/gr-filter/python/qa_freq_xlating_fir_filter.py", line 
>>> 382, in test_fir_filter_scf_002 
>>> 91:     self.assertComplexTuplesAlmostEqual(expected_data, 
>>> result_data[-20:], 5) 
>>> 91:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 74, in assertComplexTuplesAlmostEqual 
>>> 91:     self.assertComplexAlmostEqual (a[i], b[i], places, msg) 
>>> 91:   File 
>>> "/home/dave/gnuradio/gnuradio-runtime/python/gnuradio/gr_unittest.py", line 
>>> 47, in assertComplexAlmostEqual 
>>> 91:     (msg or '%s != %s within %s places' % (`first`, `second`, `places` 
>>> )) 
>>> 91: AssertionError: (0.00824625696987-1.50158575707e-05j) != (nan+nanj) 
>>> within 5 places 
>>> 91: 
>>> 91: ---------------------------------------------------------------------- 
>>> 91: Ran 12 tests in 0.045s 
>>> 91: 
>>> 91: FAILED (failures=4) 
>>> 1/1 Test #91: qa_freq_xlating_fir_filter .......***Failed    0.32 sec 
>>>
>>> 0% tests passed, 1 tests failed out of 1 
>>>
>>> Total Test time (real) =   0.34 sec 
>>>
>>> The following tests FAILED: 
>>>       91 - qa_freq_xlating_fir_filter (Failed) 
>>> Errors while running CTest 
>>>
>>>
>>> 150: Test command: /bin/sh 
>>> "/home/dave/gnuradio/build/gr-digital/python/qa_constellation_receiver_test.sh"
>>>  
>>> 150: Test timeout computed to be: 9.99988e+06 
>>> 150: Segmentation fault (core dumped) 
>>> 1/1 Test #150: qa_constellation_receiver ........***Failed   13.64 sec 
>>>
>>> 0% tests passed, 1 tests failed out of 1 
>>>
>>> Total Test time (real) =  13.66 sec 
>>>
>>> The following tests FAILED: 
>>>      150 - qa_constellation_receiver (Failed) 
>>> Errors while running CTest 
>>>
>>>
>>> 169: Test command: /bin/sh 
>>> "/home/dave/gnuradio/build/gr-vocoder/python/qa_codec2_vocoder_test.sh" 
>>> 169: Test timeout computed to be: 9.99988e+06 
>>> 169: F 
>>> 169: ====================================================================== 
>>> 169: FAIL: test001_module_load (__main__.test_codec2_vocoder) 
>>> 169: ---------------------------------------------------------------------- 
>>> 169: Traceback (most recent call last): 
>>> 169:   File "/home/dave/gnuradio/gr-vocoder/python/qa_codec2_vocoder.py", 
>>> line 56, in test001_module_load 
>>> 169:     self.assertEqual(expected_data, actual_result) 
>>> 169: AssertionError: Tuples differ: (0, 0, 0, 3, 2, 0, 1, 5, 6, 7,... != 
>>> (0L, 0L, 0L, 3L, 2L, 0L, 1L, 5... 
>>> 169: 
>>> 169: First differing element 112: 
>>> 169: 24 
>>> 169: 25 
>>> 169: 
>>> 169: Diff is 3978 characters long. Set self.maxDiff to None to see it. 
>>> 169: 
>>> 169: ---------------------------------------------------------------------- 
>>> 169: Ran 1 test in 0.503s 
>>> 169: 
>>> 169: FAILED (failures=1) 
>>> 1/1 Test #169: qa_codec2_vocoder ................***Failed    0.86 sec 
>>>
>>> 0% tests passed, 1 tests failed out of 1 
>>>
>>> Total Test time (real) =   0.87 sec 
>>>
>>> The following tests FAILED: 
>>>      169 - qa_codec2_vocoder (Failed) 
>>> Errors while running CTest 
>>>
>>>
>>>
>>> I've rerun apt-get on for the following, and all report back as being the 
>>> most current release: 
>>> python-dev 
>>> python-wxgtk2.8 
>>> python-numpy 
>>> python-cheetah 
>>> python-lxml 
>>> python-qt4 
>>> python-qwt5-qt4 
>>>
>>> Any help you can offer would be very much appreciated. 
>>> libqt4-opengl-dev libqwt5-qt4-dev libfontconfig1-dev libxrender-dev 
>>
>> Dave, 
>>
>> Thanks for the details in your question. The first three look like 
>> Volk issues and the last looks like a precision error. 
>>
>> What is the computer hardware? Specifically, what processor, processor 
>> architecture (32 or 64 bit), and are your running it in a VM? 
>>
>> Tom 
>>
>>
>>
>> _______________________________________________ 
>> Discuss-gnuradio mailing list 
>> [hidden email] 
>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>>
> _______________________________________________ 
> Discuss-gnuradio mailing list 
> [hidden email] 
> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
> 
> 
> ________________________________
>  
> If you reply to this email, your message will be added to the discussion 
> below:http://gnuradio.4.n7.nabble.com/make-test-errors-tp41841p41904.html 
> To unsubscribe from make test errors, click here.
> NAML
> 
> 
> 
> --
> View this message in context: 
> http://gnuradio.4.n7.nabble.com/make-test-errors-tp41841p41944.html
> Sent from the GnuRadio mailing list archive at Nabble.com.
> 
> 
> 
> _______________________________________________
> Discuss-gnuradio mailing list
> address@hidden
> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>