Re: [lmi] Automated GUI testing, revisited

[Boutin, Wendy]

Greg Chicares wrote: 
> On 2014-11-09 01:21Z, Greg Chicares wrote:
> >
> > 00:37:10:     validate_output_illustration: ERROR (Assertion failure: 
> > Expected wxDialog dialog was
> not shown. [file /opt/lmi/local/include/wx-3.1/wx/testing.h, line 315, in 
> ReportFailure()].)
> > 00:37:11:     validate_output_mec: ERROR (Assertion failure: A message box 
> > "Sorry, could not open
> this file." was shown unexpectedly, expected wxDialog. [file 
> /opt/lmi/local/include/wx-
> 3.1/wx/testing.h, line 315, in ReportFailure()].)
> 
> Why would these tests fail? As for the second one, I'm running
>   $./wx_test.exe --ash_nazg --data_path=/opt/lmi/data
> which certainly has the power to create and handle '.mec' files.
> Should the diagnostic name the file that it couldn't open?
> Is the use of
>   configurable_settings::instance().default_input_filename()
> a possible cause? (I see no new files written in /etc/ though.)
> I'm not sure which of these two assertions
>     unnamed_output.assert_exists();
>     existing_output.assert_exists();
> is failing; if it's the latter, then am I again missing a
> required file?
 
There are two test cases in the proprietary set that are required for these
tests to pass:
  MonthlyTrace.ill
  MecTesting.mec

I was able to produce these results[0] when I put all of the test cases in 
the same directory as my default file (as dictated by a distribution-specific 
'configurble_settings.xml' that I'm using for testing):

<default_input_filename>c:/fop-0.20.5/coli_boli_default.ill</default_input_filename>

It just seemed to be the place that worked, but I can't tell if that's
what’s actually intended. Also, I haven't quite fine-tuned my 'wx_test.conf' 
yet, so I'm not sure if that will help clean up some of the other failing 
tests. 

------
[0] these results:

22:40:07: Starting automatic tests:
22:40:07:     about_dialog_version: ok (22ms)
22:40:08: Run case for census_1: 368ms elapsed (expected not specified)
22:40:08:     benchmark_census: ERROR (Assertion failure: should have non zero 
page size [file ../src/generic/datavgen.cpp, line 3632, in OnChar()].)
22:40:13: Error: Failed to put data on the clipboard (error -2147221040: 
openClipboard Failed)
22:40:13:     calculation_summary: ok (5880ms)
22:40:13:     configurable_settings: ERROR (Assertion 
'(settings.xsl_fo_command()) == ("CMD /c c:/fop-0.20.5/fop")' failed (expected 
CMD /c c:/fop-0.20.5/fop vs observed CMD /c /fop-0.20.5/fop). [file 
/opt/lmi/src/lmi/wx_test_config_settings.cpp, line 41] )
22:40:14:     create_open_census: ok (139ms)
22:40:14:     create_open_database: ok (869ms)
22:40:15:     create_open_gpt: ok (384ms)
22:40:16:     create_open_illustration: ok (1216ms)
22:40:16:     create_open_mec: ok (289ms)
22:40:17:     create_open_policy: ok (222ms)
22:40:17:     create_open_rounding: ok (388ms)
22:40:17:     create_open_strata: ok (436ms)
22:40:17:     create_open_text: ok (74ms)
22:40:17:     default_input: ERROR (Assertion '(effective_date) == 
(first_of_month)' failed (expected 2456963 vs observed 2456973). [file 
/lmi/src/lmi/wx_test_default_input.cpp, line 44] )
22:40:18:     default_update: ok (870ms)
22:40:18:     expiry_dates: ERROR (Assertion '(end) == (end_of_month)' failed 
(expected 2450480 vs observed 2458849). [file 
/opt/lmi/src/lmi/wx_test_expiry_dates.cpp, line 77] )
22:40:19:     extract: ok (693ms)
22:40:20:     input_sequences: ok (850ms)
22:40:20:     input_validation: ok (429ms)
22:40:22:     paste_census: ok (1261ms)
22:40:22:     pdf_census: ERROR (Assertion 'fs::exists(composite_pdf_path)' 
failed. [file /lmi/src/lmi/wx_test_pdf_create.cpp, line 135] )
22:40:24:     pdf_illustration: ok (1927ms)
22:40:26:     validate_output_illustration: ok (2232ms)
22:40:26:     validate_output_mec: ok (288ms)
22:40:26: FAILURE: 5 out of 24 tests failed.




This e-mail transmission may contain information that is proprietary, 
privileged and/or confidential and is intended exclusively for the person(s) to 
whom it is addressed. Any use, copying, retention or disclosure by any person 
other than the intended recipient or the intended recipient's designees is 
strictly prohibited. If you are not the intended recipient or their designee, 
please notify the sender immediately by return e-mail and delete all copies.