Implement display of hierarchies in new HTML report of TEAM Engine

[dstenger]

No description provided.

[lgoltz]

Proposal for a first draft:

• In the new HTML report (based on CTL) the test on the first level shows the result of the group but does not display the complete hierarchy. A reference to the detailed test report could be helpful.

@keshav-nangare Are changes or enhancements in the EARL report required to display hierarchies?

[dstenger]

@keshav-nangare
Can you please check the steps required to display hierarchies?
Are all informations included in EARL report?
Do we just have to adjust the XSLT transformation?

[keshavnangare]

Steps to display hierarchies:

1. Need to update the EARL document with the parent-child relation of the test.
2. Update XSLT transformation to convert it to HTML.
3. Need to think about how to represent the hierarchy of test in the HTML page.

[lgoltz]

1. Need to update the EARL document with the parent-child relation of the test.

This is already done in branch https://github.com/opengeospatial/teamengine/tree/hierarchiesInNewHtmlReport-319.

Besides the enhancements to display hierarchies, the class CtlEarlReporter was formatted and refactored. Furthermore some bugs was fixed:

• Include of http:Request as child of a TestResult (was child of the root element)
• Output of the response (was empty)
• Increasing of the number of passed tests (was 0 in each case)

[lgoltz]

Added Unit Tests for CtlEarlReporter and fixed some more bugs.

[lgoltz]

The xslt script transforming the EARL report to the new HTML report was adjusted to display the hierarchies (currently the test cases are indented on the main page, dependent on the level of the hierarchy depth).
UnitTest was added to test the transformation (therefore the code was moved from class TECore to a new class (EarlToHtmlTransformer).

As the generated EARL report seems to differ if the report is created multiple times from the same source there was missing test cases. This was fixed in 47028b6

Handling of inheritedFailures was added within cf53e2a. For a consistent working with the URLs provided by EARL and added with the CITE enhancements the URLs should be adjusted. Ticket #326 was created, the URL for the InheritedFailures was already adjusted in 149d827

[lgoltz]

Simplified calculation of test (was counted by the TestCase/Assertions and did not work with test hierarchies):
f474069

[lgoltz]

Fixed calculation of executed tests (included inherited tests): d53f4b4

[lgoltz]

Implementation is finished so far. Currently tests without subtests (like data-preconditions in ETS WMS 1.3) contains no test results. How can we handle this?

The number of tests differs from the one in the old report as the first (main:main) and second (data-independent, data-preconditions, basic and queryable) levels tests are not included in the new html report. Furthermore inherited failures are not marked but counted as usually failures.

[dstenger]

@keshav-nangare Can you please review the implementation and provide feedback if you identify any improvements?

[keshavnangare]

The changes are fine with me and the new HTML report with Hierarchies looking nice.

ERROR: The result is not showing in the testDetails page whether the test is passed or failed etc,

[lgoltz]

ERROR: The result is not showing in the testDetails page whether the test is passed or failed etc,

Should be fixed with https://github.com/lat-lon/teamengine/commit/aef2fa6efe2290bb3c9f718a919422018e9cbb95

@keshav-nangare Can you test again?

[keshavnangare]

@lgoltz

The issue fixed and showing the result in detail HTML page.

But, the current working branch is failing with Maven Unit test:testGenerateEarlReport

[lgoltz]

But, the current working branch is failing with Maven Unit test:testGenerateEarlReport

Should be fixed with 8fefc6c

[lgoltz]

@dstenger Please review notes in #319 (comment) and create new tickets, if required.

[dstenger]

I reviewed notes in #319 (comment), created new tickets and added proposal for solution:

• New HTML report of CTL test suites: Tests without sub tests contain no test results #329
• New HTML report of CTL test suites: Number of tests differs from the one in the old report #330
• New HTML report of CTL test suites: Inherited failures are not marked but counted as usual failures #331

Pull request was created: #328

@keshav-nangare Can you please confirm if feature branch is working on your environment now?

[keshavnangare]

@dstenger

I have tested the feature branch and worked successfully with CTL and TestNG test-suites.

Tested Environment:

OS: Windows 8.1
JAVA: 1.8
ETS: gml32 1.26 and wms13 1.23-SNAPSHOT