Failing wikisyntax tests can be difficult to locate

[Ryan J Ollos]

Failing wikisyntax tests can be difficult to locate. Here is a recently encountered test execution result (#10772):

$ PYTHONPATH=. python -m trac.test
........................................................................................................................................................................................................................................................................................................................................................................................................................................................................F...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
======================================================================
FAIL: test (trac.wiki.tests.formatter.WikiTestCase)
Test milestone: link resolver + arguments
----------------------------------------------------------------------
Traceback (most recent call last):
  File "trac/wiki/tests/formatter.py", line 230, in test
    % (msg, self.file, self.line, self.title, formatter.flavor))
AssertionError:
========== expected: ==========
<p>
<a class="missing milestone" href="/milestone/?action=new" rel="nofollow">milestone:?action=new</a>
<a class="milestone" href="/milestone/boo#KnownIssues" title="No date set">Known Issues for 1.0</a>
</p>


========== actual: ==========

<p>
<a class="milestone" href="/milestone/boo#KnownIssues" title="No date set">Known Issues for 1.0</a>
</p>


========== wiki: ==========
u'
milestone:?action=new
[milestone:boo#KnownIssues Known Issues for 1.0]
'
========== diff: ==========
--- expected
+++ actual
@@ -1,5 +1,5 @@
+
<p>
-<a class="missing milestone" href="/milestone/?action=new" rel="nofollow">milestone:?action=new</a>
<a class="milestone" href="/milestone/boo#KnownIssues" title="No date set">Known Issues for 1.0</a>
</p>



trac/ticket/tests/wikisyntax.pyc:16: "milestone: link resolver + arguments" (default flavor)

----------------------------------------------------------------------
Ran 1660 tests in 327.696s

FAILED (failures=1)

The actual failure was at trunk/trac/ticket/tests/wikisyntax.py@12300:230,234#L207​.

The module in which the tests failed can be seen in the bottom of the output. Using that and a string copied from the expected or actual output, the failing test can be located. However, it would be nice to improve this for the sake of those that are less familiar with the project structure.

[Ryan J Ollos]

Moved ticket assigned to next-stable-1.0.x since maintenance of 1.0.x is coming to a close. Please move the ticket back if it's critical to fix on 1.0.x.

[Ryan J Ollos]

I don't see a way to improve this since the expected output is passed as a string variable. When a filename is passed to wikisyntax_test_suite the line number in which the failure occurs is approximately correct.