Test ToolShed functional test failures

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Test ToolShed functional test failures

Peter Cock
Hi guys,

Multiple repositories are showing failing tests, e.g.
http://testtoolshed.g2.bx.psu.edu/view/peterjc/blastxml_to_top_descr

Tests that failed
Tool id: blastxml_to_top_descr
Tool version: blastxml_to_top_descr
Test: test_tool_000000
(functional.test_toolbox.TestForTool_testtoolshed.g2.bx.psu.edu/repos/peterjc/blastxml_to_top_descr/blastxml_to_top_descr/0.0.9)
Stderr:
Traceback:
Traceback (most recent call last):
  File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/functional/test_toolbox.py",
line 106, in test_tool
    self.do_it( td )
  File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/functional/test_toolbox.py",
line 27, in do_it
    test_history = galaxy_interactor.new_history()
  File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/interactor.py",
line 405, in new_history
    self.twill_test_case.new_history()
  File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/twilltestcase.py",
line 469, in new_history
    self.check_history_for_string('Your history is empty')
  File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/twilltestcase.py",
line 310, in check_history_for_string
    raise AssertionError( errmsg )
AssertionError: no match to 'Your'
page content written to
'/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/install_and_test_tool_shed_repositories/repositories_with_tools/tmp/tmp7xhGGg/twilltestcase-eBqu05.html'

This looks like a framework regression...

Peter
___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Test ToolShed functional test failures

Dave Bouvier
Peter,

You are entirely correct, there were some changes to how histories are
rendered, resulting in the functional test framework incorrectly
detecting a failure. My commit 13079:f3c5d9a5ed95 should resolve this
issue.

   --Dave B.

On Wed 16 Apr 2014 06:38:16 AM EDT, Peter Cock wrote:

> Hi guys,
>
> Multiple repositories are showing failing tests, e.g.
> http://testtoolshed.g2.bx.psu.edu/view/peterjc/blastxml_to_top_descr
>
> Tests that failed
> Tool id: blastxml_to_top_descr
> Tool version: blastxml_to_top_descr
> Test: test_tool_000000
> (functional.test_toolbox.TestForTool_testtoolshed.g2.bx.psu.edu/repos/peterjc/blastxml_to_top_descr/blastxml_to_top_descr/0.0.9)
> Stderr:
> Traceback:
> Traceback (most recent call last):
>    File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/functional/test_toolbox.py",
> line 106, in test_tool
>      self.do_it( td )
>    File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/functional/test_toolbox.py",
> line 27, in do_it
>      test_history = galaxy_interactor.new_history()
>    File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/interactor.py",
> line 405, in new_history
>      self.twill_test_case.new_history()
>    File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/twilltestcase.py",
> line 469, in new_history
>      self.check_history_for_string('Your history is empty')
>    File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/twilltestcase.py",
> line 310, in check_history_for_string
>      raise AssertionError( errmsg )
> AssertionError: no match to 'Your'
> page content written to
> '/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/install_and_test_tool_shed_repositories/repositories_with_tools/tmp/tmp7xhGGg/twilltestcase-eBqu05.html'
>
> This looks like a framework regression...
>
> Peter
> ___________________________________________________________
> Please keep all replies on the list by using "reply all"
> in your mail client.  To manage your subscriptions to this
> and other Galaxy lists, please use the interface at:
>    http://lists.bx.psu.edu/
>
> To search Galaxy mailing lists use the unified search at:
>    http://galaxyproject.org/search/mailinglists/
___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Test ToolShed functional test failures

Peter Cock

Peter


On Wed, Apr 16, 2014 at 2:21 PM, Dave Bouvier <[hidden email]> wrote:
Peter,

You are entirely correct, there were some changes to how histories are rendered, resulting in the functional test framework incorrectly detecting a failure. My commit 13079:f3c5d9a5ed95 should resolve this issue.

  --Dave B.


On Wed 16 Apr 2014 06:38:16 AM EDT, Peter Cock wrote:
Hi guys,

Multiple repositories are showing failing tests, e.g.
http://testtoolshed.g2.bx.psu.edu/view/peterjc/blastxml_to_top_descr

Tests that failed
Tool id: blastxml_to_top_descr
Tool version: blastxml_to_top_descr
Test: test_tool_000000
(functional.test_toolbox.TestForTool_testtoolshed.g2.bx.psu.edu/repos/peterjc/blastxml_to_top_descr/blastxml_to_top_descr/0.0.9)
Stderr:
Traceback:
Traceback (most recent call last):
   File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/functional/test_toolbox.py",
line 106, in test_tool
     self.do_it( td )
   File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/functional/test_toolbox.py",
line 27, in do_it
     test_history = galaxy_interactor.new_history()
   File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/interactor.py",
line 405, in new_history
     self.twill_test_case.new_history()
   File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/twilltestcase.py",
line 469, in new_history
     self.check_history_for_string('Your history is empty')
   File "/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/base/twilltestcase.py",
line 310, in check_history_for_string
     raise AssertionError( errmsg )
AssertionError: no match to 'Your'
page content written to
'/var/opt/buildslaves/buildslave-ec2-2/buildbot-install-test-test-tool-shed-py27/build/test/install_and_test_tool_shed_repositories/repositories_with_tools/tmp/tmp7xhGGg/twilltestcase-eBqu05.html'

This looks like a framework regression...

Peter
___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
   http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
   http://galaxyproject.org/search/mailinglists/


___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/