restarting multiple web workers

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

restarting multiple web workers

Langhorst, Brad
Hi,
I’m using the multiple web server stuff described here:

that seems to address the responsiveness issues i see when many users are active.

However, when i add a new tool - it does not alway show up (only for one of the workers maybe?)

Right now I’m restarting, but this costs a minute or two of downtime as the server starts up.

Has anyone experimented with rolling restarts of web server processes?

Alternatively, has anyone found a good way to speed up the startup process?

Thanks!

Brad



--
Bradley W. Langhorst, Ph.D.
Applications and Product Development Scientist


___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: restarting multiple web workers

Dannon Baker-2
On Tue, Apr 1, 2014 at 2:48 PM, Langhorst, Brad <[hidden email]> wrote:

However, when i add a new tool - it does not alway show up (only for one of the workers maybe?)

I don't have good answers for the rest of your questions (I'm sure someone else can chime in), but I do have some information about this.  You're correct in that, currently, the only process that will reflect the new or reloaded tool is the one the admin user was actually interacting with.  While it doesn't solve your problem right now, I've been working on new mechanisms for reloading tools and generally interacting with multiple processes that will be available soon.

-Dannon

___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: restarting multiple web workers

Peter Briggs
In reply to this post by Langhorst, Brad
Hi Brad

I have a hacky shell script that I use to do rolling restarts of our
local server:

https://github.com/pjbriggs/galaxy-admin-utils/blob/master/rolling-restart.sh

Generally it works okay here but you would have to check how it fits
into your local setup. I can't guarantee that it's 100% robust.

We have multiple web processes so the service appears to be
uninterrupted, although obviously you can get anomalies e.g. when some
web processes know about a new tool but others don't.

HTH

Best wishes, Peter

On 01/04/14 19:48, Langhorst, Brad wrote:

> Hi,
> I’m using the multiple web server stuff described here:
> https://wiki.galaxyproject.org/Admin/Config/Performance/Scaling
>
> that seems to address the responsiveness issues i see when many users
> are active.
>
> However, when i add a new tool - it does not alway show up (only for one
> of the workers maybe?)
>
> Right now I’m restarting, but this costs a minute or two of downtime as
> the server starts up.
>
> Has anyone experimented with rolling restarts of web server processes?
>
> Alternatively, has anyone found a good way to speed up the startup process?
>
> Thanks!
>
> Brad
>
>
>
> --
> Bradley W. Langhorst, Ph.D.
> Applications and Product Development Scientist
>
>
>
> ___________________________________________________________
> Please keep all replies on the list by using "reply all"
> in your mail client.  To manage your subscriptions to this
> and other Galaxy lists, please use the interface at:
>    http://lists.bx.psu.edu/
>
> To search Galaxy mailing lists use the unified search at:
>    http://galaxyproject.org/search/mailinglists/
>

--
Peter Briggs [hidden email]
Bioinformatics Core Facility University of Manchester
B.1083 Michael Smith Bldg Tel: (0161) 2751482
___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/