Migrate user data to a new server

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Migrate user data to a new server

Simon Gladman
Hi all,

I've tried looking in the mailing list for this to no avail. (Maybe my search terms were no good..)

I administer a server with about 15 users. The server is failing and so I have set up a new server (with an updated OS, Galaxy version etc (galaxy versions: old - nov 2013, new - Feb 2014). Is there a method for migrating my users and their data across to the new server, without getting them to tell me their passwords....

Cheers,

Simon.

___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Migrate user data to a new server

Hans-Rudolf Hotz
Hi Simon

I recommend the following (minimal) steps to migrate to a new server:

  - set up the new server using the SAME Galaxy version your old server
    is running.

  - copy the contents of the 'database' directory

  - make the site specific adjustment, e.g. universe_wsgi.ini

  - connect your new server to your existing PostgreSQL database

  - and start your new server, followed by an upgrade to the new Galaxy
    version


Of course, there are many other points to take care of like the existing
data libraries and other site specific changes only you know about.
Hence I recommend to first work with a copy of your PostgreSQL database,
test everything, and then make an rsync of the 'database' directory and
switch to the real PostgreSQL database. This way, your user can continue
working with the old server, while you test the new one.


I hope this gives you a few ideas
Regards, Hans-Rudolf


On 04/15/2014 06:00 AM, Simon Gladman wrote:

> Hi all,
>
> I've tried looking in the mailing list for this to no avail. (Maybe my
> search terms were no good..)
>
> I administer a server with about 15 users. The server is failing and so
> I have set up a new server (with an updated OS, Galaxy version etc
> (galaxy versions: old - nov 2013, new - Feb 2014). Is there a method for
> migrating my users and their data across to the new server, without
> getting them to tell me their passwords....
>
> Cheers,
>
> Simon.
>
>
> ___________________________________________________________
> Please keep all replies on the list by using "reply all"
> in your mail client.  To manage your subscriptions to this
> and other Galaxy lists, please use the interface at:
>    http://lists.bx.psu.edu/
>
> To search Galaxy mailing lists use the unified search at:
>    http://galaxyproject.org/search/mailinglists/
>
___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Migrate user data to a new server

Geert Vandeweyer-4
In reply to this post by Simon Gladman
I successfully moved galaxy to a new server about a year ago (so some things might have changed...). Things to do/keep in mind were:

- Try to keep paths identical on the new server. Some paths are stored in the database. I changed the galaxy user-data location, so I had to manually update using mysql UPDATE commands.
- users/passwords are migrated just fine if you dump the database to a file and load that in the new server
- I simply copied over the entire installation tree, including reference data, user data, binaries and so on.

Double check the universie_wsgi for all paths and locations

Geert


On 04/15/2014 06:00 AM, Simon Gladman wrote:
Hi all,

I've tried looking in the mailing list for this to no avail. (Maybe my search terms were no good..)

I administer a server with about 15 users. The server is failing and so I have set up a new server (with an updated OS, Galaxy version etc (galaxy versions: old - nov 2013, new - Feb 2014). Is there a method for migrating my users and their data across to the new server, without getting them to tell me their passwords....

Cheers,

Simon.


___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/


-- 

Geert Vandeweyer, Ph.D.
Department of Medical Genetics
University of Antwerp
Prins Boudewijnlaan 43
2650 Edegem
Belgium
Tel: +32 (0)3 275 97 56
E-mail: [hidden email]
http://ua.ac.be/cognitivegenetics
http://www.linkedin.com/in/geertvandeweyer

___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Migrate user data to a new server

Derek Benson
In reply to this post by Simon Gladman
Hi Simon

I too have been down the long and fruitless task of searching for
details about how to migrate a public (or not so public) galaxy server
to a completely new host.

In the end, I made some assumptions, strapped on my jodhpurs and spurs
and dived in.

Now I don't know whether what I've done is supported or encouraged by
the galaxy team, or if its even the right way of doing this but after
completing the steps below I was met with great success.

0. Assume that there is an old server running galaxy, and a brand new
server running galaxy.
1. Stop Galaxy processes and Postgresql databases on old and new server.
2. To get the user data rsync /mnt/galaxy/files from old server to new
server (assuming your galaxy instance is under /mnt/galaxy)
3. To get the database:
     a) remove the directory /mnt/galaxy/db on the new server (again
assuming /mnt/galaxy is the path to your galaxy instance)
     b) Rsync the database files from the old server's /mnt/galaxy/db to
the new server.
5. Update the database on the new server.  I'm using cloudman to run a
virtual instance of a galaxy server, and so I used cloudman to update
the database.
     a) Attempt to start galaxy through cloudman (in my case this failed
if I waited too long)
     b) Wait a second or 2, and then ask cloudman to update the database
(this shutsdown galaxy and updates the database and then restarts galaxy).
     There is a command line script you can run that comes with galaxy
and which can be used to update the database manually.
     If you attempt to start the galaxy process and the database is an
older version the log files will contain a message about how to run this.

You're done.

Derek

PS.  Apologies for the terrible formatting in this Email.

--
Systems Administrator Cloud Computing
Genomics Virtual Lab
Reseach Computing Centre
The University of Queensland 4072 Australia

Phone: +61-7-33462276 Fax: +61-7-33466630
Mobile: 0411 145 379
Email: [hidden email]
Web: http://www.rcc.uq.edu.au

___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/