Storage question for Galaxy-Admins

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Storage question for Galaxy-Admins

Raj Ayyampalayam
Hello,

I am trying to come up with a number for our local galaxy storage
requirements when we go live (This is an installation for research at
our university).

I checked out the survey that was done a while back for the
GalaxyAdmins. It seems that the bigger installations have allocated
about 200TB for their installation.

It would be of great help to me if I can get some feedback on storage
used by local galaxy installations.
If possible please use the following format:

Total capacity:
Used capacity:
Storage Technology:
Comments:

Thank you all very much.
-Raj

___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Storage question for Galaxy-Admins

Bossers, Alex
Raj,

maybe others have a different view on this but I think just throwing you a number is quite useless.
It all depends on YOUR data storage strategy/policy.
How long can researchers store/use their data. What are their maxed quota...Is it backuped elsewhere, how many users. Is it public.... what kind of data (eukaryote genome sequencing or RNA seq projects....or small viral bacterial genomes).

We have a public server with limited resource mainly to display our own tools. It's getting used more and more within the university.... we started at 2T but quickly encountered storage problems. we now moved to 8T. But have to say our data is mainly of microbial origin.

Good luck on the config.

Alex

________________________________________
Van: [hidden email] [[hidden email]] namens Raj Ayyampalayam [[hidden email]]
Verzonden: donderdag 30 mei 2013 7:34
To: [hidden email] List
Onderwerp: [galaxy-dev] Storage question for Galaxy-Admins

Hello,

I am trying to come up with a number for our local galaxy storage
requirements when we go live (This is an installation for research at
our university).

I checked out the survey that was done a while back for the
GalaxyAdmins. It seems that the bigger installations have allocated
about 200TB for their installation.

It would be of great help to me if I can get some feedback on storage
used by local galaxy installations.
If possible please use the following format:

Total capacity:
Used capacity:
Storage Technology:
Comments:

Thank you all very much.
-Raj

___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/

___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Storage question for Galaxy-Admins

Adam Brenner
In reply to this post by Raj Ayyampalayam
Raj,

I agree with the points Alex made. It would be much easier to start
small and then work your way up.

I recently setup galaxy for our HPC cluster for the entire school of
medicine. Its only a few ~month into our setup but we are currently
using ~300GB of storage. This is part of our larger cluster storage
pool of 600TB.

We use the gluster filesystem across 6 storage nodes. We are trying
fhgfs and other file systems as well (lustre, ceph, etc).

If you have any other questions, feel free to ask.
-Adam

--
Adam Brenner
Computer Science, Undergraduate Student
Donald Bren School of Information and Computer Sciences

Research Computing Support
Office of Information Technology
http://www.oit.uci.edu/rcs/

University of California, Irvine
www.ics.uci.edu/~aebrenne/
[hidden email]

On Wed, May 29, 2013 at 10:34 PM, Raj Ayyampalayam <[hidden email]> wrote:

> Hello,
>
> I am trying to come up with a number for our local galaxy storage
> requirements when we go live (This is an installation for research at our
> university).
>
> I checked out the survey that was done a while back for the GalaxyAdmins. It
> seems that the bigger installations have allocated about 200TB for their
> installation.
>
> It would be of great help to me if I can get some feedback on storage used
> by local galaxy installations.
> If possible please use the following format:
>
> Total capacity:
> Used capacity:
> Storage Technology:
> Comments:
>
> Thank you all very much.
> -Raj
>
> ___________________________________________________________
> Please keep all replies on the list by using "reply all"
> in your mail client.  To manage your subscriptions to this
> and other Galaxy lists, please use the interface at:
>  http://lists.bx.psu.edu/
>
> To search Galaxy mailing lists use the unified search at:
>  http://galaxyproject.org/search/mailinglists/
___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/