Question on storage configuration for Galaxy datasets

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Question on storage configuration for Galaxy datasets

Lukasse, Pieter

Hi ,

 

We would the location of the datasets our Galaxy stores to be determined dynamically based on a set of rules. For example: for a specific role we would like a datasets to be stored in a folder /storage/no_backup and for another role this should be /storage/with_backup

 

Is there currently a configuration file in Galaxy to set this up? Or perhaps any alternative solutions?

 

Thanks and regards,

 

Pieter Lukasse

Wageningen UR, Plant Research International

Departments of Bioscience and Bioinformatics

Wageningen Campus, Building 107, Droevendaalsesteeg 1, 6708 PB,
Wageningen, the Netherlands

+31-317481122; skype: pieter.lukasse.wur

http://www.pri.wur.nl

 


___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Question on storage configuration for Galaxy datasets

Lukasse, Pieter

Hi all,

 

Could someone comment on my question below ? I see that a similar question from Eric (with title “object_store_conf.xml route users to different storage” ) is also unanswered.

 

Thanks for your help,

 

Pieter.

 

From: [hidden email] [mailto:[hidden email]] On Behalf Of Lukasse, Pieter
Sent: donderdag 30 januari 2014 11:10
To: [hidden email]
Subject: [galaxy-dev] Question on storage configuration for Galaxy datasets

 

Hi ,

 

We would the location of the datasets our Galaxy stores to be determined dynamically based on a set of rules. For example: for a specific role we would like a datasets to be stored in a folder /storage/no_backup and for another role this should be /storage/with_backup

 

Is there currently a configuration file in Galaxy to set this up? Or perhaps any alternative solutions?

 

Thanks and regards,

 

Pieter Lukasse

Wageningen UR, Plant Research International

Departments of Bioscience and Bioinformatics

Wageningen Campus, Building 107, Droevendaalsesteeg 1, 6708 PB,
Wageningen, the Netherlands

+31-317481122; skype: pieter.lukasse.wur

http://www.pri.wur.nl

 


___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/
Reply | Threaded
Open this post in threaded view
|

Re: Question on storage configuration for Galaxy datasets

John Chilton-4
An answer may not be forthcoming because it is easier to say something
is possible then to say it is impossible. I will risk embarrassment
however and say there is not a configuration file in Galaxy to support
this, there is not an alternative solution at this time that I am
aware of. I really don't know how tough this would be to implement - I
imagine object store to use gets picked at a different place from
where permissions are accessed/assigned and roles can change over the
lifetime of a dataset but I don't think there is infrastructure right
now to support moving datasets from one object store to another.

If you wanted to hack on this I would start by looking at the object
store code: https://bitbucket.org/galaxy/galaxy-central/src/6a633b37c4c47bba640d05fef72fd73f41ae5086/lib/galaxy/objectstore/__init__.py?at=default.

Hope this helps.

-John

On Fri, Feb 28, 2014 at 3:30 AM, Lukasse, Pieter <[hidden email]> wrote:

> Hi all,
>
>
>
> Could someone comment on my question below ? I see that a similar question
> from Eric (with title "object_store_conf.xml route users to different
> storage" ) is also unanswered.
>
>
>
> Thanks for your help,
>
>
>
> Pieter.
>
>
>
> From: [hidden email]
> [mailto:[hidden email]] On Behalf Of Lukasse, Pieter
> Sent: donderdag 30 januari 2014 11:10
> To: [hidden email]
> Subject: [galaxy-dev] Question on storage configuration for Galaxy datasets
>
>
>
> Hi ,
>
>
>
> We would the location of the datasets our Galaxy stores to be determined
> dynamically based on a set of rules. For example: for a specific role we
> would like a datasets to be stored in a folder /storage/no_backup and for
> another role this should be /storage/with_backup
>
>
>
> Is there currently a configuration file in Galaxy to set this up? Or perhaps
> any alternative solutions?
>
>
>
> Thanks and regards,
>
>
>
> Pieter Lukasse
>
> Wageningen UR, Plant Research International
>
> Departments of Bioscience and Bioinformatics
>
> Wageningen Campus, Building 107, Droevendaalsesteeg 1, 6708 PB,
> Wageningen, the Netherlands
>
> +31-317481122; skype: pieter.lukasse.wur
>
> http://www.pri.wur.nl
>
>
>
>
> ___________________________________________________________
> Please keep all replies on the list by using "reply all"
> in your mail client.  To manage your subscriptions to this
> and other Galaxy lists, please use the interface at:
>   http://lists.bx.psu.edu/
>
> To search Galaxy mailing lists use the unified search at:
>   http://galaxyproject.org/search/mailinglists/
___________________________________________________________
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/