Storage of diffraction data: Difference between revisions

From CCP4 wiki
Jump to navigation Jump to search
(Created page with "Synchrotrons are very good at archiving all collected data. In contrast, there's no requirement for including diffraction data when submitting a structure to the PDB. Conseque...")
 
No edit summary
 
(2 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Synchrotrons are very good at archiving all collected data. In contrast, there's no requirement for including diffraction data when submitting a structure to the PDB. Consequently, the connection between structure and the underlying data is lost for all practical purposes. Some think this is a problem, but there aren't any good solutions yet.
Synchrotrons are very good at archiving all collected data. In contrast, there's no requirement for including diffraction data when submitting a structure to the PDB. Consequently, the connection between structure and the underlying data is lost for all practical purposes.  


== Diffraction data storage solution ==
== Diffraction data storage solutions (2018) ==


As the PDB isn't developing data storage and retrieval solution, community efforts are needed. Here are a few examples:
* zenodo.org (including https://zenodo.org/communities/mx/?page=1&size=20 but maybe other "communities"); this is managed by CERN
* SBGrid https://data.sbgrid.org/ - see https://www.nature.com/articles/ncomms10882
* proteindiffraction.org (this has e.g. almost? all the JCSG data!)
* Australian synchrotron.store - see https://store.synchrotron.org.au and http://scripts.iucr.org/cgi-bin/paper?S1399004714016174
* the ESRF makes all collected data available after 3 years; see http://www.esrf.eu/datapolicy


* myTardis - developed at the Australian synchrotron and [https://github.com/mytardis/mytardis downloadable as open source].
There are many more local repositories, e.g. for universities.
* [[iRods]] - an effort headed by the Irish Centre for High End Computing of turning iRods into a modular storage solution that can be deployed at the lab or institute level.
 
Recent publications: http://journals.iucr.org/m/issues/2017/01/00/ti5008/index.html
http://journals.iucr.org/m/issues/2017/01/00/hi0156/index.html

Latest revision as of 21:42, 17 January 2018

Synchrotrons are very good at archiving all collected data. In contrast, there's no requirement for including diffraction data when submitting a structure to the PDB. Consequently, the connection between structure and the underlying data is lost for all practical purposes.

Diffraction data storage solutions (2018)[edit | edit source]

There are many more local repositories, e.g. for universities.

Recent publications: http://journals.iucr.org/m/issues/2017/01/00/ti5008/index.html http://journals.iucr.org/m/issues/2017/01/00/hi0156/index.html

Retrieved from "https://wiki.uni-konstanz.de/ccp4/index.php?title=Storage_of_diffraction_data&oldid=2502"