Data repositories

From OAD

This list is part of the Open Access Directory.

• This is a list of repositories and databases for open data.
• Please annotate the entries to indicate the hosting organization, scope, licensing, and usage restrictions (if any). If a repository is open in some respects but not others, please include it with an annotation rather than exclude it.
• If you're not sure whether a given dataset or data collection is open, post your query to Is It Open Data?
• Related lists in OAD: Disciplinary repositories (primarily for texts, not data).

---

Contents 1 Archaeology 2 Astronomy 3 Biology 4 Chemistry 5 Computer Science 6 Energy 7 Environmental sciences 8 Geology 9 Geosciences and geospatial data 10 Linguistics 11 Marine sciences 12 Medicine 13 Multidisciplinary repositories 14 Physics 15 Social sciences

[edit] Archaeology

• Also see Social sciences.

• Archaeology Data Service.

• Open Context. From the Alexandria Archive Institute.

• the Digital Archaeological Record. From Digital Antiquity.

[edit] Astronomy

• Also see Physics.

• Astronomical Data Archives Center. From the National Astronomical Observatory of Japan.

• Astrophysics Data System. From the Smithsonian Astrophysical Observatory (SAO) and National Aeronautics and Space Administration (NASA).

• The Canadian Astronomy Data Centre. From the National Research Council Canada.

• National Space Science Data Center. From the US National Aeronautics and Space Administration (NASA).

[edit] Biology

• Also see BCO-DMO, Marine Biology data, listed with Marine Sciences repositories.
• Also see DataONE, Entrez databases, KNB, and PANGAEA, listed under Multidisciplinary repositories.

• The Arabidopsis Information Resource - The Arabidopsis Information Resource (TAIR) maintains a database of genetic and molecular biology datafor the model higher plant Arabidopsis thaliana.

• BOND (Biomolecular Object Network Databank). From Unleashed Informatics.

• The Cell: An Image Library Images of all cell types from all organisms, including intracellular structures and movies or animations demonstrating functions. This project relies upon the cell biology community to populate the library. The Cell: An Image Library™ is a freely accessible, easy-to-search, public repository of reviewed and annotated images, videos, and animations of cells from a variety of organisms, showcasing cell architecture, intracellular functionalities, and both normal and abnormal processes. The purpose of this database is to advance research, education, and training, with the ultimate goal of improving human health.

• Databases at EBI. From the European Bioinformatics Institute (EBI). This is a web directory of the EBI databases. Also see the FTP interface.

• DataBasin. OA data in conservation. From the Conservation Biology Institute in partnership with Rhiza Labs.

• Dryad Dryad is an international repository of data underlying peer-reviewed articles in the basic and applied biosciences. From the National Evolutionary Synthesis Center (NESCent) and the University of North Carolina Metadata Research Center, in coordination with a large group of journals and societies in evolutionary biology and ecology.

• Gene Expression Omnibus High-throughput functional genomic data, including all array-based applications and some high-throughput sequencing data.

• Global Biodiversity Information Facility (GBIF). "Free and open access to biodiversity data." Launched in 2007 by institutions in 17 countries under a non-binding inter-governmental agreement.

• Molecular Biology Databases. From Shirley Fung. A list of 34 databases with annotations to show their openness under six criteria. Also see her list of 7 databases which comply with the Science Commons Open Access Data Protocol.

• MorphoBank. "Homology of phenotypes over the web." Hosted by the State University of New York at Stony Brook.

• National Biological Information Infrastructure A broad, collaborative program to provide increased access to data and information on the nation's biological resources. The NBII links diverse, high-quality biological databases, information products, and analytical tools maintained by NBII partners and other contributors in government agencies, academic institutions, non-government organizations, and private industry.

• Biological Information Infrastructure A broad, collaborative program to provide increased access to data and information on the nation's biological resources. The NBII links diverse, high-quality biological databases, information products, and analytical tools maintained by NBII partners and other contributors in government agencies, academic institutions, non-government organizations, and private industry.

• PaleoBiology Database. "We are bringing together taxonomic and distributional information about the entire fossil record of plants and animals." From a large number of researchers at a large number of institutions.

• Planet A network of European Plant Databases

• Peptidome. For "tandem mass spectrometry peptide and protein identification data." From the US National Center for Biotechnology Information.

• RCSB Protein Data Bank. From the Research Collaboratory for Structural Bioinformatics (RCSB).

• TreeBASE. "A Database of Phylogenetic Knowledge." Released in March 2010 based on a prototype launched in 1994. Hosted by the Phyloinformatics Research Foundation.

• The Universal Protein Resource (UniProt) is a comprehensive resource for protein sequence and annotation data. The UniProt databases are the UniProt Knowledgebase (UniProtKB), the UniProt Reference Clusters (UniRef), and the UniProt Archive (UniParc). The UniProt Metagenomic and Environmental Sequences (UniMES) database is a repository specifically developed for metagenomic and environmental data..

[edit] Chemistry

• Also see BCO-DMO, Marine Biology data, listed with Marine Sciences repositories.
• Also see Entrez databases, listed under Multidisciplinary repositories.

• Cambridge Structural Database The CCDC is a non-profit, charitable Institution whose objectives are the general advancement and promotion of the science of chemistry and crystallography for the public benefit.

• ChemSpider. Hosted by the Royal Society of Chemistry.

• ChemStar. Maintained by India's National Chemical Laboratory and sponsored by India's Department for Scientific & Industrial Research.

• ChemSynthesis. A database of chemicals and their physical properties.

• ChemXSeer. Hosted by Pennsylvania State University.

• Cooperative Association for Internet Data Analysis (CAIDA) Archive of data for scientific analysis of network functions.

• CrystalEye. From the Unilever Cambridge Centre for Molecular Informatics at the University of Cambridge.

• Crystallography Open Database. A joint project of the Mineralogical Society of America, Mineralogical Association of Canada, European Journal of Mineralogy, International Union of Crystallography, and the US National Science Foundation. Data are in the public domain.

• eCrystals. From the Southampton Chemical Crystallography Group and the EPSRC UK National Crystallography Service.

• NMRShiftDB. For "organic structures and their nuclear magnetic resonance (nmr) spectra." Distributed nodes from the EBI, University of Mainz and the Max Plank Institute for Chemical Ecology. Data are license with the GNU FDL.

• ChemStar. Maintained by India's National Chemical Laboratory and sponsored by India's Department for Scientific & Industrial Research.

• Open Notebook Science Solubility Challenge. Maintained by Jean-Claude Bradley, Rajarshi Guha, Andrew Lang and Cameron Neylon. A database of non-aqueous solubility measurements with links to lab notebook pages where experiments were recorded. The database can be searched via Web Query or alternate means.

• PubChem. From the U.S. National Center for Biotechnology Information of the National Institutes of Health (NIH).

• WorldWideMolecularMatrix. "An Open collection of information on small molecules." From the University of Cambridge.

• ZINC. "A free database of commercially-available compounds for virtual screening." From the Shoichet Laboratory in the Department of Pharmaceutical Chemistry at the University of California, San Francisco.

[edit] Computer Science

• CiteSeerX provides its databases of nearly 2 million documents and the associated texts and pdfs for research.

• Cooperative Association for Internet Data Analysis (CAIDA) Archive of data for scientific analysis of network functions.

• GitHub keeps your public and private code available, secure, and backed up.

• Google Code Project Hosting Project Hosting on Google Code provides a free collaborative development environment for open source projects. Each project comes with its own member controls, Subversion/Mercurial repository, issue tracker, wiki pages, and downloads section. Our project hosting service is simple, fast, reliable, and scalable, so that you can focus on your own open source development.

• Launchpad can host your project’s source code using the Bazaar version control system. We also import over 2000 CVS, SVN, Git and Mercurial projects, so you can use Bazaar with those too.

• SourceForge 2.7 million developers create powerful software in over 260,000 projects. Our popular directory connects more than 46 million consumers with these open source projects and serves more than 2,000,000 downloads a day. SourceForge is where open source happens.

[edit] Energy

• DOE Data Explorer. From the US Department of Energy (DOE). Data generated by DOE-sponsored research.

• OpenEI: Open Energy Information. Freely-available energy data, tools, models, and other resources.

[edit] Environmental sciences

• Also see BCO-DMO, Marine Biology data, listed with Marine Sciences repositories.
• Also see DataONE, KNB, and PANGAEA, listed under Multidisciplinary repositories.

• British Atmospheric Data Centre (BADC). From the Natural Environment Research Council (NERC). Many datasets are openly accessible but some are restricted.

• Climate Change Data Portal. From the Environment Department of the World Bank.

• Climate Data. A section within the Comprehensive Knowledge Archive Network of the Open Knowledge Foundation (OKF). A joint project of the OKF, Climate Code and Real Climate.

• California Water CyberInfrastructure. Hydrology data on California's watersheds. From the Berkeley Water Center.

• Consortium of Universities for the Advancement of Hydrologic Science, Inc HIS stands for Hydrologic Information System. CUAHSI's HIS is an internet based system to support the sharing of hydrologic data. It consists of databases connected using the internet through web services as well as software for data discovery, access and publication.

• Dryad Dryad is an international repository of data underlying peer-reviewed articles in the basic and applied biosciences. From the National Evolutionary Synthesis Center (NESCent) and the University of North Carolina Metadata Research Center, in coordination with a large group of journals and societies in evolutionary biology and ecology.

• The Marine Geoscience Data System (MGDS) The Marine Geoscience Data System (MGDS) provides access to data portals for the NSF-supported Ridge 2000 and MARGINS programs, the Antarctic and Southern Ocean Data Synthesis, the Global Multi-Resolution Topography Synthesis, and Seismic Reflection Field Data Portal.

• National Snow and Ice Data Center (NSIDC) Cryospheric datasets from ground field research and satellites.

• National Ecological Observatory Network (NEON). A joint project of 50+ US universities and laboratories.

[edit] Geology

• Also see PANGAEA, listed under Multidisciplinary repositories.

• GSA Data Repository. From the Geological Society of America.

• IRIS (Incorporated Research Institutions for Seismology). From 100+ US universities and the National Science Foundation.

[edit] Geosciences and geospatial data

• Also see DataONE and PANGAEA, listed under Multidisciplinary repositories.

• Commons of Geographic Data. "This site is intended for any data in any format that can be referenced to location on the earth." From the University of Maine.

• GeoCommons. From FortiusOne.

• Geodata Repository. From the Open Source Geospatial Foundation.

• GeoGratis. From Natural Resources Canada.

• GeoNames. A database of placenames, under a CC-BY license. Founded by Marc Wick.

• The Geosciences Network (GEON) project is a collaboration among a dozen PI institutions and a number of other partner projects, institutions, and agencies to develop cyberinfrastructure in support of an environment for integrative geoscience research. GEON is funded by the NSF Information Technology Research (ITR) program.

• National Geographic Data Center Archive of national and international marine environmental and ecosystem datasets.

• The National Space Science Data Center serves as the permanent archive for NASA space science mission data. "Space science" means astronomy and astrophysics, solar and space plasma physics, and planetary and lunar science. As permanent archive, NSSDC teams with NASA's discipline-specific space science "active archives" which provide access to data to researchers and, in some cases, to the general public.

• ShareGeo. Integrating the older GRADE (Geospatial Repository for Academic Deposit and Extraction) repository. From EDINA.

[edit] Linguistics

• See the 40+ members of the Open Language Archives Community (OLAC).

[edit] Marine sciences

• Also see DataONE and PANGAEA, listed under Multidisciplinary repositories.

• BCO-DMO. The Biological and Chemical Oceanography Data Management Office, provides access to data sets contributed by investigators funded by the Biological and Chemical Oceanography sections of the US National Science Foundation (NSF).

• Naval Oceanography Portal Data Services. From the United States Naval Observatory (USNO).

• SeaDataNet. Funded by the EU and coordinated by Institut Français de Recherche pour l'Exploitation de la Mer (IFREMER).

[edit] Medicine

• Also see Entrez databases, listed under Multidisciplinary repositories.

• Dryad Dryad is an international repository of data underlying peer-reviewed articles in the basic and applied biosciences. From the National Evolutionary Synthesis Center (NESCent) and the University of North Carolina Metadata Research Center, in coordination with a large group of journals and societies.

• GenBank. From the U.S. National Center for Biotechnology Information of the National Institutes of Health.

• Gene Expression Omnibus. From the U.S. National Center for Biotechnology Information of the National Institutes of Health.

• The Health and Medical Care Archive (HMCA) is the data archive of the Robert Wood Johnson Foundation (RWJF), the largest philanthropy devoted exclusively to health and health care in the United States. Operated by the Inter-university Consortium for Political and Social Research (ICPSR) at the University of Michigan, HMCA preserves and disseminates data collected by selected research projects funded by the Foundation and facilitates secondary analyses of the data. The data collections in HMCA include surveys of health care professionals and organizations, investigations of access to medical care, surveys on substance abuse, and evaluations of innovative programs for the delivery of health care. Our goal is to increase understanding of health and health care in the United States through secondary analysis of RWJF-supported data collections.

• MIRAGE (Middlesex medical Image Repository with a CBIR ArchivinG Environment). From JISC and Middlesex University.

• Melanoma Molecular Map Project. On melanoma biology and treatment.

• National Center for Biotechnology Information (NCBI) The National Center for Biotechnology Information advances science and health by providing access to biomedical and genomic information.

• NeuroMorpho. Neuronal morphology data. From the Krasnow Institute for Advanced Study at George Mason University.

[edit] Multidisciplinary repositories

• Also see Social Sciences.
• Also see BCO-DMO, Marine Biology data, listed with Marine Sciences repositories.

• 3TU.Datacentre. A consortial data repository for Delft University of Technology, Eindhoven University of Technology and the University of Twente.

• Data Archiving and Networked Services. Dutch research data in the humanities and social sciences. From the Royal Netherlands Academy of Arts and Sciences (KNAW) and the Netherlands Organisation for Scientific Research (NWO).

• DataONE DataONE is an international federation of data repositories containing earth observations data, including data from fields such as ecology, biology, evolution, and environmental sciences such as hydrology, oceanography, and atmospheric science. DataONE is a federation with participation from hundreds of field stations, universities, and government agencies through the DataONE Member Nodes.

• The Dataverse Network. From Harvard's Institute for Quantitative Social Science (IQSS).

• Dryad Dryad is an international repository of data underlying peer-reviewed articles in the basic and applied biosciences. From the National Evolutionary Synthesis Center (NESCent) and the University of North Carolina Metadata Research Center, in coordination with a large group of journals and societies.

• Edinburgh DataShare hosted by Edinburgh University Data Library. A repository for data produced by research at the University of Edinburgh.

• Entrez databases. A directory of chemical, biochemical, biomedical, and medical databases from the U.S. National Center for Biotechnology Information of the National Institutes of Health.

• FigShare. Scientific publishing as it stands is an inefficient way to do science on a global scale. A lot of time and money is being wasted by groups around the world duplicating research that has already been carried out. FigShare allows you to share all of your data, negative results and unpublished figures. In doing this, other researchers will not duplicate the work, but instead may publish with your previously wasted figures, or offer collaboration opportunities and feedback on preprint figures.

• Freebase. For data in all fields. From Metaweb.

• KNB The Knowledge Network for Biocomplexity (KNB) is an international data repository containing ecology, biology, and environmental science data with a global distribution. The KNB is a grass-roots partnership of collaborating feld stations, laboratories, and research networks that openly publish and share data. Founding partners include the National Center for Ecological Analysis and Synthesis (NCEAS) and the Long-term Ecological Research Network (LTER). The KNB is a Member Node within the DataONE data federation.

• KPBC. Regional academic repository for data in all fields. Poland

• PANGAEA. "PANGAEA" stands for "Publishing Network for Geoscientific & Environmental Data". Hosted by the Alfred Wegener Institute for Polar and Marine Research and the University of Bremen's Center for Marine Environmental Sciences. Open to deposits from any scientist. Most datasets are open; some are restricted.

• Public Data Sets on AWS. From Amazon Web Services. The site already hosts OA datasets in biology, chemistry, and economics, and is willing to host them in any field.

• Science 3.0 Open Data. A repository for RDF datasets in the public domain, in any field. From Science 3.0.

• USU Repository University of Sumatera Utara, Medan, Indonesia.

• UPSpace University of Pretoria Research Repository, South Africa.

[edit] Physics

• Also see Astronomy.

• Blue Obelisk Data Repository. Repository of isotope masses, under MIT license. From the Blue Obelisk. Described in 10.1021/ci050400b.

• HEP Data The data comprise total and differential cross sections, structure functions, fragmentation functions, distribuitions of jet measures, polarisations, etc... from a wide range of interactions.

[edit] Social sciences

• Also see Multidisciplinary repositories.

• Association of Religion Data Archives Coverage includes international surveys, U.S. church membership data, and U.S. Surveys.

• Australian Social Science Data Archive. From the Australian Demographic and Social Research Institute at the Australian National University.

• CESSDA Data Portal. From the Council of European Social Science Data Archives (CESSDA).

• Digital Repositories E-Science Network (DReSNeT). From the UK Engineering & Physical Sciences Research Council (EPSRC). A network of social science repositories for texts and data.

• Economic and Social Science Data Service. From the UK Data Archive (UKDA) and Institute for Social and Economic Research (ISER), University of Essex; Manchester Information and Associated Services (MIMAS), and the Cathie Marsh Centre for Census and Survey Research (CCSR), University of Manchester. Access to data requires registration.

• ICPSR (Inter-University Consortium for Political and Social Research). At the University of Michigan.

• National Archive of Criminal Justice Data holds over 700 data collections relating to criminal justice.

• Roper Center for Public Opinion Research data from surveys of public opinion from the 1930s to the present.