Zenodo launched on next generation platform - InvenioRDM 🚀

by Lars Holm Nielsen, on October 13, 2023


CERN, OpenAIRE, and the InvenioRDM open source community are excited to announce that Zenodo has moved onto our next generation underlying technical platform, InvenioRDM!

Over the past year, we've been working intensely on preparing to move Zenodo on top of a refreshed underlying technical platform, InvenioRDM. Zenodo's simple user experience and high scalability stay the same, but the underlying engine has been substantially upgraded. In addition InvenioRDM comes with a suite of new features and improvements that have been high on many of our users' wishlist.

What's new?

We've significantly expanded Zenodo's collaborative features in many different areas:

  • Communities: Our community feature has been upgraded with support for multiple curators, members, reviews, curation, and branding, so e.g. multiple curators can now edit records in their community.
  • Sharing: You can now share records for confidential peer review, enable access requests, or simply create a preview link for your colleagues.
  • Deposit: Our upload form has received many usability improvements, e.g. being able to select the file which should be previewed by default. In addition we've strengthened it through connections to the open science PID infrsatructure, e.g. you can now auto-complete creators from ORCiD and affiliations from ROR, and link to custom funders/awards.
  • Extras: We've also made significant improvements to web accessibility, enabled institutional login via the OpenAIRE AAI, improved usability, and added a download all button for files among other things.

You can find a comprehensive overview of new and changed behaviors in our documentation:

Checkout the user guide for a full overview on how to use the many new features:

Feedback

Don't hesitate to reach out to us on support in case you find any issues on the refreshed Zenodo.

InvenioRDM - an open source community

The engine behind the new Zenodo, InvenioRDM, is available for institutions worldwide and can be customized to your institutional or domain-specific needs, staying close to Zenodo's simple and seamless user experience.

We're proud to have built InvenioRDM together with 27 other partner organisations across the globe as an open source community around the simple vision of providing a great user experience to researchers with the ability to handle large amounts of data. Next, we're working towards making InvenioRDM a fully collaborative platform that empowers its users to share and preserve research.

Credit

The new Zenodo platform was made possible through a strong open collaboration.

We're grateful to our project funders who have enabled us to build and operate Zenodo for the long tail of science over the past 10 years:

  • European Union
    • OpenAIRE, OpenAIREplus, OpenAIRE2020, OpenAIRE-Connect, OpenAIRE-Advance, OpenAIRE-Nexus, BICIKL, CS3MESH4EOSC, FAIRCORE4EOSC, HORIZON-ZEN
  • US National Institutes of Health
    • GREI - Generalist Repository Ecosystem Initiative
  • Arcadia Fund
    • Biodiversity Literature Repository 1 and 2
  • Alfred P. Sloan Foundation
    • Asclepias, Hub for accessible data publishing.
  • CERN Knowledge Transfer Fund
    • InvenioRDM - an open-source research data management platform
  • Donors to CERN & Society Foundation

We're grateful to all the InvenioRDM partners who shared our vision and helped build an amazing next-generation platform. Thanks to:

  • Brookhaven National Laboratory
  • Caltech
  • CERN
  • CNUDST
  • Cottage Labs
  • Data Futures
  • EkoConnect
  • EU Joint Research Centre (JRC)
  • FZ Juelich
  • Group on Earth Observations (GEO)
  • Front Matter
  • HZDR
  • Japan National Institutes of Informatics
  • KTH
  • New York University
  • Northwestern University
  • OpenAIRE
  • TIND
  • TU Graz
  • TU Wien
  • TUBITAK
  • Universität Bamberg
  • Universität Hamburg
  • Universität Freiburg
  • Universität Tübingen
  • WACREN
  • WWU Münster
  • ZHB Luzern

We'd like to extend a big thank you to our users and project partners for testing, feedback, and patience, in particular:

  • California Digital Library
  • Christopher Erdmann
  • Dryad
  • Northwestern University
  • OpenAIRE
  • Plazi
  • ZHB Luzern

The CERN team who worked on the implementation and migration:

  • Alexandros Ioannidis
  • Anika Churilova
  • Antonio Vivace
  • Dimitris Frangiadakis
  • Fatimah Zulfiqar
  • Francois Decourcelle
  • George Lignos
  • German Cancio Melia
  • Javier Romero Castro
  • Jean-Yves Le Meur
  • Jenny Bonsak
  • Jose Benito Gonzalez Lopez
  • Karolina Prezerwa
  • Lars Holm Nielsen
  • Manuel Alejandro De Oliveira Da Costa
  • Martin Lettry
  • Nicola Tarocco
  • Pablo Garcia Marcos
  • Pablo Panero
  • Pablo Saiz
  • Panna Georgina Liptak
  • Rodrigo Oliveira Almeida
  • Tim Smith
  • Yash Lamda
  • Zacharias Zacharodimos

Including many other highly experienced CERN colleagues from the IT Department who helped with all things infrastructure (admin, compute, databases, network, openshift, outreach, search, storage).

The InvenioRDM open source community who contributed with design, development, testing, requirements, outreach, documentation, and expertise:

  • Alessia Bardi, OpenAIRE/National Research Council of Italy
  • Alexander Bardel, TU Graz
  • Anders Friis-Christensen, European Commission JRC
  • Audun Bjørkøy, TIND
  • Austin Sharp, Northwestern University
  • Bessem AAmira, CNUDST
  • Camelia Ignat, European Commission JRC
  • Chokri Ben Romdhane, CNUDST
  • Christian Erlinger, ZHB
  • Christina Zeller, University of Bamberg
  • Christoph Ladurner, TU Graz
  • Claudio Atzori, OpenAIRE/National Research Council of Italy
  • Dan Granville, Data Futures GmbH
  • David Eckhard, TU Graz
  • David Pape, HZDR
  • Eric Newman, Northwestern University
  • Esteban Gabancho, Universität Hamburg
  • Gretchen Neidhardt, Northwestern University
  • Guido Juckeland, HZDR
  • Guillaume Viger, Northwestern University
  • Hagar Lowenthal, European Commission JRC
  • Hakan Bayındır, TÜBİTAK ULAKBİM
  • Hermann Schranzhofer, TU Graz
  • Ilire Hasani-Mavriqi, TU Graz
  • Jan-Olof Wiefel, Universität Münster
  • Jesse Asamoa, WACREN
  • Jonathan Bauer, University of Freiburg
  • Jonathan LeBonzec, TIND
  • Joshua Elder, Northwestern University
  • Kai Wörner, Universität Hamburg
  • Karen Gutzman, Northwestern University
  • Karl Krägelin, Universität Münster
  • Katerina Iatropoulou, OpenAIRE/Athena Research and Innovation Centre
  • Kathrin Heim, ZHB
  • Kristi Holmes, Northwestern University
  • Lars Holm Nielsen, CERN
  • Mahonry Estrada, Northwestern University
  • Maik Fiedler, HZDR
  • Martin Fenner, Frontmatter
  • Matt Carson, Northwestern University
  • Maximilian Johannes Moser, TU Wien
  • Michael Dütting, Universität Münster
  • Michael Groh, University of Bamberg
  • Mike Hucka, Caltech
  • Mojib Wali, TU Graz
  • Nikolaos Alexandrakis, European Commission JRC
  • Oliver Knodel, HZDR
  • Paolo Manghi, OpenAIRE/National Research Council of Italy
  • Peter Cornwell, Data Futures GmbH
  • Philipp Gualdi, TU Graz
  • Robert Doiel, Caltech
  • Rosa Lönneborg, KTH
  • Salaheddine Ben Ali, CNUDST
  • Sam Arbid, KTH
  • Sara Gonzales, Northwestern University
  • Sarah Wiechers, Universität Münster
  • Sefakor Ankora, WACREN
  • Sotirios Tsepelakis, TU Wien
  • Thomas Gruber, HZDR
  • Tom Morrell, Caltech
  • Werner Greßhoff, Universität Münster
  • Wibke Fellermann, Universität Münster


UPDATE: Zenodo migration postponed to Oct 13 from 06:00-08:00 UTC

by Lars Holm Nielsen, on September 25, 2023


See the original announcement.

We unfortunately have to postpone the planned migration on September 29th 6-8 UTC. The new migration date is October 13 from 06:00-08:00 UTC. We apologise for any inconvenience it may cause.

During a final trial migration run last week we have discovered some issues that we've been trying to address in time to be ready to start the final migration process today. Unfortunately, we've not be able to fully address the issues and as a precautionary measure we're postponing the migration.

Zenodo has over the past 10 years grown in both scale and size, and thus migrating the full system to a new technical platform is a large undertaking. In order to minimize service disruption for our users, we're taking an incremental approach. This approach works by migrating a snapshot of the existing system, and afterwards incrementally apply changes in the existing system to the new system. This method enables us to keep the downtime of Zenodo to about 1-2 hours instead of the ~3 days which full migration takes due to Zenodo's scale and size. The incremental approach however is also more technically challenging, and it is through our extensive quality assurance checks that we discovered issues that we need further time to investigate.

If you're eager to learn more abou the new platform, then you can find a comprehensive overview over what's new and what's changed on the following links:



Zenodo.org unavailable for 2 hours on Sep 29 from 06:00 to 08:00 UTC

by Lars Holm Nielsen, on September 6, 2023


TL;DR

Zenodo.org will be unavailable for 2 hours on September 29th from 06:00-08:00 UTC.

Zenodo relaunching on next-generation platform - InvenioRDM

We're excited to finally announce the launch date for migrating Zenodo to our next-generation platform. On September 29th, Zenodo's underlying technical platform will be migrated to InvenioRDM, a digital repository platform born out of Zenodo and developed together with 25 partners. See also our earlier announcement.

Demo site

You can see a demo of the new Zenodo at https://zenodo-rdm-qa.web.cern.ch. The demo site has a snapshot of Zenodo production data from end-August.

Logging in

If you have an account on Zenodo.org, you can login on the demo site by resetting your password using the same email address as you registered with on Zenodo.org.

FAQ

Why must I save the changes before the migration?

We are setting up an entirely new production system, and thus once the intervention is over you will be required to login again. This means that any page you had open on Zenodo.org prior to the intervention starting, will no longer be able to interact with Zenodo after the intervention is over, and thus the changes you made will be lost. To avoid losing changes, you must simply ensure that you save any changes prior to the intervention starting on Sep 29 at 06:00 UTC.

What's new/changed?

We're launching several new features together with the release as well. A full announcement is going out two weeks in advance of the release, thus following is a quick overview of some of the new features:

  • Community members: Ability for multiple users to curate/manage a community, as well as the ability of community members to see files in restricted records.
  • Reviews: Community curators will be able to edit submissions to their community, and have a conversation with the submitter to fix issues prior to the submission.
  • Sharing: New options for sharing records with specific users and as well as generating secret links that can be shared.
  • Deposit form: Auto-completion of creators/contributors, affiliations and subjects from ORCiD, ROR, and OECD Fields of Science and Technology as well as improved funding and license selectors.
  • Web accessibility: We still have to make many more improvements towards being level AA complaint with the W3C Web Content Accessibility Guidelines, however the new platform has overall made significant improvements to web accessibility of the platform.
  • User interface: Zenodo will look familiar, but we've introduced many smaller usability improvements to the user interface as well as better usage of screen space.

Will feature X still work?

Yes, we provide backward compatibility for all existing features. We will be launching a series of new and improved features which will be announced 2 weeks before the migration.

Will your APIs be backward compatible?

Yes, we do our outmost to ensure backward compatibility of our APIs, and that your integration will continue to work on the new platform as well.

Will I be required to update my API integration?

After Zenodo on InvenioRDM has been launched, we will deprecate some of our existing APIs. We will provide a migration period of 1-year for the transition. New features will only be available on the new API. The new API is similar to the existing API to ease the transition.

Will the community curators be able to edit my existing records?

If your record has been accepted into a community which you're not the owner of, you will receive a request to grant community curators access to edit the metadata of your record. If you decline the request, your record will be removed from the community. If you neither accept or decline the request within 6 months, the community curators will be granted access to edit the metadata.

Will community curators be able to view the files of my closed access or restricted record?

If your record has been accepted into a community which you're not the owner of and your record is either closed access or restricted access, you will receive a request to grant community curators access to view the files of your closed/restricted record. If you decline the request, or you do not accept the request within 6 months, your record will be automatically removed from the community.

Will old links still work?

Yes. We have ensured that all old links have been redirected to their new location. This include e.g. also a translation layer that ensure search queries still work.

You're releasing on Friday?

Yes. The migration process starts already on Monday Sep 25th and will last throughout the week. In addition we have senior staff on duty during the full weekend in case of any problems.