Data access and transfer#
The UNLOCK FAIR Data Platform provides long-term, structured storage for all project data and metadata, and supports flexible access and data transfer across different analysis tools and systems. This storage and management is handled through iRODS, according to the UNLOCK ontology.
Data management backend#
The underlying storage system of the UNLOCK FDP is powered by iRODS (integrated Rule-Oriented Data System), an open source data management software solution. It enables the UNLOCK FDP to capture all data that is generated during an experiment and to access and transfer this data. For example, this could be data obtained from bioreactor measurements, proteomics or standard sequencing procedures. Through standardisation procedures the data becomes better organised, containing essential metadata elements and loss or corruption of data should not happen anymore. Currently, standards for genomics, transcriptomics and amplicon sequencing are in place. Other formats will become available when an agreement on standardisation has been made.
Accessing and transferring data#
There are various ways to access and transfer the data on the UNLOCK FDP. Broadly, these methods can be split into intuitive, user-friendly GUI (Graphical User Interface) options, more powerful CLI (Command Line Interface) options, and integrated programming options.
GUI methods offer a user-friendly way to browse, upload, and download data using standard tools such as web browsers, file explorers and graphical file transfer clients. These tools are not optimized for large transfers (files larger than 1 GB, or many files).
CLI methods provide more powerful and flexible options for managing, scripting, and automating data transfers.
Integrated programming methods provide similar power in regards to data management, they also offer integration into programming languages. In this guide only the Python integration from iBridges will be discusse.