RDIM Step 2 - Manage Organise Data Data Storage - Active or Working Data
Data Storage - Active or Working Data
- Future Students
- ·¬ÇÑÉçÇø Global Experience
- International Students
- Open Day
- How to apply
- Pathways to university
- Virtual Open Day
- Living on Campus
- Courses
- Publications
- Scholarships
- Parents and Partners
- ·¬ÇÑÉçÇø Heroes Programs
- Aboriginal and Torres Strait Islander in Marine Science
- Elite Athletes
- Defence
- ·¬ÇÑÉçÇø
- New students
- ·¬ÇÑÉçÇø Orientation
- Learn·¬ÇÑÉçÇø
- Placements
- CEE
- Unicare Centre and Unicampus Kids
- Graduation
- Off-Campus Students
- ·¬ÇÑÉçÇø Job Ready
- Safety and Wellbeing
- ·¬ÇÑÉçÇø Prizes
- Professional Experience Placement
- Employability Edge
- Art of Academic Writing
- Art of Academic Editing
- Careers and Employability
- Student Equity and Wellbeing
- Career Ready Plan
- Careers at ·¬ÇÑÉçÇø
- Partners and Community
- ·¬ÇÑÉçÇø-CSIRO Partnership
- Alumni
- About ·¬ÇÑÉçÇø
- Reputation and Experience
- Chancellery
- Governance
- Celebrating 50 Years
- Academy
- Indigenous Engagement
- Education Division
- Graduate Research School
- Research and Teaching
- Research Division
- Research and Innovation Services
- CASE
- College of Business, Law and Governance
- College of Healthcare Sciences
- College of Medicine and Dentistry
- College of Science and Engineering
- CPHMVS
- Anthropological Laboratory for Tropical Audiovisual Research (ALTAR)
- Anton Breinl Research Centre
- Agriculture Technology and Adoption Centre (AgTAC)
- Advanced Analytical Centre
- AMHHEC
- Aquaculture Solutions
- AusAsian Mental Health Research Group
- ARCSTA
- Area 61
- Lions Marine Research Trust
- Australian Tropical Herbarium
- Australian Quantum & Classical Transport Physics Group
- Boating and Diving
- Clinical Psychedelic Research Lab
- Centre for Tropical Biosecurity
- Centre for Tropical Bioinformatics and Molecular Biology
- CITBA
- CMT
- Centre for Disaster Solutions
- CSTFA
- Cyclone Testing Station
- The Centre for Disaster Studies
- Daintree Rainforest Observatory
- Fletcherview
- ·¬ÇÑÉçÇø Eduquarium
- ·¬ÇÑÉçÇø Turtle Health Research
- Language and Culture Research Centre
- MARF
- Orpheus
- TESS
- ·¬ÇÑÉçÇø Ideas Lab
- TARL
- eResearch
- Indigenous Education and Research Centre
- Estate
- Work Health and Safety
- Staff
- Discover Nature at ·¬ÇÑÉçÇø
- Cyber Security Hub
- Association of Australian University Secretaries
- Services and Resources Division
- Environmental Research Complex [ERC]
- Foundation for Australian Literary Studies
- Gender Equity Action and Research
- General Practice and Rural Medicine
- Give to ·¬ÇÑÉçÇø
- Indigenous Legal Needs Project
- Inherent Requirements
- IsoTropics Geochemistry Lab
- IT Services
- ·¬ÇÑÉçÇø Webinars
- ·¬ÇÑÉçÇø Events
- ·¬ÇÑÉçÇø Motorsports
- ·¬ÇÑÉçÇø Sport
- Library
- Mabo Decision: 30 years on
- Marine Geophysics Laboratory
- Office of the Vice Chancellor and President
- Outstanding Alumni
- Pharmacy Full Scope
- Planning for your future
- Policy
- PAHL
- Queensland Research Centre for Peripheral Vascular Disease
- Rapid Assessment Unit
-
RDIM
- Introduction
- RDIM Overview
- My Responsibilities
- Research Data ·¬ÇÑÉçÇø Platform
- Step 1 - Plan
- Step 2 - Manage
- Step 3 - Archive
- Step 4 - Publish
- Step 5 - Reuse
- Step 6 - Review
- Step 7 - Dispose
-
Terminology
- Access Conditions (Open, Conditional, Restricted)
- Active Data
- Active Storage and Collaboration Options
- Citations
- Collaborator
- Completed Data
- Conditional Access
- Confidentiality
- Consent
- Contracts
- Copyright
- Creative Commons Licence
- Creative Commons Zero (CC0)
- Custodian
- Custodianship
- Data
- Data Creator
- Data Custodian
- Data Manager
- Digital Object Identifier (DOI)
- Data Package
- Data Papers
- Data Publication
- Data Record
- Data Repositories
- Data Retention
- Data Storage - Active Data or Working Data
- Data Storage - Completed Data
- Data Visualisation
- Data Wrangling (Cleaning)
- De-identifying Data
- Digital Object Identifier (DOI)
- DIKW Model
- DOI Minting Services
- Embargo
- Ethics and Ethical Clearance
- FAIR Data Principles
- File Formats
- File Names
- Folder Structures
- HDR Candidate
- Information
- Intellectual Property
- ·¬ÇÑÉçÇø Researcher
- Lead Investigator
- Licensing Data
- Metadata
- Moral Rights
- Open Access
- Primary Advisor
- Primary Materials
- Privacy and Personal Information
- Repositories
- Research Data
- Research (Data and Information) Asset
- Research (Data and Information) Asset Lifecycle
- Research Data ·¬ÇÑÉçÇø Platform
- Research Data Management Plan (RDMP)
- Research Information
- Research Project
- Restricted Access
- Retention
- Retention Rules for Specific Data Types
- Sensitive Data
- Storage
- Supporting Documents
- Triangulation, Data Linkage and Integrating Authorities
- Version Control
- Working Data
- Wrangling (Cleaning) Data
- Frequently Asked Questions
- Information Sheets
- Training Videos
- Site Map
- Contact Us
- Researcher Development Portal
- Roderick Centre for Australian Literature and Creative Writing
- Contextual Science for Tropical Coastal Ecosystems
- State of the Tropics
- Strategic Procurement
- Student profiles
- SWIRLnet
- TREAD
- TropEco for Staff and Students
- TQ Maths Hub
- TUDLab
- UAV
- VAVS Home
- WHOCC for Vector-borne & NTDs
- Media
- Copyright and Terms of Use
- Australian Institute of Tropical Health & Medicine
- Pay review
Active data and working data are the same thing, read the definition of Active Data.
Appropriate data storage is a critical aspect of good research data management.
Many factors can lead to data loss or misuse with devastating consequences for your research and research career. Safeguarding against these should be a priority.
Researchers may need different storage and collaboration solutions at different stages of the Research (Data and Information) Asset Lifecycle. The options, also listed under ‘Active Storage and Collaboration Options’ are suitable for storing active (working) data, collaborating with other researchers, and/or creating backups.
Safe data is data stored in a “safe” data storage system:
- The system operates with a low probability of failure
- It is managed by ·¬ÇÑÉçÇø staff or an approved third-party provider
- It is designed for mid to long-term data storage.
It is important to note that while you may consider the data on the system you are currently using for analysis as your primary or main data, these systems do not necessarily qualify as “safe” storage.
·¬ÇÑÉçÇø approved storage options for safe active data include:
- ·¬ÇÑÉçÇø Microsoft OneDrive | up to 5 TB – staff and students
- ·¬ÇÑÉçÇø Microsoft Teams | up to 25 TB per team - available to ·¬ÇÑÉçÇø staff on request
- ·¬ÇÑÉçÇø | greater than 50 GB, up to many TB - access via ·¬ÇÑÉçÇø QRISCloud Cache or direct
- Storage as dictated by Research Partner and/or Funding Agency
- ·¬ÇÑÉçÇø research file shares - limited availability, based strictly on research need i.e. highly sensitive data
Note: Use Research Data ·¬ÇÑÉçÇø for completed data only | less than 100 MB - contact researchdata@jcu.edu.au for sensitive data or larger datasets.
Options that are suitable for backup storage include:
- Shared university network drive (e.g. G, H etc.)
- Desktop equipment (e.g. external drive/s, laptop, RAID systems, etc.)
- External cloud storage/collaboration space (e.g., Dropbox, Google Drive).
Options that should NOT be used for storing research data include:
- ·¬ÇÑÉçÇø High Performance Computing (HPC)
- ·¬ÇÑÉçÇø research file shares - limited availability, based strictly on research need i.e temporary storage during analysis where the data needs to be local to the application for optimal performance (e.g. ArcGIS software and laptops)
While you may use many and varied different systems for data analysis during your research (e.g., ·¬ÇÑÉçÇø HPC, Metashape and Galaxy), these should only serve as temporary storage during the active analysis phase. They are not replacements for a long-term data storage solution. Never store your only copy of crucial data on these systems.
·¬ÇÑÉçÇø HPC may have been used for long-term storage in the past; however, this practice is no longer recommended
For archiving completed data see Data Storage - Completed Data.
The basic rules for storing data and safeguarding against data loss are:DO keep three copies in separate places i.e., on at least two different types of media (physical device or cloud) and in another location (physical location or cloud) DON'T keep the only copy of your research data on a physical device e.g., hard drive (PC, laptop or external HDD) or USB key. These can easily be lost, damaged or fail. |
The optimal combination of storage solutions will depend on your specific workflow, the volume and sensitivity of your data, and your preferences for file access and collaboration. For instance, you may prefer to work on your PC’s hard drive and synch to ·¬ÇÑÉçÇø Microsoft OneDrive if factors such as internet access, performance, or application compatibility are important. On the other hand, synching from OneDrive back to your PC (ensure you have sufficient space), facilitates collaboration and provides access to version history and a cloud backup if local storage fails. In practice, a combination of these approaches is likely to be helpful.
IMPORTANT: The following hypothetical research projects and storage options are provided for guidance only and are not prescriptive. To discuss a specific project and storage requirements in more detail please contact researchdata@jcu.edu.au
General
| Field-work based:
| ||
Computational analysis:
| Sensitive data:
|
Active Storage and Collaboration Options
·¬ÇÑÉçÇø Microsoft OneDrive | ·¬ÇÑÉçÇø Microsoft Teams | Analysis phase only | ||
---|---|---|---|---|
Storage Capacity | 5 TB | 25 TB per team |
Up to 5 TB and 250, 000 files | > 50 GB up to many TB and 1,000,000 files |
Collaborating with ·¬ÇÑÉçÇø researchers | ✔ | ✔ | ✔ | ✔ |
Collaborating with external researchers | ✔ | ✔1 | ✔2 | ✔ |
Sensitive Data | ✔ | ✔ | ✘ | ✔ |
Remote Access | ✔ | ✔ | ✔ | ✔ |
Data Stored in Australia | ✔ | ✔ | ✔ | ✔ |
Deleted File Recovery | ✔3 via Service Now request | ✘ | ✘ | ✘ |
Suitable for Backups | ✔ | ✔ | ✘ | ✔ |
Best Feature | Quick to setup, easy to use, access from day one. | Includes other methods for collaboration along with file sharing. | Excellent for use with HPC compute for data analysis. | Large-scale data storage |
Getting Setup | ·¬ÇÑÉçÇø Microsoft OneDrive | Make a collaboration tool request. |
Notes
- Microsoft Team team owners (·¬ÇÑÉçÇø staff) can add or .
- Researchers can apply (via ServiceNow) for external collaborators to have access to their ·¬ÇÑÉçÇø HPC account.
- Within 30 days.