Ranch Maintenance, March 22-25
Posted by Mark Brueschke on Mar 22, 2019 5:51:14 PM
Updated on Mar 25, 2019 12:03:53 PM
Ranch is now back in production after an extended maintenance. During this maintenance, the current Ranch archive transitioned to a new support infrastructure based on Quantum StorNext hardware and software technology.
For detailed information on this transition and how it affects users, please consult the Ranch Transition to Quantum Archiving System document (https://portal.tacc.utexas.edu/user-guides/ranch/transition) and the updated Ranch User Guide (https://portal.tacc.utexas.edu/user-guides/ranch).
Now that users are allowed back onto the Ranch system, their new personal directories will be empty except for a symbolic link (“./old_HSM”) pointing to each user’s directories on the old Oracle archive. Your data is untouched and unmoved. It is now up to each user to review and evaluate all their data and decide whether to move it to their new directory within the new Quantum system.
Please be aware of the following changes to the Ranch user environment:
- Users will have access to their existing data, read-only, through March 31, 2020.
- Quotas: Users in the new environment are now subject to default file space quota of 2TB and file count quota of 50,000 files in their personal directories.
- Project Spaces: Additionally, a “Project Space” directory structure has been implemented to support both shared and user directories that exceed the 2TB per user quota. These “Project Space” directories will continue to be set up only upon PI request, with appropriate file count and file size quotas, a defined retention period, and group permissions allowing shared access among the projects’ users.
Please submit any questions you may have through the TACC Consulting System or feedback form. https://portal.tacc.utexas.edu/tacc-consulting https://portal.tacc.utexas.edu/feedback
Ranch will be unavailable for an extended maintenance from 5:00 PM (CT) Friday, March 22, through 9:00 AM Monday, March 25, 2019. During this maintenance, the current Ranch archive will transition to a new support infrastructure based on Quantum StorNext hardware and software technology.
Detailed information will be available in a transition guide and an updated Ranch user guide. Both guides are currently under development and will be released when the new system enters production.
After over two decades of operation, the Ranch system has more than 49,000 users. What has been revealed after running Ranch for so long, with so many users, is that continuing to support file storage quotas, implementing a total file count quota, and enforcing explicit data retention periods are the keys to the sustainability of the Ranch archiving environment over the long-term.
In the new environment each user will have a default file quota of 50,000 files and 2TB of storage in their personal directories. Additionally, a "project" directory structure will be implemented to support both shared and user directories that exceed the 2TB per user quota. These "project" directories will be set up only upon PI request, with appropriate file count and file size quotas, a defined retention period, and group permissions allowing shared access.
On March 25, 2019 at 9:00 AM, when users are allowed back onto the Ranch system, all current Ranch user home directories will reside within the new system. These directories will be empty, except for a link (./old_HSM) that will point to the users’ old Ranch directories. Users will have access to their existing data, read-only, through March 31, 2020.
Users are encouraged to migrate the data that they need to keep beyond March 31, 2020 by copying ONLY that data from their existing Ranch directory into their new personal directory. As the file quota of 50,000 files will be in effect for this new directory, using tar or some other methodology will be necessary to keep file count beneath quota for both any migrated data and all new incoming data.
Please submit any questions you may have via the TACC User Portal or the XSEDE User Portal.