Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
accounts:ics_home_directory [2018/09/14 16:06] Hans [Snapshots] |
accounts:ics_home_directory [2024/07/16 10:58] (current) relkhou1 [Storage System] |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== ICS Home Directory ====== | ====== ICS Home Directory ====== | ||
- | ===== Summary ===== | + | ===== Overview ====== |
- | Your ICS Home Directory is shared across all ICS supported hosts. Any time you login to an ICS support host you will be presenting with the same home directory and files as any other supported host at ICS. You will always start at the root level of your home directory. e.g. /home/$USER. | + | * The school provides an ICS home directory for every member of the ICS community. |
+ | * The ICS home directory is, typically, automatically available on any ICS managed Windows and Linux system. | ||
+ | * That ICS home directory is available to **any** computer connected to the Campus Network(even via [[network:campus:campusvpn|VPN]]). | ||
+ | * Backed up twice daily | ||
- | ===== Services ===== | ||
- | This is accomplished via [[https://en.wikipedia.org/wiki/Network_File_System:NFS]] storage and the [[https://en.wikipedia.org/wiki/Automounter|autofs]] service. | + | ===== Ubiquitous Availability ====== |
- | + | ||
- | ===== Backups ===== | + | |
- | ==== Snapshots ==== | + | Any time you login to an ICS managed Windows or [[https://swiki.ics.uci.edu/doku.php/services:supported_os|Linux computer]] you will be presented with the same home directory and files as any other managed host at ICS. |
- | Thirty days of home directory [[accounts:snapshots|Snapshots]] are available to all users for file recovery. | + | The School of ICS provides an ICS home directory for **every** member of the ICS community, including faculty, staff, grad and ugrad students, and visitors. That ICS Home Directory is available to **any** ICS computer, **any** computer on the UCI campus, and **any** computer connected to the [[network:campus:campusvpn|Campus VPN]]. |
+ | The ICS home directory is automatically mounted on any ICS managed Linux or Windows host. Your home directory may be [[accounts:fuse-sshfs|mounted via sshfs or Samba]] from any unmanaged host. | ||
- | ==== Long Term Backups ==== | + | |
+ | === ICS Managed Linux === | ||
+ | |||
+ | Home directories are automatically mounted on /home/<username> via [[https://en.wikipedia.org/wiki/Network_File_System|NFS]] by the [[https://en.wikipedia.org/wiki/Automounter|autofs]] service. | ||
+ | |||
+ | === ICS Managed Windows === | ||
+ | |||
+ | Home directories are typically mapped as the H: drive at login time via the [[accounts:mapping_network_drive|Samba service]]. | ||
+ | |||
+ | === Unmanged/Personal Linux, Windows, Macintosh === | ||
+ | |||
+ | Follow these instructions to mount your home directory [[accounts:fuse-sshfs|via sshfs or Samba]] from any host connected to the campus network. | ||
+ | |||
+ | |||
+ | ==== Tardigrade: The Updated Storage Server ==== | ||
+ | |||
+ | Beginning Fall 2021, all home directories are being stored on a new [[https://www.purestorage.com/products/file-and-object/flashblade.html|Purestorage Flashblade]] named [[hardware:storage:tardigrade|tardigrade.ics.uci.edu]], occasionally abbreviated as tg.ics.uci.edu. | ||
+ | |||
+ | Highlights: | ||
+ | |||
+ | * Backed by all flash storage so home directory access is fast | ||
+ | * Redundant 40Gb/s uplink to the ICS Data Center Backbone | ||
+ | * Inline compression (data reduction factor of ~1.6) | ||
+ | * [[accounts:snapshots|28 days of self service snapshots]] + long term disaster recovery backups | ||
+ | |||
+ | ==== Storage System ==== | ||
+ | Typically, there are two types of storage systems at ICS. | ||
+ | |||
+ | === Network File System === | ||
+ | Network file system, NFS, is available on every managed ICS system. On Linux, NFS is managed by the automounter (autofs) service. Anything under /home, /extra/, or /auto is NFS and autofs managed. On Windows or Mac systems, the space is available via CIFS or SMB and mapped as a network drive. This is also included in /home/ and /extra/. | ||
+ | |||
+ | NFS Pros: | ||
+ | * Available everywhere | ||
+ | * Backups | ||
+ | * Hourly snapshots | ||
+ | * Access control | ||
+ | * Quotas | ||
+ | |||
+ | NFS cons: | ||
+ | * Only as fast as the network | ||
+ | * Expensive: RAID + Snapshots + Fast Network are not cheap | ||
+ | |||
+ | === Local File System === | ||
+ | Local file systems are backed by local physical media and are only available on filesystems they are physically attached to. Most systems have local storage exposed for all users in /scratch or /tmp. Some faculty and researchers purchase extra and that's made available via /srv/disk# or srv/nvme#. | ||
+ | |||
+ | LocalFS Pros: | ||
+ | * Cheap | ||
+ | * Fast | ||
+ | * Abundant | ||
+ | |||
+ | LocaFS Cons: | ||
+ | * Scratch only, no backup | ||
+ | * Localhost only. | ||
+ | * Available over network via slower protocols, fuse or sshfs | ||
+ | |||
+ | ==== Quotas ==== | ||
+ | |||
+ | The following chart lists current quota limits for home directories that are on Tardigrade. There are no limits on the number of files a user may own. Quota only counts what is in your /home/*username* directory. | ||
+ | |||
+ | | **Account Type** | **Quota** | | ||
+ | | Faculty | 512 GB | | ||
+ | | Graduate Students |384 GB | | ||
+ | | Staff |256 GB | | ||
+ | | Undergraduate Students | 256GB | | ||
+ | | Visitors | TBD | | ||
+ | |||
+ | === How much space am I using? === | ||
+ | |||
+ | Are you getting an over quota message but when running **df -h** it shows that there TBs of available space? | ||
+ | |||
+ | <code> | ||
+ | # df . -h | ||
+ | Filesystem Size Used Avail Use% Mounted on | ||
+ | tardigrade:/ugrad 99T 13T 86T 13% /net/tardigrade/ugrad | ||
+ | </code> | ||
+ | |||
+ | The command is returning the size of physical filesystem. Your quota is what is listed in the table above. If you would like to know how much space you're using, please run **du -sh /home/your_username**. This command could take a few minutes depending on how much data is in your home directory. | ||
+ | ==== Backup and Recovery==== | ||
+ | |||
+ | === Snapshots === | ||
+ | |||
+ | Self service [[accounts:snapshots|Snapshots]] are available to all users for file recovery for the previous four weeks (28 days). | ||
+ | |||
+ | === Long Term Backups/Disaster Recovery === | ||
Backups to tape are made once per month. Our goals is to keep a quarterly copy of the each home directory on tape for two or more years. Contact [[:start#contacting_ics_computing_support_helpdesk|ICS Computing Support Helpdesk]] if you feel you require a file recovery that is no available via snapshots. | Backups to tape are made once per month. Our goals is to keep a quarterly copy of the each home directory on tape for two or more years. Contact [[:start#contacting_ics_computing_support_helpdesk|ICS Computing Support Helpdesk]] if you feel you require a file recovery that is no available via snapshots. | ||
+ | |||
+ | === Exceptions ==== | ||
+ | |||
+ | Files or directories called "scratch" and some video and audio files will be excluded from backups. | ||