Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
accounts:ics_home_directory [2022/01/04 14:36]
Hans
accounts:ics_home_directory [2024/07/16 10:58] (current)
relkhou1 [Storage System]
Line 1: Line 1:
 ====== ICS Home Directory ====== ====== ICS Home Directory ======
 +===== Overview ======
  
-ICS Computing Support ​provides an ICS Home Directory ​for **every** member of the ICS community, ​including facultystaff, grad and ugrad students, and visitors.+  * The school ​provides an ICS home directory ​for every member of the ICS community
 +  * The ICS home directory istypicallyautomatically available on any ICS managed Windows ​and Linux system. 
 +  * That ICS home directory is available to **any** computer connected to the Campus Network(even via [[network:​campus:​campusvpn|VPN]]). 
 +  * Backed up twice daily
  
-That ICS Home Directory is available to **any** ICS computer, **any** computer on the UCI campus, and **any** computer connected to the [[network:​campus:​campusvpn|Campus VPN]]. 
  
-Your ICS Home Directory is automatically mounted on any ICS managed Linux or Windows host.  Your home directory may be [[accounts:​fuse-sshfs|mounted via sshfs or Samba]] from any unmanaged host.+===== Ubiquitous Availability ====== 
 + 
 +Any time you login to an ICS managed Windows or [[https://​swiki.ics.uci.edu/​doku.php/​services:​supported_os|Linux computer]] you will be presented with the same home directory and files as any other managed host at ICS.    
 + 
 +The School of ICS provides an ICS home directory for **every** member of the ICS community, including faculty, staff, grad and ugrad students, and visitors. ​ That ICS Home Directory ​is available to **any** ICS computer, **any** computer on the UCI campus, and **any** computer connected to the [[network:​campus:​campusvpn|Campus VPN]]. 
 +The ICS home directory ​is automatically mounted on any ICS managed Linux or Windows host.  Your home directory may be [[accounts:​fuse-sshfs|mounted via sshfs or Samba]] from any unmanaged host. 
 + 
 + 
 +=== ICS Managed Linux === 
 + 
 +Home directories are automatically mounted on /​home/<​username>​ via [[https://​en.wikipedia.org/​wiki/​Network_File_System|NFS]] by the [[https://​en.wikipedia.org/​wiki/​Automounter|autofs]] service. ​   
 + 
 +=== ICS Managed Windows === 
 + 
 +Home directories are typically mapped as the H: drive at login time via the [[accounts:​mapping_network_drive|Samba service]]. 
 + 
 +=== Unmanged/​Personal Linux, Windows, Macintosh === 
 + 
 +Follow these instructions to mount your home directory [[accounts:​fuse-sshfs|via sshfs or Samba]] from any host connected to the campus network. 
 + 
 + 
 +==== Tardigrade: ​ The Updated Storage Server ====
  
 Beginning Fall 2021, all home directories are being stored on a new [[https://​www.purestorage.com/​products/​file-and-object/​flashblade.html|Purestorage Flashblade]] named [[hardware:​storage:​tardigrade|tardigrade.ics.uci.edu]],​ occasionally abbreviated as tg.ics.uci.edu. Beginning Fall 2021, all home directories are being stored on a new [[https://​www.purestorage.com/​products/​file-and-object/​flashblade.html|Purestorage Flashblade]] named [[hardware:​storage:​tardigrade|tardigrade.ics.uci.edu]],​ occasionally abbreviated as tg.ics.uci.edu.
Line 11: Line 35:
 Highlights: Highlights:
  
-  * All Flash Storage ​+  * Backed by all flash storage so home directory access is fast 
   * Redundant 40Gb/s uplink to the ICS Data Center Backbone   * Redundant 40Gb/s uplink to the ICS Data Center Backbone
   * Inline compression (data reduction factor of ~1.6)   * Inline compression (data reduction factor of ~1.6)
-  * 28 days of self services ​+ disaster recovery backups+  * [[accounts:​snapshots|28 days of self service snapshots]] ​long term disaster recovery backups
  
 +==== Storage System ====
 +Typically, there are two types of storage systems at ICS.
  
 +=== Network File System ===
 +Network file system, NFS, is available on every managed ICS system. On Linux, NFS is managed by the automounter (autofs) service. Anything under /home, /extra/, or /auto is NFS and autofs managed. On Windows or Mac systems, the space is available via CIFS or SMB and mapped as a network drive. This is also included in /home/ and /extra/.
 +
 +NFS Pros:
 +  * Available everywhere
 +  * Backups ​
 +  * Hourly snapshots
 +  * Access control
 +  * Quotas
 +
 +NFS cons:
 +  * Only as fast as the network  ​
 +  * Expensive: ​ RAID + Snapshots + Fast Network are not cheap
 +
 +=== Local File System ===
 +Local file systems are backed by local physical media and are only available on filesystems they are physically attached to. Most systems have local storage exposed for all users in /scratch or /tmp. Some faculty and researchers purchase extra and that's made available via /srv/disk# or srv/nvme#.
 +
 +LocalFS Pros:
 +  * Cheap
 +  * Fast
 +  * Abundant
 +
 +LocaFS Cons:
 +  * Scratch only, no backup
 +  * Localhost only.
 +  * Available over network via slower protocols, fuse or sshfs
  
 ==== Quotas ==== ==== Quotas ====
  
-The following chart lists current quota limits for home directories that are on Tardigrade. ​ There are no limits on the number of files a user may own.+The following chart lists current quota limits for home directories that are on Tardigrade. ​ There are no limits on the number of files a user may own. Quota only counts what is in your /​home/​*username* directory.
  
 | **Account Type** ​ | **Quota** ​ | | **Account Type** ​ | **Quota** ​ |
Line 29: Line 81:
 | Visitors | TBD | | Visitors | TBD |
  
-\\+=== How much space am I using? ===
  
-==== Ubuquitous Home Directory==== +Are you getting ​an over quota message but when running **df -h** it shows that there TBs of available space? ​
- +
-Any time you login to an ICS managed host you will be presented with the same home directory and files as any other managed host at ICS.    +
- +
-=== ICS Managed Linux === +
- +
-Home directories are automatically mounted on /​home/<​username>​ via [[https://​en.wikipedia.org/​wiki/​Network_File_System|NFS]] by the [[https://​en.wikipedia.org/​wiki/​Automounter|autofs]] service. ​   +
- +
-=== ICS Managed Windows === +
- +
-Home directories are typically mounted as the H: drive at login time via the [[https://​en.wikipedia.org/​wiki/​Samba|Samba service]]. +
- +
-=== Unmanged/​Personal Linux, Windows, Macintosh ===+
  
-Follow these instructions to mount your home directory [[accounts:​fuse-sshfs|via sshfs or Samba]] from any unmanaged host.+<​code>​ 
 +# df -h 
 +Filesystem ​        ​Size ​ Used Avail Use% Mounted on 
 +tardigrade:/​ugrad ​  ​99T ​  ​13T ​  ​86T ​ 13% /​net/​tardigrade/​ugrad 
 +</​code>​
  
 +The command is returning the size of physical filesystem. Your quota is what is listed in the table above. If you would like to know how much space you're using, please run **du -sh /​home/​your_username**. This command could take a few minutes depending on how much data is in your home directory.
 ==== Backup and Recovery==== ==== Backup and Recovery====
  
accounts/ics_home_directory.1641335786.txt.gz · Last modified: 2022/01/04 14:36 by Hans
CC Attribution-Noncommercial-Share Alike 4.0 International
Driven by DokuWiki Recent changes RSS feed Valid CSS Valid XHTML 1.0