Apple Xsan 1.0 User Manual

XsanAdministrator’s GuideIncludes information for managing Xsanvolumes in a storage area network usingXsan Admin or the command line019-0192_Cvr 8/17

10 Chapter 1 Overview of Xsan Xsan Storage Area NetworksA storage area network is a way of connecting computers to storage devices that gives users

100 Appendix B Using the Command Line ## Set up a stripe group for exclusive 8-bit NTSC 525 video use.#[StripeGroup VideoGroup1]Status UP # UP/DOW

Appendix B Using the Command Line 101 [StripeGroup AudioGroup2]Status UPExclusive YesAffinity 6100_p8aRead EnabledWrite EnabledStripeBreadth 15Node

102 Appendix B Using the Command Line The Volume Auto-Start ListYou can use the fsmlist configuration file to control which file system processes a

Appendix B Using the Command Line 103 ### Below are some example file system service configuration lines.## Example #1.## This file system is named

104 Appendix B Using the Command Line The Controller ListXsan stores a list of SAN controllers in the file /Library/Filesystems/Xsan/config/fsnames

Appendix B Using the Command Line 105 #crag## Secondary FS Name Server #2 is arete#areteLL0192.book Page 105 Thursday, July 29, 2004 5:20 PM

LL0192.book Page 106 Thursday, July 29, 2004 5:20 PM

107GlossaryGlossaryACFS Apple Cluster File System. The underlying Xsan file system. ACFS is a shared SAN file system that uses a controller to

108 Glossary fill An Xsan storage pool allocation strategy. In a volume consisting of more than one storage pool, Xsan fills up the first pool be

Glossary 109 storage pool A group of logical disks that share common characteristics, such as throughput or latency, across which Xsan stripes us

Chapter 1 Overview of Xsan 11 Shared SAN VolumesUsers and applications see shared SAN storage as local volumes. Xsan volumes are logical disks made

LL0192.book Page 110 Thursday, July 29, 2004 5:20 PM

111IndexIndex“command not found” message 77“No manual entry for...” message 77Aaccesspermissions for folders 59adding storage 16, 42affinityassign

112 Index free spacechecking quota use 71checking storage pool 70checking volume 70fsm command 93fsmpm command 93fsnameservers file 80, 104FS

Index 113removing 38renaming 38security considerations 15, 23serial number 32shared secret file 81shell commands“command not found” 77cvadmi

12 Chapter 1 Overview of Xsan How Xsan Storage Is OrganizedUsers use an Xsan volume the same way they use a local disk. What they don’t see is that

Chapter 1 Overview of Xsan 13 One of your first tasks when you set up a SAN volume is to prepare LUNs. If the two RAID 5 arrays on a new Xserve RAI

14 Chapter 1 Overview of Xsan The following screen image shows how LUNs, storage pools, and volumes appear as you organize them in the Xsan Admin a

Chapter 1 Overview of Xsan 15 How Xsan Utilizes Available StorageXsan stores both user files and file system data on SAN volumes, and stripes data

16 Chapter 1 Overview of Xsan Expanding StorageYou can add free space to an Xsan volume without interrupting the users or applications that rely on

2 172 Setting Up a Storage Area NetworkThis chapter lists requirements, suggests planning tips, and gives instructions for setting up an Xsan SAN

18 Chapter 2 Setting Up a Storage Area Network Hardware and Software RequirementsYour SAN environment needs to satisfy requirements in these areas:

Chapter 2 Setting Up a Storage Area Network 19 Fibre Channel FabricUnlike file system metadata, which is transferred over Ethernet, actual file con

 Apple Computer, Inc.© 2004 Apple Computer, Inc. All rights reserved. The owner or authorized user of a valid copy of Xsan software may reproduce

20 Chapter 2 Setting Up a Storage Area Network IP Addresses and Domain NamesFor best results, assign fixed, non-routed IP addresses to all clients,

Chapter 2 Setting Up a Storage Area Network 21 Planning Your SANIt’s easy to add storage to an existing Xsan SAN without interrupting users, but re

22 Chapter 2 Setting Up a Storage Area Network Planning Considerations and GuidelinesThe following paragraphs might help you make some of your SAN

Chapter 2 Setting Up a Storage Area Network 23 • Store user files, file system metadata, and journal data on separate storage pools, and create the

24 Chapter 2 Setting Up a Storage Area Network Xserve RAID supports all popular RAID levels. Each RAID scheme offers a different balance of perform

Chapter 2 Setting Up a Storage Area Network 25 To provide high performance, Xsan uses the RAID 0 scheme to stripe data across the LUNs in a storage

26 Chapter 2 Setting Up a Storage Area Network If high availability is important, you should use at least two controllers, one as the primary contr

Chapter 2 Setting Up a Storage Area Network 27 Connecting Computers and Storage DevicesBefore you set up your Xsan SAN, connect client computers, c

28 Chapter 2 Setting Up a Storage Area Network Using the Xsan Admin ApplicationYou use the Xsan Admin application to set up and manage SANs. You ca

Chapter 2 Setting Up a Storage Area Network 29 SAN Setup SummaryYou’ll perform the following tasks to set up your first Xsan storage area network.

3 3 Contents Preface 7 About This Book8 Notation Conventions Chapter 1 9 Overview of Xsan9 What Is Xsan? 10 Xsan Storage Area Networks 11 Shar

30 Chapter 2 Setting Up a Storage Area Network Setting Up an Xsan Storage Area NetworkStep 1: Set Up the Fibre Channel NetworkmConnect controller

Chapter 2 Setting Up a Storage Area Network 31 Step 5: Install Xsan Software on Clients and ControllersTake the Xsan installer disc to each contro

32 Chapter 2 Setting Up a Storage Area Network Step 7: Set Up Controllers and ClientsAll computers on the local network with Xsan installed are li

Chapter 2 Setting Up a Storage Area Network 33 Step 8: Label and Initialize LUNs (RAID Arrays)Next, prepare (label and initialize) available LUNs

34 Chapter 2 Setting Up a Storage Area Network Step 9: Create VolumesNext, you’ll create the volumes your users will see.1 In Xsan Admin, click St

Chapter 2 Setting Up a Storage Area Network 35 Step 10: Add Storage Pools to the Volumes1 Select a volume in the list and click the New Storage Po

36 Chapter 2 Setting Up a Storage Area Network Step 12: (Optional) Set Up SAN Status NotificationsXsan can notify you by email or pager when the c

Chapter 2 Setting Up a Storage Area Network 37 Step 14: (Optional) Set User and Group QuotasYou can set up quotas to control how much space in eac

38 Chapter 2 Setting Up a Storage Area Network Renaming a SANSANs are listed by name in the SAN Components list in Xsan Admin. By default, a SAN is

Chapter 2 Setting Up a Storage Area Network 39 Setting Up Additional SANsYou can use Xsan Admin to set up and manage more than one SAN. To add a ne

4 Contents 28 Using the Xsan Admin Application 28 Installing Xsan Admin Separately 28 Connecting Through a Firewall 28 Xsan Admin Preferences 28 Gett

LL0192.book Page 40 Thursday, July 29, 2004 5:20 PM

3 413 Managing SAN StorageThis chapter shows how to expand, modify, check, and repair SAN storage.This chapter shows how to:• Add storage to a SA

42 Chapter 3 Managing SAN Storage Adding StorageThere are several ways you can add storage to a SAN:• Add RAID arrays (LUNs) to existing storage po

Chapter 3 Managing SAN Storage 43 Adding LUNs to a Storage PoolYou can increase the capacity of a SAN volume by adding LUNs (RAID arrays or array s

44 Chapter 3 Managing SAN Storage From the Command LineYou can also add LUNs to a storage pool by modifying the associated volume configuration fil

Chapter 3 Managing SAN Storage 45 Adding a Volume to a SANA single Xsan SAN can provide multiple shared volumes.1 Open Xsan Admin and select the SA

46 Chapter 3 Managing SAN Storage From the Command LineYou can also add a volume by setting up a configuration file. For more information, see the

Chapter 3 Managing SAN Storage 47 Assigning an Affinity to a Folder Within a FolderYou can use Xsan Admin to assign an affinity to a folder at the

48 Chapter 3 Managing SAN Storage Changing Storage Pool SettingsThe best way to set up a SAN is to plan its organization carefully before you set i

Chapter 3 Managing SAN Storage 49 Setting Storage Pool Access PermissionsYou can set up storage pools for read-write or read-only access. Changing

Contents 5 60 Removing Xsan Software From a Computer 61 Setting User and Group Quotas 61 About Xsan Quotas 62 Checking Quota Use Chapter 5 63 Managin

50 Chapter 3 Managing SAN Storage Setting Storage Pool Stripe BreadthThe default stripe breadth value (64 file system blocks) is adequate for stora

Chapter 3 Managing SAN Storage 51 The Fibre Channel interface in an Xserve RAID caches up to 1 MB of data before passing the data on to the RAID co

52 Chapter 3 Managing SAN Storage Changing Volume SettingsYou can change some settings for an existing volume, but other changes require the volume

Chapter 3 Managing SAN Storage 53 Setting the Volume Allocation StrategyYou can set the allocation strategy for a volume to determine the order in

54 Chapter 3 Managing SAN Storage Setting the Block Allocation SizeThe default file system block allocation size (4KB) is adequate for most volumes

Chapter 3 Managing SAN Storage 55 Defragmenting a VolumeWhen you create a file, Xsan breaks the file into pieces and distributes these pieces effic

56 Chapter 3 Managing SAN Storage Checking the Integrity of a VolumeIf SAN users are having trouble accessing files, you can use the cvfsck command

4 574 Managing Clients and UsersThis chapter shows how to add, control, and remove client computers and their users.Xsan clients are computers th

58 Chapter 4 Managing Clients and Users Adding a ClientBefore a computer can access a SAN volume, you need to set up that computer as a SAN client.

Chapter 4 Managing Clients and Users 59 Mounting a Volume on a ClientA user who is logged in to a client computer can’t mount a SAN volume. A SAN a

6 Contents 81 Using Xsan Controllers With StorNext Clients Appendix B 83 Using the Command Line83 Using the Shell Commands 83 Working on Remote Compu

60 Chapter 4 Managing Clients and Users Unmounting a Volume From a ClientTo prevent a client from accessing a volume, you can unmount the volume fr

Chapter 4 Managing Clients and Users 61 Setting User and Group QuotasYou can set quotas to manage the amount of storage available to a user or grou

62 Chapter 4 Managing Clients and Users Soft Quotas Change to Hard QuotasIf a user or group exceeds their soft quota for a time longer than their g

5 635 Managing Metadata ControllersThis chapter shows how to add, switch, monitor, and upgrade Xsan metadata controllers.Every SAN volume you set

64 Chapter 5 Managing Metadata Controllers Adding a ControllerYou can add one or more standby controllers to a SAN so that volumes are still availa

Chapter 5 Managing Metadata Controllers 65 Switching to a Standby ControllerYou can force an active metadata controller to turn over control of a v

66 Chapter 5 Managing Metadata Controllers Finding Out Which Controller Is Hosting a VolumeControl of a particular volume can move from one control

Chapter 5 Managing Metadata Controllers 67 Changing a Controller’s IP AddressFollow these instructions if you need to change the IP address of an X

68 Chapter 5 Managing Metadata Controllers Upgrading Controller SoftwareIf your configuration includes a standby controller, you can upgrade the Xs

6 696 Monitoring SAN StatusThis chapter shows how to check the condition of a SAN and its components.This chapter shows how you can check on or a

7PrefaceAbout This BookUse this guide to learn how to set up and manage Xsan volumes on a storage area network.This guide shows how to use Xsan

70 Chapter 6 Monitoring SAN Status Checking Free Space on a SAN VolumeThere are several ways to see how much space is available on a SAN volume.To

Chapter 6 Monitoring SAN Status 71 Checking User Quota UseYou can use Xsan Admin to check file system quotas to see how much of their allotment a u

72 Chapter 6 Monitoring SAN Status Setting Up Status NotificationsXsan can send an email or dial a pager to notify you or other administrators when

Chapter 6 Monitoring SAN Status 73 Viewing LogsYou can use Xsan Admin to view diagnostic and informational messages that Xsan has written to a comp

74 Chapter 6 Monitoring SAN Status Checking for Fibre Channel Connection FailuresFibre Channel connection failures or errors are recorded in the sy

7 757 Solving SAN ProblemsThis chapter lists solutions to common problems you might encounter while working with a SAN.Look here for solutions to

76 Chapter 7 Solving SAN Problems You Can’t Add a Storage PoolThere are some reserved names you can’t use to name a storage pool. If you type one o

Chapter 7 Solving SAN Problems 77 After Slicing, Some LUNs Aren’t Listed in Xsan Admin• If you slice an array that was previously labeled for use w

LL0192.book Page 78 Thursday, July 29, 2004 5:20 PM

79AppendixAA Combining Xsan and StorNext Clients and ControllersThis appendix shows how to add Macintosh clients to an existing StorNext File Sy

8 Preface About This Book Notation ConventionsThe following conventions are used in this book wherever shell commands or other command-line items a

80 Appendix A Combining Xsan and StorNext Clients and Controllers Adding Macintosh Clients to a StorNext SANIf you already have a StorNext File Sys

Appendix A Combining Xsan and StorNext Clients and Controllers 81 Using Xsan Controllers With StorNext ClientsYou can use ADIC’s StorNext software

LL0192.book Page 82 Thursday, July 29, 2004 5:20 PM

83AppendixBB Using the Command LineThis appendix describes Xsan shell commands and configuration files you can use to work with a SAN from the c

84 Appendix B Using the Command Line If you get the response “No manual entry for...” when you try to view a man page, add the Xsan man pages direc

Appendix B Using the Command Line 85 Viewing or Changing Volume and Storage Pool Settings (cvadmin)You can use the cvadmin tool to perform a variet

86 Appendix B Using the Command Line cvadmin Commandscvadmin command Descriptionactivate [volume|index] Choose the “active” volume that you want to

Appendix B Using the Command Line 87 repquota Generate the following quota report files in /Library/Filesystems/Xsan/data/<vol>:quota_report.

88 Appendix B Using the Command Line Copying Files or Folders (cvcp)You can use the cvcp command to perform high-speed file copies to or from an Xs

Appendix B Using the Command Line 89 Perform a similar copy as above, but only copy files with names that begin “jul”:$ cvcp -vxy -p jul data1 /dat

1 91 Overview of XsanThis chapter gives you an overview of Xsan and storage area networks.Read this chapter for an overview of Xsan and how you c

90 Appendix B Using the Command Line Labeling LUNs (cvlabel)You can use the cvlabel command to initialize LUNs so they can be added to storage pool

Appendix B Using the Command Line 91 Creating a Folder With an Affinity (cvmkdir)You can use the cvmkdir command to create a folder with an affinit

92 Appendix B Using the Command Line Initializing a Volume (cvmkfs)You can use the cvmkfs command to initialize an Xsan volume based on the informa

Appendix B Using the Command Line 93 Starting a Volume Controller (fsm)You can use the fsm command to start a file system manager process on a cont

94 Appendix B Using the Command Line ExamplesCount the extents in file datafile:$ snfsdefrag -c datafileList the extents:$ snfsdefrag -e datafileDe

Appendix B Using the Command Line 95 Mounting an Xsan VolumeYou can use the mount command to mount an Xsan volume on a computer.1 Either go to the

96 Appendix B Using the Command Line The Configuration FilesXsan stores its configuration information in the following files:The Volume Configurati

Appendix B Using the Command Line 97 ## The maximum number in file system blocks a file should expand by.#InodeExpandMax 2048 # 8M per ex

98 Appendix B Using the Command Line ## Maximum log file size#MaxLogSize 1M## Client Pool Threads. Number of threads in the message ha

Appendix B Using the Command Line 99 [Disk CvfsDisk5]Status UPType ST19171FC[Disk CvfsDisk6]Status UPType ST19171FC[Disk CvfsDisk7]Status UPType ST