Dell DX6000 Deployment Manual

[Page 1] Dell DX6000

DE L Fil e A Del l L L D X e Ga t l Technic a Dell │ S t Storage E X Obj e t ewa y a l White P a t orage E ngineering e ct S y De p a per tora g p loy m g ...

[Page 2] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page ii THIS DOCUMENT IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS ...

[Page 3] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 1 Contents Scope of this Document and Requirements ......................................................................... 4  Conventions Used in This Document .................

[Page 4] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 2 Install and Configure Red Hat Enterprise Linux ................................................................ 17  Create the Master Boot Record (MBR) on the Second Drive ........

[Page 5] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 3 Shut Down CFS and CNS ............................................................................................ 62  Special Considerations for MD3200i Spooler ..................

[Page 6] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 4 Scope of this Document and Requirements This document provides instruction for deploying either a CIFS or NFS gateway solution on the Dell DX Object Storage platform. Successful ...

[Page 7] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 5 Deployment Checklist Complete the steps below for the type of CFS solution you are deploying. Single-Server, Standalone Authentication, Local Spooler (DX Cluster + 1 CFS, not a...

[Page 8] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 6 Failover, Standalone Authentication, External Spooler (DX Cluster + 2 CFS Systems + MD3200i, not a member of Active Directory)  Complete the Site Survey  Technical revie...

[Page 9] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 7 Architecture The DX Object Storage Gateway Solution is offered in two different types of configurations — single- server and failover. Standard hardware The following briefly ...

[Page 10] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 8 o PSU: 500Watt Redundant power supplies o Embedded Management: iDRAC6 Enterprise o Network Adapter: Broadcom NetXtreme II 5709 Gigabit NIC w/TOE & iSOE, Quad Port, Cop...

[Page 11] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 9 o Network Adapter: Broadcom NetXtreme II 5709 Gigabit NIC w/TOE & iSOE, Quad Port, Copper, PCIe-4 o DVD-ROM Drive o Operating System: RHEL 6 X64 Basic with 3 Year Subsc...

[Page 12] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 10 Gateway Protocols The CFS can be configured for NFS or SMB/CIFS gateways. For SMB/CIFS, users and groups can access the system through standalone authentication, or if Active Di...

[Page 13] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 11 How it all works together The data flow in a DX Object Storage File Gateway depends on the type of configuration. The following examples show, a standard DX Object Storage clust...

[Page 14] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 12 DX Object Storage File Gateway (single-server) In a DX Object Storage File Gateway, data objects are written to a CFS server before being written to a Storage Node. In this conf...

[Page 15] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 13 DX Object Storage File Gateway (Failover) A failover configuration (see Figure 3) provides two CFS servers and a separate dedicated spool/cache. This configuration provides cont...

[Page 16] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 14 Set up the DX Object Storage Cluster This section includes the steps for setting up and activating the DX Object Storage Cluster. BEFORE YOU BEGIN: Did you complete the Site Su...

[Page 17] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 15 9. Complete the following network information as prompted. (see the Site Survey)  External IP address for the CSN.  External IP address for the cluster.  Subnet ma...

[Page 18] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 16 Set up the CFS Server BEFORE YOU BEGIN: Did you Set up the DX Object Storage Cluste r ? NOTE: Make sure there is a DNS entry for the CIFS/NFS interface of the server. In th...

[Page 19] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 17 Create RAID1 Volumes BEFORE YOU BEGIN: Did you Validate BIOS settings Before installing the operating system, you need to create two RAID1 arrays. One array will ...

[Page 20] Dell DX6000

Dell DX O 8. Enter serve NOT E 9. Click 10. On th 11. Enter set t o 12. Click 13. Enter bject Storag e a fully-quali f r.domain.tld ) E : This hostn a Configure N e e Wired tab a Connecti o o au...

[Page 21] Dell DX6000

Dell DX O 14. Provi d 15. Click 16. In th e Next . 17. On th 18. On th Spac e bject Storag e d e informati o Apply, click e time zone s c . e password s e installatio n e , and click N e – File Gate w o n...

[Page 22] Dell DX6000

Dell DX O 19. In th e Devi c 20. In th e again bject Storag e e storage dev i c es list, and c e Please Sele when asked e – File Gate w i ces screen, s c lick the arro w ct a Device s to confir...

[Page 23] Dell DX6000

Dell DX O 21. Click 22. Click 23. Whe n bject Storag e Next to initi a Write chang e the boot lo a e – File Gate w a te formatti n e s to disk w h a der operatin w ay Deploym e n g the hard d r h en p...

[Page 24] Dell DX6000

Dell DX O 24. Selec t 25. Click 26. After 27. Whe n Upda t 28. In th e 29. On th and c bject Storag e t Desktop as Next to star t the installat i the Welco m t e screens. e Create Use r e Date and T...

[Page 25] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 23 30. On the Kdump screen uncheck the box. 31. Add the master boot record to the second boot drive. Create the Master Boot Record (MBR) on the Second Drive By creating a master b...

[Page 26] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 24 # grub> setup (h d 0) Checking if "/boot/grub/stage1" exists... no Checking if "/grub/stage1" exists... yes Checking if "/grub/stage2" exis...

[Page 27] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 25 NEXT STEP: Create the YUM Repository and Install Packages Create the YUM Repository and Install Packages BEFORE YOU BEGIN: Did you Disable SELinux? The CFS...

[Page 28] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 26 name=Red Hat Enterprise Linux 6.0 mediaid=1285193176.460470 metadata_expire=-1 gpgcheck=0 cost=500 baseurl=file:/root/RHEL6 enabled=1 8. Ensure that avahi-daemon is run...

[Page 29] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 27 The CFS system is now ready to be updated with all the dependencies required to complete the installation. NEXT STEP: Stop and Disable Services ...

[Page 30] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 28 Stop and Disable Services BEFORE YOU BEGIN: Did you Disable SELinux? 1. Create a list of file services. # vi list 2. Add the following services to the file. ns...

[Page 31] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 29 # service ntp d stop 3. Edit the /etc/ntpd.conf file. # vi /etc/ntp d .conf 4. Edit the file to configure the time server to your site time server as identified in t...

[Page 32] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 30 Dell supports two different types of bonding: balance-alb (adaptive load balancing) and link aggregation control (LACP, also known as 802.3ad). Balance-alb is configured as m...

[Page 33] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 31 ONBOOT=yes HWADDR=00:26:B9:3D:55:19 (validate this against /etc/udev/rules.d/70-persistent-net.rules) NAME="System ethn" (where n is the number of the Ethernet port) ...

[Page 34] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 32 1. Enter the following information in the resolv.conf file: search xyz.project.local (see Site Surve y ) nameserver xx.xx.x.x (see Site Survey) domainname xyz.project...

[Page 35] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 33 NOTE: Services should show as not running for all of the above. If they are running, they must be disabled. NOTE: If any of these commands fail (other than saying that the se...

[Page 36] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 34 Example, customer was running a batch job that needed to quickly scan all files in a share for viruses, would quickly flood the cache and evict files from another application run...

[Page 37] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 35 /dev / Drive _ ID1 /var/spool/cf s / s h are _ nam e e xt4 rw,acl,user _ xattr,nodelalloc 1 20 0 7. Mount the file system. # mount –a 8. Validat...

[Page 38] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 36 1. Cable the MD3200i as follows: a. Connect the management ports on each controller to the public network. b. Connect the data ports (4 on each controller) to the storage...

[Page 39] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 37 f. If VLAN, click Advanced IPv4 Settings and enter VLAN information. g. Click OK. h. Check Manage iSCSI Settings and Target Authentication set to None. 8. From a root log...

[Page 40] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 38 16. Run the following command to log the server into the storage, and create disks in /dev and mapper entries for the multipath disk-mapper volumes. # iscsiadm -m node –l...

[Page 41] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 39 22. After all LUNs are added to /etc/fstab, mount the new file systems. # m ount –a 23. Use ‘df’ to verify that all are mounted. WARNING: Do NOT mount the dr...

[Page 42] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 40 # service iscsi stop # chkconfig iscsi --level 2345 on && chkconfig iscsi - -list # chkconfig iscsid --level 2345 on && chkconfig iscsid --list # servic...

[Page 43] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 41 IMPORTANT: Of the MD3200i configuration steps, only the one adding a host to the host group need to be repeated. Do NOT repeat the fdisk and mkfs steps. NEXT STEP: Configure t...

[Page 44] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 42 both files will be configured to keep up to 8 log files, rotating weekly or at a max file size of 512 MB. Syslog facility – If the syslog option was selected, enter the facili...

[Page 45] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 43 If you select Yes, complete the following: Cluster name – name of the Dell DX Object Storage cluster. This must match the value of the Dell DX Object Storage "cluster&quo...

[Page 46] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 44 Configure the CFS and its DX Object Storage Mount Points BEFORE YOU BEGIN: Did you Configure the Cluster Name Space (CNS)? After installing the CFS server and creating t...

[Page 47] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 45 directory. With file logging, default log rotation will be configured to keep up to 8 log files, rotating weekly or at a max file size of 512 MB. Syslog facility – If the sysl...

[Page 48] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 46 3. If the Spooler/cache and mount directories do not already exist, you will be asked if you would like them to be created. The recommended response is Yes, as CFS cannot st...

[Page 49] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 47 NOTE: A customer’s gateway can be configured only as standalone (local authentication) server OR as an Active Directory Domain member server. It cannot be configured as both; i...

[Page 50] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 48 NOTE: If the site uses a WINS server, add the following to the above: w ins server = 123.45.67.89 (where 123.45.67.89 should be replaced with the IP address of the...

[Page 51] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 49 NOTE: This account will be removed or disabled after the administrator account has been established. ii. Create a Linux account as follows: # useradd -m - g 4 a d m...

[Page 52] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 50 vii. Delete the root account from the CIFS password back end by running the following command: # pdbedit -u root – x 5. Add a local UNIX group, which is required ...

[Page 53] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 51 NEXT STEP: Configure Share Resources Active Directory Domain Member Server NOTE: A customer’s gateway can be configured only as standalone (local authentication) s...

[Page 54] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 52 # vi /etc/krb5.conf 2. Edit the file as shown with your domain name information. [libdefaults] default_realm = XYZ.PROJECT.LOCAL [realms] XYZ.PROJECT.LOCAL = { kdc ...

[Page 55] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 53 server string = DX Storage security = ADS log level = 1 log file = /var/log/samba/log.%L.%m max log size = 0 smb ports = 445 ...

[Page 56] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 54 XYZ+jackb 8. Run the following command to obtain the list of Active Directory domain group accounts: # wbinfo –g XYZ+domain computers XYZ+domain controllers XYZ+schema...

[Page 57] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 55 11. Obtain a list of groups: # getent group root:x:0: daemon:x:1: bin:x:2: sys:x:3: ... XYZ+domain computers:x:5000006: XYZ+domain controllers:x:5000007: XYZ+schema a...

[Page 58] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 56 [realms] XYZ.PROJECT.LOCAL = { kdc = 192.168.1.22 kdc = w2k8r2.xyz.project.local } The CFS server is now ready for configu...

[Page 59] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 57 Administrators can configure the shared resources manually outside of the Dell-supported resources, but it is without Dell support. IMPORTANT: CFS mounts created by cfs-admin ca...

[Page 60] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 58 In the example above, there is a CFS mounted file system resource under the mount point /mnt/share_name. The contents of this directory will be owned by the user gillian and the ...

[Page 61] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 59 m) Click Shares to see the shares that are available. n) Double-click the share on which access controls must be set. o) In the Properties dialog, click the Share Permissions...

[Page 62] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 60 3. Set file system ownership and group ownership for the user and group that will have write access to the shared resource. In the following example there is a CFS mounted fi...

[Page 63] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 61 Add an NFSv3 Share Point 1. Add the nfs mount specification - edit the /etc/exports file: The following is a sample entry, using a mount point with the name "CFS1&quo...

[Page 64] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 62 # /etc/init.d/caringo-CFS start To mount a single mount point that was previously defined using the CFS-admin mkfs script, run a command similar to the following (where /mnt/C...

[Page 65] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 63 Special Considerations for MD3200i Spooler When a CFS node using MD3200i external spooler storage is being shut down, the following procedure must be used to avoid a possible ha...

[Page 66] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 64 replicas and leave all other departments utilizing a mount point with a lifepoint policy for fewer replicas. As a baseline for file metadata, CFS will automatically add the fo...

[Page 67] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 65 previous values. By default, metadata is cached for 60 seconds so attachment of new or updated metadata to new files written to the mount point will be delayed until the cache is...

[Page 68] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 66 • --lifepoint=#: The number of the lifepoint to affect with a particular action. This number does not indicate the order in which a lifepoint will be considered but simply a na...

[Page 69] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 67 The tool will generate a gzipped tar file with the current date timestamp (example: grab- 1272553621.tgz) with a collection of relevant data that can be attached to a support tick...

[Page 70] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 68 If the available space on the partition where the spool/cache directories reside gets too low, cached files with the oldest access dates will be flushed until adequate space has ...

[Page 71] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 69 The current default value of the max protocol parameter is NT1 (the latest CIFS support level). Samba version 3.5.0 (and above) also supports the new Microsoft Windows Vista (and...

[Page 72] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 70 APPENDIX D. CFS Failover For a failover configuration, two identical CFS servers are required, as well as external storage for the CNS cache and spooler directories (as configur...

[Page 73] Dell DX6000

Dell DX Object Storage – File Gateway Deployment Guide Page 71 Also, when the issues that caused the primary server to be taken out of service are resolved, the backup server must be shut down first before the primary is restarted. 2. Mou...