![Lenovo DM StudentGuide [PDF]](https://pdfs.asia/img/200x200/lenovo-dm-studentguide.jpg)
7 0 8 MB
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Lenovo DM-series Storage Technical Workshop
ERC 1.3
Lenovo Accredited Learning Provider
1
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Course Agenda - DM Series Storage - Theory • Lenovo DM Series Storage • ONTAP Cluster, Management, Configuration • ONTAP Networking • ONTAP Architecture • Data Access NAS / SAN • Snapshots • Storage Efficiency – Deduplication, Compression, Compaction • Disaster Recovery & Continuous Availability – SnapMirror, SnapVault, MetroCluster • Additional ONTAP features – SnapLock, Quality of Service, FabricPool • Cluster Maintenance
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
2
2
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Course Agenda – DM Series Storage - Practice – Exercise 0: Create ONTAP Cluster – Exercise 1: Checking the Lab environment – Exercise 2: Exploring ONTAP Management interfaces – CLI & GUI – Exercise 3: Managing Physical and Logical Network Resources – Exercise 4: Create Storage Virtual Machine – Exercise 5: SAN configuration - FC – Exercise 6: SAN configuration - iSCSI – Exercise 7: NAS configuration - NFS – Exercise 8: NAS configuration - CIFS – Exercise 9: Managing Snapshot Copies – Exercise 10: Managing Storage Efficiency – Exercise 11: Managing FlexClone Volumes Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
3
3
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Lenovo DM Series Storage
Lenovo Accredited Learning Provider
4
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DM Series Unified Offering Overview UNIFIED
All Flash Maximum performance
A400
Latency sensitive apps
A300
DM7100H/F (NVMe)
Mission critical workload FAS8200
DM7000F
Hybrid
A220
Cost effective Mixed workloads Secondary sites
DM7000H FAS2750
DM5000F
DM5000H FAS2720
DM3000H Blue = NetApp Model
Lenovo Accredited Learning Provider
PERFORMANCE
5
DM Series models are DM3000H, DM5000H, DM5000F, DM7000H, DM7000F, DM7100H and DM7100F.
Lenovo Accredited Learning Provider
5
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Introduction to DM3000H and DM5000H/F • • •
2U 12 x 3,5“ HDDs (DM3000H), 2U 24 x 2,5“ HDDs (DM5000H/F) CPU cores: 24 Memory: 64GB – 8GB is used as NVMEM
Onboard NVMe M.2 Flash Cache™ (Hybrid models) Onboard I/O ports (per controller) 2x 10GbE: Cluster interconnect 4x UTA2 (16Gb FC or 10GbE): Host connectivity Also configurable as 1GbE
or 4x 10GBASE-T: Host connectivity (Hybrid) Will auto-negotiate to 1GbE
2x 12Gb mini-HD SAS: External storage attachment • DM120S and DM240S
Persistent write log NVlog written to flash if unplanned power loss occur
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
6
6
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ThinkSystem DM3000H/5000H/F Front View
2U ThinkSystem DM7000H/F Front View
3U
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
7
7
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Introducing the DM7000H/F • • •
3U – No HDD CPU cores: 32 Memory: 256GB – 16GB used for NVMEM
•
•
Onboard 2TB NVMe M.2 Flash Cache™ (Hybrid models) per controller Onboard I/O ports (per controller) – 2x 10GbE: Cluster Interconnect – 4x UTA2 (16Gb FC or 10GbE): Host connectivity • Can also be configured to also support 1GbE
– 4x mini-SAS HD: External storage attachment • DM240S Shelf supported
– 2x 10GBase-T: Host connectivity – 2x PCIe slots
•
Persistent write log – NVlog written to flash if unplanned power loss occurs
Lenovo Accredited Learning Provider
8
DM7000H Lenovo ThinkSystem DM7000H is a scalable, unified, hybrid storage system that is designed to provide high performance, simplicity, capacity, security, and high availability for large enterprises. Powered by the ONTAP software, ThinkSystem DM7000H delivers enterprise-class storage management capabilities with a wide choice of host connectivity options, flexible drive configurations, and enhanced data management features. The ThinkSystem DM7000H is a perfect fit for a wide range of enterprise workloads, including big data and analytics, artificial intelligence, engineering and design, hybrid clouds, and other storage I/O-intensive applications. ThinkSystem DM7000H models are 3U rack-mount controller enclosures that include two controllers, and 256 GB RAM and 16 GB battery-backed NVRAM (128 GB RAM and 8 GB NVRAM per controller). Universal 1/10 GbE NAS/iSCSI or 4/8/16 Gb Fibre Channel (FC) ports and 1/10 GbE RJ-45 ports provide base host connectivity, with an option for additional 1/10 GbE, 25 GbE, or 40 GbE NAS/iSCSI, or 8/16/32 Gb FC connections with the adapter cards. A single ThinkSystem DM7000H Storage Array scales up to 480 drives with the attachment of Lenovo ThinkSystem DM240S 2U24 SFF, DM120S 2U12, and DM600S 4U60 LFF Expansion Enclosures. It also offers flexible drive configurations with the choice of 2.5-inch (SFF) and 3.5-inch (LFF) form factors, 10 K rpm SAS and 7.2 K rpm NL SAS hard disk drives (HDDs), and SAS solid-state drives (SSDs).
Lenovo Accredited Learning Provider
8
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Introducing the DM7100H/F 4U – No HDD CPU cores: 40 Memory: 256GB + 32GB used for NVMEM
Onboard 4TB NVMe M.2 Flash Cache™ (Hybrid models) per controller Onboard I/O ports (per controller) • 2x QSFP28 (100GbE RoCE): NVMe storage attachment • 2x SFP28 (25GbE RoCE): HA • 4x mini-SAS HD: External storage attachment • Host access • Ethernet configuration:4x SFP28 (25/100GbE ) • Unified configuration: 4x SFP+ (16/32Gb FC)
• 5x PCIe slots
• Expansion: • Supports 480 SSDs • DM240N, max 2 enclosures (48 NVMe drives) • DM240S Lenovo Accredited Learning Provider
9
DM7100H Lenovo ThinkSystem DM7100H is a scalable, unified, hybrid storage system that is designed to provide high performance, simplicity, capacity, security, and high availability for large enterprises. Powered by the ONTAP software, ThinkSystem DM7100H delivers enterprise-class storage management capabilities with a wide choice of host connectivity options, flexible drive configurations, and enhanced data management features. The ThinkSystem DM7100H is a perfect fit for a wide range of enterprise workloads, including big data and analytics, artificial intelligence, engineering and design, hybrid clouds, and other storage I/O-intensive applications. A single ThinkSystem DM7100H Storage Array consists of the 4U rack-mount controller enclosure and one or more expansion enclosures. The controller enclosure includes two controllers, 256 GB RAM (128 GB RAM per controller), and 32 GB battery-backed NVRAM (16 GB NVRAM per controller). 25 GbE SFP28 NAS/iSCSI or 4/8/16 Gb Fibre Channel (FC) ports on the controller's mezzanine cards provide base host connectivity, with adapter card options for additional 1/10 GbE, 25 GbE, or 40/100 GbE NAS/iSCSI, or 8/16/32 Gb FC connections. The attachment of the Lenovo ThinkSystem DM240S 2U24 SFF, DM120S 2U12 LFF, and DM600S 4U60 LFF Expansion Enclosures to the controller enclosure provides scalability up to 720 drives and flexible drive configurations with the choice of 2.5-inch (SFF) and 3.5-inch (LFF) form factors, 10K rpm SAS and 7.2K rpm NL SAS hard disk drives (HDDs), and SAS solid-state drives (SSDs). 9 Lenovo Accredited Learning Provider
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ThinkSystem DM3000H/5000H/F 2 x 12Gb SAS ports
2 x 10GbE ports for cluster interconnect or data networking
Status LEDs for controller and non-volatile memory status
Serial Console Ports for configuration and management
Four Unified Target Adapter 2 ports per controller operate as 8Gb/16Gb FC or GbE/10GbE Private Management port for remote management
Dual, hot-plug power supplies are 80 Plus Platinum rated and provide enclosure and temperature monitoring. Lenovo Accredited Learning Provider
10
1st initial setup is done trough RS-232
Lenovo Accredited Learning Provider
10
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
I/O Per Controller Unified Configuration SAS
Management
Micro USB
10GbE
Console
UTA2
Ethernet Configuration
Lenovo Accredited Learning Provider
USB
Management SAS
Micro USB
10GbE
10GBASE-T (RJ45)
Console
USB
11
0a 0b – SAS ports 1 and 2 e0a e0b – on board 10Gb ethernet for CLUSTER E0c e0d e0e e0f – Module 4 x Ethernet 10Gb E0c/0c … – Module : Ethernet SFP+ 10Gb / 8Gb/16Gb FC 0(a,b,c…) – onboard 1(a,b,c…) PCI card
Lenovo Accredited Learning Provider
11
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ThinkSystem DM7000H / F 4 x 12Gb SAS ports per controller for disk shelf connectivity.
2 x 10GbE ports per controller for use as cluster interconnect or data network ports.
4 x Unified Target Adapter 2 ports per controller operate as 8Gb/16Gb FC, GbE/10GbE, or FCVI ports, or cluster interconnect ports.
10G Base-T ports per controller for highspeed host (NFS, SMB, iSCSI) connectivity or cluster interconnect ports.
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
Serial Console Ports For configuration and troubleshooting
Status LEDs for controller and nonvolatile memory status
Redundant Components: Hot-swappable controllers, cooling fans, power supplies and optics.
40GbE and 32Gb FC Two high-performance PCIe Gen 3 slots per controller to accommodate additional I/O connectivity including 40GbE and 32Gb FC. 12
12
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DM7100 Hardware Overview
4U enclosure NVMe FlashCache on Hybrid only Available in two possible configurations
Ethernet: 4x 25Gb Ethernet (SFP28) ports Fiber Channel: 4x 16Gb FC (SFP+) ports
Lenovo Accredited Learning Provider
13
The rear of the ThinkSystem DM7100F 4U controller enclosure includes the following components: Two redundant hot-swap controllers, each with the following ports: Two 25 GbE SFP28 ports for direct-attach HA pair interconnect. Two 40/100 GbE QSFP28 onboard ports for connections to the NVMe expansion enclosures. Two 40/100 GbE QSFP28 ports on the SmartIO adapter in Slot 3 for direct-attach or switched cluster interconnect. Four 12 Gb SAS x4 ports (Mini-SAS HD SFF-8644) for connections to the SAS expansion enclosures. A mezzanine slot for one of the following mezzanine cards (a mezzanine card is required): Four 25 GbE SFP28 host ports (NAS or iSCSI). Four 4/8/16 Gb FC SFP+ host ports (FC only). Four slots for the following optional adapter cards (ports per adapter card): Host ports: Two 1/10 GbE RJ-45 host ports (NAS or iSCSI). Four 10 GbE SFP+ host ports (NAS or iSCSI). Two 25 GbE SFP28 host ports (NAS or iSCSI). Two 40/100 GbE QSFP28 host ports (NAS or iSCSI). Four 8/16/32 Gb FC SFP+ host ports (FC or NVMe/FC). Expansion ports: Two 100 GbE QSFP28 expansion ports (NVMe/RoCE). Four 12 Gb SAS x4 expansion ports (Mini-SAS HD SFF-8644). MetroCluster ports: Two 4/8/16 Gb FC SFP+ MetroCluster FC ports (planned for the Lenovo Accredited Learning Provider
13
Lenovo DM Storage – Technical Workshop – Student Lesson Guide future). One RJ-45 10/100/1000 Mb Ethernet port for out-of-band management. Two serial console ports (RJ-45 and Micro-USB) for another means to configure the system. One USB Type A port (read-only) for software updates. Four redundant hot-swap 1600 W (100 - 240 V) AC power supplies (IEC 320-C14 power connector) with integrated cooling fans. Controller status LEDs.
Lenovo Accredited Learning Provider
13
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DM Series Enclosures Form factor Max # Drives
Size
DM3000H
DM5000H / F
DM7000H / F
DM7100H / F
2U12
2U24
3U0
4U0
144
144
480
720
DM120S
DM240S
DM600S
DM240N
2U
2U
4U
2U
IO Connectivity
12Gb SAS
100Gb Eth
Max Drives
12
24
60
24
Drive Form Factor
3.5”
2.5”
3.5”
2.5“
4TB 7K HDD 8TB 7K HDD 10TB 7K HDD
960GB SSD 3.84TB SSD 7.68TB SSD 15.36TB SSD 900GB 10K HDD 1.2TB 10K HDD 1.8TB 10K HDD
4TB 7K HDD 8TB 7K HDD 10TB 7K HDD
960GB NVMe SSD 3.84TB NVMe SSD 7.68TB NVMe SSD 15.36TB NVMe SSD
Drives Supported
2016 Lenovo Internal. 2019 Lenovo. All rightsAll reserved. rights reserved.
14
DM3000 System comes in a 2U12 form factor supporting 12 3.5“ drives internally. Maximum configuration is up to 144 drives. DM5000 System comes in a 2U24 form factor supporting 24 2.5“ drives internally. Maximum configuration is up to 144 drives. DM7000 System comes in a 3U0 form factor without support for any internal drives. Maximum configuration is up to 480 drives in Hybrid and up to 384 drives in All Flash. DM7100 System comes in a 4U0 form factor without support for any internal drives. Maximum configuration is up to 720 drives in Hybrid and up to 480 SSD drives or 432 SSD + 48 NVMe drives in All Flash.
14 Lenovo Accredited Learning Provider
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DM Storage Expensions - Overview
Lenovo Accredited Learning Provider
15
The rear of the ThinkSystem DM600S 4U LFF expansion enclosure includes the following components: Two redundant hot-swap I/O Modules; each I/O Module provides four 12 Gb SAS x4 expansion ports (Mini-SAS HD SFF-8644) for connections to the controller enclosures and for connecting the expansion enclosures between each other. Two redundant hot-swap 2325 W (200 - 240 V) AC power supplies (IEC 320-C20 power connector) Two hot-swap cooling fan modules; each module has two fans. Note: The failed cooling module should be replaced as soon as possible. I/O Module status LEDs.
Lenovo Accredited Learning Provider
15
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DM240N Overview
4x 100GbE ports A maximum of two DM240N shelves is supported per array 24 NVMe SSD drive bays Each shelf orderable with 12, 18, or 24 NVMe SSDs Standard NVMe SSDs are self-encrypting drives (SED)
More information on NVMe SED SSDs on the following slide 1.9TB and 3.8TB NVMe non-SED SSD available for restricted countries
NSM* NSM* * NVMe Shelf Module PSUs
LEDs
100GbE ports
Lenovo Accredited Learning Provider
16
The front of the ThinkSystem DM240N 2U SFF NVMe expansion enclosure includes the following components: - 24 SFF hot-swap drive bays. - Enclosure status LEDs. - Enclosure ID LED. The rear of the ThinkSystem DM240N 2U SFF NVMe expansion enclosure includes the following components: - Two redundant hot-swap NVMe I/O Modules; each NVMe I/O Module provides two 100 GbE QSFP28 expansion ports for connections to the controller enclosures. - Two redundant hot-swap 1600 W (100 - 240 V) AC power supplies (IEC 320-C14 power connector) with integrated cooling fans. - NVMe I/O Module status LEDs.
16 Lenovo Accredited Learning Provider
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Cluster Interconnects Default cluster interconnects are 10GbE ports e0a & e0b
Two Node Switchless Cluster (TNSC) configurations 10GbE ports (e0a & e0b) for interconnect cluster connectivity DM3000H and DM5000H/F have physically dedicated ports
Switch for most cluster deployments > 2 nodes – max 16 nodes
10GbE Cluster Interconnect ports
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
17
17
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DM Series Cabling 2-node DM Cluster cabling 10 GbE SFP+ - DAC cable 4 or more node DM Cluster cabling Ethernet switch required If no external storage – expansions best practice is to connect SAS ports between controllers
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
18
18
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DM Series Expansion Cabling
Lenovo Accredited Learning Provider
19
This cabling is called “top-down & bottom up” It provides FT/HA because of two chains – blue and yellow
Lenovo Accredited Learning Provider
19
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Host - Unified Target Adapter 2 (UTA2) Ports Four onboard UTA2 ports on DM3000H/5000H Series systems in Unified configuration Field configurable as FC or CNA (CNA is for Ethernet) Supports 16Gbps, 8Gbps, and 4Gbps speeds with 16Gbps FC SFP+ 10GbE and 1GbE are fixed speed and do not auto-range Supports FC, iSCSI and NAS protocols
UTA2 ASICs are dual-port and both ports share the same personality: FC or Ethernet (CNA) Two steps needed to set port personality in the field Choose either FC or CNA personality per ASIC ONTAP 9 set port command: system node hardware unified-connect modify
Install appropriate SFP+ or Twinax cable when using CNA personality
When set to FC mode, both ports on ASIC can be set to either target or initiator A controller reboot is required to change Fiber Channel port type
When set to CNA mode, 1GbE and 10GbE SFPs can be used together on same ASIC Lenovo Accredited Learning Provider
20
CNA – Converged network adapter
Lenovo Accredited Learning Provider
20
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
LSST - Lenovo Storage Sizing Tool
Lenovo Accredited Learning Provider
21
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Lenovo Storage Sizing Tool - LSST LSST – Lenovo Storage Sizing Tool Landing page:
https://storagesizingtool.lenovo.com Login via LENOVO Business Partner Portal There are several links: - Lenovo Storage Sizing Tool (LSST) - for DM Storage - Lenovo Storage Sizing Tool (LSST) - for DE Storage For DM storage, there are two possibilities: - Size and Recommend - Design a system manually Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
22
22
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Lenovo Storage Sizing Tool - LSST
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
23
23
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Lenovo Storage Sizing Tool - LSST
Separate course available Next: 17.06.2020 10:00 -13:00 CET Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
24
24
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Cluster
Lenovo Accredited Learning Provider
25
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Unified Storage and Multiprotocol Support
All Flash DM
Hybrid DM
Supported protocols: FC, iSCSI, CIFS and SMB, FCoE, and NFS and parallel NFS (pNFS)
Unified Management SAN and NAS workloads
Built-in storage efficiency
Nondisruptive operations
Scale-out and scaleup expansion
Advanced application integration
Secure, multitenant management with QoS
Integrated data protection
Lenovo Accredited Learning Provider
26
The ONTAP multiprotocol unified architecture supports multiple data access protocols concurrently on the same storage system over a range of controller and disk types. Supported protocols include FC, iSCSI, FCoE, SMB (Samba protocol) = CIFS (Common Internet File System), and NFS (network File System), including parallel NFS (pNFS). Data replication and storage efficiency features are supported across all protocols in ONTAP software.
Lenovo Accredited Learning Provider
26
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
HA Pairs High-availability (HA) pairs provide hardware redundancy that supports the following features: • Nondisruptive operations (NDO) and nondisruptive upgrade (NDU) • Fault tolerance • Takeover and giveback of partner storage • Elimination of most hardware components and cables as single points of failure • Improved data availability
Lenovo Accredited Learning Provider
27
HA pairs provide hardware redundancy that is required for nondisruptive operations (NDO) and fault tolerance. The hardware redundancy gives each node in the pair the software functionality to take over and return partner storage. The features also provide the fault tolerance required to perform NDO during hardware and software upgrades or maintenance. A storage system has various single points of failure, such as certain cables or hardware components. An HA pair greatly reduces the number of single points of failure. If a failure occurs, the partner can take over and continue serving data until the failure is fixed. The controller failover function provides continuous data availability and preserves data integrity for client applications and users. Nodes can be mixed! For example DM5000AF and DM7000H, also disks can be shared, but NOT between LENOVO and NetApp
Lenovo Accredited Learning Provider
27
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Network Cluster Interconnect
• Cluster interconnect: – Connection of nodes – Private network
• Management network: – Cluster administration – Ethernet network that can be shared with data
• Data network: Management Network Data Network
– One or more networks for data access from clients or hosts – Ethernet, FC, or converged network
Lenovo Accredited Learning Provider
28
Clusters require one or more networks, depending on the environment. In multinode clusters, nodes need to communicate with each other over a cluster interconnect. In a two-node cluster, the interconnect can be switchless. Clusters with more than two nodes require a private cluster interconnect that uses switches. The management network is for cluster administration. Redundant connections to the management ports on each node and management ports on each cluster switch should be provided to the management network. In smaller environments, the management and data networks might be on a shared Ethernet network. For clients and hosts to access data, a data network is also required. The data network includes one or more networks that are primarily used for data access by clients or hosts. Depending on the environment, there might be an Ethernet, FC, or converged network. Data networks can consist of one or more switches or even redundant networks. - e0m… – MANAGEMENT ports
Lenovo Accredited Learning Provider
28
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Two-Node switchless Cluster
In a two-node switchless cluster, ports are connected between nodes. Lenovo Accredited Learning Provider
29
In a two-node cluster, the cluster interconnect can be switchless. The slide shows a DM system that has two controllers installed in the chassis. Each controller has a set of onboard Gigabit Ethernet ports that can be used to connect to the cluster interconnect. The slide shows a two-node switchless cluster with a redundant pair of the ports cabled using 10GbE ports.
Lenovo Accredited Learning Provider
29
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Switched Clusters Cluster Interconnect Cluster Switch
Inter-Switch Links (ISLs) Cluster Switch
More networking details are discussed in the Network Management module.
Lenovo Accredited Learning Provider
30
If your workload requires more than two nodes, the cluster interconnect requires switches. The cluster interconnect requires two dedicated switches for redundancy and load balancing. Inter-Switch Links (ISLs) are required between the two switches. From each node, there should always be at least two cluster connections, one to each switch. The required connections vary, depending on the controller model. After the cluster interconnect is established, you can add more nodes, as your workload requires. For more information about the maximum number and models of controllers supported, see the ONTAP Storage Platform Mixing Rules in the ONTAP Library. For more information about the cluster interconnect and connections, see the ONTAP Network Management Guide. Use dedicated switches – LENOV switches for example
Lenovo Accredited Learning Provider
30
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Hardware Setup Connect the following hardware: • HA interconnect - internal – – – –
• • • • •
Failover Disk firmware Heartbeat Version information
Controllers to disk shelves – SAS Define disk shelves IDs Controllers to cluster interconnect – 10GbEth Controllers to networks – UTP, optical Controllers and disk shelves to power
Data Network Lenovo Accredited Learning Provider
31
Connect controllers to disk shelves. Verify that shelf IDs are set properly. You have to connect NVRAM HA cable between partners. The connections can be through the chassis, 10-GbE, or InfiniBand, depending on your storage controllers. Connect controllers to networks. Connect any tape devices that you might have. (You can connect tape devices later.) Connect controllers and disk shelves to power.
Lenovo Accredited Learning Provider
31
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Basic Steps to Set Up a Cluster 1. 2. 3. 4. 5. 6. 7.
Connect controllers, disks, and cables. Set up Shelves IDs (if you have external shelves) Set up and configure nodes – serial cable Set up cluster. Create data aggregates. Create a data storage virtual machine (SVM). Create data volumes and configure protocols
Lenovo Accredited Learning Provider
32
To set up a cluster, you must first connect the controller, disks, and cables. Power on the networking first, then disk shelves, and finally the controllers. If the system is new and does not require a software upgrade (or downgrade), simply start the setup process. If the system requires an upgrade or downgrade, install the software first. After the software installation is complete, initialize the disks. Initialization takes some time. When the system boots completely, run a setup procedure to set up and configure the system or cluster. After the configuration is complete, you can create storage resources. Step 5. – DATA aggregates – This is storage pool of hdd/SSDs/NVMe disks, configured within an ARRAY, protected with RAID parity/multiparity
Lenovo Accredited Learning Provider
32
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Creating a Cluster • Cluster creation methods: – Cluster setup wizard, using the CLI (boud rate 115000) – Guided Cluster Setup, using ThinkSystem System Manager
• CLI cluster setup wizard: 1. 2. 3.
Create the cluster on the first node. Join the remaining nodes to the cluster. Configure the cluster time and AutoSupport.
• Guided Cluster Setup: 1. 2.
Use the CLI to configure the node management interface. Use a web browser to connect to the node management IP address.
Lenovo Accredited Learning Provider
33
After installing the hardware, you can set up the cluster by using the cluster setup wizard (through the CLI). Before setting up a cluster, you should use a cluster setup worksheet and record the values that you need during the setup process. Worksheets are available on the ONTAP Support website. If you use the System Setup software, enter the information that you collected on the worksheet as the software prompts you. Whichever method you select, you begin by using the CLI to enter the cluster setup wizard from a single node in the cluster. The cluster setup wizard prompts you to configure the node management interface. Next, the cluster setup wizard asks whether you want to complete the setup wizard by using the CLI. If you press Enter, the wizard continues to use the CLI to guide you through the configuration. When you are prompted, enter the information that you collected on the worksheet. After creating the cluster, you use the node setup wizard to join nodes to the cluster one at a time. The node setup wizard helps you to configure each node's node-management interface. After using the CLI to add all nodes, you also need to manually configure a few items. Synchronizing the time ensures that every node in the cluster has the same time and prevents CIFS and Kerberos failures. You need to decide where to send event notifications: to an email address, a syslog server, or an SNMP traphost. ONTAP also recommends that you configure the AutoSupport support tool. If you choose to use Guided Cluster Setup instead of the CLI, use a web browser to connect to the node management IP that you configured on the first node. When you are prompted, enter the information that you collected on the worksheet. The Guided Cluster Setup discovers all of the nodes in the cluster, and then configures the nodes simultaneously. Lenovo Accredited Learning Provider
33
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Guided Cluster Setup •
Set up the node management interface
•
Boot a node that is part of the cluster. From the node management IP interface for the node, launch the cluster setup wizard. From the following URL, continue the cluster setup:
•
•
– https://
Lenovo Accredited Learning Provider
34
From the cluster setup wizard in ONTAP 9.x software, you can continue using the CLI or resume the cluster setup from a web browser.
Lenovo Accredited Learning Provider
34
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
GUI Cluster Setup
Select to autoconfigure storage
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
35
35
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Cluster Administrators • Manage the entire cluster: – All cluster resources – SVM creation and management – Access control and roles – Resource delegation
• Use login credentials: – Username (default): admin – Password: password that you created during cluster setup
Lenovo Accredited Learning Provider
36
After you use System Setup to create the cluster, a link is provided to launch ThinkSystem Storage Manager. Log in as the cluster administrator to manage the entire cluster. You manage all cluster resources, the creation and management of SVMs, access control and roles, and resource delegation. To log in to the cluster, use the default username “admin” and the password that you configured during cluster creation.
Lenovo Accredited Learning Provider
36
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Managing Resources in a Cluster •
ThinkSystem Storage Manager: – – – –
Visual representation of the available resources Wizard-based resource creation Best practice configurations Limited advanced operations
•
The CLI: – Manual or scripted commands – Manual resource creation that might require many steps – Ability to focus and switch quickly among specific objects
Lenovo Accredited Learning Provider
37
You can use many tools to create and manage cluster resources. Each tool has advantages and disadvantages. ThinkSystem Storage Manager is a web-based UI that provides a visual representation of the available resources. Resource creation is wizard-based and adheres to best practices. However, not all operations are available. Some advanced operations might need to be performed by using commands in the CLI. You can use the CLI to create and configure resources. Enter commands manually or through scripts. Instead of the wizards that System Manager uses, the CLI might require many manual commands to create and configure a resource. Although manual commands give the administrator more control, manual commands are also more prone to mistakes that can cause issues. One advantage of using the CLI is that the administrator can quickly switch focus without needing to move through System Manager pages to find different objects.
Lenovo Accredited Learning Provider
37
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ThinkSystem Storage Manager (9.7)
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
38
38
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Clustershell The default CLI, or shell, in ONTAP is called the clustershell and has the following features: • Inline help • Online manual pages • Command history • Ability to reissue a command • Keyboard shortcuts • Queries and UNIX-style patterns • Wildcards
Lenovo Accredited Learning Provider
39
The cluster has different CLIs or shells for different purposes. This course focuses on the clustershell, which starts automatically when you log in to the cluster. Clustershell features include inline help, an online manual, history and redo commands, and keyboard shortcuts. The clustershell also supports queries and UNIXstyle patterns. Wildcards enable you to match multiple values in command-parameter arguments.
Lenovo Accredited Learning Provider
39
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Hardware Management Interface Service Processor (SP/BMC) available through Ethernet or serial console connections – even without ONTAP installation Shares the same Ethernet interface with e0M
Service Processor is used to generate system cores Non-maskable interrupt (NMI) reset button is not present
Actively manages some hardware Advanced sensor management, FRU tracking, fans Maintains the system event log (SEL) for hardware troubleshooting
Access to the ONTAP console using „system console“ command
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
40
40
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Lenovo ONTAP choices Fulfil wide range of customer needs with two ONTAP offerings
ONTAP Fundamentals
ONTAP Premium
•
Available on DM3000H &DM5000H
•
Available on all DM Series
•
Includes: • Unified Storage • Asynchronous replication • SnapRestore • Scale up to 84 drives
•
Everything in Fundamentals plus: • Synchronous Replication • SnapCenter • MetroCluster • Scale up and out
ONTAP Fundamentals will be a great option for someone who wants a unified storage solution with data efficiency features, snapshots and async-replication. Lenovo Accredited Learning Provider
ONTAP Premium is ideal for customers who require systems with high availability, application aware snapshots and enhanced management capabilities. 41
ONTAP Fundamentals - available on DM3000H and DM5000H only - includes: Unified Storage Asynchronous replication SnapRestore Scale up to 84 nodes ONTAP Premium - available on all DM Series - includes everything like in Fundamentals plus: Synchronous replication SnapCenter MetroCluster Scale up and out
41 Lenovo Accredited Learning Provider
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Licencing • •
DM Storage comes by default with all licences uploaded and enabled in ONTAP In case of deletetion of cluster – wipe configuration – all licences are gone
Licences are available vie the Lenovo LKMS website https://fod2.lenovo.com - After login use „Retrieve history ” option. - In “Search type*” select “Search history via UID” - Then in the “Search value“ enter serial number of each controller You will have to repeat this step for each controller as licences are based per controller
Lenovo Accredited Learning Provider
42
Each controller has it’s own serial number (S/N) and every license is bound to S/N – so a set of licenses for number of the nodes within cluster.
Lenovo Accredited Learning Provider
42
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Storage Virtual Machine - Types Data SVM: • Provides client access to user data • Includes data volumes, LIFs, and protocols and access control • Is for multiple use cases: – Secure multitenancy – Separation of resources and workloads – Delegation of management
Admin SVM: • Represents the cluster • One per cluster • Owns cluster-scoped resources
Node SVM: • Represents an individual node • One per node in the cluster • Owns node-scoped resources
DM3000::> vserver show
Vserver
Type
Subtype
Admin
Operational
State
State
Root Volume
Aggregate
----------- ------- ---------- ---------- -----------
----------
----------
DM3000
admin
-
-
-
-
-
DM3000_1
node
-
-
-
-
-
DM3000_2
node
-
-
-
-
-
svm_Team1
data
default
running
running
svm_Team1_root
data_001
svm_Team2
data
default
running
running
svm_Team2_root
data_001
svm_Team3
data
default
running
running
svm_Team3_root
data_002
6 entries were displayed.
Lenovo Accredited Learning Provider
43
A data SVM contains data volumes and LIFs that serve data to clients. Unless otherwise specified, the term “SVM” refers to a data SVM. In the CLI, SVMs are displayed as “Vservers.” SVMs might have one or more FlexVol volumes or scalable FlexGroup volumes.
Lenovo Accredited Learning Provider
43
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM Benefits • Unified storage (with FlexVol volumes): – NAS protocols: CIFS and NFS – SAN protocols: iSCSI and FC (including FCoE)
• Nondisruptive operations (NDO) and nondisruptive upgrade (NDU): – Resource migration – Resource availability during hardware and software upgrades
• Secure multitenancy: – Partitioning of a storage system – Isolation of data and management – No data flow among SVMs in the cluster
• Delegation of management: – User authentication and administrator authentication – Access assigned by the cluster administrator
• Scalability: – Addition and removal – Modification on demand to meet data-throughput and storage requirements
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
44
44
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Logical Storage • Storage virtual machine (SVM) – Is a container for data volumes, which store client data – Enables access to client data through a LIF
Data LIF
• Volume – Is a logical data container for files or LUNs – Can contain one or more FlexVol volumes on an SVM or one scalable infinite volume on an SVM
SVM with FlexVol Volumes
Client Access
• LIF – Represents the network address that is associated with a port – Provides access to client data
Cluster
Lenovo Accredited Learning Provider
45 45
A storage virtual machine (SVM) contains data volumes and LIFs. The data volumes store client data which is accessed through a LIF. A volume is a logical data container that might contain files or LUNs. SVMs might have one or more FlexVol volumes or a single, scalable infinite volume. A LIF represents the IP address or WWPN that is associated with a port. Data LIFs are used to access client data.
Lenovo Accredited Learning Provider
45
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM with FlexVol Volumes • FlexVol volume – In a NAS environment, represents the file system – In a SAN environment, contains LUNs
• Qtree – Partitions FlexVol volumes into smaller segments – Enables management of quotas, security styles, and CIFS opportunistic lock (oplock) settings
Qtree Q3 Q2 Q1
LUN SVM
Data LIF
Client Access Data LIF
Host Access
• LUN: – Is a logical unit that represents a SCSI disk
Cluster
Lenovo Accredited Learning Provider
46 46
In SVM can contain one or more FlexVol volumes (or simply volumes). In a NAS environment, volumes represent the file system where clients store data. In a SAN environment, LUNs are created in the volumes for a host to access. Qtrees partition a volume into smaller segments, much like directories. Qtrees can also be used to manage quotas, security styles, and CIFS opportunistic lock (oplock) settings. A LUN is a logical unit that represents a SCSI disk. In a SAN environment, the host operating system controls the reads and writes for the file system.
Lenovo Accredited Learning Provider
46
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Cluster Failover
Lenovo Accredited Learning Provider
47
If one node fails , automatically other controller will take over the storage. Enabling storage failover (SFO) is done within pairs, regardless of how many nodes are in the cluster. For SFO (storage failover), the HA pairs must be of the same model. The cluster itself can contain a mixture of models, but each HA pair must be homogeneous. The version of the Data ONTAP operating system must be the same on both nodes of the HA pair, except for the short period of time during which the pair is upgraded. Two HA interconnect cables are required to connect the NVRAM cards (except for FAS and VSeries 32×0 models with single-enclosure HA). The storage failover(SFO) can be enabled on either node in the pair. Storage Failover(SFO) can be initiated from any node in the cluster.
Lenovo Accredited Learning Provider
47
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Networking
Lenovo Accredited Learning Provider
48
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Network Types • Cluster interconnect: – Connection of nodes – Private network
• Management network: – Cluster administration network – Possibly a shared Ethernet network with data
• Data network: Management Network
– One or more networks that are used for data access from clients or hosts – Ethernet, FC, or converged network
Data Network Lenovo Accredited Learning Provider
49
In multinode clusters, nodes need to communicate with each other over a cluster interconnect. In a two-node cluster, the interconnect can be switchless. When you add more than two nodes to a cluster, a private cluster interconnect that uses switches is required. The management network is used for cluster administration. Redundant connections to the management ports on each node and management ports on each cluster switch should be provided to the management network. In smaller environments, the management and data networks might be on a shared Ethernet network. For clients and hosts to access data, a data network is required. The data network can be composed of one or more networks. Depending on the environment, the network might be an Ethernet, FC, or converged network. Data networks can consist of one or more switches or redundant networks.
Lenovo Accredited Learning Provider
49
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Networking Logical
LIF
Virtual LAN (VLAN)
Virtual (Optional)
Physical
DM3000-mgmt
DM3000-data1
a0a-50
a0a-80
Interface Group (ifgroup)
Port
a0a
e2a
e3a
Network Ports
Lenovo Accredited Learning Provider
50
Nodes have physical ports that are available for cluster traffic, management traffic, and data traffic. The ports need to be configured appropriately for the environment. The example shows Ethernet ports. Physical ports also include FC ports and Unified Target Adapter (UTA) ports. Physical Ethernet ports can be used directly or combined by using interface groups (ifgroups). Also, physical Ethernet ports and ifgroups can be segmented by using virtual LANs (VLANs). VLANs and ifgroups are considered virtual ports but are treated like physical ports. Unless specified, the term network port includes physical ports, ifgroups, and VLANs.
Lenovo Accredited Learning Provider
50
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DM7000 Controller - Physical Ports Example
SAS
10GbE Cluster Ports e0a, e0b
10GBase-T Data Ports e0c, e0d
Additional PCI Cards eg. e1a, e1b eg. 2a, 2b
e0M & SP UTA2 Data Ports CNA - e0e, e0f, e0g, e0h FC – 0e, 0f, 0g, 0h
Console Port
Lenovo Accredited Learning Provider
51
4 x 10-GbE ports for cluster interconnects • Supported: Two cluster interconnects (e0a and e0c) and two data (e0b and e0d) ports • Recommended: Four cluster interconnects (switched clusters only) 4x Unified Target Adapter 2 (UTA2) ports that can be configured as either 10-GbE or 16Gbps FC for data • Only for data (not cluster interconnects) • Port pairs that must be set the same: • e0e/0e and e0f/0f, and e0g/0g and e0h/0h, are port pairs. • You can select from FC enhanced small-form factor pluggable (SFP+), 10-GbE SFP+, or Twinax Ethernet. • The set port mode command is ucadmin. • There are four GbE ports for data. One management port (default for node-management network): • e0M runs at GbE. • SP runs at 10/100. One private management port that is used as an alternate control path (ACP) for SAS shelves One console port that can be configured for Service Processor (SP) • To toggle from serial console into SP, press Ctrl+G. • To toggle back, press Ctrl+D.
Lenovo Accredited Learning Provider
51
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Physical Port Identification •
Ethernet ports are named e:
– e0a is the first port on the controller motherboard. – e2a is a port on a card in slot 2. •
FC ports are named :
– 0a is the first port on the controller motherboard. – 1a is a port on a card in slot 1. •
UTA ports have both an Ethernet name and an FC name, e/:
– e0a/0a is the first port on the controller motherboard. – e1a/1a is a port on a card in slot 1. – Use of show commands returns only FC label names (even in Ethernet mode).
Lenovo Accredited Learning Provider
52
Port names consist of two or three characters that describe the port type and location. Remember port-naming conventions on the network interfaces. Ethernet ports: The first character describes the port type and is always e to represent Ethernet. The second character is a numeral that identifies the slot in which the port adapter is located. The numeral 0 (zero) indicates that the port is on the node motherboard. The third character indicates the port position on a multiport adapter. For example, the port name e0b indicates the second Ethernet port on the motherboard, and the port name e3a indicates the first Ethernet port on an adapter in slot 3. FC ports: The name consists of two characters (dropping the e) but otherwise follows the same naming convention as Ethernet ports. For example, the port name 0b indicates the second FC port on the motherboard, and the port name 3a indicates the first FC port on an adapter in slot 3. UTA ports: A UTA port is physically one port but can pass either Ethernet traffic or FC traffic. Therefore, UTA ports are labeled with both the Ethernet name and the FC name. For example, the port name e0b/0b indicates the second UTA port on the motherboard, and the port name e3a/3a indicates the first UTA port on an adapter in slot 3. Note: UTA adapter ports are listed by only the FC label name when you use the ucadmin command, even when the personality is configured as 10-GbE.
Lenovo Accredited Learning Provider
52
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Modifying Network Port Attributes Set the UTA2 port personality
First remove any LIFs and take the port offline. DM3000::> system node hardware unified-connect modify -node DM3000_1 -adapter 0e -mode fc|cna DM3000::> system node reboot –node DM3000_1
Insert the proper optical module before changing modes.
Lenovo Accredited Learning Provider
53
UTA ports are managed in a similar way and require a reboot to take effect. The adapter must also be offline before any changes can be made.
When the adapter type is initiator, use the run local storage disable adapter command to take the adapter offline.
When the adapter type is target, use the network fcp adapter modify command to take the adapter offline.
For more information about configuring FC ports, see the ONTAP SAN Administration Guide for your release, or attend the ONTAP University SAN Implementation course.
Lenovo Accredited Learning Provider
53
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ifgroups • Combination of one or more Ethernet interfaces • Three ifgroup modes: – Single-mode (active-standby) – Static multimode (active-active) – Dynamic multimode using Link Aggregation Control Protocol (LACP)
• Naming syntax: a (for example, a0a)
Multimode ifgroup
Single-Mode ifgroup
Active Standby Lenovo Accredited Learning Provider
54
An ifgroup combines one or more Ethernet interfaces, which can be implemented in one of three ways. In single mode, one interface is active and the other interfaces are inactive until the active link goes down. The standby paths are used only during a link failover. In static multimode, all links are active. Therefore, static multimode provides link failover and load-balancing features. Static multimode complies with the IEEE 802.3ad (static) standard and works with any switch that supports the combination of Ethernet interfaces. However, static multimode does not have control packet exchange. Dynamic multimode is similar to static multimode but complies with the IEEE 802.3ad (dynamic) standard. When switches that support Link Aggregation Control Protocol (LACP) are used, the switch can detect a loss of link status and dynamically route data. ONTAP recommends that when you configure ifgroups, you use dynamic multimode with LACP and compliant switches. All modes support the same number of interfaces per ifgroup, but the interfaces in the group should always be the same speed and type. The naming syntax for interface groups is the letter “a”, followed by a number, followed by a letter; for example, a0a. Vendors might use terms such as link aggregation, port aggregation, trunking, bundling, bonding, teaming, or EtherChannel.
Lenovo Accredited Learning Provider
54
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ifgroup Considerations • Because of the limited capabilities of single mode, you should not use a singlemode ifgroup in ONTAP software. • Use dynamic multimode (LACP) when you use ifgroups, to take advantage of performance and resiliency functionality: – An LACP-enabled switch is required. – All of the interfaces in the group are active, share a MAC address, and use loadbalancing for outbound (not inbound) traffic. – A single host does not achieve larger bandwidth than any of the constituent connections (two 10-GbE does not equal one 20-GbE). – Dynamic multimode might not have any advantages for iSCSI hosts.
Lenovo Accredited Learning Provider
55
You can configure ifgroups to add a layer of redundancy and functionality to an ONTAP software environment. You can also use ifgroups with a failover group to help protect against Layer 2 and Layer 3 Ethernet failures. A single-mode ifgroup is an active-passive configuration (one port sits idle, waiting for the active port to fail) and cannot aggregate bandwidth. ONTAP advises against using the single-mode type of ifgroup. To achieve as much redundancy, you can use failover groups or one of the two multimode methods. You might use a static multimode ifgroup if you want to use all the ports in the group to simultaneously service connections. Static multimode does differ from the type of aggregation that happens in a dynamic multimode ifgroup, in that no negotiation or automatic detection happens within the group in regard to the ports. A port sends data when the node detects a link, regardless of the state of the connecting port on the switch side. You might use a dynamic multimode ifgroup to aggregate bandwidth of more than one port. LACP monitors the ports on an ongoing basis to determine the aggregation capability of the ports. LACP also continuously provides the maximum level of aggregation capability achievable between a given pair of devices. However, all the interfaces in the group are active, share MAC address, and load-balance outbound traffic. A single host does not necessarily achieve larger bandwidth, exceeding the capabilities of any constituent connections. For example, adding four 10-GbE ports to a dynamic multimode ifgroup does not result in one 40-GbE link for one host. The situation is because of the way that both the switch and the node manage the aggregation of the ports in the ifgroup. A recommended best practice is to use the Lenovo Accredited Learning Provider
55
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
dynamic multimode type of ifgroup so that you can take advantage of all the performance and resiliency functionality that the ifgroup algorithm offers. You can use two methods to achieve path redundancy when using iSCSI in ONTAP software: by using ifgroups or by configuring hosts to use multipath I/O over multiple distinct physical links. Because multipath I/O is required, ifgroups might have little value.
Lenovo Accredited Learning Provider
55
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Ports, ifgroups, and VLANs
LIF
LIF LIF
LIF
VLAN
LIF
LIF LIF
VLAN
VLAN
port
VLAN ifgrp
port LIF
LIF ifgrp port
port
port
port
NOTE: - VLANs and ifgroups cannot be created on cluster interconnect ports. - e0M/SP port doesn‘t support VLAN
Lenovo Accredited Learning Provider
56
Most small to medium environments and FC environments use physical ports. Ethernet environments in which multiple physical networks are impossible often use VLANs to separate management traffic from data traffic. VLANs are also often used to separate differing workloads. For example, you might separate NAS traffic from iSCSI traffic for performance and security reasons. In Ethernet environments where many application servers or hosts share switches and ports, dynamic multimode ifgroups of four Ethernet ports per node are commonly used for load balancing. Environments that use ifgroups typically also use VLANs to segment the network. Segmentation is typical for service providers with multiple clients that require the bandwidth that ifgroups provide and the security that VLANs provide. And lastly, it is not uncommon for different types of ports to be used in mixed environments that have various workloads. For example, an environment might use ifgroups with VLANs that are dedicated to NAS protocols, a VLAN that is dedicated to management traffic, and physical ports for FC traffic. ifgroups and VLANs cannot be created on cluster interconnect ports.
Lenovo Accredited Learning Provider
56
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
VLANs Switch 1 e0a-40 Switch 2
Router
Mgmt Switch VLAN10 Clients
VLAN20 Tenant B
VLAN30 Tenant A
VLAN40 Mgmt
Lenovo Accredited Learning Provider
57
A port or ifgroup can be subdivided into multiple VLANs. Each VLAN has a unique tag that is communicated in the header of every packet. The switch must be configured to support VLANs and the tags that are in use. In ONTAP software, a VLAN ID is configured into the name. For example, VLAN e0a-70 is a VLAN with tag 70 configured on physical port e0a. VLANs that share a base port can belong to the same or different IPspaces, and the base port can be in a different IPspace than the VLANs that share the base port. IPspaces are covered later in this module.
Lenovo Accredited Learning Provider
57
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
IPspaces Default IPspace
Company A IPspace
Company B IPspace
SVM 1
SVM_A-1
SVM_B-1
SVM 2
SVM_A-2
SVM_B-2
Company A Routing Table
Company B Routing Table
Company A: 10.0.0.0
Company B: 10.0.0.0
Default Routing Table Storage SP Point of Presence
Default: 192.168.0.0
192.168.0.5
10.0.5.10
10.0.5.10
Lenovo Accredited Learning Provider
58
The IPspace feature enables clients from more than one disconnected network to access a storage system or cluster, even if the clients use the same IP address. An IPspace defines a distinct IP address space in which virtual storage systems can participate. IP addresses that are defined for an IPspace are applicable only within the IPspace. A distinct routing table is maintained for each IPspace. No cross-IPspace traffic routing occurs. Each IPspace has a unique assigned loopback interface. The loopback traffic on each IPspace is isolated from the loopback traffic on other IPspaces. Example A storage SP needs to connect customers of companies A and B to a storage system on the storage SP premises. The storage SP creates SVMs on the cluster—one per customer. The storage SP then provides one dedicated network path from one SVM to the A network and another dedicated network path from the other SVM to the B network. The deployment should work if both companies use nonprivate IP address ranges. However, because the companies use the same private addresses, the SVMs on the cluster at the storage SP location have conflicting IP addresses. To overcome the problem, two IPspaces are defined on the cluster—one per company. Because a distinct routing table is maintained for each IPspace, and no cross-IPspace traffic is routed, the data for each company is securely routed to the respective network. Data is securely routed even if the two SVMs are configured in the 10.0.0.0 address space. Lenovo Accredited Learning Provider
58
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Broadcast Domains Overview • Broadcast domains enable you to group network ports that belong to the same Layer 2 network. • An SVM can then use the ports in the group for data or management traffic.
Default Broadcast Domain Company A Broadcast Domain
Company B Broadcast Domain
Broadcast domains can contain physical ports, ifgroups, and VLANs. Lenovo Accredited Learning Provider
59
Broadcast domains are often used when a system administrator wants to reserve specific ports for use by a certain client or group of clients. A broadcast domain should include ports from many nodes in the cluster, to provide high availability for the connections to SVMs. Default has to be set. The figure shows the ports that are assigned to three broadcast domains in a four-node cluster: • The Default broadcast domain, which was created automatically during cluster initialization, is configured to contain a port from each node in the cluster. • The Company A broadcast domain was created manually and contains one port each from the nodes in the first HA pair. • The Company B broadcast domain was created manually and contains one port each from the nodes in the second HA pair. • The Cluster broadcast domain was created automatically during cluster initialization but is not shown in the figure. The system administrator created the two broadcast domains specifically to support the customer IPspaces.
Lenovo Accredited Learning Provider
59
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Failover Groups Versus Failover Policies A failover group is a list of ports (physical or virtual): Defines the targets for the LIF Is automatically created when you create a broadcast domain Does not apply to iSCSI or FC SAN LIFs
Failover Policy
Failover Group A failover policy restricts the list of ports within a failover group.
Ports to Migrate Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
60
60
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Subnets •
•
Subnets enable the allocation of specific blocks, or pools, of IP addresses for easier LIF creation. A subnet is created within a broadcast domain and contains a pool of IP addresses that belong to the same Layer 3 subnet.
Default Broadcast Domain
192.168.0.1
to subnet
192.168.0.100
Company A Broadcast Domain
to subnet
Company B Broadcast Domain
10.1.2.5 to subnet 10.1.2.100
10.1.2.5
10.1.2.20
Subnets are recommended for easier LIF creation.
Lenovo Accredited Learning Provider
61
Subnets enable you to allocate specific blocks, or pools, of IP addresses for your ONTAP network configuration. The allocation enables you to create LIFs more easily when you use the network interface create command, by specifying a subnet name instead of specifying IP address and network mask values. IP addresses in a subnet are allocated to ports in the broadcast domain when LIFs are created. When LIFs are removed, the IP addresses are returned to the subnet pool and are available for future LIFs. You should use subnets because subnets simplify the management of IP addresses and the creation of LIFs. Also, if you specify a gateway when defining a subnet, a default route to that gateway is added automatically to the SVM when a LIF is created using that subnet. More: https://en.wikipedia.org/wiki/Subnetwork
Lenovo Accredited Learning Provider
61
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Subnets Subnets and gateways •
When creating subnets, considering the following information:
– If a gateway is specified, then when a LIF is created using the subnet, a default route is added automatically to the SVM. – If you do not use subnets, or if you do not specify a gateway when defining a subnet, then you must use the route create command to add a route to the SVM manually. •
If you add or change the gateway IP address, the following changes occur:
– The modified gateway is applied to new SVMs when a LIF is created in an SVM that uses the subnet. – A default route to the gateway is created for the SVM (if the route does not already exist). NOTE: When you change the gateway IP address, you might need to manually add a new route to the SVM. Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
62
62
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
IPspace Review
IPspace
Broadcast Domain
Storage Virtual Machine (SVM)
Subnet Port
LIF 10.0.5.10
IP Addresses: 10.0.5.1 – 10.0.5.100
Lenovo Accredited Learning Provider
63
ONTAP software has a set of features that work together to enable multitenancy. An IPspace is a logical container that is used to create administratively separate network domains. An IPspace defines a distinct IP address space that contains storage virtual machines (SVMs). The IPspace contains a broadcast domain, which enables you to group network ports that belong to the same Layer 2 network. The broadcast domain contains a subnet, which enables you to allocate a pool of IP addresses for your ONTAP network configuration. When you create a LIF on the SVM, the LIF represents a network access point to the node. You can manually assign the IP address for the LIF. If a subnet is specified, the IP address is automatically assigned from the pool of addresses in the subnet, much like how a Dynamic Host Configuration Protocol (DHCP) server assigns IP addresses.
Lenovo Accredited Learning Provider
63
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
LIFs •
An IP address or worldwide port name (WWPN) is associated with a LIF: – If subnets are configured (recommended), then when the LIF is created, IP addresses are automatically assigned. – If subnets are not configured, then when the LIF is created, IP addresses must be manually assigned. – When an FC LIF is created, WWPNs are automatically assigned.
• • • • •
One node-management LIF exists per node. One cluster-management LIF exists per cluster. Cluster LIFs depend on the cluster configuration. Multiple data LIFs are enabled per port (client-facing for NFS, CIFS, iSCSI, and FC access). For intercluster peering, intercluster LIFs must be created on each node. – Used for Cluster to Cluster connections
Lenovo Accredited Learning Provider
64
Data LIFs can have a many-to-one relationship with network ports: Many data IP addresses can be assigned to a single network port. If the port becomes overburdened, NAS data LIFs can be transparently migrated to different ports or nodes. Clients know the data LIF IP address but do not know which node or port hosts the LIF. If a NAS data LIF is migrated, the client might unknowingly be contacting a different node. The NFS mount point or CIFS share is unchanged.
Lenovo Accredited Learning Provider
64
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Network Interfaces Review Logical
Virtual (Optional)
Physical
LIF
VLAN
Team1-mgmt
Team1-data1
a0a-50
a0a-80
Ifgroup
Port
Network Ports
a0a
e2a
e3a
Lenovo Accredited Learning Provider
65
A LIF is associated with a physical port, an ifgroup, or a VLAN. Virtual storage systems— VLANs and SVMs—own the LIFs. Multiple LIFs that belong to multiple SVMs can reside on a single port.
Lenovo Accredited Learning Provider
65
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Architecture
Lenovo Accredited Learning Provider
66
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Storage Architecture
Files and LUNs
Logical Layer FlexVol Volumes
Aggregate
Physical Layer RAID Groups of Disks
Lenovo Accredited Learning Provider
67
The ONTAP software storage architecture uses a dynamic virtualization engine in which data volumes are dynamically mapped to physical space. In ONTAP software, disks are grouped into RAID groups. An aggregate is a collection of physical disk space that contains one or more RAID groups. Each aggregate has a RAID configuration and a set of assigned disks. The disks, RAID groups, and aggregates make up the physical storage layer. Within each aggregate, you can create one or more FlexVol volumes. A FlexVol volume is an allocation of disk space that is a portion of the available space in the aggregate. A FlexVol volume can contain files or LUNs. The FlexVol volumes, files, and LUNs make up the logical storage layer.
Lenovo Accredited Learning Provider
67
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Disks and Aggregates • What happens when a disk is inserted into a system: Unowned Disks
– The disk is initially unassigned. – By default, disk ownership is assigned automatically. – Disk ownership can be changed.
• What happens after ownership is assigned: Spare Disks Aggregate
– The disk functions as a hot spare. – The disk can be assigned to an aggregate.
Lenovo Accredited Learning Provider
68
When a disk is inserted into a storage system disk shelf or when a new shelf is added, the controller takes ownership of the disk by default. In a high-availability (HA) pair, only one controller can own a particular disk, but ownership can be manually assigned to either controller. When an aggregate is created or disks are added to an aggregate, the spare disks are used.
Lenovo Accredited Learning Provider
68
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Create an Aggregate Information to provide: • Aggregate name • Disk type • Owning node • Number of disks • RAID type
DM3000::> aggr create -aggregate rtp01_fcal_001 -node DM3000_1 -disktype fcal -diskcount 8 Lenovo Accredited Learning Provider
69
For most disk types, RAID DP is the default. Beginning with ThinkSystem Storage Manager 9.1, RAID-TEC is the only available RAID type if the following are true: The disk type of the aggregate disks is FSAS or mSATA The disk size is equal to or larger than 10 TB
Lenovo Accredited Learning Provider
69
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
RAID Types RAID groups can be one of the following: • RAID 4 group – Single parity for single-disk failure – Minimum of two disks
• RAID DP group
RAID 4
Data Disks
Parity Disk
RAID DP
– Double parity for double-disk failure – Minimum of three disks
• RAID-TEC group – Triple parity for triple-disk failure
Data Disks
Parity Disk
dParity Disk
RAID-TEC
– Minimum of four disks – Less time to rebuild a large disk that fails Data Disks
Parity Disk
dParity Disk
tParity Disk
Lenovo Accredited Learning Provider
70
Understanding how RAID protects your data and data availability can help you to administer your storage systems more effectively. For native storage, ONTAP software uses ONTAP RAID DP (double-parity) technology or RAID 4 protection to provide data integrity within a RAID group, even if one or two of the disks fail. Parity disks provide redundancy for the data that is stored on the data disks. If a disk fails, the RAID subsystem can use the parity disks to reconstruct the data in the failed disk. NOTE: The minimum number of disks per RAID group for each RAID type is a standard RAID specification. During aggregate creation, ONTAP imposes a seven-disk minimum for aggregates with RAID-TEC groups, a five-disk minimum for aggregates with RAID DP groups, and a four-disk minimum for aggregates with RAID 4 groups.
Lenovo Accredited Learning Provider
70
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP RAID Technologies Description D0
D1
D2
D3
D4
D5
RP
DP
TP
• RAID 4 (row parity) – Add a row parity disk – Protect against single-disk failure, media error
• RAID-DP (double parity) technology – Adds a diagonal parity disk to a RAID 4 group – Protect against two disk failures, disk failure and media error, and double media errors D0
D1
D2
D3
D4
D5
RP
DP
TP
• RAID-TEC (triple erasure coding) technology – Adds a triple-parity disk to a RAID-DP group – Protect against three-disk failure, two disk failure and media error, and triple media errors
Lenovo Accredited Learning Provider
71
RAID 4 In a RAID 4 group, parity is calculated separately for each row. In the example, the RAID 4 group contains seven disks, with each row containing six data blocks and one parity block. RAID-DP Technology In a RAID-DP group, a diagonal parity set is created in addition to the row parity. Therefore, an extra double-parity disk must be added. In the example, the RAID-DP group contains eight disks, with the double parity calculated diagonally by using seven parity blocks. The number in each block indicates the diagonal parity set to which the block belongs. Each row parity block contains even parity of data blocks in the row, not including the diagonal parity block. Each diagonal parity block contains even parity of data and row parity blocks in same diagonal. RAID-TEC Technology In a RAID-TEC group, an anti-diagonal parity set is created in addition to both the row parity and diagonal parity sets. Therefore, an extra third-parity disk must be added. In the example, the RAID-TEC group contains nine disks, with the triple parity calculated anti-diagonally using seven parity blocks. Seven diagonals (parity blocks) exist, but ONTAP software stores six diagonals (p-1). The missed diagonal selection is arbitrary. Here, diagonal 6 is missing and is not
Lenovo Accredited Learning Provider
71
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
stored or calculated. Regarding diagonal numbers, the following guidelines apply:
The set of diagonals collectively span all of the data disks and the row parity disk. Each diagonal misses only one disk, and each diagonal misses a different disk. Each disk misses a different diagonal. The diagonal sequencing within a given disk starts with the diagonal number that corresponds with the given disk number. So the first diagonal on disk number 0 is diagonal 0, and the first diagonal on disk N is diagonal N. The diagonals on the disk wrap around when the end of the diagonal set is reached.
Lenovo Accredited Learning Provider
71
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
RAID Group Sizes •
Requirements and options:
– Default for near-line class disks (SATA or NL-SAS) of 6 TB or larger HDDs – Required for 10 TB and larger HDDs – Optional for other disks (SSD or SAS) •
Group Type
Default
Maximum
SATA
RAID4
7
7
RAID-DP
14
20
NL-SAS
Default RAID group sizes:
– 21 disks for SATA or NL-SAS disks – 24 disks for SAS disks •
Disk Type
Ability to upgrade and downgrade nondisruptively between RAID types
SAS
SSD
RAID-TEC
21
29
RAID4
7
7
RAID-DP
14
20
RAID-TEC
21
29
RAID4
8
14
RAID-DP
16
28
RAID-TEC
24
29
RAID4
8
14
RAID-DP
23
28
RAID-TEC
24
29
Lenovo Accredited Learning Provider
72
To create a RAID-TEC aggregate, you need a minimum of seven disks. RAID4 can only be set up through CLI
Lenovo Accredited Learning Provider
72
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Adding Capacity to Aggregates Provide the following information: • Aggregate name • Disk type • Number of disks
You cannot shrink aggregates. DM3000::> storage disk show -spare -owner rtp-nau-01 DM3000::> storage aggregate add-disks –aggr rtp01_fcal_001 disks 2 Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
73
73
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Advanced Drive Partitioning
Root-Data HDD Partitioning (first 24 HDDs, All Hybrid) Root-Data-Data SSD Partitioning (first 48 SSDs, All Flash) Root-Data-Data (RD2) Partitioning
Root-Data (RD) Partitioning
P1
SSD
SSD
HDD
Data Partition
P1
P2 P1
P1Data
Partition
Root Partition Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
P2
Root Partition
P2
P3
74
74
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Root-Data Advanced Disk Partitioning
DM3000_1
• •
DP
R
P
R
R
R
R
R
R
S
R
S
R
DP
R
P
R
R
R
R
S
R
S
R
DP
P
D
D
D
D
D
D
D
D
D
S
DP
P
D
D
D
D
D
D
D
D
D
S
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
DM3000_2
SSDs are partitioned into one small root partition and one large data partition. Standard aggregate configuration per node is as follows: – A root aggregate RAID group of 8 data + 2 parity partitions, and 2 spare root partitions – A data aggregate RAID group of 9 data + 2 parity partitions, and 1 spare data partition
•
Total usable capacity is 18 data partitions out of a total of 24—75% efficiency.
Lenovo Accredited Learning Provider
75
The figure shows the default configuration for a single-shelf All Flash DM system in Data ONTAP 8.3.x software.
Lenovo Accredited Learning Provider
75
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Root-Data-Data Advanced Disk Partitioning ONTAP 9 and later software
DM3000_1
DP
R
P
R
R
R
R
R
R
S
R
S
R
DP
R
P
R
R
R
R
S
R
R
S
DP
P
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
S
DP
P
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
D
S
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
DM3000_2
• SSDs are partitioned into one small root and two data partitions, each of which is half the size of a root-data partition. • The standard aggregate configuration per node is as follows: – A root aggregate RAID group of 8 data + 2 parity partitions and 2 spare root partitions (no change from root-data partition) – A data aggregate RAID group of 21 data + 2 parity partitions and 1 spare data partition
• The total usable capacity is 42 data partitions out of a total of 48: 87.5% efficiency, or 16.7% more usable capacity (0.875 / 0.75). Lenovo Accredited Learning Provider
76
The figure shows the default configuration for a single-shelf All Flash DM system in ONTAP 9 software.
Lenovo Accredited Learning Provider
76
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Root-Data-Data Advanced Disk Partitioning Additional root-data-data partitioning information • R
R R
R R
R
S
R
S
R DP R
P
R
R
R R
S
R
S
rg0
DP R D
D
D D
D D
D D
D
P D
S
D
D D
D
D
D
D D
S
D
P D
rg0
rg1
D
D
D D
D D
D D
D
P D
S
D
D D
D D
D D D
S
D
P D
rg1 DM3000_2
DM3000_1
P
R
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 R R
R
R R
R R
R R
R R
R R
R R
R
R
R
R R
R R
rg0
DP D D
R
D
D D
D D
D D
D D DP D D
R
D D
D D
D
D D
D D
rg0
rg1
DP D D
D
D D
D D
D D
D D DP D D
D D
D D
D
D D
D D
rg1
– Default root aggregate provisioning method for All Flash DM – Unsupported on entry-level DM or All Flash DM MetroCluster software
•
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
Data partition assignments with two shelves are similar to root-data partitioning: – Data partitions on an SSD are assigned to the same node. – Twice as many RAID groups are used.
• DM3000_1
Root-data-data partitioning is supported on only All Flash DM systems:
DM3000_2
Half-shelf All Flash DM systems have 50% more usable capacity than with root-data partitioning. All Flash DM systems with 12 x 3.8-TB or 12 x 15.3-TB SSDs are available with only ONTAP 9 software.
Lenovo Accredited Learning Provider
77
The figures show the default configuration for two-shelf and half-shelf All Flash DM systems in ONTAP 9 software. For root-data partitioning and root-data-data partitioning, RAID uses the partitions in the same way as physical disks. If a partitioned disk is moved to another node or used in another aggregate, the partitioning persists. You can use the disk only in RAID groups that are composed of partitioned disks. If you add an unpartitioned drive to a RAID group that consists of partitioned drives, the unpartitioned drive is partitioned to match the partition size of the drives in the RAID group. The rest of the disk is unused.
Lenovo Accredited Learning Provider
77
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Virtual Storage Tier • Flash Cache intelligent caching: – Has highest performance for file services – Improves latency for random reads – Delivers predictable, high-speed data access
Server
• Flash Pool intelligent caching: – – – –
Has the highest performance for OLTP Is best for SATA enablement across multiple workloads Caches for random reads and writes Automates the use of SSD technology
Flash Cache
Flash Pool Storage
Lenovo Accredited Learning Provider
78
At the storage level, there are two ways to implement Virtual Storage Tier (VST): • The controller-based Flash Cache feature accelerates random-read operations and generally provides the highest performance solution for file-services workloads. • The Flash Pool feature is implemented at the disk-shelf level, enabling SSDs and traditional HDDs to be combined in a single ONTAP aggregate. Flash Pool technology provides read caching and write caching and is well-suited for OLTP workloads, which typically have a higher percentage of write operations. Both VST technologies improve overall storage performance and efficiency and are simple to deploy and operate.
Lenovo Accredited Learning Provider
78
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Flash Cache 2 Feature • Flash Cache caching includes the following elements: – 1-TB, 2-TB or 4TB Peripheral Component Interconnect Express (PCIe) module – Preinstalled in all DM-Series Hybrid models – Support for all protocols – An extension to the ONTAP WAFL file system buffer cache to save evicted buffers
• De-duplicated and compressed blocks are maintained in the cache. • Cache is shared by all volumes on a node.
Lenovo Accredited Learning Provider
79
Flash Cache intelligent caching combines software and hardware within ONTAP storage controllers to increase system performance without increasing the disk count. The Flash Cache plug-and-play Peripheral Component Interconnect Express (PCIe) module requires no configuration to use the default settings, which are recommended for most workloads. The original Flash Cache module is available in 256-GB, 512-GB, or 1-TB capacities and accelerates performance on all supported ONTAP client protocols. The Flash Cache controller-based solution is available to all volumes that are hosted on the controller. A common use case for Flash Cache is to manage VMware boot storms. Flash Cache 2 is the second generation of Flash Cache performance accelerators. The new architecture of Flash Cache 2 accelerators enables even higher throughput. For more information, see TR-3832: Flash Cache Best Practice Guide.
Lenovo Accredited Learning Provider
79
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Flash Pool Overview Flash Pool cache is a least-recently used (LRU) read cache with writethrough caching for random overwrites
Maximum
Frequently read data blocks are retained longer – “heat” map tracks block usage Frequently updated blocks (random overwrites) are inserted directly into cache
Repeat random-read workloads benefit most Write-back policies enable pre-populating cache with new writes Random overwrite caching helps keep latency low when blocks are updated
Aggregate-level cache – cache used only by volumes in the aggregate Cache is provisioned from whole SSDs or SSD storage pool allocation units Cache is part of the aggregate, not separate
Cache is persistent through planned and unplanned takeover/shutdown
Evict
Works with compressed, deduplicated, cloned, and encrypted blocks Supported with Volume Encrypted Systems Support for SnapLock
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
80
80
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Add allocation units to Aggregate Can not be removed without destroying aggregate Storage Pool (ssd_pool_001)
Aggr2
Aggr1 DATA
DATA
DATA
DATA
PARITY
PARITY
HDD rg1
HDD rg0 HDD rg1 SSD rg2
HDD rg0
DATA
DATA
DATA
DATA
PARITY
PARITY
DATA
DATA
DATA
DATA
PARITY
PARITY
1
2
3
4
5
HDD rg2 SSD rg3 SSD rg4
DM3000::> storage aggregate add-disks –aggregate agg1_HDD -storage-pool ssd_pool_001 –allocation-units 2 –raidtype raid4 Lenovo Accredited Learning Provider
81
SSD partitioning define four allocation units, each with 25% SSD storage capacity that can be alocated per one or more aggregates. You can add one, two, three or four allocation units to aggregate – Best practice is addinng one allocation units at a time – add more only if really needed. NOTE: Allocation units can not be removed later on. If you want to change SSD FlashPool capacity you should destroy whole aggregate meaning losing all data on that aggregate.
Lenovo Accredited Learning Provider
81
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Virtual Storage Tier Feature comparison Flash Cache What is the feature? A controller-based PCIe card
Flash Pool
A plug-and-play device
What is the feature? Storage-level, RAID-protected cache (specific to aggregates)
What does the feature do?
What does the feature do?
Provides per-controller cache
Caches random reads and overwrites
Caches random reads
Provides cached data persistence through failovers
Where does the feature fit?
Where does the feature fit?
With random-read workloads, such as file services
With random-overwrite-heavy workloads such as OLTP workloads
With workloads that contain multiple volumes that are in various aggregates on a controller
Where consistent performance is required
Flash Cache and Flash Pool can be used together – increasing cache capacity Lenovo Accredited Learning Provider
82
The Flash Cache and Flash Pool features bring flash technology to ONTAP software. The table compares the primary uses and benefits of both features.
Lenovo Accredited Learning Provider
82
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ONTAP Storage Architecture
Files and LUNs
Logical Layer FlexVol Volumes
Aggregate
Physical Layer RAID Groups of Disks Lenovo Accredited Learning Provider
83
The ONTAP storage architecture uses a dynamic virtualization engine, in which data volumes are dynamically mapped to physical space. In ONTAP, disks are grouped into RAID groups. An aggregate is a collection of physical disk space that contains one or more RAID groups. Each aggregate has a RAID configuration and a set of assigned disks. The disks, RAID groups, and aggregates make up the physical storage layer. Within each aggregate, you can create one or more FlexVol volumes. A FlexVol volume is an allocation of disk space that is a portion of the available space in the aggregate. A FlexVol volume can contain files or LUNs. The FlexVol volumes, files, and LUNs make up the logical storage layer.
Lenovo Accredited Learning Provider
83
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Volume Properties
Actions that can be taken on volumes:
Create Edit Resize Delete Clone Move
Volume options: Storage efficiency Storage quality of service (QoS)
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
Tools to protect volumes: Snapshot copies Mirror copies Vaults
84
84
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Automatic Resizing of Volumes • Automatic resizing of volumes enables a FlexVol volume to automatically grow or shrink the maximum space capacity of the volume. • You can specify a mode: – Off: Volume does not grow or shrink. – Grow: Volume automatically grows when space in the volume reaches a threshold. – Grow_shrink: Volume automatically grows or shrinks in response to the amount of used space.
• In addition, you can specify the following: – Maximum to grow (default is 120% of volume size) – Minimum to shrink (default is volume size) – Grow and shrink thresholds
vol01
vol01
Lenovo Accredited Learning Provider
85
You can enable or disable automatic resizing of volumes. If you enable the capability, ONTAP automatically increases the capacity of the volume up to a predetermined maximum size. Space must be available in the containing aggregate to support the automatic growth of the volume. Therefore, if you enable automatic resizing, you must monitor the free space in the containing aggregate and add more when needed. The capability cannot be triggered to support Snapshot creation. If you attempt to create a Snapshot copy and the volume has insufficient space, the Snapshot creation fails, even when automatic resizing is enabled. For more information about using automatic resizing, see the SAN Administration Guide.
Lenovo Accredited Learning Provider
85
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
FlexVol Volumes Versus FlexGroup Volumes How they differ at a high level
/vol1
/vol1/vol2
Managed storage as one volume
/FlexGroup
FlexVol volumes
FlexGroup volumes
FlexVol volumes are owned by one node.
A FlexGroup volume is a pool of FlexVol volumes.
FlexVol volumes span one aggregate.
FlexGroup volumes span multiple aggregates.
Reads and writes are isolated to one volume, node, or aggregate.
Reads and writes are balanced across all nodes and aggregates.
A FlexVol volume is limited to 100 TB (system-dependent).
A FlexGroup volume can be 20 PB (200 FlexVol volumes).
FlexVol volumes are within one namespace, but with limits.
FlexVol groups are within one namespace, almost without limits.
Lenovo Accredited Learning Provider
86
Although ONTAP FlexGroup volumes are positioned as a capacity feature, FlexGroup volumes are also a high-performance feature. With a FlexGroup volume, you can have massive capacity, predictably low latency, and high throughput for the same storage container. A FlexGroup volume adds concurrency to workloads and presents multiple volume affinities to a single storage container with no need for increased management.
Lenovo Accredited Learning Provider
86
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Balanced Placement Balanced LUN and volume placement based on application requirements
Application-Aware Provisioning (Template-Based)
Balanced Placement
• Simplified provisioning • Balanced use of cluster storage and CPU (node headroom) resources • Balanced placement that depends on the following: – QoS – Headroom availability
• Balanced placement logic that needs the following inputs: – Storage Level Classes: Extreme, High, or Value (Capacity) – Protection Level Classes: sync or async – Size of application or application components Lenovo Accredited Learning Provider
87
Balanced placement simplifies provisioning by eliminating questions such as the following: Where is the capacity to match my application I/O requirements? Which node or nodes have CPU headroom to take on additional work? Identifying remaining performance capacity Performance capacity, or headroom, measures how much work you can place on a node or an aggregate before performance of workloads on the resource begins to be affected by latency. Knowing the available performance capacity on the cluster helps you provision and balance workloads. Identifying high-traffic clients or files You can use ONTAP Active Objects technology to identify clients or files that are responsible for a disproportionately large amount of cluster traffic. Once you have identified these "top" clients or files, you can rebalance cluster workloads or take other steps to resolve the issue. Guaranteeing throughput with QoS You can use storage quality of service (QoS) to guarantee that performance of critical workloads is not degraded by competing workloads. You can set a throughput ceiling on a competing workload to limit its impact on system resources, or set a throughput floor for a critical workload, ensuring that it meets minimum throughput targets, regardless of demand by competing workloads. You can even set a ceiling and floor for the same workload.
Lenovo Accredited Learning Provider
87
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Volume Move • Rules: – To any aggregate in the cluster – Only within the SVM – Nondisruptively to the client
• Use cases: aggr1 aggr5 aggr2
aggr3 aggr6 aggr4
– Capacity: Move a volume to an aggregate with more space. – Performance: Move a volume to an aggregate with different performance characteristics. – Servicing: Move volumes to newly added nodes or from nodes that are being retired.
Lenovo Accredited Learning Provider
88
FlexVol volumes can be moved from one aggregate or node to another within the same storage virtual machine (SVM). A volume move does not disrupt client access during the move. You can move volumes for capacity use, such as when more space is needed. You can move volumes to change performance characteristics, such as from a controller with HDDs to one that uses solid-state drives (SSDs). You can also move volumes during service periods.
Lenovo Accredited Learning Provider
88
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Volume Rehost Within a Cluster
Audit
Docs
Tax
Database
Docs
(SVM) Test
(SVM) Finance
Steps to rehost a volume: 1.
Identify the source volume and SVM.
2.
Identify the destination SVM within the cluster.
3.
Prevent access to the volume that is being rehosted.
4.
Rehost the volume to the destination SVM by using the rehost command.
5.
Configure access to the volume in the destination SVM.
ONTAP
Destination Cluster Lenovo Accredited Learning Provider
89
The volume rehost command rehosts a volume from a source SVM to a destination SVM. The volume name must be unique among the other volumes on the destination SVM. If the volume contains a LUN, you can specify that the LUN needs to be unmapped. In addition, you can specify whether you want the LUN to be automatically remapped on the destination SVM. NOTE: Volume rehost is a disruptive operation and requires you to reconfigure access to the volume at the destination. Access to the volume must be prevented before a rehost to prevent data loss or inconsistency.
Lenovo Accredited Learning Provider
89
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
DATA ACCESS SAN / NAS
Lenovo Accredited Learning Provider
90
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Unified Storage Review File System (SAN)
Corporate LAN
NFS SMB
iSCSI FCoE
File System (NAS) NAS (File-Level Access)
ONTAP DM
FC SAN (Block-Level Access)
Lenovo Accredited Learning Provider
91
NAS is a file-based storage system that uses NFS and SMB protocols to make data available over the network. CIFS is a dialect of SMB. A SAN is a block-based storage system that uses FC, FCoE, and iSCSI protocols to make data available over the network.
Lenovo Accredited Learning Provider
91
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SAN Host
A LUN is a logical representation of a hard disk.
Storage
Centrally managed storage
Host Cluster
LUN LUN
Locally Attached Hard Disk
Centrally managed data protection
Lenovo Accredited Learning Provider
92
In an application server environment, locally attached hard disks, also called directattached storage (DAS), are separately managed resources. In an environment with more than one application server, each server’s storage resource also needs to be managed separately. A SAN provides access to a LUN, which represents a SCSI-attached hard disk. The host operating system partitions, formats, writes to, and reads from the LUN as if the LUN were any other locally attached disk. The advantages of using SAN storage include support for clustered hosts, where shared disks are required, and centrally managed resources. In the example, if the administrator did not use a SAN, the administrator would need to manage separate resources for each application server and host cluster. As well as enabling centrally managed resources, SAN uses ONTAP Snapshot copy technology to enable centrally managed data protection.
Lenovo Accredited Learning Provider
92
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Connecting Initiator to Target How can you connect an initiator to a target? Direct or Indirect access
Initiator
Eth
Connected Through a Switch
Target (SVM)
e0a
Application File System SCSI Driver
FC
Disk 1 (C:) Disk 2 (E:) LUN
Connected Through a Switch
SAN Services HA WAFL
0a
LUN
FlexVol Volume
Lenovo Accredited Learning Provider
93
ONTAP supports the iSCSI, FC,, FCoE and NVMe protocols. In this course, we use FC and iSCSI protocols. Data is communicated over ports and LIFs. In an Ethernet SAN, the data is communicated using Ethernet ports. In an FC SAN, the data is communicated over FC ports. For FCoE, the initiator has a converged network adapter (CNA), and the target has a unified target adapter (UTA). SAN data LIFs do not migrate or fail over the way that NAS does. However, the LIFs can be moved to another node or port in the SVM. ONTAP best practices: Use at least one LIF per node, per SVM, per network. Use redundant connections to connect the initiator to the target. Use redundantly configured switched networks to ensure resiliency if a cable, port, or switch fails.
Lenovo Accredited Learning Provider
93
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
iSCSI/FC Architecture Multipathing software is required.
Initiator Ethernet / FC
LIF
Disk 1 (C:) Disk 2 (E:)
The LUN
LIF
Initiator group (igroup): LUN
FlexVol Volume
Initiator node name: iqn/WWPN Protocol Type: iSCSI / FC OS Type: eg. Windows
Target: Data SVM Each node requires minimumone LIF Lenovo Accredited Learning Provider
94
Initiator groups (igroups) are tables of FC protocol host WWPNs or iSCSI host node names. You can define igroups and map the igroups to LUNs to control which initiators have access to LUNs. In the example, the initiator uses the iSCSI protocol to communicate with the target. Typically, you want all of the host’s initiator ports or software initiators to have access to a LUN. In the example, there is a single host. The iSCSI Software Initiator iSCSI Qualified Name (IQN) is used to identify the host. Initiator groups can have multiple initiators, and multiple igroups can have the same initiator. However, you cannot map a LUN to multiple igroups that have the same initiator. An initiator cannot be a member of igroups of differing OS types. In the example, the initiator runs Windows. When multiple paths are created between the storage controllers and the host, the LUN is seen once through each path. When a multipath driver is added to the host, the multipath driver can present the LUN as a single instance. The figure illustrates two paths. The multipath driver uses asymmetric logical unit access (ALUA) to identify the path to the node where the LUN is located as the active “direct path.” The direct path is sometimes called the “optimized path.” The active path to the node where the LUN is not located is called the “indirect path.” The indirect path is sometimes called the “non-optimized path.” Because indirect paths must transfer I/O over the cluster interconnect, which might increase latency, ALUA uses only the direct paths, unless no direct path is available. ALUA never uses both direct and indirect paths to a LUN. Lenovo Accredited Learning Provider
94
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
iSCSI / FC Implementation Steps 1. 2. 3. 4.
Enable the iSCSI / FC functionality on the SVM (first time only) Create or identify the necessary resources (eg LIFs). Map the LUN to the appropriate igroup. Locate the LUN on the host computer and prepare the disk.
Lenovo Accredited Learning Provider
95
The figure shows the basic process for implementing the iSCSI protocol between an initiator and an ONTAP storage system. The process consists of several steps. First, you need to enable the iSCSI functionality and then enable the feature on the SVM. You must also identify the software initiator’s node name. Second, you need resources to map, so you create a volume, LUN, igroup, and data LIFs. Third, you determine which hosts have access to the resources and map the hosts to the LUN. Finally, the LUN is discovered on the host and prepared.
Lenovo Accredited Learning Provider
95
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Windows iSCSI Implementation Identify the iSCSI node name
iSCSI initiator name iqn.1991-05.com.microsoft:w2k12.learn.netapp.local
The prompt might appear the first time that you start the iSCSI initiator.
Lenovo Accredited Learning Provider
96
The iSCSI Software Initiator creates the iSCSI connection on the Windows host. The iSCSI Software Initiator is built in to Windows Server 2008 and Windows Server 2012. If the system has not used an iSCSI Software Initiator before, a dialog box appears, which requests that you turn on the service. Click Yes. The iSCSI Initiator Properties dialog box appears. You need to identify the iSCSI initiator name before you start the SVM create wizard.
Lenovo Accredited Learning Provider
96
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
LUN Creation Wizard: iSCSI LUN Creation
Click
Click
Lenovo Accredited Learning Provider
97
You view the steps to create an LUN for an iSCSI environment. The iSCSI protocol can also be enabled on an existing SVM by using ThinkSystem Storage Manager or the vserver iscsi create –vserver command. Verify that the operational status of the iSCSI service on the specified SVM is up and ready to serve data.
Lenovo Accredited Learning Provider
97
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
LUN Creation Wizard: iSCSI Configure iSCSI protocol: - Define iSCSI initiator
Click ‘Save’ To create LUN And map to host
Lenovo Accredited Learning Provider
98
The SVM creation wizard automatically creates a LIF on each node of the cluster. IP addresses can be assigned manually or automatically by selecting a subnet. To verify or modify the LIF configuration, select “Review or modify LIF configuration.” To create an iSCSI LIF manually, using either ThinkSystem Storage Manager or the CLI, you must specify the -role parameter as data and the –data-protocol parameter as iscsi. CLI LIF creation example: DM3000::> network interface create -vserver svm_black -lif black_iscsi_lif1 -role data -data-protocol iscsi home-node rtp-nau-01 -home-port e0e –subnet snDefault The SVM creation wizard also enables you to provision a LUN for iSCSI storage. Enter the size, the LUN OS type, and the IQN for the host initiator. NOTE: You should create at least one LIF for each node and each network on all SVMs that serve data with the iSCSI protocol. ONTAP recommends having network redundancy, either through multiple networks or link aggregation.
Lenovo Accredited Learning Provider
98
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
LUN Creation Wizard: iSCSI LUN summary
SVM
Volume name Initiator (host)
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
99
99
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
The NAS File System Client UNIX1
Client /mnt/vol01 1 1 1 1 1 0 0 0 0 01 1 1 1 010 100 101 011 010 100 101 01 1 1
WIN1 1 1 1 1 1 0 0 0 0 01 1 1 1 010 100 101 011 010 100 1 1 01 1 1 11
Disk 1 (C:) Disk 2 (E:) \\svm\vol02
2-node Cluster
NFS Volume
SMB Volume
Lenovo Accredited Learning Provider
100
NAS is a distributed file system that enables users to access resources, such as volumes, on a remote storage system as if the resources were on a local computer system. NAS provides services through a client-server relationship. Storage systems that enable file systems and other resources to be available for remote access are called servers. The server is set up with a network address and provides file-based data storage to other computers, called clients, that use the server resources. The ONTAP software supports the NFS and SMB protocols. (SMB is also known as CIFS.)
Lenovo Accredited Learning Provider
100
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
NFS Client UNIX1
/mnt/vol01 1 1 1 1 1 0 0 0 0 01 1 1 1 010 100 0 0 1 1 11 010 100 101 01 1 1
vol01 is exported to UNIX1 with read/write permission. UNIX1 mounts vol01 to /mnt/project with read/write permission.
vol01
Lenovo Accredited Learning Provider
101
NFS is a distributed file system that enables users to access resources, such as volumes, on remote storage systems as if the resources were on a local computer system. NFS provides services through a client-server relationship. Storage systems that enable the file systems and other resources to be available for remote access are called servers. The computers that use a server's resources are called clients. The procedure of making file systems available is called exporting. The act of a client accessing an exported file system is called mounting. When a client mounts a file system that a server exports, users on the client computer can view and interact with the mounted file systems on the server within the permissions granted.
Lenovo Accredited Learning Provider
101
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
NFS Implementation Steps 1. Enable the NFS functionality on the SVM (only first time) 2. Create or identify the necessary resources (eg. LIF) 3. Export the available resources. 4. Configure NFS authentication (export policy) 5. Authorize the user. 6. Mount the exported resources.
Lenovo Accredited Learning Provider
102
The figure shows the basic process for implementing the NFS protocol between a UNIX client and an ONTAP storage system. The process consists of several steps. First, you need to enable the NFS functionality and then enable the feature on the SVM. Second, you need resources to export, so you create volumes, qtrees, and data LIFs. Third, you determine which clients have which type of access to the resources. You need a way to authenticate client access and authorize users with appropriate permissions, including read-only or read/write. Finally, when the client has been granted access to the exported resource, the client mounts the resource and grants access to the users.
Lenovo Accredited Learning Provider
102
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM Create Wizard: NFS SVM basic details
Create
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
103
103
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM Create Wizard: NFS Configure the NFS protocol
Select an IP address from the subnet?
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
104
104
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM Create Wizard: NFS SVM administrator details Create an SVM administrator.
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
105
105
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
CIFS Client WIN1 1 1 1 1 1 0 0 0 0 01 1 1 1 010 100 101 011 010 100 1 1 01 1 1 11
Disk 1 (C:) Disk 2 (E:) \\Team1\vol01
vol01
Lenovo Accredited Learning Provider
106
CIFS is an application-layer network file-sharing protocol that the Microsoft Windows operating system uses. CIFS enables users or applications to access, read, and write to files on remote computers like on a local computer. A user or application can send network requests to read and write to files on remote computers. Messages travel from the network interface card (NIC) of the user’s computer, through the Ethernet switch, to the NIC of the remote computer. CIFS provides access to files and directories that are stored on the remote computer, through sharing resources. The network read and write process, which is also called network I/O, is controlled by the rules of network protocols, such as IPv4 and IPv6.
Lenovo Accredited Learning Provider
106
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
CIFS Implementation Steps 1. 2. 3. 4. 5. 6. 7.
Enable the CIFS functionality on the SVM (first time only) Create or identify the necessary resources (eg. LIF) Share the available resources. Check Date/Time, DNS Configure CIFS authentication. Authorize the user. Map the shared resources.
Lenovo Accredited Learning Provider
107
The figure shows the basic process for implementing the CIFS protocol between a Windows client and an ONTAP storage system. The process consists of several steps. First, you need to enable the CIFS functionality and then enable the feature on the SVM. Second, you need resources to share, so you create volumes, qtrees, and data LIFs. Third, you determine which clients have which type of access to the resources. You need a way to authenticate client access and authorize users with appropriate permissions, including read-only or read/write. Finally, when the client has been granted access to the shared resource, the client maps the resource and grants access to the users.
Lenovo Accredited Learning Provider
107
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM Create Wizard: CIFS SVM basic details
Create
Select
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
108
108
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM Create Wizard: CIFS SVM basic details
Click
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
109
109
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM Create Wizard: CIFS Configure the CIFS protocol
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
110
110
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SVM Create Wizard: CIFS SVM administrator details
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
111
111
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Snapshot Copies
Lenovo Accredited Learning Provider
112
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Snapshot Copy Technology Create Snapshot copy 1
File or LUN
Volume
Blocks on Disk
A
A
B
B
C
C
1.
Create Snapshot copy 1:
– Pointers are copied. – No data is moved.
A B C Snapshot Copy 1 Lenovo Accredited Learning Provider
113
Understanding the technology that is used to create a Snapshot copy helps you to understand how space is used. Furthermore, understanding the technology also helps you to understand features such as FlexClone technology, deduplication, and compression. A Snapshot copy is a local, read-only, point-in-time image of data. Snapshot copy technology is a built-in feature of WAFL storage virtualization technology and provides easy access to old versions of files and LUNs. When ONTAP creates a Snapshot copy, ONTAP starts by creating pointers to physical locations. The system preserves the inode map at a point in time and then continues to change the inode map on the active file system. ONTAP then retains the old version of the inode map. No data is moved when the Snapshot copy is created. Snapshot technology is highly scalable. A Snapshot copy can be created in a few seconds, regardless of the size of the volume or the level of activity on the ONTAP storage system. After the copy is created, changes to data objects are reflected in updates to the current version of the objects, as if the copy did not exist. Meanwhile, the Snapshot copy of the data remains stable. A Snapshot copy incurs no performance overhead. Users can store as many as 255 Snapshot copies per volume. All the Snapshot copies are accessible as read-only and online versions of the data.
Lenovo Accredited Learning Provider
113
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Snapshot Copy Technology Continue writing data
C’
Volume
Blocks on Disk
A
A
B
B
C
C
1. 2.
Create Snapshot copy 1. Continue writing data:
• Data is written to a new location on the disk. • Pointers are updated.
C’
A B C Snapshot Copy 1 Lenovo Accredited Learning Provider
114
When ONTAP writes changes to disk, the changed version of block C is written to a new location. In the example, C’ is the new location. ONTAP changes the pointers rather than moving data. The file system avoids the parity update changes that are required if new data is written to the original location. If the WAFL file system updated the same block, then the system would need to perform multiple parity reads to update both parity disks. The WAFL file system writes the changed block to a new location, again writing in complete stripes and without moving or changing the original data blocks.
Lenovo Accredited Learning Provider
114
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Snapshot Copy Technology Create Snapshot copy 2
Volume
Blocks on Disk
A
A
B
B
C’
C
1. 2. 3.
Create Snapshot copy 1. Continue writing data. Create Snapshot copy 2:
• Pointers are copied. • No data is moved.
C’
A
A
B
B
C
C’
Snapshot Copy 1
Snapshot Copy 2
Lenovo Accredited Learning Provider
115
When ONTAP creates another Snapshot copy, the new Snapshot copy points only to the unchanged blocks A and B and to block C’. Block C’ is the new location for the changed contents of block C. ONTAP does not move any data; the system keeps building on the original active file system. The method is simple and so is good for disk use. Only new and updated blocks use additional block space.
Lenovo Accredited Learning Provider
115
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Snapshot Copy Design • • • • •
Understand that Snapshot copy design is highly dependent on the customer environment. Study the customer recovery time objective (RTO) and recovery point objective (RPO) requirements. Do not create more Snapshot copies than necessary – max 1023 per volume Check and adjust the aggregate and volume Snapshot copy reserve defaults. To control storage consumption, configure Snapshot copy automatic deletion and volume automatic increase.
Lenovo Accredited Learning Provider
116
Snapshot copies are the first line of defense against accidental data loss or inconsistency. Before you implement a Snapshot copy solution, you should thoroughly understand the customer needs and environment. Each customer has unique requirements for the recovery time objective (RTO) and recovery point objective (RPO). RTO The RTO is the amount of time within which the service, data, or process must be made available again to avoid undesirable outcomes. RPO The RPO is a point to which data must be restored or recovered to be acceptable to the organization’s acceptable data loss policy. To provide efficient use of disk space, deploy only the required number of Snapshot copies on each volume. If you deploy more Snapshot copies than are required, the copies consume more disk space than necessary. You might need to adjust default settings for the Snapshot copy reserve for volumes and aggregates: • The Snapshot copy reserve guarantees that you can create Snapshot copies until the reserved space is filled. • When Snapshot copies fill the reserved space, then Snapshot blocks compete for space with the active file system.
Lenovo Accredited Learning Provider
116
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
The Snapshot Policy Automatically manage Snapshot copy schedules and retention.
Snapshot Policy Job Schedule
SVM Cluster
FlexVol Volume
Lenovo Accredited Learning Provider
117
A Snapshot policy enables you to configure the frequency and maximum number of Snapshot copies that are created automatically: You can create Snapshot polices as necessary. You can apply one or more schedules to the Snapshot policy. The Snapshot policy can have zero schedules. When you create an SVM, you can specify a Snapshot policy that becomes the default for all FlexVol volumes that are created for the SVM. When you create a FlexVol volume, you can specify which Snapshot policy you want to use, or you can enable the FlexVol to inherit the SVM Snapshot policy. The default Snapshot policy might meet your needs. The default Snapshot copy policy is useful if users rarely lose files. For typical systems, only 5% to 10% of the data changes each week: six daily and two weekly Snapshot copies consume 10% to 20% of disk space. Adjust the Snapshot copy reserve for the appropriate amount of disk space for Snapshot copies. Each volume on an SVM can use a different Snapshot copy policy. For active volumes, create a Snapshot schedule that creates Snapshot copies every hour and keeps them for just a few hours, or turn off the Snapshot copy feature. You back up Snapshot copies to the vault destination. If an empty label ("") is specified, the existing label is deleted.
Lenovo Accredited Learning Provider
117
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Typical Workflow 1. 2. 3.
Create a job schedule or use the default. Create a Snapshot policy, and then specify the job schedule. Assign the Snapshot policy to a FlexVol volume, or inherit a Snapshot policy from the SVM.
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
118
118
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Snapshot Copy Technology Restore from a Snapshot copy
Volume
Blocks on disk
A
A
B
B
C’ C
C
•
•
C’
•
A
A
B
B
C
C’
Snapshot Copy 1
Snapshot Copy 2
To restore a file or LUN from Snapshot copy 1, use SnapRestore data recovery software. Snapshot copies that were created after Snapshot copy 1 are deleted. Unused blocks on disk are made available as free space.
Lenovo Accredited Learning Provider
119
Suppose that after the Snapshot copy is created, the file or LUN becomes corrupted, which affects logical block C’. If the block is physically bad, RAID can manage the issue without recourse to the Snapshot copies. In the example, block C’ becomes corrupted because part of the file is accidentally deleted. You want to restore the file. To easily restore data from a Snapshot copy, use the SnapRestore feature. SnapRestore technology does not copy files. SnapRestore technology moves pointers from files in the good Snapshot copy to the active file system. The pointers from the good Snapshot copy are promoted to become the active file system pointers. When a Snapshot copy is restored, all Snapshot copies that were created after that Snapshot copy are destroyed. The system tracks links to blocks on the WAFL system. When no more links to a block exist, the block is available for overwrite and is considered free space. Because a SnapRestore operation affects only pointers, the operation is quick. No data is updated, nothing is moved, and the file system frees any blocks that were used after the selected Snapshot copy. SnapRestore operations generally require less than one second. To recover a single file, the SnapRestore feature might require a few seconds or a few minutes.
Lenovo Accredited Learning Provider
119
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Snapshot Visibility to Clients Enable client access to a Snapshot directory.
DM3000::> vol modify –vserver svm_Team1 –volume Team1_vol002 –snapdir-access true DM3000::> vserver cifs share modify –vserver svm_Team1 –share-name Team1_vol2 –share-properties showsnapshot Lenovo Accredited Learning Provider
120
CLI commands are available to control visibility from NAS clients of Snapshot directories on a volume. NOTE: Show Hidden Files and Folders must be enabled on your Windows system. Access to .snapshot and ~snapshot is controlled at the volume level by setting the – snapdir-access switch. You can also control access to ~snapshot from CIFS clients at the share level with the showsnapshot share property.
Lenovo Accredited Learning Provider
120
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Introducing FlexClone Application development and test – Instantaneous replica of a volume – Any database environment – Commercial & Embedded Software Development
– ERP, CRM, Decision Support applications
Server and desktop virtualization – Instantaneous replica of a file or LUN – Create low overhead “gold images” – Provision thousands of virtual desktops Lenovo Accredited Learning Provider
121
FlexClone software represents a dramatic breakthrough when you need to have multiple copies of data which can be modified for various uses in your organization. It is particularly well suited for: • Software application development and test where multiple developers need individual copies of production level data to work with. • Provisioning for virtual infrastructure where many copies of similar but not identical data set images are needed.
Lenovo Accredited Learning Provider
121
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Volume Level Cloning
FlexClone®
Cloned volume: a transparent writable layer in front of Snapshot™
Snapshot of the volume Snapshot
Active volume to be cloned Active volume Lenovo Accredited Learning Provider
122
FlexClone replicas can be created for complete data volumes or at a more granular level, if needed. This graphic represents volume level cloning. In terms of technology, you can think of a volume level FlexClone as a transparent, writable layer which sits in front of a Snapshot copy. Like the Snapshot on which it is based, FlexClone simply points to any shared data in the source volume, so the only new storage capacity needed is for unique changes stored for each cloned copy.
Lenovo Accredited Learning Provider
122
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
File and LUN Level Cloning
Cloned file: an independent, space efficient data replica FlexClone®
File or LUN to be cloned File or LUN in active volume Lenovo Accredited Learning Provider
123
In some cases, you may need to create data replicas at a more granular level than complete volumes. FlexClone provides the option to create clones at the file or LUN level and in this case, there is no dependency upon a Snapshot copy of the parent volume. As in the volume cloning example, however, file and LUN clones are 100% space efficient and can be created instantly.
Lenovo Accredited Learning Provider
123
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Storage Efficiency
Lenovo Accredited Learning Provider
124
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Proven Efficiency Drive storage cost reductions: Lower CapEx and OpEx
1PB of storage in a 2U rack space Data growth RAID-TEC™ and RAID DP® technologies
Storage Cost
Snapshot® technology Thin provisioning Cloning Inline deduplication Inline adaptive compression
2+ racks
•
event log show
• Each event contains the following: – – – –
Message name Severity level Description Corrective action, if applicable
Lenovo Accredited Learning Provider
163
The event management system (EMS) collects and displays information about events that occur in a cluster. You can manage the event destination, event route, mail history records, and SNMP trap history records. You can also configure event notification and logging.
Lenovo Accredited Learning Provider
163
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
System Logs • Log messages can be sent to the following: – The console – The message log
• You can access the message log by using the following: – The debug log command – ThinkSystem Storage Manager – A web browser: http://cluster-mgmt-ip/spi/svl-nau-01/etc/log/
Use the debug log command to browse the messages.log file. Lenovo Accredited Learning Provider
164
The system log contains information and error messages that the storage system displays on the console and logs in message files.
Lenovo Accredited Learning Provider
164
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Console on Boot SP node2> system console Type Ctrl-D to exit. LOADER> LOADER> boot_ontap ... ******************************* * * * Press Ctrl-C for Boot Menu. * * * ******************************* ...
Lenovo Accredited Learning Provider
165
Typical boot sequence: 1. Loads the kernel into memory from the boot device 2. Mounts the “/” root image from rootfs.img on the boot device 3. Loads Init and runs start-up scripts 4. Loads NVRAM kernel modules 5. Creates /var partition on NVRAM (restored from the boot device if a backup copy exists) 6. Starts management processes 7. Loads the data and network modules 8. Mounts the vol0 root volume 9. Is ready for use
Lenovo Accredited Learning Provider
165
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Boot Menu
Boot Menu will be available. Please choose one of the following: (1) Normal Boot. (2) Boot without /etc/rc. (3) Change password. (4) Clean configuration and initialize all disks. (5) Maintenance mode boot. (6) Update flash from backup config. (7) Install new software first. (8) Reboot node. (9) Configure Advanced Drive Partitioning Selection (1-9)?
Lenovo Accredited Learning Provider
166
To access the boot menu, you must press Ctrl+C. Select one of the following options by entering the corresponding number: 1. Normal Boot: Continue to boot the node in normal mode. 2. Boot without /etc/rc: This option is obsolete—it does not affect the system. 3. Change password: Change the password of the node, which is also the “admin” account password. 4. Clean configuration and initialize all disks: Initialize the node disks and create a root volume for the node. NOTE: This menu option erases all data on the disks of the node and resets your node configuration to the factory default settings. 5. Maintenance mode boot: Perform aggregate and disk maintenance operations and obtain detailed aggregate and disk information. To exit Maintenance mode, use the halt command. 6. Update flash from backup config: Restore the configuration information from the node’s root volume to the boot device. 7. Install new software first: Install new software on the node. NOTE: This menu option is only for installing a newer version of ONTAP software on a node that has no root volume installed. Do not use this menu option to upgrade ONTAP. 8. Reboot Node: Reboot the node.
Lenovo Accredited Learning Provider
166
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Additional Software for DM Series Storage - Overview
Lenovo Accredited Learning Provider
167
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Basic
Complexity of Configuration Complex
Management Software Portfolio
Management at Scale, Automated Storage Processes, and Data Protection
Unified Manager and Workflow Automation Simple, Web-Based Tool that Requires No Storage Expertise
ThinkSystem Storage Manager ONTAP Storage Lenovo Accredited Learning Provider
168
There are many management tools from which to choose. Although ThinkSystem Storage Manager provides simplified device-level management and OnCommand Unified Manager can be used to monitor cluster resources at scale, both products are used to monitor only ONTAP storage systems. ONTAP OnCommand Insight enables storage resource management, including configuration and performance management and capacity planning, along with advanced reporting for heterogeneous environments.
Lenovo Accredited Learning Provider
168
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
ThinkSystem Storage Manager Dashboard
Lenovo Accredited Learning Provider
169
The ThinkSystem Storage Manager dashboard shows at-a-glance system status for a storage system. The dashboard displays vital storage information, including efficiency and capacity use for various storage objects, such as aggregates and volumes.
Lenovo Accredited Learning Provider
169
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
OnCommand Unified Manager
Lenovo Accredited Learning Provider
170
By using OnCommand Unified Manager, you can configure global threshold values for all of your aggregates and volumes to track any threshold breaches. Events are notifications that are generated automatically when a predefined condition occurs or when an object crosses a threshold. The events enable you to act to prevent issues that can lead to poor performance and system unavailability. Events include an impact area, severity, and impact level. Events are categorized by the type of impact area, such as availability, capacity, configuration, or protection. You can create alerts to notify you when a particular event is generated. You can create alerts for a single resource, group of resources, and events of a particular severity type. You can specify the frequency with which you want to be notified. You can integrate OnCommand Workflow Automation with Unified Manager to run workflows for your storage classes. You can also monitor storage virtual machines (SVMs) that have an infinite volume but do not have storage classes. When Unified Manager is integrated with OnCommand Workflow Automation, the reacquisition of Workflow Automation cached data is triggered.
Lenovo Accredited Learning Provider
170
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
SnapCenter software Unified, scalable software for data protection and clone management
Host
Host
Host
PlugIn
Plug-In
PlugIn
SnapCenter SnapCenter
® Server(s) SnapCenter Server(s) Server
NetApp® Storage Systems
Community Supported: Management Data
Lenovo Accredited Learning Provider
171
SnapCenter is management software developed by NetApp that represents the upcoming generation of application-centric data protection management for DM Series storage. It is designed for the Data Fabric and offers a modern architecture with simplicity and performance in mind. Standard licenses are included with the purchase of the DM Series Storage system. Application integration includes plug-ins for the following applications: - Oracle database - SAP HANA - Microsoft SQL Server - Microsoft Exchange Server (requires SnapCenter 4.0+) - VMware VMs A plug-in creator capability allows customers to create plug-ins for in-house applications or other applications of choice. Many plug-ins are already available and supported, including: - DB2 - MongoDB (July 2017) - MySQL
Lenovo Accredited Learning Provider
171
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Let’s break down the diagram: • In the middle, we are introducing a new product, the SnapCenter Server: – The SnapCenter Server is architected for centralized management and high availability and load balancing. – SnapCenter also provides a common GUI for ease of management across the IT infrastructure and provides role-based access control (RBAC) for delegated management while preserving central oversight. • On the left, we are showing the SnapCenter plug-ins that are installed on each host by using the SnapCenter Server: – These lightweight application, database, and OS plug-ins offer role-specific functions and workflows. • SnapCenter Server and plug-ins talk to ONTAP based storage. SnapCenter software is designed for multiplatform support, meaning that eventually it might work with more than ONTAP supported storage systems. • Along with multiplatform support, SnapCenter is also designed to support multiple hypervisors.
Lenovo Accredited Learning Provider
171
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Other Tools • Config Advisor – For validation of ONTAP Cluster configuration after the installation or Operational Healthcheck
• Host Utilites for Windows & Linux – Multipath drivers
• AntiVirus report – This package enables support to configure AntiVirus scanning on ONTAP enabled SVMs
• Virtual Storage Console: – This is a product suite that provides support as a VASA Provider and SRA in vCenter Server.
• SnapDrive for Windows & Linux • MIBs • MetroCluster Tiebreaker All of them available on https://datacentersupport.lenovo.com Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
172
172
Lenovo DM Storage – Technical Workshop – Student Lesson Guide
Course Summary In the course you have learned about the following topics: • Lenovo DM Series Overview • ONTAP Cluster, Management, Network Configuration, Architecture • Data Access NAS / SAN • Snapshots • Storage Efficiency – Deduplication, Compression, Compaction • Disaster Recovery & Continuous Availability – SnapMirror, SnapVault, MetroCluster • Other ONTAP features – SnapLock, Quality of Service, FabricPool • Cluster Maintenance • Additional Software
Lenovo Accredited Learning Provider
Lenovo Accredited Learning Provider
173
173
