May 19, 2012

Setup Guide for Multiple NetApp ONTAP 8.1 Simulators

I have written previously on deploying the ONTAP simulator on a vSphere host, and they seem to be some of my more popular posts.  Now that the ONTAP 8.1 simulator has been released, I thought I would do an updated post that is a little more comprehensive than my previous posts.

In my most recent post on this topic, I ran through the configuration I use to optimize usable space and getting necessary license keys installed.  I wanted to build on that for the 8.1 simulator, and specifically about getting multiple simulators to work with OnCommand.  If you install multiple copies of the simulator and then try to add them into the NetApp Management Console, you will get an error similar to this:

Even though they are separate virtual machines and have different IP addresses and hostnames, their simulator system id’s are identical so the NMC thinks it’s a duplicate host you are trying to add.  Luckily it is possible to change the serial number and system id so we can get multiple simulators added in and be able to utilize things like Protection Manager and Provisioning Manager.  The easiest way to do this is to change these values before you run the setup so you don’t have to reassign the disks.

To begin, I still utilize VMware converter to bring it into my vSphere environment.  There are other methods out there but this one has worked well for me.  I won’t screenshot the entire process as it’s mostly just taking the defaults and deciding what name you want to use etc, but here is the summary screen:

Summary screen for VMware Converter

I change the disk type to be thin provisioned instead of thick, I change the NICs to be the relevant networks for my lab, and finally I didn’t set it to power on just because I wanted to make sure I boot it into maintenance mode to change the serial number as soon as it boots up.  When it boots press a key other than enter to break the boot, then run the following commands to make this simulator unique (screenshot below):

set bootarg.nvram.sysid=1111111101
set SYS_SERIAL_NUM=1111111101
boot

Interrupt boot process to change serial number

These commands were documented in this post on the NetApp Communities, and I’ve followed the same pattern – 8 1′s with a unique two character string at the end that matches the hostname (e.g. STO-FAS1 is 01 STO-FAS2 is 02 etc)

After you hit enter to boot the simulator, you need to go into maintenance mode to wipe the config and setup the simulator, you need to hit control-C to bring up the boot menu and then option 4 for wiping the configuration:

Boot menu options

Once you run through the wizard, this is the config I apply (I usually use a text snippet to insert the following into  my SSH session):

options security.passwd.rules.enable off
snap reserve -A aggr0 0
snap sched -A aggr0 0
options autosupport.enable off
aggr options aggr0 raidsize 28
disk assign all
license add DZDACHD
license add PZKEAZL
yes
license add NAZOMKC
license add ANLEAZL
license add BSLRLTG
license add NQBYFJJ
license add ELNRLTG
license add MTVVGAF
license add BQOEAZL
license add RKBAFSN
license add HNGEAZL
license add BCJEAZL
license add DFVXFJJ
license add XJQIVFK
license add DNDCBQH
license add JQAACHD
license add ZYICXLC
license add PVOIVFK
license add PDXMQMI
license add RQAYBFE
license add ZOFNMID
license add ZOPRKAM
license add RIQTKCL
ndmpd on
options nfs.export.auto-update off

I turn off the password rules since this is just my lab and I typically use a very easy password (yep, you probably already guessed it) for most of the lab stuff that can only be accessed from inside.

Next step is to add some more disks in the simulator, this info was found on this thread over on the NetApp Communities.  Not all of the commands worked for me, in part 2 step 3 I wasn’t able to successfully enter those commands.  It mentions that was a glitch in the way the program was complied so I’m just guessing that it may now be resolved and not necessary now as without it I still was able to add disks without issue.

priv set advanced
useradmin diaguser unlock
useradmin diaguser password

Enter a password to use for the diaguser (again, it’s my lab so I use a relaxed password)

systemshell

Login with the user diag and the password you just created

setenv PATH "${PATH}:/sim/bin"
cd /sim/dev
sudo makedisks.main -n 14 -t 23 -a 2
sudo makedisks.main -n 14 -t 23 -a 3
exit
useradmin diaguser lock
priv set admin
reboot

After the system comes back up, login and we can assign the new disks

disk assign all

If you run into an error where you get a bad disk label, that can be easily fixed by:

aggr status -f

This output will give you the list of the failed disks, make note of the disk ids – they should be similar to v6.32

priv set advanced
disk unfail -s v6.32

At this point you should have a total of 56 disks on the simulator, with an aggregate raid group size of 28. I added 52 of the disks into my aggregate to leave 1 as a spare so I don’t constantly get errors about low spare count (you can disable the option to warn you about low spares but unfortunately that only works on systems with 16 disks or less).

aggr add aggr0 52

Now you should have the first simulator completed, I took a VM snapshot at this point to be able to revert to after I do my testing.  Next up is configuring the second simulator, obviously the VMware Converter steps are basically identical except for the VM name so I won’t repeat that part.  The only thing to be aware of is when you first power on the VM, press a key other than enter just like you did previously so we can set a different serial number:

 

Configuring unique serial number and system id on second simulator instance

Run through the rest of the configuration steps above and now you should be able to add both simulators into the NetApp Management Console:

Both simulators showing within the NetApp Management Console. Click for larger image.

Hopefully that helps you get started with the ONTAP 8.1 simulator, I’ll have some more posts coming up that will build off of this.

Popularity: 35% [?]

Getting Started with the NetApp ONTAP 8.0.1 Simulator

2011-12-01 Update: I have a new post on using the latest version of the NetApp ONTAP Simulator (8.1) here, follow those instructions to deploy the newest  simulator in your environment.

Now that the ONTAP 8.0.1 simulator is (finally) available, I thought I’d mention a few basic tweaks to get the most out of running the sim.  There are some settings that you probably don’t need enabled when running a simulator (such as AutoSupport) and also since it comes with 28Gb worth of “disk” you would likely want to maximize the usable space.

If you want to use the 8.0.1 simulator on a VMware ESX or ESXi server, see my other post on this – the same steps still work.

The first thing I normally do on the simulator is disable AutoSupport, theres really no reason to have AutoSupports enabled on a system I’m using for testing purposes.

options autosupport.enable off

Next up is assigning the rest of the disks, by default it only assigns the minimum disks required to boot up the system (3 for RAID-DP) and there are 25 other disks to assign to the system.

disk assign all

Now we need to add the license keys, the following license keys work for the simulator (note, these will not work on a physical system):

a_sis                   MTVVGAF
cifs	                DZDACHD
disk_sanitization	    PZKEAZL
http	                NAZOMKC
flex_clone	            ANLEAZL
iscsi	                BSLRLTG
multistore	            NQBYFJJ
nearstore_option        ELNRLTG
nfs	                    BQOEAZL
smdomino	            RKBAFSN
smsql	                HNGEAZL
snapmanagerexchange	    BCJEAZL
snapmirror	            DFVXFJJ
snapmirror_sync	        XJQIVFK
snaprestore	            DNDCBQH
snapvalidator	        JQAACHD
sv_linux_pri	        ZYICXLC
sv_ontap_pri	        PVOIVFK
sv_ontap_sec	        PDXMQMI
sv_unix_pri	            RQAYBFE
sv_windows_ofm_pri    	ZOFNMID
sv_windows_pri	        ZOPRKAM
syncmirror_local   	    RIQTKCL

Note: These licenses are also listed on this NetApp Communities page, my list does not include the licenses that do not work on the 8.0.1 simulator (such as FCP or Snaplock).  Also, you will want to run cifs setup and iscsi start after you enter the license keys in.

At this point we need to decide how to carve up the remaining disks, the root volume is on a 3 disk aggregate which is 32 bit.  We could assign the remaining disks into the existing aggregate or we could also create a new 64 bit aggregate if we wanted (although since we won’t come anywhere near maxing out a 32 bit aggregate I’m going to continue down that route).  Keep in mind if you decide to use a 64 bit aggregate, that now in 8.0.1 you can have the root volume on a 64 bit aggregate although there are some challenges getting the data from a 32 bit aggregate to a 64 bit aggregate – I’ve just used the ndmpcopy command to do it.

The default RAID group size is 16, since I don’t want to lose 2 more of my “disks” to parity drives, I’m going to set the RAID group size to 28.

aggr options aggr0 raidsize 28

Now we can add the remaining spare disks into the aggregate, I’m going to add all of them in leaving no spares.  Normally there is an option to disable the complaining about no spare disks – options raid.min_spare_count but unfortunately that doesn’t work with more than 16 drives on the system.  If you don’t want to see that error just add 24 instead of 25 for the following step:

aggr add aggr0 25

Next up is to reclaim the aggregate snap reserve space of 5%

snap reserve -A aggr0 0
snap sched -A aggr0 0

That should be enough to get you going, the nice part about the 8.0.1 simulator is it allows you to play around with VAAI with vSphere 4.1 (using iSCSI).  I’ll cover that in my next post.

Popularity: 55% [?]

Use ONTAP 8.0 7-Mode Simulator on ESX

2011-12-01 Update: I have a new post on using the latest version of the NetApp ONTAP Simulator (8.1) here, follow those instructions to deploy the newest  simulator in your environment.

If you want to use the ONTAP 8.0 7-mode simulator in ESX the process is actually pretty simple, personally I wish NetApp would just offer an OVF format for the simulator but anyways…

Create a new VM in the vSphere Client and select Custom, assign a name to the VM, a resource group and select the datastore to place the VM files on.  Then you will be at the Virtual Machine Version screen.

Select Virtual Machine Version 7 and click Next

Select Other and choose FreeBSD 64bit from the drop down and click Next

Select 2 Virtual CPUs and click Next

Assign 2 GB RAM and click Next

Chose 4 NICs, in my case I placed the 1st and 3rd NIC on my VM network and the 2nd and 4th NIC on the Storage Network.  Click Next

Leave the default on SCSI controller and click Next

Select Do Not Create Disk and click Next

Click Finish

Now you need to copy the .vmdk files(including the cf card folder) from the ZIP into the directory you created the FreeBSD VM.  After you do that go into the VM properties and add hard disk choosing Use an Existing Virtual Disk. Browse to the VM location.

The first disk you want to add is the larger of the two with ‘cf’ in the name, after you add this disk add the other disk as well (I used default options for IDE controller etc).

That’s all there is to it, from this point you can follow the manual to setup the simulator.

After you power it on press ctrl-c and then select option 4.

Popularity: 100% [?]