May 18, 2012

Using Compression with SnapMirror transfers in ONTAP 7.3.2

One of the new features in Data ONTAP 7.3.2 is that you can now enable compression for your SnapMirror/SnapVault transfers.  This is great news for customers with limited bandwidth on their WAN links.  We have had customers in the past in this situation with SnapMirror transfers that would never finish and they had to look into WAN accelerators, nice to know that now there may be another option that in included free with ONTAP 7.3.2.  The compression is done on the controllers by using a standard gzip compression.

Obviously you need to be aware that enabling compression will add additional load onto your system but keep in mind you can use FlexShare to set lower priority to system level (e.g. SnapMirror) operations.  Another thing to keep in mind is that FlexShare is assigned per volume, so it doesn’t have to assign ALL of your SnapMirror transfers a low priority.

Enabling compression is as easy as modifying the /etc/snapmirror.conf file, you can enable compression on existing SnapMirror relationships.  The changes you need to make are as follows:

At the top of snapmirror.conf you need to establish a connection name and assign the source and destination filers to it.  For my example this will be:

sm1=multi(940-1,940-2)

<connection name>=multi(<sourcefiler>,<destinationfiler>)

Now you need to modify the existing line for the SnapMirror schedule, my example looks like this:

sm1:test_vol 940-2:test_vol_recv compression=enable – 10 * * *

Example:

For my example I was setting this up on a FAS940, I ran ‘sysstat –s 1’ before running the snapmirror and it averaged about 1% CPU usage

Source NetApp:

Destination NetApp:

After kicking off the initial snapmirror transfer I re-ran the same command and it returned an average CPU usage of 72% on the destination and 100% on the source.

Source NetApp:

Destination NetApp:

So again if you have a busy system, you will need to decide if the decreased WAN traffic outweighs the added load on your system.  I kicked off a ‘snapmirror initialize’ and then monitored the transfer with ‘snapmirror status -l’ and saw that I was getting a steady 8:1 compression ratio on my transfer.

Popularity: 20% [?]

Error opening NZB files in Snow Leopard

For some reason in Snow Leopard when you open a .nzb file in Safari it is marked as a quarantined file and gives the error “<filename>.nzb is an application downloaded from the Internet.  Are you sure you want to open it?”

Annoying, I searched a bit for how to get rid of it – I assumed it would be easy, an option to allow *.nzb but it is not.  The two main options I found were to run an Automator script on the Downloads folder (this didn’t work for me) or edit a .plist file which also didn’t work.

Since I already use Hazel (great app btw) I made a script that can handle this for me, it marks the file as safe, opens it automatically with the default application, moves the .nzb file to the trash and makes a growl notification for me.

Screen shot 2009-11-08 at 1.12.21 PM

Popularity: 2% [?]

NetApp Virtual Storage Console (VSC) for vSphere

NetApp released v1.0 of their VSC for VMware vSphere, VSC is a plugin for vCenter which allows anyone connecting with the VI Client to access it.  What is nice about the tool is it allows you to see an overview of your storage environment and ensure things are configured inline with NetApp’s recommended best practices and, if they aren’t, allows you to set the recommended values.

4072171914_c27283b945[1]

Click on the pictures for a larger view, you can see it adds a new tab called NetApp when the ESX server is selected.  In my environment we are using all NFS for storage to the ESX boxes, so in the next screen I show the ‘Storage Details – NAS’ option:

4071409815_03c2070da6[1]

What is nice about this view is I can quickly see I need to make a couple changes on the NetApp, the ucode settings should be set to on and the atime update should be set to on as well.

As mentioned before, there are also ESX specific settings that should be set to follow best practices, by right clicking on the ESX hosts listed in the NetApp tab (see 1st picture) there is an option to ‘Set Recommended Values’

4071409861_96e302a9c5_o[1]

Finally you can also set guest timeout settings, under the Tools option there is a download link for the .iso for Windows and Linux guests.  For some reason in my environment I couldn’t download the ISO from this page – if you have the same issue you can find it in the Program Files\NetApp\Virtual Storage Console\webapps\public folder.

Once you load the ISO in the VM, double clicking on the CD drive will ask you if you want to add the info in the windows_gos_timeout.reg file to the registry.

While I only have NFS mounted storage, you can also use the VSC to check things like:

  • Storage adapter timeout settings
  • Multipathing settings
  • Collecting diag info from fibre channel switches (or ESX hosts/NetApp controllers)

Also remember to check NetApp TR-3749 for best practices with NetApp and VMware vSphere.

Popularity: 10% [?]