Skip to content

New Server, New Software!

May 11, 2011

Last year when I wrote the post about my mini server its performance satisfied my need for a small device that was able to acquire and stream Xvid quality media to our devices around the house. Well with the upgrade at the beginning of the year to a HTPC that can handle full 1080p quality media I quickly realized that the back-end was going to require some upgrades too.

Hardware

Having a small device that I could stash in the corner of the office was great but suffered from one major flaw: 4 drives packed into that small space produced heat that killed hard drives at an extremely high rate.  Of course a second flaw was that it would never be able to grow past 4 drives. I now highly recommend that you do not try that similar build. Instead, I’ve opted for a mid-sized tower with 9 5 1/4 “ bays, giving me the ability to install up to 3 hard drive cages holding 5 drives each. Yes, this gives me the ridiculous ability to install up to 15 hard drives. In addition to the case upgrade I also too this opportunity to upgrade the rest of the components.


Here’s the full part list:

 

Case Hardware:

Software

For the operating system I stuck with Ubuntu 10.04. (long-term release) I have seen a lot of people in the media server community go with dedicated storage solutions like Windows Home Server or unRaid, but with the added complexity of Ubuntu (and once you get past the learning curve it’s really not that bad) comes a ton of additional capabilities and expansion options. I would dive into what you can do with Ubuntu that you can’t do easily with WHS or unRaid but the options on Linux are truly unlimited. The basic software layer is similar to what I used previously so I won’t go in to excruciating detail about the installation and configuration of Linux but I will make a few key notes about some of the tweaks:

  • The RAM does not default to the tighter timings when first booted. To get the performance you paid for, make sure you change the timing in the bios
  • The RAID setup is still as a soft RAID 5 array using mdadm (the native Linux soft RAID application) but since I am using “advanced format” drives I took care to partition each drive first to start on sector 64 instead of 63 so that the blocks would align correctly. Next, create the RAID device using the partitions and not the drives themselves.So, if your drives are /dev/had, /dev/hdb, and /dev/hdc, you would create the RAID using /dev/hda1 /dev/hdb1 and /dev/hdc1 so that it builds off the proper alignment. Further instructions are available here.
    • The read speed for this array is around 270 Mb/sec using hdparm
  • The move to a solid state drive requires some tweaking to get the best speed and life. I found a couple helpful articles here and here about how to do this

In my previous build I recommended a mix between torrents for TV shows and newsgroups for movies. You probably don’t need too many more reasons to abandon torrents but my main reason for switching over completely was that with my move to all HD content, newsgroups produce a much higher, consistent download speed and the programs for acquisition are more feature rich. To revisit how my media acquisition piece did work, it went like this:

  • TV Shows: Using an RSS feed from ShowRSS, my torrent program (torrentflux-b4rt) would scan the feed every 30 minutes for new content and download the show when it became available
    • After the show downloaded the Perl script SortTV would try to sort the TV shows by show name, season, and episode
    • Movies: Using an RSS feed from nzbs.org fed into the program Sabnzbd, movies I added to my “cart” on their website would be downloaded, unzipped, and filed into the movie directory

The new build keeps the same flow for movies, but adds a helper program that feeds TV shows into Sabnzbd from newsgroups as well, eliminating the complex torrent setup and sorting above.  The program I now use to feed TV shows into Sabnzbd is called Sickbeard. Not only does Sickbeard scan newsgroups (using a site like nzbs.org or nzbmatrix) for new TV shows, but it also sorts them and downloads their info/artwork from thetvdb.com, helps to back fill episodes your collection is missing, and updates XBMC after a download completes (amongst many other advanced features). Sickbeard gives you better organization of TV shows upon downloading them and doesn’t require another developer’s Perl script to make the magic happen. The best guide I’ve found for installing Sickbeard in Ubuntu is found here.

The features above really just scratch the surface of what this setup is capable of. I still use programs like ampache to listen to music when away, have installed a VPN server so I can always surf securely when using the internet at remote locations, and have my UPS system email me whenever the power goes out at the house. The bottom line here, is that if you can think up an application for the server, you should find a large community of people willing to help you out with it!

One final word on networking…

I was using both 802.11N and network over powerline to get the media from the old server to viewing devices around the house. With some movies requiring a constant 9MB/sec to stream, I took the plunge and ran Ethernet to my TV setup upstairs and the office. To keep the wireless signal strong around the rest of the house I’m now using two Netgear WNDR3700 (one v1 using dd-wrt and one v2) routers.  Remember, your network is only as strong as the weakest point!

7 Comments leave one →
  1. May 12, 2011 7:44 pm

    Hey,

    Interesting write up, and glad you found my guide helpful! If you’re looking for a similar program for movies I suggest taking a look at Couch Potato. I hope to have a guide out for it soon, but it’s much the same as Sick Beard.

    Cheers!
    daemox

    • May 12, 2011 8:21 pm

      Yes it was very helpful indeed! I actually had Couch Potato installed before I rebuilt my home server. Between that and Sickbeard, it’s pretty much the perfect setup. I only wish there was a Sickbeard-like program for music though I’m sure someone will develop one soon enough. The only reason I haven’t installed Couch Potato again (yet) is that I found myself checking the latest movie posts on a daily basis anyways to find other movies I might not have thought of.

      Thanks for reading my blog and keep up the great work yourself!

  2. May 31, 2011 8:16 am

    Will you please create an ubuntu PPA for SB?

    preferably with options stored in home dir (default) but data not stored on the boot drive

    • May 31, 2011 8:24 am

      You should request this from the software’s developer. I didn’t write SB. I don’t write or know how to write any software or make PPAs for that matter; I just use the software and try to help other people do the same. Also, the software is still in the alpha stage so there probably wouldn’t be an official PPA until it hit a release version.

  3. MoebiusTripp permalink
    June 23, 2011 2:46 pm

    Dave:

    I just noticed you were having issues with the WD green drives. The problem may be the head parking issue mentioned in this discussion: http://forums.storagereview.com/index.php/topic/27269-wd-greenpower-drives-head-parking-issue/

    If this seems likely, the firmware is available here: http://support.wdc.com/product/download.asp?groupid=609&sid=113

    I ran this before I built my storage array and I haven’t had one peep out of it yet.

    • June 23, 2011 3:20 pm

      Thanks for the suggestion! So far (*knocks on wood*) I have only had that one drive issue. I looked at the SMART data for the drives and they don’t appear to park nearly as often as the guy in that post saw them park. Mine are parking about once ever 14 minutes as opposed to 2. Of course, these are a little newer than his and came straight from WD so they could have already implemented a similar fix.

      When that one drive went out after a month I was so angry that I almost tossed the whole batch to go buy Spinpoints but I will definitely try this if I have problems in the future before taking any drastic measures… Thanks again!

Trackbacks

  1. How to make a Home Theater PC/ Storage Server as easy to use as a toaster « something tangential

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.