Saturday, January 29, 2011

Server room kit?

I feel like this is a question I've seen on here before, but some searching didn't do me any good. This looks similar, but I'm looking for stuff I leave there, not what's in my go-bag.

What would you say is indispensable equipment in your server room? I've inherited one that's a bit light on stuff (except for servers, those are in there). We're in the single digits of racks, if that matters.

I'm thinking of things like:

  • Cable labeler
  • Ethernet tester (copper at least, fibre if you need)
  • ... ?

Community wiki, because, really.

[Edit] I suppose it's important to say that it's a colo facility, kind of far from the office. No food, water, etc. :(

  • A big, big roll of sheet plastic and duct tape.

    For when the ceiling leaks (water), or someone decides they have to drill holes in the walls (dust tent), or when you have to rig up some emergency cooling.

    Bill Weiss : Ok... why? I'm intrigued.
    quack quixote : for sealing yourself in, of course. in case of zombie attack or world-ending virus. someone's got to keep the servers running, right?
    Massimo : It **will** get useful when some (l)user comes screaming in because he wants his data *immediately*.
    Massimo : Carpets can also be quite useful, you know.
    Bill Weiss : Fair enough. (15 character max)
    quack quixote : but carpets leak. sure, they're opaque, but you need that first layer to be waterproof or you'll end up with physical evidence all over the place.
    pboin : For when the ceiling leaks (water), or someone decides they *have* to drill holes in the walls (dust tent), or when you have to rig up some emergency cooling.
    quack quixote : @pboin: that's actually a really good reason. gonna add it into your answer so it's more obvious and detached from our collective sarcasm.
    From pboin
  • I'm looking for stuff I leave there, not what's in my go-bag.

    The only thing that should be stored in the server room is servers. Everything else should be stored nearby, but removed from the server room when not needed.


    To add a bit to my above statement. Colo's and Server rooms are two different animals. With colos you generally have your cage space and that is it - would be nice if they provided lockers for client use but they generally don't.

    Before we shutdown our colo we had a crash cart with the following:

    • Multiple screw driver sets - torx, phillips, flat head in a wide range of sizes
    • Battery Powered Drill with screw bits (and the charger)
    • CD Case with all needed software for all systems at that site
    • BERT tester
    • Cable making supplies - coil of cat5e, crimper/cutter tool, tester, tips
    • Small trashcan
    • Small key safe with keys for all the equipment front panel locks
    • Collection of spare screws
    • Spare lock box for tape transport
    • Leatherman Multitool (most useful!)
    ceejayoz : Some have server rooms that aren't conveniently located near additional secured storage space. I'd rather have equipment safely stored in a cabinet in the server room itself than trekking across a building because I forgot something I'd never use outside the room...
    Bill Weiss : Unfortunately, my servers are in a colo facility an hour from the office. Some things I just don't want to haul back and forth. Plus, I leave for there from different places: the office, my house, bars (when I'm really unlucky), etc. Otherwise, I'd be with you.
    Michael Stum : If you have space in your rack, I wouldn't be surprised if some company offers 19" lockable drawers...
    From Zypher
  • Larger, easier to handle screwdrivers, torx wrenches, wire cutters.

    The small packs are nice in an emergency, and they go with you, but trying to use those little guys for hours on end can begin to hurt your hands.

    Bill Weiss : Absolutely agreed.
    Posipiet : You may want to check out this system: It combines into a real proper screwdriver, locked tight. Available large and small. http://www.wiha.com/england/Onlineshop/Reversible-blade-systems/Wiha-SYSTEM-6-Sets/281T11-SYSTEM-6-reversible-blades-set-11-pcs
    From EricJLN
  • After years of replacing cordless screwdrivers because the NiCad battery wore out, the Flashcell cordless screwdriver is very welcomed.

    Bill Weiss : That's a neat looking tool.
    Marc-Andre R. : OMG I want one so badly :D But appear that it's not in sale anymore :( Can't find it...
    EricJLN : In Stock: http://www.amazon.com/Coleman-5-4V-Flashcell-Cordless-Screwdriver/dp/B001U8FF5Q
    Michael Stum : +1, awesome tool!
    From EricJLN
  • Rolling carts. For the single-digit server room you describe, one may be enough, although I'd guess you'd want 2 or more.

    Use them as a portable tool bin, an easy-to-move worktable, etc. Some setups might have a couple as wandering worktables, and another couple as dedicated terminal carts.

  • Zip ties, preferably in various colors, and some kind of snip (I use wire cutters) to cut them free.

    Velco ties for short-term binding.

    Keep the server room all pretty and neat.

    Posipiet : lets add some velcro ties, too
    Bill Weiss : I've read that zip ties aren't a good idea for Ethernet cables. A reference, though not a great one: http://www.lanshack.com/cat5e-tutorial.aspx . I don't know how accurate that is, but I've heard similar. However, velcro ties, I whole-heartedly agree.
    James : Urban myth. As long as you don't tighten the ties so tight that they cut into the cable you'll be fine...
    ceejayoz : Agreed with @James. There's no physical reason an inert plastic tie would be inherently bad.
    Bill Weiss : I think the concern is that it's easy to over-tighten those plastic ties. I didn't think that the plastic would set up an EM field or something :)
    Oskar Duveborn : I always use velcro ties for long-term binding as well, so much easier when the time comes to un-bind a run for whatever reason ^^
    EricJLN : @Oskar - one reason to use the zip ties is so that others don't unbind the run just because they came up with a reason. It creates a barrier to change - both for good and for ill. All in all, 6/half dozen, IMHO.
    From EricJLN
    • A workspace with enough room to work comfortably on a broken 19" server, with screen, keyboard, mouse. Separate from the racks.
    • An old PC. Optimally with controllers and slots to fit every piece of hardware you may have to analyze. Mine speaks SCSI wide & narrow, IDE, SATA, PCI, USB, Firewire 400. Keep a small stash of old computers, if you can. They will come and ask if you can rescue the data from this 5.25" disk one day.
    • A notebook on the side. The rescue PC has no internet connection, to make sure it cant be infected.
    • A big enough disk to put data on that you may have to rescue.
    • Room for spare parts and cables. Room for a museum of old stuff you might need for old systems.
    • Cart. In case you have heavy servers, a lift of some sort.
    • A selection of tools you know you will need. You can keep this small, if you have a complete set elsewhere.
    • Telephone with outside access, if your mobile doesnt allow that.
    • Pen and Paper.
    • Spare parts for your most important servers. If you have several identical machines, keep one spare. It is the organ donor. It may be used for testing new setups, but be prepared to rip it apart.
    • A few switches, network converters, cables of all kinds.

    Generally make the server room your fortress of solitude, where you can retreat when the brown stuff hits the rotating thing. Nothing like coming out smiling after one hour of hacking, and the broken server is back up, with all data.

    Helvick : Amen to point #1. As someone who has to regularly work for a couple of days at a stretch in customer server rooms the one thing that I find that is most frequently overlooked is a decent work surface. Doesn't have to be a full desk but as you say, big enough to open up a broken 19" server and take a screen, keyboard and mouse.
    Michael Stum : Just to add: A Chair. Really, sitting on the floor or standing for 2 hours just because some update/backup/rescue operation takes time sucks and may not be healthy.
    From Posipiet
  • Multiple spools of cat 5 cable, along with several boxes of RJ45 ends, because you know you want to use that cable-crimper you've been lugging in your go-bag.

    Bill Weiss : But, I don't want to make cables :( You're right though.
    Massimo : But you **will** need to.
    Joe : Most datacenters (think: private cages) will not allow you to run your own cable to their meet-me punch-down block; Instead, I recommend having a few spares of appropriate length and color pre-made.
    From EricJLN
  • I'd say these are something I've needed and I've started keeping in the Server Room kit:

    • Flashlight
    • Zip ties
    • Labeler
    • Dell DVDs so if I need to install something or get drivers I can get it from there instead of downloading them
    • A pen (many times I wanted to write something down and found my self with no pen or pencil
    • Sharpie to lable stuff if the labeler won't work
    quack quixote : better than just keeping your Dell DVDs, keep a latest-drivers archive on a handy network share. don't delete old driver versions, since you never know what new drivers might break (or not work with the ancient OS you're installing). having a DVD is handy, but not as handy as having any drivers you need ready to drop onto a thumbdrive, optical disc, or whatever.
    Chris S : A network boot image (or WinPE CD) for booting a borked computer and retrieving data without having to change any physical hardware.
    From Hondalex
  • A PC with a floppy disk drive and a DVD burner, and a stock of floppy disks and writable CDs/DVDs.

    A time will come when you will need to flash that firmware...

    Farseeker : Floppy Disk! The number of times I've been saved by that long-obsolete technology...
    Massimo : Not to speak about installing pre-Windows 2008 systems when a controller driver is needed...
    From Massimo
  • TOOLS!

    Keep them locked away in the server room so they don't go walk about...

    From James
  • I've seen some people mention zip ties, and while they are nice looking, I don't like them so much anymore anymore. I've come to prefer twist ties. They're easy to remove (don't require a tool to do so) and they are also easy to modify (if you need to add additional cables to the bundle). I picked up a spool of it from the gardening section of menards that comes with a cutter... that's similar to this...

    Joel : Have you tried the "releasable" cable ties? They have a little tab you can pinch and it releases the tie. They work really well, and for short term bundling, try velcro ties.
    Chris S : Velcro, it's cheap, comes in different colors, removable and less likely to dig into wires.
    From Brett G
  • A desk, so you can go in there and work when the "outside" world gets to be too much. Also a fold-up bed/cot, for those times when things get so bad you're too tired to drive home afterwards. Oh yeah, and a beer fridge won't go astray either.

    Personally, I've found one of the most valuable items to be a rechargeable torch (flashlight), mounted just inside the door. Non-rechargeable types have a habit of always being flat just when you need them most.

  • Aside from tools I would highly recomend a small first aid kit, and some nonmessy snack foods that keep in storage well. Being able to put a bandage on a paper cut or other small nick on the spot is nice insted on having to hunt down someone from security just for a small bandage. The snacks are good for when it has been two hours too long and you are still more or less stuck in the computer room.

    C. Ross : Forget papercut! Some of the worst cuts I've ever had have been from moving and cataloging old hardware, those steel cases can cut like a knife under the right(wrong?) circumstances. I used a paper towel and duck tape at the time, but a first aid kit would have been much appreciated.
    From joe
  • A small tool box to keep small tools mentioned above.

    From Chris
  • We have and use "community" fold-up tables and chairs in our colo areas. Provides the work surface, a place to sit and takes up little room when stowed.

    Also a light jacket for when it's 90 degrees outside, you're wearing shorts and a t-shirt and you end up spending most of the night in a 65 degree server room.

    Bill Weiss : The colo offering tables and chairs would be so nice... doubt it's going to happen, unless I want to cart the machines out to the break room.
    Keith Stokes : That's why the tenants do it themselves. A couple of cheap chairs and a table fit in-between racks pretty easily.
    Bill Weiss : Oh, I get it. Great idea!
  • Telephones as mentioned above, but with a long enough cord to take the handset to any cabinet. And yes, corded phones -- there's likely to be enough signal on whatever freq you choose for there to be a problem with cordless.

    While I'm on the subject, even if the site uses VOIP phones, you need a non-VOIP, non-PBX, direct line to handle the instances where the VOIP or PBX equipment is down.

    Other stuff that hasn't been mentioned: Printed reference material - phone numbers, networks, remote host dependencies, etc. Stuff that you might need to bring up the server where the online copies reside.

    Massimo : +1. Nothing worse than having critical info for fixing a server... on the same failed server.
    From mpez0
  • I'd add

    A magnifying glass** so you can read the ridiculously teeny-tiny writing you get on some equipment, and a mini-maglite so you can use it.

    ** yes, I am seriously old

    Bill Weiss : I'm completely with you on that one.
    Joe H. : For when it's in awkward places, I've been known to use a digital camera. (and then zoom in on the display, if necessary) It also keeps me from needing to copy down serial numbers while wedging my head into racks.
    From
  • Digital camera, so that when you have to unplug or move things, you can put them back the way they were.

    Joe H. : Cell phone cameras work okay for cabling ... but most can't handle the macro issues of shoving it between servers to snap a picture of a serial number.
  • Quality tools. Cheap tools like screwdrivers that the tips shear off when you're trying to remove that overtightened screw can ruin your day, especially if you're at the colo in a downtown urban centre at 3am, and there is nowhere within a hour drive (or commute) to get a replacement. They don't have to be top of the line machinist tools, but decent quality, not a bigbox / department store set bought on sale for $4.99. Wiha, Wera, Snap-On, and Klein Tools are recommended brands.

    And the right tools, that actually fit. Needing to open a case where the screws have been "stripped" due to screwdriver slippage, or using the wrong screwdriver is an act of unnecessary frustration.

    • Notebook and pen/pencils.
    • serial cable, USB to serial adapter (for laptop), null-modem connector, and serial to RJ-45 adapter for routers and switches (a cheap multi-cable for the DIY types)
    • cross-over ethernet cable (if not covered by previous)
    • install / recovery media, and portable hard drive for storage / backup
    • nut drivers, particularly for rack screw / nuts that can need more torque to loosen
    • bottled water (for colo); not a diuretic like soda or coffee, which forces bio-breaks
    • spare power cord - I always seem to end up short
    • compact keyboard
    • Cat-5/6 cable, plus RJ-45 connectors, and crimper, wire cutters, utility knife
    • Multi-tool, again quality one, e.g. Leatherman or Gerber
    • phone list / directory of contacts
    From mctylr
  • a small pry bar (I use a Stanley Wonder Bar II) has come in handy a number of times -- trying to get a tight server out of the rack; replacing swollen batteries out of a UPS. But it gets its most use when I have to shift everything in the rack up a couple of mm because the server I'm inserting is just a hair taller than whatever it was I just took out. (lossen a higher machine, lift it 'til it's tight against the one above it, tighten screws, repeat down the line).

    ... if you weren't in a colo, I'd also suggest a crash cart w/ serial terminal, and a lift cart (for those times when your management won't give you a maintenance window, and you really, really need to move that server; it also comes in handy when you don't have enough people to safely unrack that ancient 8U UPS, but can extend it far enough to get a lift under it)

    From Joe H.

0 comments:

Post a Comment