Racking and data center tips

Pre-Deployment Staging: Burn-In, Firmware Baseline and Asset Tags

A server that fails in its first week almost always failed on the bench first and nobody was watching. Memory that throws errors under load, a drive that drops out of the array under heat, firmware three revisions behind on the day it shipped, a RAID controller with a dead cache battery. All of it is easy to find in a staging area and expensive to find on site.

Staging means building the server completely somewhere you can work on it, running it hard for a day or two, bringing every piece of firmware to a known version, and tagging it, before it goes in a box for the site. The rack install then becomes a mechanical job.

Unbox, inspect, and check the order

Start with the boring part. Compare the shipping paperwork against the order and against what is actually in the chassis. Vendors make mistakes, and a server that arrived with the wrong drive size or one fewer DIMM than ordered is much easier to sort out in the staging room. Open the lid and look: every DIMM seated, every drive latched, no loose screws, the cache battery connected.

Log into the management controller as soon as it has power and pull the hardware inventory. On Dell that is the iDRAC system inventory or `racadm hwinventory`; on Lenovo the XClarity inventory page; on Supermicro the BMC's system page. Save the output to the project folder. It is the first entry in that server's record and the reference you compare against on site.

  • Compare the order, the packing slip and the physical contents.
  • Visual inspection with the lid off: DIMMs, drives, cache battery, cables, fans.
racadm -r 10.0.0.50 -u root -p <password> hwinventory > fs01-hwinventory.txt
racadm -r 10.0.0.50 -u root -p <password> getsvctag

Firmware baseline before anything else

Bring all firmware to a chosen version set before installing an operating system. That means the management controller, BIOS, RAID or HBA controller, network cards, drive firmware and the backplane. Doing it first means the OS install sees the final hardware behaviour, and it avoids the reboot loop of updating each piece later with workloads running.

Dell's Lifecycle Controller updates from the network or from a repository built with Dell Repository Manager, and Dell System Update does the same from within an OS. Lenovo has OneCLI and XClarity update bundles; Supermicro has SUM. Whichever vendor, pick the versions once, write them in a baseline document with the date, and apply the same set to every server of that model in the batch.

  1. Write the baseline: model, and the target version of iDRAC or BMC, BIOS, RAID controller, NICs, drives, backplane.
  2. Update the management controller first, then BIOS, then the rest. Reboot between stages as the tool requires.
  3. Verify every version against the baseline from the controller's firmware inventory.
  4. Configure the RAID or HBA: create the arrays, set the cache policy, confirm the battery or capacitor is healthy.
racadm -r 10.0.0.50 -u root -p <password> swinventory
# or via Redfish on any vendor
curl -sk -u admin:<password> https://10.0.0.51/redfish/v1/UpdateService/FirmwareInventory

Burn-in: make it fail here, not there

Now run it hard. The point is to push the memory, CPUs, drives and cooling long enough that a marginal part shows itself. A memory test overnight, a CPU and disk stress run for most of a day, and a watch on the controller's event log throughout. Weak DIMMs, a drive with a rising reallocated sector count, a fan that cannot hold speed, and a power supply that drops out under load all show up here.

Use the vendor's built-in diagnostics as the first pass; Dell's are in the Lifecycle Controller under F10 at boot. Then boot a Linux live image and use general tools. Watch the inlet and CPU temperatures on the controller during the run; a server that overheats on a bench will not survive a warm closet.

  • Memory: MemTest86 for at least a full pass, overnight if the machine has a lot of RAM.
  • CPU and memory under the OS: `stress-ng` for several hours with all cores loaded.
  • Drives: a read of every sector on every drive, and `smartctl` before and after to compare reallocated sector counts.
  • Watch the management controller event log and temperatures throughout. Any entry is a reason to stop and look.
stress-ng --cpu 0 --vm 4 --vm-bytes 75% --timeout 8h --metrics-brief
smartctl -a /dev/sda | grep -i -E "reallocated|pending|uncorrect"
badblocks -sv /dev/sda

Asset tag, record, and pack

Tag the server before it goes in the box: a durable printed asset label on the rear near the service tag, and a second on the front ear or bezel. Put the same asset number in the management controller's asset tag field so it shows up in inventory tools. Record the asset number, service tag, model, inventories, firmware baseline, burn-in results, management IP and rack position in one place. That record is what the site team checks against and what support will ask for in a year.

Then install the OS or hypervisor to your standard image, set the management controller's network settings for the destination site, and shut it down cleanly. Pack the rails and the cords in the same box, with the layout sheet showing where it goes. On site, the work is rails, lift, cable, power on and a five-minute check against the record.

  1. Apply asset labels front and rear, and set the asset tag in the controller.
  2. Complete the record: asset, service tag, model, inventories, baseline, burn-in results, management IP, rack position.
  3. Install the OS or hypervisor image and apply the site-specific network settings.
  4. Set the management controller for the destination site's management VLAN.
racadm -r 10.0.0.50 -u root -p <password> set System.ServerTopology.AssetTag RL-2026-0042

Frequently asked questions

How long should burn-in run?

Long enough for a full memory pass, several hours of CPU and memory stress, and a full read of every drive. For most servers that is one to two days including the overnight memory test.

Why update firmware before installing the OS?

So the OS sees the final hardware behaviour and you avoid rebooting a production server repeatedly later. Every server in the batch then matches one baseline.

Takeaway

Build it, inspect it, bring the firmware to a written baseline, run it hard for a day or two, tag it and record everything, then ship. The rack install becomes a short mechanical job and the server's record starts complete. Skipping staging saves a day and costs the first week.

Related posts

More racking and data center tips

Need a hand with this?

Tell us what you are running and what is slowing you down. You get a straight assessment and a plan, with no obligation. Support desk is staffed 24/7.

Get in touch