Past incidents in phab: T123924 T137647 T159870 (also observed on acamar today, no separate task for that)
acpid_pad continues to occasionally cause problems, usually fixable by rmmod of the module with no apparent other ill effects in the general case. Dell has some older documentation that talks about blacklisting acpi_pad and a few other modules here: http://en.community.dell.com/techcenter/b/techcenter/archive/2012/08/27/ubuntu-on-dell-12g-poweredge-servers . I don't think we should blindly follow that advice, as it was written in the context of both older kernels and older servers, but I think at this point it might be reasonable for us to universally blacklist this module in base (or disable it on the kernel cmdline, if that's what's necessary to stop it from loading).
---
list of Dell PowerEdge 320 hosts: (cumin/facter:` 'F:productname ~ "^PowerEdge R320"'`)
acamar.wikimedia.org
achernar.wikimedia.org
baham.wikimedia.org
bast2001.wikimedia.org
cerium.eqiad.wmnet
heze.codfw.wmnet
labservices1002.wikimedia.org
logstash[1001-1003].eqiad.wmnet
mira.codfw.wmnet
praseodymium.eqiad.wmnet
subra.codfw.wmnet
suhail.codfw.wmnet
tin.eqiad.wmnet
xenon.eqiad.wmnet