The dCache health check failed on all SRM tests with the following:

SRMClientV1 : org.globus.common.ChainedIOException: Authentication failed [Caused by: Defective credential detected [Caused by: [JGLOBUS-96] Certificate "DC=org,DC=doegrids,OU=Services,CN=cmsdcache03.hep.wisc.edu" expired]]



The only thing I could find to explain this was that the clock on 
cmsdcache03 was about 4 minutes fast.  I reset it with 'date' but that 
didn't immediately fix the problem.  I then restarted dcache-srm and 
things started working again.

I don't know for sure that the clock skew was responsible, but clock 
skew can cause this sort of authentication problem.  I don't understand 
why ntpd allowed the clock to drift so much.  Maybe I just wasn't 
patient enough to wait for it to synchronize.

--Dan