[ic] sudden perl signal 11 (long-lived store)

[Glenn McCalley]

At approx. 0900 yesterday morning (Dec 11) one of our stores began returning 
a 500 Server Error in the checkout process.  There is a syslog message that 
corresponds to the time of the 500 error:

(perl) uid 1005: exited on signal 11 (core dumped)

uid 1005 is "interch"

It seems to be at the point after payment processing (the credit card is in 
fact charged) but before the customer and store manager emails are sent and 
the order copy placed in the "orders" directory.  The icdebug.log shows the 
payment and no error messages are appearing there.  Same with the other 
system and catalog log files - no errors logged.

What has us really going is it is only happening in one store -- there are 4 
stores in production and a couple test ones configured that do not get the 
error.  That would indicate to me it is not memory or hardware or the error 
would be global?  There were minor cosmetic changes made on Dec 10, however 
several orders in the goofy store processed successfully between the 
application of those changes and the start of the errors.

This system has been running fine for a long time and no other errors are 
apparent.  Disk checks are OK, nothing useful in the system messages log. 
The software is FreeBSD, IC V5.2.0 installed in the summer of 2004 and rock 
solid ever since.  Perl v5.8.8 last upgrade forever ago.

ANY thoughts appreciated.
Thank you!
Glenn.