There seems to some variability in the ICM testing that is performed in this way. The techs that know what they're doing will test the unit three or four times, all the while bumping it during the test with a screw driver of something. This, of course, mimicks the unit being on the car and operating under somewhat normal conditions.

So yea, if it was tested incorrectly the ICM may still be bad.