As James Smart suggested, you can try to decrease the HBA driver nodev timeout value to 1 sec.
mumble... i'm using a qlogic 2312 with kernel builtin driver now... is it the same problem? is there a similiar parameter?