problem with Outlook Express receiving certain msgs.

Setup:
Using OE, SP1 with everything up to date. Fetches mail
from my website's mail server.

Problem:
At least once a day, a random message fails to be
retrieved by OE and it basically stops OE from bringing
in any other messages. The status shows that it
is "receiving 1 message" and it just stops at about 40%
progress until I cancel it. I then have to quit OE, go
to my webmail access, delete the message, log out, and
restart OE. (The message is usually spam of some sort -
but nothing unusual). Has anyone else run into this
problem? I thought it might be a server issue, but the
email is getting to my mailbox fine, just not into OE.

Any suggestions?

Thanks in advance.

Richard