rpm package "installed" and "not installed"

["xavier.sinecosa" <xavier sinecosa laposte net>]

I installed a the speex-1.0.3-2.1.i386.rpm package and tried
thaen to uninstall it in order to do an upgrade, but the
package seems to be installed from "rpm -Uvh" and not
installed from "rpm -e"!
Here is what I get: 

# rpm -Uvh speex-1.0.3-2.1.i386.rpm
Preparing...               
########################################### [100%]
        package speex-1.0.3-2.1 is already installed
# ldconfig
# rpm -e speex-1.0.3-2.1.i386.rpm
error: package speex-1.0.3-2.1.i386.rpm is not installed

What can I do to remove this package ? And then upgrade ?

Cheers, Xavier