[K12OSN] strange behavior with eth0 and eth1

["Dr. Daniel Loomis" <drloomis cox-internet com>]

I have a fresh install of k12ltsp-5.0 on a test server with all the 
latest yum updates as of 04-25-06.  The server is a Tyan S2460 dual cpu 
MB with 2 x 1800 athlon-mp cpus and 512mb memory.

With only eth1 connected to the outgoing router, everything comes up 
ok.  But when I connect eth0 to a switch and connect thin clients to 
that switch, eth0 comes up as 192.168.0.250 instead of 192.168.0.254 as 
setup in /etc/sysconfig/network-scripts.  Also, when eth0 is connected 
to the switch eth1 fails to come up, but will do so when, after boot up, 
I issue a commandline:  ifup eth1. 

If I turn off the switch connected to eth0, everything comes up as it 
should:  eth0 192.168.0.254 and eth1 as 192.168.1.254.

This is a new one on me.  I've never seen such behavior before with a 
default k12ltsp install.

I have tried the following combinations of ethernet cards:

eth1: 3c905-cx tm
eth0: 3c905-cx tm, 3c905b-nm, & a DLink NIC using the 8139 chip.

It does not seem to matter which NIC I use in eth0.  If the switch is 
active on eth0, I get the wrong ip address on eth0.  There is no dhcp 
running on the 192.168.0.0 subnet.  Replacing the switch on the 
192.168.0.0 subnet with an old 10base-T hub makes no difference.

Suggestions for debugging this problem would be most appreciated.

Dan