device problems from a serial interface board?

I know the manuals say not the remove the serial interface board from z world while power is plugged in…what if someone potentially removed it while powered, could it potentially make it where lets say you have a OP7100 touchscreen and nothing will come on or the debugger will not run right?