you should use one of non-skin styles to be able to provide the border color for Panel. That is, set the control's LookAndFeel.Style property to Flat, UltraFlat or Style3D.
then write following code to change color
panelControl1.Appearance.BorderColor = Color.Red;