You dont have to install Visual studio on clients computer. All you need is .NET framework on target machine.
For SQLExpress, If you are using Clickonce to publish your application, you can try this link [
^] that shown how to customize SQLserver express edition with clickonce deployment.