You can have cascaded delete set up, so that when you try to delete the parent record all the related child records are deleted. Take a look at the detialed example here.
Performing a Cascade Delete in SQL Server 7[
^]
Alternatively, if you are manually deleting records then you should make sure you are deleting them in a single transaction, either in c# code or in sql.