finally found solution on myself. But the poor part is i am not sure how it works...
added the below line before the Listview Items remove part which resolved the issue
listView1.Sorting = System.Windows.Forms.SortOrder.None;
P.S: May be before recreating listview items i settled the sorting in to NONE which resolves my issue.