You're easier handling the CollectionViewSource in the code behind to achieve what you need. See my example here
MVVM ListBox Grouping[
^] that has an example of the CollecitonViewSource being manipulated in the code. From this, it should be easy to merge your two xml files into the list.