Yes: CSV allows for that: just surround the data with double quotes:
123,"this has no problem","this would, though", 456
Depending on what you are using to create the CSV file it should do it automatically for you, but if you are generating them yourself, then don't forget to process double quotes in user input to double-double quotes!
123,"this has no problem","this ""would"", though", 456