I would consider using a file to store the data and read it in small chunks for processing.
If you're on Windows, I would recommend, storing the data in a file and memory mapping the file using the following APIs -
CreateFile
CreateFileMapping
MapViewOfFile