Click here to Skip to main content
14,699,754 members
Please Sign up or sign in to vote.
0.00/5 (No votes)
See more:
My company are going to install a new production line next year and must be able to collect production data and measured parameters to a database. The machine vendor can supply us with csv files containing production statistic (produced parts, rejected parts, alarms, stop reason with frequency and time) and measured data (around 50 measured parameters). The csv files will be generated for each shift which lasts up to 9 hours(3 shift a day). At maximum production speed the csv file with measured data can contain 50 x 21600 measurements equals 1.1 mill data :omg: . The csv file with production data will typically contain up to 1000 datapoints. My question is; Can this amount of data be loaded into a database in an efficient way? Or should we consult a different vendor to collect data directly from an OPC server into a database? Or other solutions??? :) I am greatful for help regarding this issue! :laugh:

1 solution

If you are utilizing MS SQL server as your database, I would recommend using bcp or bulk insert

It is fairly quick and you can control whether triggers or constraints are applied while inserting the data.[^]

Importing and Exporting Bulk Data by Using the bcp Utility[^]

Importing Bulk Data by Using BULK INSERT or OPENROWSET(BULK...)[^]

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900