You have a problem. There is no 64-bit version of the Jet database engine so your AnyCPU compile will run as 64-bit on a 64-bit Windows and 32-bit on 32-bit Windows. The problem is that you cannot combine 32- and 64-bit code in the same process and, therefor, your OLEDB4.0 provider won't work when your app is running as 64-bit.
In order to get this to work, you either have to:
A) Recompile your app 32-bit (x86) only. Then you can use the Jet database engine on any machine that has Access or the Jet runtime installed on it.
B) Remove the dependency on OLEDB4.0 and use the ACE engine instead. The ACE engine come in either 32- or 64-bit versions. You can get the redistributables
here[
^].