Thursday, 19 September 2013

Combining data files with Querying? Manual Coding, Xml or SQL from VB.NEt

Combining data files with Querying? Manual Coding, Xml or SQL from VB.NEt

I am looking to combine huge CSV file together (+150 megs x9), apply a
simple query and remove data from the archive, and repeat the exercise. I
don't know much about SQL yet, thus I have stayed from it(time has always
been a factor). However with large Excel documents > 1 gig. which take
forever to load and edit, I am rethinking my approach. I would like to do
something in VB.Net
I have rather enjoyed the XML database system, however not sure how it is
going to cope with copious amounts of data?? Something I might test if I
don't get any feedback.
My question would be is it possible to package in a single exe, a SQLCE
database, with type of functionality?
It is something I can manually code into memory, but then the querying I
would have to manually code the process as well.
Any comments or suggestions?

No comments:

Post a Comment