Format to read in CSV files

[Stellaferox]

Hi,

Does anyone have a routine that reads CSV files of certain length? Moreover, I 'd like to know what the fastest way is to read these files. Do you have to use SQL?
thnx
Marc

[RandomCoder]

The easiest way is to load the file into a table.
From there you can extract the data you want.
You can also use SQL which is faster for large databases, however I'm yet to learn how to use SQL (maybe some time soon I'll give it a try).

Regards,
RandomCoder

[Stellaferox]

thnx,

I was wondering whether anyone had a routine which regardless of the parameters (which are read at runtime and passed through) could read a csv file. I am not too familiar with SQL myself, so I hope someone is.....
Marc

[RandomCoder]

You don't need to understand SQL to use the table control.
The table control is very simple to use and will load the CSV file directly into the table cells.
All you then need to do is either filter the table or just extract the desired cells.

Regards,
RandomCoder

[Stellaferox]

Well, I dont need a table actually. i want to store over a few million data in the CSV file to retrieve with a search function matching one or two entries.

[RandomCoder]

Originally Posted by Stellaferox

Well, I dont need a table actually. i want to store over a few million data in the CSV file to retrieve with a search function matching one or two entries.

A few million

You would be best to use SQL, although my understanding is that a table will still be required for SQL to utilise.
My approach is usually to try and understand a few examples of other peoples work and then tailor it to my own needs.
Here is a link to an example that Erel did some time ago, maybe it will help you... SQLite Viewer

Regards,
RandomCoder

[Stellaferox]

hmmmmmm.... missed this little gem, though I thought I skimmed the forum daily.
Thnx!
Marc

[Erel]

What type of data do you need to store?

[Stellaferox]

@ Erel

Hi erel,

I want to store a table containing numbers. The program computes the rank of a hand in poker with 7 cards, taken the best 5 out of it (Texas Holdem). Because there are 133784560 combinations with 7 cards out of 52, it takes too long to compute the hands, especially because I want to run simulations with dealing a lot of hands (Monte Carlo simulation) and compute the probability of winning with that certain hand against other random AI-hands. Therefore I want to generate a table and compare the hand to an index (with a unique longinteger) and retrieve the value of the hand.
Marc

[Erel]

I recommend you to use the BinaryFile to store the data in a raw file.
Write with WriteInt64 and read with ReadInt64.
Every number occupies 8 bytes so it is very easy to navigate the file.