I'm working on a project where we need to load several 10s of
thousands of rows per second (roughly 50 bytes/row) into MySQL tables.
We're using LOAD DATA INFILE, which works fine. The problem is, that
we have to write this data from our application into ASCII files so
load data infile can read them. The bottleneck is the writing of the
data. We were thinking that if we could write the data in binary
format, the writing might be quicker. Is there a way to load binary
data into mysql tables with something akin to load data infile?
Thanks
thousands of rows per second (roughly 50 bytes/row) into MySQL tables.
We're using LOAD DATA INFILE, which works fine. The problem is, that
we have to write this data from our application into ASCII files so
load data infile can read them. The bottleneck is the writing of the
data. We were thinking that if we could write the data in binary
format, the writing might be quicker. Is there a way to load binary
data into mysql tables with something akin to load data infile?
Thanks