How to use map in multithreading in C++?

[Man4ish]

Hi,

I have one input file having almost trillions of records.


Input:
Key Value
a XYZ
b xyz
. ...
. ...

How to store the above data in multithreaded map and retrieve in the same manner?

[weaknessforcats]

With trillions of records I would start thinking about an actual database product along the lines of Oracle or some such.

You starting getting into long access times, partitioning, multiple indexes, hashing, etc. While all of these can be written in C++, you will need a corporate programming team to accomplish it.

I am suspicious about trillions of records in one file, though. are you sure about that?

[Man4ish]

As per my project guidelines, i am not supposed to use Oracle. I have 1000 core processor I want to make use of each core for storing it. I need to write my own program. There is not one file but folder having million of files. I need to store all the records in a file.

Regards