Optimization Megaticket

[qpfiffer]

General dumping ground for things that need doing to make Oleg Do the Dew™ faster.

• AOL is pretty damn slow right now. See ticket.
• fsync/fflush distinction. I've had problems with fsync not actually writing data to disk, so we have to fsync and fflush. Sometimes many times.
• Transactions must be written to disk and then read from disk to be commited. This fucking sucks. Redo the AOL file so that it is trivially mmap()-able. This way we can take full advantage of the kernel's caching layer.
• Re-examine stop-the-world rehashing. Might be a good oppotunity to use Google's JumpConsistentHash as a way to only re-index small parts of the table. This would mean removing Murmur3. I'm open for conversation on this one. #nodeps Edit: Tried this, it was slower.

[lykkin]

bump

[dequis]

• have
• you
• heard
• about
• check
• lists

You can use them like this:

• Privilege