This is a very neat solution. Kudos for solving it!
What's the average lookup time for a certificate as the DB grows into the TB range? Is it using Bloom Filters to cut this down?
Thank you!
SlateDB is indeed using bloom filters. Here's the end of the tree on a test instance where I loaded 50 million certificates - the latency is basically indistinguishable from an instance with only a few thousand records: https://compact-log.pre-test.ct.merklemap.com/ct/v1/get-entr...
You can see the current tree size here: https://compact-log.pre-test.ct.merklemap.com/ct/v1/get-sth