Will Fuks
Apr 23, 2021

--

Hi Akhil,

I don't quite remember the metrics of the system, I think it was something like 1~2 million reads per day so 30k probably will be quite fine.

On the other hand, writing 60GB to datastore doesn't seem like a good approach IIUC. It will be unbelieavebly expensive and given the assymetry between your reads and writes it seems like you might not need to write all this information to DS (still I'm mostly guessing after all).

Maybe using storage or a sql database would fit better your use case and then DS remains hot with only caching data.

--

--

Will Fuks
Will Fuks

Written by Will Fuks

Mainly interested in data science and software development topics.

Responses (1)