This topic was automatically generated from Slack. You can find the original thread here.
Quick question: can this 1000KB Storage limit be increased somehow?
Hi , what’s your use case that requires more than 1000kb for data stores?
Have you looked into File Stores?
Hi thanks for answering!
I currently use file stores to store many short JSON files and I want to use data stores instead. However, 1000KB won’t be enough.
I guess their next question will probably be: what’s the problem/challenge with using the file store?
just to give you an idea, I have in the file store already over 7K small JSON files (around 1KB), and counting…
But why is that a problem?
Yeah that’s because the two storage systems are different — Data Stores uses storage in memory, so it’s largely more expensive than storing in File Stores
So yeah, the (next) question is: any issues with File Stores that’s making you prefer Data Stores?
I personally prefer the Data Stores UX, it’s easier and quicker to use
Is the issue with the file store that you need to find the file, download it, and then read it, and then parse the JSON?
If so, I’m sure that could be streamlined with a simple new method in the file store API.
Something like $.files.getJson('some_file.json') or $.files.open('some_file.json').toJson()
That way it would pretty much act like a key-value store.
Agreed, if the DX for file stores were simpler, I’d have no problem using it over data stores
do you feel the same or do you have anything else in mind?
In the meantime, this should work:
JSON.parse($.files.open('some_file.json').toBuffer().toString());
It’s not as pretty as this.datastore.get("key");, but it should get the same job done. :man-shrugging:
: If you don’t plan on adding a simplified JSON method as suggested above, it could be worth it to add that use case + line of code to the file store documentation.
the “problem” with Files Store is the UX. I have 7K files and it’s not so easy to handler. For example, there is not a search in the Files Store or in bulk action like selecting multiple files to delete them.
And there is a problem in the pagination, because it shows only half of the files, but I search them using a script and the files are still there in the File Store.
Also, it will be nice to be able to create Folders in the Files Store so I can organize much betters my files.
In summary, if the Files Store had better capabilities, it would be fantastic.