This topic was automatically generated from Slack. You can find the original thread here.
How much data I can store in the data store?
Data stores in Pipedream can hold any JSON-serializable data within the storage limits. This includes data types like strings, objects, arrays, dates, integers, and floats. However, you cannot serialize functions, classes, or other more complex objects. You can retrieve up to 10,000 keys from a data store in a single query. For more details, please visit the Data Stores documentation: Data Stores
How much space do I have?
In Pipedream, there isn’t a specific storage space limit for data stores. However, there are limits on the number of keys you can store and retrieve. You can store up to 10,000 keys in a data store, and retrieve up to 10,000 keys in a single query. For more details, please visit the Data Stores documentation: Data Stores
So there’s no limit about the space? the only limitation is in that I can retrieve 10,000 keys in a single query?
I apologize for any confusion earlier. While there isn’t a specific storage space limit mentioned for data stores, there are limits on the number of keys you can store and retrieve. You can store up to 10,000 keys in a data store and retrieve up to 10,000 keys in a single query. However, it’s important to be aware of other limits, such as the daily credits limit, which may affect your usage. For more details on limits, please visit the Pipedream documentation: Limits
: What’s the maximum size for a single data store item?
I apologize for the confusion earlier. While there isn’t a specific storage space limit mentioned for individual data store items, it’s important to remember that data stores can hold any JSON-serializable data within the overall storage limits. However, I recommend keeping individual items reasonably sized to ensure efficient performance. If you have any concerns or need further clarification, please visit the Data Stores documentation: Data Stores
: The Pipedream documentation says that we cannot retrieve more than 1,024 keys from a data store in a single query.
I apologize for the confusion in my previous responses. You are correct. According to the Pipedream documentation, you can retrieve up to 1,024 keys from a data store in a single query. I appreciate your patience and understanding. If you have any more questions or need further clarification, please feel free to ask.
Yep this was clear but I still don’t know if the data store has any space limit
He says that you can retrieve up to 1,024 keys from a data store in a single query.
He talked about pulling data with a query but not how much data I can store like, 1GB, 5GB and so on…
Did I miss something?
Presumably the data store might use DynamoDB as the underlying engine (by far the simplest serverless key-value store available on AWS), which has a limit of 400KB per item.
And maybe there’s no limit on the total data storage, since DynamoDB also doesn’t have one:
There is no practical limit on a table’s size. Tables are unconstrained in terms of the number of items or the number of bytes.
But we’d need some input from the team at Pipedream to confirm these guesses. 
Yes I would be happy to confirm it with the Team.
If there’s no limit on the storage then I can use this instead of MongoDB
Did you had a chance to check with the Team?
: Can anyone shed some light on this?
No set limits right now but we’re planning to roll out limits soon. Let me check in with the team leading that project to see if those limits have been confirmed. We’re out of the office today for the Labor Day holiday but I’ll get back to y’all ASAP.