This topic was automatically generated from Slack. You can find the original thread here.
explain this to me Troubleshooting Common Issues - Pipedream
You can find detailed information about the “Function Payload Limit Exceeded” error in the Pipedream documentation here. Below is a summary of the key points: ### Function Payload Limit Exceeded The total size of console.log() statements, step exports, and the original event data sent to workflows and sources cannot exceed a combined size of {process.env.FUNCTION_PAYLOAD_LIMIT}. If you produce logs or step exports larger than this - for example, passing around large API responses, CSVs, or other data - you may encounter a Function Payload Limit Exceeded error in your workflow. #### How to Avoid This Error 1. Write Data to /tmp Directory: - Instead of passing large data between steps using step exports, you can write that data to the /tmp directory in one step and read the data into another step. This avoids the use of step exports and should keep you under the payload limit. - Example: import fs from 'fs'; import path from 'path'; export default defineComponent({ async run({ steps, $ }) { const filePath = '/tmp/large_data.json'; fs.writeFileSync(filePath, JSON.stringify(steps.previous_step.data)); // Later, read the data const data = JSON.parse(fs.readFileSync(filePath, 'utf8')); return data; } }); 2. Compression: - Pipedream also compresses the function payload from your workflow, which can yield roughly a 2x-3x increase in payload size (somewhere between 12MB and 18MB), depending on the data. By following these practices, you can manage large data within your Pipedream workflows more effectively and avoid hitting the payload limit.
I’m testing and I need to clear it
It looks like you want to clear some data, but I need more information to provide a precise answer. Could you please clarify what you need to clear? For example: 1. Are you trying to clear data from a Pipedream Data Store? 2. Are you looking to clear logs or workflow history? 3. Is there a specific app or service you are working with that you need to clear data from? Please provide more details so I can assist you better.
2
It seems like your question was cut off. Could you please provide more details or clarify what you need help with? This will help me give you the most accurate and helpful answer.
I want to clear my workflow history
To clear your workflow history in Pipedream, you can follow these steps: 1. Navigate to the Event History: Go to the Event History section in the Pipedream dashboard. 2. Filter by Workflow: If you want to clear the history for a specific workflow, you can filter the events by that workflow. You can do this by searching for the workflow’s name in the search bar at the top right or by selecting Filter By Workflow from the menu on the far right of a specific event. 3. Clear Events: Unfortunately, Pipedream does not currently provide a direct option to bulk delete or clear all events from the Event History UI. However, you can manually delete individual events if necessary. If you need further assistance or have specific requirements, please visit Pipedream Support. If you have any other questions or need more detailed instructions, please let me know!