This topic was automatically generated from Slack. You can find the original thread here.
, can you help me with this error?
{“code”:“Error”,“killed”:false,“signal”:null,“cmd”:“pnpm install --prefer-offline --ignore-scripts -P”,“stdout”:“Progress: resolved 1, reused 0, downloaded 0, added 0\nPackages: +33\n+++++++++++++++++++++++++++++++++\nProgress: resolved 33, reused 0, downloaded 33, added 33, done\n ENOSPC ENOSPC: no space left on device, write\n\n\n\n”,“stderr”:“”,“name”:“Error”,“message”:“Command failed: pnpm install --prefer-offline --ignore-scripts -P\n”,“stack”:“Error: Command failed: pnpm install --prefer-offline --ignore-scripts -P\n\n at genericNodeError (node:internal/errors:984:15)\n at wrappedFn (node:internal/errors:538:14)\n at ChildProcess.exithandler (node:child_process:422:12)\n at ChildProcess.emit (node:events:519:28)\n at maybeClose (node:internal/child_process:1105:16)\n at ChildProcess._handle.onexit (node:internal/child_process:305:5)“,”ts”:“2024-07-16T16:34:48.082Z”}
It looks like you’re encountering an ENOSPC error, which indicates that there is no space left on the device. This can happen when the storage limit for your Pipedream workflow is exceeded. Pipedream provides a limited amount of disk space in the /tmp directory for workflows and event sources. This limit cannot be raised. ### Possible Solutions: 1. Check Your Imports: - Ensure that you’re not importing entire libraries when you only need specific modules. For example, importing the entire lodash library can consume a lot of space. Instead, import only the specific modules you need: // Avoid this import { pick } from "lodash"; // Use this import pick from "lodash.pick"; 2. Clean Up Temporary Files: - If your workflow generates temporary files, make sure to delete them when they’re no longer needed to free up space. 3. Optimize Dependencies: - Review your package.json and ensure you’re only including necessary dependencies. Remove any unused or redundant packages. 4. Reduce Data Storage: - If you’re storing large amounts of data in the workflow, consider using external storage solutions like AWS S3 or Google Cloud Storage. ### Example of Cleaning Up Temporary Files: Here’s an example of how you can clean up temporary files in a Pipedream component: ```
import { axios } from “@pipedream/platform”; import fs from “fs”; import path from “path”; export default defineComponent({ async run({ steps, $ }) { const filePath = “/tmp/myfile.txt”; // Create a temporary file fs.writeFileSync(filePath, “Temporary data”); // Perform operations with the file const data = fs.readFileSync(filePath, “utf-8”); console.log(data); // Clean up the temporary file fs.unlinkSync(filePath); return { message: “Temporary file cleaned up” }; }, });
Thanks for the help. I’m not saving anything to disk, but I’m loading some databases in memory so I guess that uses up temp space. I also maximised the memory but it didn’t help. I’ll add the code above to see if it makes a difference & I also have to double check my code to see why it uses so much space/memory (it shouldn’t)