Why does Pipedream only display a limited number of items, causing some not to appear in the list?

This topic was automatically generated from Slack. You can find the original thread here.

I know this isn’t a bug, but it really feels like it, when Pipedream displays a list of items to select from, it only fetches a limited list (for performances, avoiding over-fetch) and doesn’t tell us explicitly about this behavior, which leads to misunderstanding about “why does my item not appear in the list”?

It happened yesterday again where I tried to selected an Asana “Project”, but I have hundreds of those, and only the first 25-50 are displayed/fetched.
I had to find the project ID from Asana to work around this limitation, but that’s really not user friendly, and had I not ran into this recently, I wouldn’t have figured it out.

:point_right: It really believe this UX can be improved! This is one of the recurring pain and source of frustration I run into when using Pipedream.

, when there’s more item, the Load More button is there for you to fetch more items. Does that help?

~It isn’t reliable~, I couldn’t find that particular project, and it’s not the first time it happens. I wasn’t sure if what I was doing was doing anything

:point_right: I recorded this video to explain my journey, at the very end, I finally noticed the Showing 10 of 368 options on the right, that I hadn’t noticed before today. Might seem dumb, but I was looking for that info without seeing it, maybe a small animation on that sentence whenever it changes would make it more catchy? (like a “fade in” or something)

Also, the very first time, the slowness of the fetch makes it even harder to comprehend what’s happening, it gets better after the initial fetch, but the UX for the first fetch wasn’t “intuitive” enough to my taste.

Another issue (which can be seen in the video) is that I need to go over that “Load more” 10 times again every time I refresh the page, if I want to know which Asana project is being selected. (the ID shows, but not the name, and the ID doesn’t help me figuring out which project is being linked)

So if we improve the Asana Project prop to allow you to input project name to search for it (across all projects, not just the current page), would it solve your issue?

I believe it would solve this particular issue with this particular (Asana) connector, but from my experience I believe the core issue is broader (I don’t remember exactly, but I feel like I’ve met this issue with other connectors, not just with Asana, as it’s the first time I’m trying Asana connector)

So you’d suggest to have an improvement on the UX to emphasize the pagination information right?

Yes, if I missed it, I guess others would, too.

It’s the kind of thing that, once you know it’s there, you don’t have any trouble with it

But considering I wished very hard to have that info and couldn’t see it, I guess it could be better highlighted, and a small animation when the displayed text changes makes sense to me

Okay thank you for the suggestion! I’ll create tickets for the improvement for the Pipedream internal team to check

I’ve created a ticket here: [FEATURE] Improve UI for Async Options prop Item Selection · Issue #12076 · PipedreamHQ/pipedream · GitHub