Youtube New Video Source *sometimes* doesn't get an event

Help
#1

I have a Workflow set up that works well.
The Source checks a Youtube Channel for new videos. For some reason this only sometimes works.

image
image320×776 67.4 KB

As you can see above on the 14th, 15th and 16th it worked properly. Then on the 17th I noticed at 2pm that the 1pm event didn’t trigger and activated it manually. Now on the 18th the 1pm event didn’t trigger again.
The CRON Schedule is set to 2 3,7,11,19 * * * (so 2 past at 5am, 9am, 1pm and 9pm CEST. The conversion between UTC and CEST doesn’t show up everywhere the same, but that’s what it’s doing). The logs also reflect this:
1654×401 110 KB

It’s checking at all the right times, but for some reason didn’t find the Youtube video on the 11:03:17 event even though the video should’ve been uploaded already

(using the tool from amnesty international and just checking the upload time manually)

Any ideas why this could be happening and how to fix it?

#2

as a note, it’s intentionally that it checks at 7am UTC. The channel has two different upload schedules depending on what’s being uploaded.
Also any other workflows that use the same Account for Youtube Sources are at least 2 hours apart from this one, so it shouldn’t be caused by timeouts either.

#3

Hi @NukeOfficial

The screenshots are helpful thanks.

Regarding Source Polling Runs

The Source Logs are going to be your best bet for a source of truth if polls are occurring at the correct time.

I can’t tell if the 2nd screenshot that shows your source event logs is before you manually ran the source or not.

The Logs are different from the Events section, because an even is only emitted when a new video is detected, whereas the Logs will always show when the YouTube API was polled.

Regarding missed new Videos

It’s possible there’s a longer lag for the video to be present in the YouTube API after it’s been published publicly.

I think unfortunately the only way to compensate for that kind of case is to give your polling a larger window to make sure the video is present in the YouTube Data API results.

#4

Hey, thanks for the answer!
The screenshot of the Logs were from before I manually ran the source. I included it to show that the timer isn’t what’s broken^^

I added updated the timer to request the videos at a later time again, I hope 8 Minutes should be enough to allow for the delay on Youtube’s side of things :smiley:
I’ll post in here if there seems to be something else that’s broken.

#5

Hi @NukeOfficial

Ah got it, good that means that the scheduled polling is working correctly, it’s just that a new video wasn’t detected yet, so no event was emitted.

Hopefully adding a bit more of a lag manually will help with this problem.

#6

Hey, yeah that seems to have been the only problem.
Something I encountered now though is that the processing somehow got delayed and then executed twice at once.

image
image974×299 46.6 KB

As you can see it should trigger at 4, 5, 6, 7 and 10 past the hour, but the events occurred at 5, 5, 6, 7 and 10 past the hour. So twice at 5 past instead of one at 4 past and one at 5 past. Is there a way to fix this or should I just space the trigger out a little more to avoid this?