Mirrormanager crawler timeout

Teams Infrastructure
1

Hi
We just add our mirror (located in Thailand mirrored from sg.rpmdb.org) to Mirrormanager. but our mirrors is not active because 5 consecutive crawl failures.

As I check in crawler log. I found this

2022-01-03 16:05:01,570 - WARNING - Host 272 marked not up2date: Crawler timed out before completing.  Host is likely overloaded.
2022-01-03 16:05:01,615 - INFO - Ending crawl of <Host(272 - mirrors.bangmod.cloud)> with status 2

Can anyone give me some idea how to solve this problem?

Thank you.

2

There have been similar posts on Rocky Mattermost. They suggest using rsync to mirror with instead of http/https. Can you do that?

The steps for rsync should be in the mirror documentation.

3

As an aside, we plan on moving the old 8.3 and 8.4 content to a vault to reduce the amount of time it takes to rsync from our endpoints but also to speed up the crawl process to avoid this in the future. Either way, having an rsync endpoint on your end can help speed up the crawl process from mirror manager.