Just put a site URL, Refresh Crawler will index, crawl, and refresh whatever you want and for how deep you want
Customize Refresh Crawler how deep you want to crawl, and how often you want the refresh to occur.
We use smart technologies which makes your crawler unstobale. You don't need proxies, hacks or hard work.
Provide Refresh Crawler with a URL. It will index all the links and start crawling to them and refreshing all the pages of this website, and if you want - of pages outside of the domain.
Refresh Crawler is the smartest refresh tool on the internet:
You can crawl and refresh on the same domain or set the crawler to crawl all over the internet
You decide how often to refresh each page in a click of a button
Like Google, Refresh Crawler crawls to any website, no matter which technology it is using.
Refresh crawler will refresh any webpage, no matter which technology it is using (html / javascript / react / angular)
Refresh Crawler can deep crawl to many levels and refresh all pages, you choose how deep to crawl
Everything is done automatically, the tool will present you the queue of which pages are next to refresh