LinkCrawler FOLLOWREDIRECT example
Posted by pspzockerscene psp, Last modified by pspzockerscene psp on 13 April 2023 12:20 PM

LinkCrawler example - FOLLOWREDIRECT

FOLLOWREDIRECT rules can be used for the following tasks:

  • Make JD accept unsupported URLs that redirect to URLs (via http status codes 3XX) which JD either accepts or which are handled by subsequent LinkCrawler rules e.g. -->
    "enabled": true,
    "name": "example rule for LinkCrawler type FOLLOWREDIRECT",
    "pattern": "https?://example\\.com/[A-Za-z0-9]+",
    "rule": "FOLLOWREDIRECT"