* comment: Whether to ignore content exceptions during crawling.
     * @return The determination, true or false. (if not found, exception but basically no way)
     */
    boolean isCrawlerIgnoreContentException();

    /**
     * Get the value for the key 'crawler.failure.url.status.codes'. <br>
     * The value is, e.g. 404 <br>
     * comment: HTTP status codes considered as failure URLs.