* comment: Whether to ignore robots meta tags during crawling.
     * @return The value of found property. (NotNull: if not found, exception but basically no way)
     */
    String getCrawlerIgnoreRobotsTags();

    /**
     * Is the property for the key 'crawler.ignore.robots.tags' true? <br>
     * The value is, e.g. false <br>
     * comment: Whether to ignore robots meta tags during crawling.