Search Options

Results per page
Sort
Preferred Languages
Advance

Results 1 - 1 of 1 for setNoFollow (0.05 sec)

  1. src/main/java/org/codelibs/fess/crawler/transformer/FessXpathTransformer.java

                    }
                    if (nofollow) {
                        logger.info("META(robots=nofollow): {}", responseData.getUrl());
                        responseData.setNoFollow(true);
                    }
                }
            } catch (final XPathExpressionException e) {
                logger.warn("Could not parse a value of {}", META_NAME_ROBOTS_CONTENT, e);
            }
    
        }
    
    Registered: Thu Oct 31 13:40:30 UTC 2024
    - Last Modified: Thu Oct 24 13:01:38 UTC 2024
    - 42.9K bytes
    - Viewed (0)
Back to top