- Sort Score
- Result 10 results
- Languages All
Results 1 - 1 of 1 for anyRoot (2.38 sec)
-
fess-crawler/src/test/java/org/codelibs/fess/crawler/helper/RobotsTxtHelperTest.java
// Test that orphaned directives (before any User-agent) are ignored // These should not affect any bot assertTrue(robotsTxt.allows("/orphaned1/", "AnyBot")); assertTrue(robotsTxt.allows("/orphaned2/", "AnyBot")); // Test GoodBot - should parse valid directives and ignore invalid ones assertNotNull(robotsTxt.getDirective("goodbot"));Registered: Sat Dec 20 11:21:39 UTC 2025 - Last Modified: Mon Nov 24 03:59:47 UTC 2025 - 20.6K bytes - Viewed (0)