- Sort Score
- Result 10 results
- Languages All
Results 1 - 2 of 2 for listSem (0.02 sec)
-
fess-crawler/src/main/java/org/codelibs/fess/crawler/entity/SitemapFile.java
*/ private String loc; /** * Identifies the time that the corresponding Sitemap file was modified. It * does not correspond to the time that any of the pages listed in that * Sitemap were changed. The value for the lastmod tag should be in W3C * Datetime format. * * By providing the last modification timestamp, you enable search engineRegistered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Jul 06 02:13:03 UTC 2025 - 4.4K bytes - Viewed (1) -
fess-crawler/src/main/java/org/codelibs/fess/crawler/entity/RobotsTxt.java
* <li>Handles Allow and Disallow rules for path-based access control</li> * <li>Manages crawl delay settings per user agent</li> * <li>Stores sitemap URLs listed in robots.txt</li> * </ul> * * <p>The class uses case-insensitive pattern matching for user agents and supports * wildcard characters (*) in user agent strings. When multiple directives match a user agent,
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Jul 06 02:13:03 UTC 2025 - 10K bytes - Viewed (0)