Search Options

Results per page
Sort
Preferred Languages
Advance

Results 1 - 2 of 2 for listSem (0.05 sec)

  1. fess-crawler/src/main/java/org/codelibs/fess/crawler/entity/SitemapFile.java

         */
        private String loc;
    
        /**
         * Identifies the time that the corresponding Sitemap file was modified. It
         * does not correspond to the time that any of the pages listed in that
         * Sitemap were changed. The value for the lastmod tag should be in W3C
         * Datetime format.
         *
         * By providing the last modification timestamp, you enable search engine
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sun Jul 06 02:13:03 UTC 2025
    - 4.4K bytes
    - Viewed (1)
  2. fess-crawler/src/main/java/org/codelibs/fess/crawler/entity/RobotsTxt.java

     *   <li>Handles Allow and Disallow rules for path-based access control</li>
     *   <li>Manages crawl delay settings per user agent</li>
     *   <li>Stores sitemap URLs listed in robots.txt</li>
     * </ul>
     *
     * <p>The class uses case-insensitive pattern matching for user agents and supports
     * wildcard characters (*) in user agent strings. When multiple directives match a user agent,
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sun Jul 06 02:13:03 UTC 2025
    - 10K bytes
    - Viewed (0)
Back to top