Search Options

Results per page
Sort
Preferred Languages
Advance

Results 1 - 4 of 4 for delayBeforeProcessing (0.08 sec)

  1. fess-crawler/src/main/java/org/codelibs/fess/crawler/interval/impl/HostIntervalController.java

     * that controls the interval between requests to the same host.
     * It uses a ConcurrentMap to store the last access time for each host.
     * The delayBeforeProcessing method is overridden to introduce a delay before processing a URL,
     * ensuring that requests to the same host are not made too frequently.
     * The delay is calculated based on the configured delayMillisBeforeProcessing parameter.
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sun Jul 06 02:13:03 UTC 2025
    - 4.2K bytes
    - Viewed (0)
  2. fess-crawler/src/main/java/org/codelibs/fess/crawler/interval/impl/AbstractIntervalController.java

     *
     * <p>
     * This class defines the contract for delaying the crawling process at various points, such as:
     * </p>
     * <ul>
     *   <li>Before processing a URL ({@link #delayBeforeProcessing()})</li>
     *   <li>After processing a URL ({@link #delayAfterProcessing()})</li>
     *   <li>When there are no URLs in the queue ({@link #delayAtNoUrlInQueue()})</li>
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sun Jul 06 02:13:03 UTC 2025
    - 4.5K bytes
    - Viewed (0)
  3. fess-crawler/src/main/java/org/codelibs/fess/crawler/interval/impl/DefaultIntervalController.java

                ThreadUtil.sleep(delayMillisAtNoUrlInQueue);
            }
        }
    
        /**
         * Delays before processing a URL.
         */
        @Override
        protected void delayBeforeProcessing() {
            if (delayMillisBeforeProcessing > 0) {
                ThreadUtil.sleep(delayMillisBeforeProcessing);
            }
        }
    
        /**
         * Delays for waiting for new URLs.
         */
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sun Jul 06 02:13:03 UTC 2025
    - 3.4K bytes
    - Viewed (0)
  4. fess-crawler/src/test/java/org/codelibs/fess/crawler/CrawlerContextTest.java

         */
        private static class TestIntervalController implements IntervalController {
            @Override
            public void delay(int type) {
            }
    
            public void delayBeforeProcessing() {
            }
    
            public void delayAfterProcessing() {
            }
    
            public void delayAtNoUrlInQueue() {
            }
    
            public void delayForWaitingNewUrl() {
            }
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sat Sep 06 04:15:37 UTC 2025
    - 25.6K bytes
    - Viewed (0)
Back to top