- Sort Score
- Result 10 results
- Languages All
Results 1 - 10 of 10 for intervalController (0.07 sec)
-
fess-crawler/src/main/java/org/codelibs/fess/crawler/interval/IntervalController.java
* either express or implied. See the License for the specific language * governing permissions and limitations under the License. */ package org.codelibs.fess.crawler.interval; /** * The {@code IntervalController} interface defines methods for controlling * the delay intervals in a web crawler. It includes constants representing * different types of processing states and a method to introduce a delay
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Jul 06 02:13:03 UTC 2025 - 1.8K bytes - Viewed (0) -
fess-crawler/src/main/java/org/codelibs/fess/crawler/CrawlerContext.java
* Returns the interval controller. * @return The IntervalController. */ public IntervalController getIntervalController() { return intervalController; } /** * Sets the interval controller. * @param intervalController The IntervalController. */ public void setIntervalController(final IntervalController intervalController) { this.intervalController = intervalController;
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Jul 06 02:13:03 UTC 2025 - 8.9K bytes - Viewed (0) -
fess-crawler/src/main/java/org/codelibs/fess/crawler/Crawler.java
* @return The IntervalController instance. */ public IntervalController getIntervalController() { return intervalController; } /** * Sets the interval controller. * @param intervalController The IntervalController instance to set. */ public void setIntervalController(final IntervalController intervalController) {
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Jul 06 02:13:03 UTC 2025 - 14K bytes - Viewed (0) -
fess-crawler/src/main/java/org/codelibs/fess/crawler/CrawlerThread.java
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Thu Aug 07 02:55:08 UTC 2025 - 20.4K bytes - Viewed (0) -
fess-crawler/src/main/java/org/codelibs/fess/crawler/interval/impl/AbstractIntervalController.java
*/ package org.codelibs.fess.crawler.interval.impl; import org.codelibs.fess.crawler.exception.CrawlerSystemException; import org.codelibs.fess.crawler.interval.IntervalController; /** * An abstract base class for implementing {@link IntervalController}. * Provides a common structure for handling delays at different stages of the crawling process. * It encapsulates the delay logic and exception handling, allowing subclasses to focus on
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Jul 06 02:13:03 UTC 2025 - 4.5K bytes - Viewed (0) -
fess-crawler/src/main/java/org/codelibs/fess/crawler/interval/impl/DefaultIntervalController.java
*/ package org.codelibs.fess.crawler.interval.impl; import java.util.Map; import org.codelibs.core.lang.ThreadUtil; /** * Default implementation of the IntervalController. * This class provides a default way to manage delays between crawler operations. * It allows setting delays before processing, after processing, when no URLs are in the queue, * and when waiting for new URLs.
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Jul 06 02:13:03 UTC 2025 - 3.4K bytes - Viewed (0) -
fess-crawler/src/test/java/org/codelibs/fess/crawler/CrawlerContextTest.java
@Override public boolean hasRule(Rule rule) { return false; } } /** * Test implementation of IntervalController for testing */ private static class TestIntervalController implements IntervalController { @Override public void delay(int type) { } public void delayBeforeProcessing() { }
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sat Sep 06 04:15:37 UTC 2025 - 25.6K bytes - Viewed (0) -
fess-crawler/src/main/java/org/codelibs/fess/crawler/interval/impl/HostIntervalController.java
import org.codelibs.fess.crawler.exception.CrawlerSystemException; import org.codelibs.fess.crawler.util.CrawlingParameterUtil; /** * HostIntervalController is an implementation of {@link org.codelibs.fess.crawler.interval.IntervalController} * that controls the interval between requests to the same host. * It uses a ConcurrentMap to store the last access time for each host.
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Jul 06 02:13:03 UTC 2025 - 4.2K bytes - Viewed (0) -
README.md
String sessionId2 = crawler2.execute(); crawler1.awaitTermination(); crawler2.awaitTermination(); ``` ### Custom Interval Control ```java // Configure politeness policy container.singleton("intervalController", DefaultIntervalController.class, controller -> { controller.setDelayMillisForWaitingNewUrl(5000); controller.setDefaultIntervalTime(1000); }); ``` ### Sitemap Support ```java
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sun Aug 31 05:32:52 UTC 2025 - 15.3K bytes - Viewed (0) -
fess-crawler/src/test/java/org/codelibs/fess/crawler/CrawlerTest.java
.prototype("dataService", DataServiceImpl.class) .prototype("urlFilter", UrlFilterImpl.class) .singleton("urlConvertHelper", UrlConvertHelper.class) .singleton("intervalController", DefaultIntervalController.class) .singleton("sitemapsHelper", SitemapsHelper.class) .singleton("logHelper", LogHelperImpl.class)
Registered: Sun Sep 21 03:50:09 UTC 2025 - Last Modified: Sat Sep 06 04:15:37 UTC 2025 - 19.1K bytes - Viewed (0)