- Sort Score
- Num 10 results
- Language All
Results 1 - 4 of 4 for CrawlerContext (0.07 seconds)
-
fess-crawler/src/main/java/org/codelibs/fess/crawler/CrawlerContext.java
* </p> * * <p> * It also provides thread-local storage for sitemaps, allowing each thread to have its own set of sitemaps. * </p> */ public class CrawlerContext { /** * Constructs a new CrawlerContext. */ public CrawlerContext() { // Default constructor } /** * Session identifier for the crawling session. */ protected String sessionId; /**Created: Sun Apr 12 03:50:13 GMT 2026 - Last Modified: Wed Dec 31 09:07:38 GMT 2025 - 9K bytes - Click Count (0) -
src/main/java/org/codelibs/fess/helper/CrawlerLogHelper.java
final UrlQueue<?> urlQueue = objs.length > 1 && objs[1] instanceof UrlQueue<?> ? (UrlQueue<?>) objs[1] : null; try { final CrawlerContext crawlerContext = (CrawlerContext) objs[0]; final Throwable e = (Throwable) objs[2]; storeFailureUrl(crawlerContext, urlQueue, e.getClass().getCanonicalName(), e); } catch (final ContainerNotAvailableException e) { if (logger.isDebugEnabled()) {
Created: Tue Mar 31 13:07:34 GMT 2026 - Last Modified: Fri Nov 28 16:29:12 GMT 2025 - 8.3K bytes - Click Count (0) -
fess-crawler-opensearch/src/test/java/org/codelibs/fess/crawler/CrawlerTest.java
assertFalse(crawler1.crawlerContext == crawler2.crawlerContext); for (int i = 0; i < 100; i++) { if (crawler1.crawlerContext.getStatus() == CrawlerStatus.RUNNING) { break; } Thread.sleep(50); } assertEquals(CrawlerStatus.RUNNING, crawler1.crawlerContext.getStatus());
Created: Sun Apr 12 03:50:13 GMT 2026 - Last Modified: Thu Jan 15 01:11:43 GMT 2026 - 7.8K bytes - Click Count (0) -
CLAUDE.md
--- ## Key Components ### Core Classes - **Crawler** (`Crawler.java`): Main orchestrator - `execute()`, `addUrl()`, `cleanup()`, `stop()` - **CrawlerContext** (`CrawlerContext.java`): Execution context - `sessionId`, `status`, `accessCount`, `numOfThread`, `maxDepth`, `maxAccessCount` - **CrawlerThread** (`CrawlerThread.java`): Worker thread - Poll URL → Validate → Execute → Process → Queue children
Created: Sun Apr 12 03:50:13 GMT 2026 - Last Modified: Thu Mar 12 03:39:20 GMT 2026 - 8.1K bytes - Click Count (0)