Search Options

Display Count
Sort
Preferred Language
Advanced Search

Results 1 - 4 of 4 for CrawlerContext (0.07 seconds)

  1. fess-crawler/src/main/java/org/codelibs/fess/crawler/CrawlerContext.java

     * </p>
     *
     * <p>
     * It also provides thread-local storage for sitemaps, allowing each thread to have its own set of sitemaps.
     * </p>
     */
    public class CrawlerContext {
        /**
         * Constructs a new CrawlerContext.
         */
        public CrawlerContext() {
            // Default constructor
        }
    
        /**
         * Session identifier for the crawling session.
         */
        protected String sessionId;
    
        /**
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Wed Dec 31 09:07:38 GMT 2025
    - 9K bytes
    - Click Count (0)
  2. src/main/java/org/codelibs/fess/helper/CrawlerLogHelper.java

            final UrlQueue<?> urlQueue = objs.length > 1 && objs[1] instanceof UrlQueue<?> ? (UrlQueue<?>) objs[1] : null;
            try {
                final CrawlerContext crawlerContext = (CrawlerContext) objs[0];
                final Throwable e = (Throwable) objs[2];
    
                storeFailureUrl(crawlerContext, urlQueue, e.getClass().getCanonicalName(), e);
            } catch (final ContainerNotAvailableException e) {
                if (logger.isDebugEnabled()) {
    Created: Tue Mar 31 13:07:34 GMT 2026
    - Last Modified: Fri Nov 28 16:29:12 GMT 2025
    - 8.3K bytes
    - Click Count (0)
  3. fess-crawler-opensearch/src/test/java/org/codelibs/fess/crawler/CrawlerTest.java

                assertFalse(crawler1.crawlerContext == crawler2.crawlerContext);
    
                for (int i = 0; i < 100; i++) {
                    if (crawler1.crawlerContext.getStatus() == CrawlerStatus.RUNNING) {
                        break;
                    }
                    Thread.sleep(50);
                }
                assertEquals(CrawlerStatus.RUNNING, crawler1.crawlerContext.getStatus());
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Thu Jan 15 01:11:43 GMT 2026
    - 7.8K bytes
    - Click Count (0)
  4. CLAUDE.md

    ---
    
    ## Key Components
    
    ### Core Classes
    
    - **Crawler** (`Crawler.java`): Main orchestrator - `execute()`, `addUrl()`, `cleanup()`, `stop()`
    - **CrawlerContext** (`CrawlerContext.java`): Execution context - `sessionId`, `status`, `accessCount`, `numOfThread`, `maxDepth`, `maxAccessCount`
    - **CrawlerThread** (`CrawlerThread.java`): Worker thread - Poll URL → Validate → Execute → Process → Queue children
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Thu Mar 12 03:39:20 GMT 2026
    - 8.1K bytes
    - Click Count (0)
Back to Top