Search Options

Display Count
Sort
Preferred Language
Advanced Search

Results 1 - 10 of 11 for CrawlerThread (0.06 seconds)

  1. fess-crawler/src/main/java/org/codelibs/fess/crawler/CrawlerThread.java

     * {@link #isContinue(int)} method returns {@code false}.
     * </p>
     *
     */
    public class CrawlerThread implements Runnable {
        /**
         * Constructs a new CrawlerThread.
         */
        public CrawlerThread() {
            // Default constructor
        }
    
        /**
         * Service for managing URL queues during crawling.
         */
        @Resource
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Wed Dec 31 09:07:38 GMT 2025
    - 20.3K bytes
    - Click Count (0)
  2. src/main/resources/crawler_opensearch+crawlerThread.xml

    <?xml version="1.0" encoding="UTF-8"?>
    <!DOCTYPE components PUBLIC "-//DBFLUTE//DTD LastaDi 1.0//EN" 
    	"http://dbflute.org/meta/lastadi10.dtd">
    <components namespace="fessCrawler">
    	<!-- Crawler Thread -->
    	<component name="crawlerThread" class="org.codelibs.fess.crawler.FessCrawlerThread" instance="prototype" >
    	</component>
    Created: Tue Mar 31 13:07:34 GMT 2026
    - Last Modified: Thu Oct 30 05:29:49 GMT 2025
    - 342 bytes
    - Click Count (0)
  3. src/test/java/org/codelibs/fess/crawler/FessCrawlerThreadTest.java

        @Test
        public void test_getClientRuleList() {
            FessCrawlerThread crawlerThread = new FessCrawlerThread();
    
            List<Pair<String, Pattern>> list = crawlerThread.getClientRuleList(null);
            assertEquals(0, list.size());
    
            list = crawlerThread.getClientRuleList("");
            assertEquals(0, list.size());
    
            list = crawlerThread.getClientRuleList(" ");
            assertEquals(0, list.size());
    
    Created: Tue Mar 31 13:07:34 GMT 2026
    - Last Modified: Sun Jan 11 08:43:05 GMT 2026
    - 9.3K bytes
    - Click Count (0)
  4. fess-crawler/src/main/java/org/codelibs/fess/crawler/Crawler.java

            for (int i = 0; i < crawlerContext.getNumOfThread(); i++) {
                final CrawlerThread crawlerThread = crawlerContainer.getComponent("crawlerThread");
                crawlerThread.setCrawlerContext(crawlerContext);
                crawlerThread.setClientFactory(clientFactory);
                threads[i] =
                        new Thread(crawlerThreadGroup, crawlerThread, "Crawler-" + crawlerContext.sessionId + "-" + Integer.toString(i + 1));
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Mon Nov 24 03:59:47 GMT 2025
    - 17K bytes
    - Click Count (0)
  5. fess-crawler-opensearch/src/main/resources/crawler_opensearch.xml

    	<!-- Crawler -->
    	<component name="crawler" class="org.codelibs.fess.crawler.Crawler" instance="prototype" >
    	</component>
    
    	<!-- Crawler Thread -->
    	<component name="crawlerThread" class="org.codelibs.fess.crawler.CrawlerThread" instance="prototype" >
    	</component>
    
    	<!-- Entity -->
    	<component name="accessResult"
    		class="org.codelibs.fess.crawler.entity.OpenSearchAccessResult" instance="prototype">
    	</component>
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Thu Nov 07 04:44:10 GMT 2024
    - 2.2K bytes
    - Click Count (0)
  6. fess-crawler-lasta/src/main/resources/crawler.xml

    	<!-- Crawler -->
    	<component name="crawler" class="org.codelibs.fess.crawler.Crawler" instance="prototype" >
    	</component>
    
    	<!-- Crawler Thread -->
    	<component name="crawlerThread" class="org.codelibs.fess.crawler.CrawlerThread" instance="prototype" >
    	</component>
    
    	<!-- Entity -->
    	<component name="accessResult" class="org.codelibs.fess.crawler.entity.AccessResultImpl" instance="prototype" >
    	</component>
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Tue Nov 28 13:40:25 GMT 2017
    - 1.7K bytes
    - Click Count (0)
  7. CLAUDE.md

    - **CrawlerContext** (`CrawlerContext.java`): Execution context - `sessionId`, `status`, `accessCount`, `numOfThread`, `maxDepth`, `maxAccessCount`
    - **CrawlerThread** (`CrawlerThread.java`): Worker thread - Poll URL → Validate → Execute → Process → Queue children
    
    ### HTTP Client Architecture
    
    ```
    SwitchableHttpClient (extends FaultTolerantClient)
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Thu Mar 12 03:39:20 GMT 2026
    - 8.1K bytes
    - Click Count (0)
  8. src/main/java/org/codelibs/fess/exec/Crawler.java

         *
         * @param crawlerThread the thread to wait for; null threads are ignored
         */
        private void joinCrawlerThread(final Thread crawlerThread) {
            if (crawlerThread != null) {
                try {
                    crawlerThread.join();
                } catch (final Exception e) {
                    logger.info("Interrupted crawling process: name={}", crawlerThread.getName());
                }
            }
    Created: Tue Mar 31 13:07:34 GMT 2026
    - Last Modified: Thu Mar 26 02:24:08 GMT 2026
    - 32.4K bytes
    - Click Count (0)
  9. src/main/java/org/codelibs/fess/crawler/FessCrawlerThread.java

     * <li>Integration with Fess configuration and permission systems</li>
     * <li>Client selection based on URL patterns</li>
     * </ul>
     *
     * @see CrawlerThread
     * @see org.codelibs.fess.crawler.client.CrawlerClient
     */
    public class FessCrawlerThread extends CrawlerThread {
    
        /**
         * Default constructor.
         */
        public FessCrawlerThread() {
            super();
        }
    
    Created: Tue Mar 31 13:07:34 GMT 2026
    - Last Modified: Thu Dec 11 09:47:03 GMT 2025
    - 19.5K bytes
    - Click Count (0)
  10. src/main/java/org/codelibs/fess/helper/DataIndexHelper.java

            while (startedCrawlerNum < dataCrawlingThreadList.size()) {
                // Force to stop crawl
                if (systemHelper.isForceStop()) {
                    for (final DataCrawlingThread crawlerThread : dataCrawlingThreadList) {
                        crawlerThread.stopCrawling();
                    }
                    break;
                }
    
                if (activeCrawlerNum < multiprocessCrawlingCount) {
                    // start crawling
    Created: Tue Mar 31 13:07:34 GMT 2026
    - Last Modified: Fri Nov 28 16:29:12 GMT 2025
    - 19K bytes
    - Click Count (0)
Back to Top