*/
    public void setConnTimeout(final long connTimeout) {
        this.connTimeout = connTimeout;
    }

    /**
     * Sets the search preference for search requests.
     *
     * @param searchPreference The search preference.
     */
    public void setSearchPreference(final String searchPreference) {
        this.searchPreference = searchPreference;
    }

    @Override

  - [Apache Solr](#apache-solr)
  - [Other Search Systems](#other-search-systems)
- [Data Import Methods](#data-import-methods)
- [Configuration Migration](#configuration-migration)
- [API Reference](#api-reference)
- [Troubleshooting](#troubleshooting)
- [Migration Checklist](#migration-checklist)

---

## Supported Migration Sources

Fess provides built-in support and compatibility layers for:

# Sorts for inner hits in collapse queries.
query.collapse.inner.hits.sorts=
# Default languages for queries.
query.default.languages=
# Default preference for JSON queries.
query.json.default.preference=_query
# Default preference for GSA queries.
query.gsa.default.preference=_query
# Language mapping for queries.
query.language.mapping=\
ar=ar\n\
bg=bg\n\
bn=bn\n\
ca=ca\n\
ckb-iq=ckb-iq\n\
ckb_IQ=ckb-iq\n\

    public static final String REQUEST_LANGUAGES = "requestLanguages";

    /** Request page size parameter name. */
    public static final String REQUEST_PAGE_SIZE = "requestPageSize";

    /** Search preference for local node. */
    public static final String SEARCH_PREFERENCE_LOCAL = "_local";

    /** GSA API version identifier. */
    public static final String GSA_API_VERSION = "3.2";

     * Get the value for the key 'query.json.default.preference'. <br>
     * The value is, e.g. _query <br>
     * comment: Default preference for JSON queries.
     * @return The value of found property. (NotNull: if not found, exception but basically no way)
     */
    String getQueryJsonDefaultPreference();

    /**
     * Get the value for the key 'query.gsa.default.preference'. <br>
     * The value is, e.g. _query <br>

# CLAUDE.md - Fess Crawler Development Guide

Quick reference for AI assistants working on the Fess Crawler project.

## Project Overview

**Fess Crawler** is a Java-based web crawling framework for enterprise content extraction.

### Essential Info

- **Language**: Java 21+
- **Build**: Maven 3.x
- **License**: Apache 2.0
- **DI**: LastaFlute DI
- **Repo**: https://github.com/codelibs/fess-crawler

### Tech Stack

        // Test that allow takes precedence over disallow
        RobotsTxt robotsTxt = new RobotsTxt();

        Directive directive = new Directive("MyBot");
        directive.addDisallow("/admin/");
        directive.addAllow("/admin/public/");
        robotsTxt.addDirective(directive);

        // Allow should take precedence
        assertTrue(robotsTxt.allows("/admin/public/page.html", "MyBot"));

         * According to RFC 9309:
         * 1. Find the longest matching pattern (by priority length)
         * 2. If both Allow and Disallow patterns match with the same length, Allow takes precedence
         * 3. If no pattern matches, the path is allowed by default
         *
         * @param path the path to check
         * @return true if the path is allowed, false otherwise
         */

    if (is == null) {
        throw new IOException("Resource not found");
    }
    return new String(is.readAllBytes(), StandardCharsets.UTF_8);
}
```

---

## Quick Reference

### Essential Files

| File | Purpose |
|------|---------|
| `Suggester.java` | Main entry point, index management |
| `SuggestIndexer.java` | Indexing operations |

import org.codelibs.fess.util.ComponentUtil;
import org.codelibs.fess.util.DocumentUtil;

/**
 * HTML tag-based thumbnail generator that creates thumbnails from image content
 * referenced in HTML documents. This generator extracts images from HTML content
 * and processes them to create thumbnail images based on configured dimensions
 * and format settings.
 *