You can register crawling targets in the Admin UI on the (Web, File, Data Store) crawler configuration pages, and then start the Crawler manually on the [Scheduler page](https://fess.codelibs.org/15.0/admin/scheduler-guide.html).

## Migration from another search provider

Please see [MIGRATION.md](MIGRATION.md).

## Data Store

    /** The key of the message: Start Crawling */
    public static final String LABELS_wizard_start_crawling_title = "{labels.wizard_start_crawling_title}";

    /** The key of the message: Crawler */
    public static final String LABELS_wizard_start_crawler_title = "{labels.wizard_start_crawler_title}";

    /** The key of the message: You can start crawling now by clicking "Start Crawling" button. */

 */
package org.codelibs.fess.exception;

/**
 * Exception thrown when requested content cannot be found.
 * Typically used when a document or resource is not available during crawling or indexing.
 */
public class ContentNotFoundException extends FessSystemException {

    private static final long serialVersionUID = 1L;

    /**

import org.dbflute.optional.OptionalEntity;

import jakarta.annotation.Resource;

/**
 * Service class for managing request headers used in web crawling configurations.
 * This service provides CRUD operations for request headers that are applied
 * during web crawling to configure HTTP request behavior.
 *
 */
public class RequestHeaderService {

    /**
     * Behavior for request header database operations.
     */

import org.dbflute.optional.OptionalEntity;

import jakarta.annotation.Resource;

/**
 * Service class for managing web crawling configurations.
 * Provides CRUD operations for web configuration settings including
 * listing, retrieving, storing, and deleting web crawling configurations.
 */
public class WebConfigService extends FessAppService {

    /**
     * Default constructor.
     */

import jakarta.validation.constraints.Size;

/**
 * Form class for creating new duplicate host configuration entries.
 * This form handles the creation of duplicate host mappings that redirect
 * crawling from duplicate hostnames to the regular canonical hostname.
 */
public class CreateForm {

    /**
     * Creates a new CreateForm instance.
     */
    public CreateForm() {
    }

 * including tracking information for optimistic locking and audit trails.
 * Duplicate hosts are used to define which domains should be treated as the same site for crawling purposes.
 *
 */
public class EditForm extends CreateForm {

    /**
     * Creates a new EditForm instance.
     */
    public EditForm() {
        super();
    }

    /**

We only use our bug tracker for tracking bugs and tracking proposals going through the [Proposal Process](https://go.dev/s/proposal-process).

For asking questions, see:

* [The golang-nuts mailing list](https://groups.google.com/d/forum/golang-nuts)

* [The Go Forum](https://forum.golangbridge.org/), a web-based forum

    /**
     * The script data or code for the scheduled job.
     */
    @CustomSize(maxKey = "form.admin.max.input.size")
    public String scriptData;

    /**
     * Whether this job is related to crawling.
     */
    public String crawler;

    /**
     * Whether job logging is enabled.
     */
    public String jobLogging;

    /**
     * Whether the scheduled job is available/enabled.
     */

crawler.document.fullstop.chars=u002eu06d4u2e3cu3002
# Encoding for crawling data.
crawler.crawling.data.encoding=UTF-8
# Supported web protocols for crawling.
crawler.web.protocols=http,https
# Supported file protocols for crawling.
crawler.file.protocols=file,smb,smb1,ftp,storage
# Pattern for environment variable keys in crawling data.
crawler.data.env.param.key.pattern=^FESS_ENV_.*