- **Apache Solr** - Document import via REST API
- **Database Systems** - Direct connection via DataStore plugins
- **File Systems** - SMB, FTP, local file crawling
- **Custom Systems** - REST API for bulk document indexing

---

## Pre-Migration Planning

### 1. Assessment Phase

Before starting migration, assess your current system:

- **Document Count**: Total number of indexed documents

  api(libs.conscrypt.openjdk)
  api(libs.openjsse)

  api(rootProject.libs.junit.jupiter.engine)

  // This runs Corretto on macOS (aarch64) and Linux (x86_64). We don't test Corretto on other
  // operating systems or architectures.
  api(variantOf(libs.amazonCorretto) {
    classifier(
      when {
        OperatingSystem.current().isMacOsX -> "osx-aarch_64"
        OperatingSystem.current().isLinux -> "linux-x86_64"

    version number is enough for some build systems (notably, Gradle) to select
    that empty artifact over the "real" listenablefuture-1.0 -- avoiding a
    conflict with the copy of ListenableFuture in guava itself. If users are
    using an older version of Guava or a build system other than Gradle, they
    may see class conflicts. If so, they can solve them by manually excluding

import java.io.OutputStream;
import java.util.List;
import java.util.Map;

/**
 * Interface for cloud storage operations.
 * Implementations provide access to S3-compatible storage, GCS, or other cloud storage systems.
 */
public interface StorageClient extends AutoCloseable {

    /**
     * Uploads an object to storage.
     *
     * @param objectName the name/path for the object

import software.amazon.awssdk.services.s3.model.Tagging;

/**
 * S3-compatible storage client implementation using AWS SDK v2.
 * Supports Amazon S3, MinIO, and other S3-compatible storage systems.
 */
public class S3StorageClient implements StorageClient {

    private static final Logger logger = LogManager.getLogger(S3StorageClient.class);

    private final S3Client s3Client;

 * It manages the crawling lifecycle, including initialization, execution coordination,
 * monitoring, and cleanup operations.
 *
 * <p>The crawler can operate in different modes based on command-line options:
 * <ul>
 * <li>Web crawling - crawls web sites and web content</li>
 * <li>File system crawling - crawls file systems and documents</li>

// Count
int count = ds.getCount(sessionId);

// Get by URL
AccessResult result = ds.getAccessResult(sessionId, url);

// Iterate all
ds.iterate(sessionId, accessResult -> {
    System.out.println(accessResult.getUrl());
    System.out.println(accessResult.getContent());
});

// Cleanup
ds.delete(sessionId);
```

### Resource Cleanup Pattern

```java

import software.amazon.awssdk.services.s3.model.Tag;

/**
 * A crawler client implementation for accessing and retrieving content from S3-compatible storage systems
 * using AWS SDK v2. This client supports operations on Amazon S3 and S3-compatible storage systems.
 *
 * <p>This client requires the following initialization parameters:
 * <ul>
 *   <li>endpoint - The URL of the S3-compatible server</li>

Fess basiert auf [OpenSearch](https://github.com/opensearch-project/OpenSearch), aber es ist kein Wissen oder Erfahrung mit OpenSearch erforderlich. Fess bietet eine einfach zu bedienende Administrations-GUI zur Konfiguration des Systems über Ihren Browser.

import io.minio.messages.Item;
import io.minio.messages.Tags;
import jakarta.annotation.Resource;

/**
 * A crawler client implementation for accessing and retrieving content from storage systems using MinIO.
 * This client supports operations on object storage systems compatible with S3 protocol.
 *
 * <p>This client requires the following initialization parameters:
 * <ul>
 *   <li>endpoint - The URL of the MinIO server</li>