*/
    public ExtractData extract() {
        final ExtractorFactory extractorFactory = crawlerContainer.getComponent("extractorFactory");

        DeferredFileOutputStream dfos = null;
        try (DeferredFileOutputStream out = new DeferredFileOutputStream(cacheFileSize, "fess-extractor-", ".out", null)) {
            dfos = out;
            CopyUtil.copy(in, out);
            out.flush();

import java.io.File;
import java.io.IOException;
import java.nio.file.Files;
import java.util.logging.Logger;

import org.apache.commons.io.output.DeferredFileOutputStream;

/**
 * ContentOutputStream is a custom output stream that extends DeferredFileOutputStream.
 * It writes data to a temporary file once the data size exceeds a specified threshold.
 *
 * <p>This class ensures that the temporary file is deleted if it is not needed.

        File tempFile = null;
        final String enc = encoding == null ? Constants.UTF_8 : encoding;
        try (DeferredFileOutputStream dfos = new DeferredFileOutputStream(memorySize, "tika", ".tmp", SystemUtils.getJavaIoTmpDir())) {
            final BufferedWriter writer = new BufferedWriter(new OutputStreamWriter(dfos, enc));
            out.accept(writer);

                    contentType = defaultMimeType;
                }
            } else {
                final InputStream responseBodyStream = httpEntity.getContent();
                try (final DeferredFileOutputStream dfos = DeferredFileOutputStream.builder()
                        .setThreshold((int) maxCachedContentSize)
                        .setPrefix("crawler-HcHttpClient-")
                        .setSuffix(".out")

- `volatile` for status flags
- Synchronized blocks for critical sections
- Thread-local storage via `CrawlingParameterUtil`

**Resource Management**:
- `AutoCloseable` throughout
- `DeferredFileOutputStream` for large responses (temp files for >1MB)
- Connection pooling with limits
- Background temp file deletion via `FileUtil.deleteInBackground()`

**Fault Tolerance**: