**DataService**: Access result persistence, iteration

**Implementations**:
- `UrlQueueServiceImpl`, `DataServiceImpl`: In-memory (default)
- `OpenSearchDataService`: OpenSearch backend (persistent)

### Processing Pipeline

```
CrawlerThread → Client → ResponseProcessor → Transformer → Extractor → ExtractData
                                                                            ↓

        if (logger.isDebugEnabled()) {
            logger.debug("Total documents added: {}", documentSize.get());
        }

    }

    /**
     * Processes a document through the ingest pipeline.
     * Applies all available ingesters to transform the document data.
     *
     * @param paramMap the data store parameters
     * @param dataMap the document data to process

- **FileSystemClient**: File system access
- **FtpClient**: FTP protocol support
- **SmbClient**: SMB/CIFS network shares
- **StorageClient**: Cloud storage integration

#### Content Processing Pipeline
- **Extractors**: Content extraction from various formats
- **Transformers**: Data transformation and enrichment
- **Filters**: URL filtering with regex patterns
- **Rules**: Content processing rules and validation

        } catch (final IOException e) {
            return StringUtil.EMPTY; // empty
        }
    }

    /**
     * Processes a crawling request for a specific URL.
     * Executes the full crawling pipeline including client execution, rule processing,
     * transformation, and data extraction.
     *
     * @param crawlingConfig the crawling configuration to use
     * @param crawlingInfoId the crawling session ID

            logger.warn("Failed to get data: url={}", accessResult.getUrl(), e);
        }
        return null;
    }

    /**
     * Processes a document through the ingest pipeline if an ingest factory is available.
     * Applies all configured ingesters to transform and enrich the document data.
     *
     * @param accessResult the access result containing document metadata

### Major Features and Improvements

* `tf.data`
    * Adds `autotune.min_parallelism` to `tf.data.Options` to enable faster input pipeline warm up.
* `tf.lite`

Some of the details map precisely to the machine, but some do not.
This is because the compiler suite (see
<a href="https://9p.io/sys/doc/compiler.html">this description</a>)
needs no assembler pass in the usual pipeline.
Instead, the compiler operates on a kind of semi-abstract instruction set,
and instruction selection occurs partly after code generation.
The assembler works on the semi-abstract form, so

			}
		} else {
			if errors[fileline] != "" {
				t.Errorf("unexpected error on %s: %v", fileline, errors[fileline])
			}
		}
		delete(errors, fileline)
	}
	var extra []string
	for key := range errors {
		extra = append(extra, key)
	}
	sort.Strings(extra)
	for _, fileline := range extra {
		t.Errorf("unexpected error on %s: %v", fileline, errors[fileline])
	}

                "-PmaxParallelForks=%maxParallelForks%",
                "-Dorg.gradle.internal.plugins.portal.url.override=%gradle.plugins.portal.url%",
                "-Dscan.value.tcPipeline=master",
                "-s",
                "%additional.gradle.parameters%",
                "--continue",

     */
    @Test
    void testReadDataWireFormat_withNullPipeIn() {
        mockPipe.pipeIn = null;
        byte[] buffer = new byte[10];
        int len = 10;
        int result = response.readDataWireFormat(buffer, 0, len);
        assertEquals(len, result, "readDataWireFormat should return the length when pipeIn is null.");
    }

    /**