### Connection Pool Tuning

```java
container.singleton("httpClient", HcHttpClient.class, client -> {
    client.setMaxConnections(200);          // Total connections
    client.setMaxConnectionsPerRoute(20);   // Per-host connections
    client.setConnectionTimeout(30000);     // Connection timeout
    client.setSocketTimeout(60000);         // Read timeout
});
```

### Memory Management

```java

        this.maxTotalConnections = maxTotalConnections;
    }

    /**
     * Sets the maximum connections per route.
     *
     * @param maxConnectionsPerRoute The maximum connections per route
     */
    public void setMaxConnectionsPerRoute(final Integer maxConnectionsPerRoute) {
        this.maxConnectionsPerRoute = maxConnectionsPerRoute;
    }

 * <li>{@link #indexFromQueryLog(QueryLog[])} - Index from multiple query logs.
 * <li>{@link #indexFromQueryLog(QueryLogReader, int, long)} - Index from query log reader with specified document per request and request interval.
 * <li>{@link #indexFromDocument(Map[])} - Index from an array of documents.
 * <li>{@link #indexFromSearchWord(String, String[], String[], String[], int, String[])} - Index from search word.

 *
 * <p>Key features:</p>
 * <ul>
 *   <li>Supports multiple user-agent directives with pattern matching</li>
 *   <li>Handles Allow and Disallow rules for path-based access control</li>
 *   <li>Manages crawl delay settings per user agent</li>
 *   <li>Stores sitemap URLs listed in robots.txt</li>
 * </ul>
 *
 * <p>The class uses case-insensitive pattern matching for user agents and supports