* @return the normalized encoding name
     */
    protected String normalizeEncoding(final String encoding) {
        try {
            final EncodingHelper encodingHelper = crawlerContainer.getComponent("encodingHelper");
            return encodingHelper.normalize(encoding);
        } catch (final Exception e) {
            // NOP
        }
        return encoding;
    }

    /**

                .singleton("sitemapsHelper", SitemapsHelper.class)
                .singleton("logHelper", LogHelperImpl.class)
                .singleton("encodingHelper", EncodingHelper.class)
                .singleton("contentLengthHelper", ContentLengthHelper.class)
                .singleton("mimeTypeHelper", MimeTypeHelperImpl.class)

```

### Helpers

**RobotsTxtHelper**: RFC 9309 parsing, user-agent matching, crawl-delay, sitemaps
**SitemapsHelper**: Sitemap XML parsing, index handling
**MimeTypeHelper**: MIME detection via Tika
**EncodingHelper**: Charset detection with BOM
**UrlConvertHelper**: URL normalization

---

## Development Workflow

### Build Commands

```bash
mvn clean install              # Build all