This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.

## Project Overview

curl4j is a simple cURL-like Java HTTP client library providing a fluent API for building HTTP requests. It's designed to be minimal with only Apache Commons IO as a dependency.

## Development Commands

### Build and Test
```bash
# Clean build and run tests
mvn clean test

# Full build with packaging
mvn clean package

- Use batch operations for indexing (100-500 items)
- Don't call `refresh()` too frequently
- Limit `maxReadingNum` to prevent memory issues
- OpenSearch auto-refreshes every 1 second by default

### Compatibility
- Designed for OpenSearch 2.x+
- All text processing uses UTF-8

        return parse(stream, Constants.UTF_8);
    }

    /**
     * Parses a robots.txt file from the given input stream using the specified character encoding.
     *
     * <p>This method is designed to be resilient to malformed robots.txt files.
     * It will parse valid directives and ignore invalid ones, ensuring that partial
     * content can be extracted even from poorly formatted files.</p>
     *

				"multipart/example",
				"multipart/form-data",
				"multipart/header-set",
				"multipart/mixed",
				"multipart/parallel",
				"multipart/related",
				"multipart/report",
				"multipart/signed",
				"multipart/voice-message",
				"text/x-actionscript",
				"text/x-ada",
				"text/x-applescript",
				"text/asp",
				"text/aspdotnet",
				"text/x-aspectj",
				"text/x-assembly",

  <mime-type type="multipart/header-set"/>
  <mime-type type="multipart/mixed"/>
  <mime-type type="multipart/parallel"/>
  <mime-type type="multipart/report"/>
  <mime-type type="multipart/signed"/>
  <mime-type type="multipart/voice-message"/>

  <mime-type type="application/dif+xml">
    <root-XML localName="DIF"/>
    <root-XML localName="DIF" namespaceURI="http://gcmd.gsfc.nasa.gov/Aboutus/xml/dif/"/>