---
title: Sample Markdown Document
author: John Doe
date: 2025-01-15
tags:
  - crawler
  - extractor
  - markdown
---

# Introduction

This is a sample Markdown document for testing the MarkdownExtractor.

## Features

The extractor should handle:

- YAML front matter extraction
- Heading structure
- **Bold text** and *italic text*
- Lists and other formatting

### Code Examples

{
  "title": "Sample Document",
  "author": "John Doe",
  "version": "1.0",
  "published": "2025-01-15",
  "tags": ["crawler", "extractor", "json"],
  "content": {
    "summary": "This is a sample JSON document for testing",
    "body": "The extractor should handle nested objects and arrays properly"
  },
  "metadata": {
    "created_at": "2025-01-01T00:00:00Z",
    "updated_at": "2025-01-15T12:00:00Z"
  }

import org.dbflute.utflute.core.PlainTestCase;

/**
 * Test class for AbstractExtractor base functionality.
 * Focuses on testing the validateInputStream() method and other common functionality.
 */
public class AbstractExtractorTest extends PlainTestCase {

    /**
     * Concrete test implementation of AbstractExtractor for testing purposes.
     */
    private static class TestExtractor extends AbstractExtractor {

**Technology Stack:**
- Java 21+, Maven
- OpenSearch (provided dependency)
- Apache Lucene (query parsing, text analysis)
- ICU4J (Unicode text processing)
- JUnit 4 (testing)

**Repository:** https://github.com/codelibs/fess-suggest

---

## Architecture

### Package Structure

```
org.codelibs.fess.suggest/
├── Suggester.java              # Main entry point (Facade)

# This workflow will build a Java project with Maven
# For more information see: https://help.github.com/actions/language-and-framework-guides/building-and-testing-java-with-maven

name: Java CI with Maven

on:
  push:
    branches:
    - master
    - "*.x"
  pull_request:
    branches:
    - master
    - "*.x"

jobs:
  build:
    runs-on: ${{ matrix.os }}

    strategy:
      matrix:

# This workflow will build a Java project with Maven
# For more information see: https://help.github.com/actions/language-and-framework-guides/building-and-testing-java-with-maven

name: Java CI with Maven

on:
  push:
    branches:
    - master
    - "*.x"
  pull_request:
    branches:
    - master
    - "*.x"
  workflow_dispatch:

jobs:
  build:
    runs-on: ubuntu-24.04
    env:
      PARENT_BRANCH: main

- `org.codelibs.curl.io.ContentCache` and `ContentOutputStream`: internal utilities for streaming and caching.

Refer to the Javadoc for full API details.

## Building and Testing

```bash
git clone https://github.com/codelibs/curl4j.git
cd curl4j
mvn clean test
```

## License

        String[] keywords = { "java", "crawler", "testing" };
        data.putValues("keywords", keywords);

        String[] retrievedKeywords = data.getValues("keywords");
        assertNotNull(retrievedKeywords);
        assertEquals(3, retrievedKeywords.length);
        assertEquals("java", retrievedKeywords[0]);
        assertEquals("crawler", retrievedKeywords[1]);
        assertEquals("testing", retrievedKeywords[2]);
    }

- **DI**: LastaFlute DI
- **Repo**: https://github.com/codelibs/fess-crawler

### Tech Stack

- **HTTP**: Apache HttpComponents 4.5+
- **Extraction**: Apache Tika 3.0+, POI 5.3+, PDFBox 3.0+
- **Testing**: JUnit 4, UTFlute, Mockito 5.7.0
- **Storage**: In-memory (default), OpenSearch (optional)

### Protocols

- **HTTP/HTTPS**: Full crawling, cookies, auth, robots.txt
- **File**: Local/network file systems

        cipher.setKey("mySecretKey");

        final StringBuilder sb = new StringBuilder();
        for (int i = 0; i < 1000; i++) {
            sb.append("Long text for testing. ");
        }
        final String original = sb.toString();
        final String encrypted = cipher.encryptText(original);
        final String decrypted = cipher.decryptText(encrypted);

        assertThat(decrypted, is(original));
    }