[[TestingFrameworkCheatsheet]]
= Testing

[partintro]

Elasticsearch uses jUnit for testing, it also uses randomness in the
tests, that can be set using a seed, the following is a cheatsheet of
options for running the tests for ES.

== Creating packages

To create a distribution without running the tests, simply run the
following:

-----------------------------
./gradlew assemble
-----------------------------

packaging/internal-build-reports/           @gradle/bt-developer-productivity
testing/distributions-basics/               @gradle/bt-developer-productivity
testing/distributions-core/                 @gradle/bt-developer-productivity
testing/internal-architecture-testing/      @gradle/bt-developer-productivity
testing/internal-distribution-testing/      @gradle/bt-developer-productivity
testing/internal-integ-testing/             @gradle/bt-developer-productivity

            <option value="$PROJECT_DIR$/testing/internal-integ-testing" />
            <option value="$PROJECT_DIR$/testing/internal-performance-testing" />
            <option value="$PROJECT_DIR$/testing/internal-testing" />
            <option value="$PROJECT_DIR$/testing/performance" />
            <option value="$PROJECT_DIR$/testing/precondition-tester" />

pkg testing, method (*F) Fatal(...interface{})
pkg testing, method (*F) Fatalf(string, ...interface{})
pkg testing, method (*F) Fuzz(interface{})
pkg testing, method (*F) Helper()
pkg testing, method (*F) Log(...interface{})
pkg testing, method (*F) Logf(string, ...interface{})
pkg testing, method (*F) Name() string
pkg testing, method (*F) Setenv(string, string)
pkg testing, method (*F) Skip(...interface{})

    "crossVersionTests": false
  },
  {
    "name": "internal-integ-testing",
    "path": "testing/internal-integ-testing",
    "unitTests": true,
    "functionalTests": true,
    "crossVersionTests": false
  },
  {
    "name": "internal-performance-testing",
    "path": "testing/internal-performance-testing",
    "unitTests": true,
    "functionalTests": true,
    "crossVersionTests": false

    - advanced/sub-applications.md
    - advanced/behind-a-proxy.md
    - advanced/templates.md
    - advanced/websockets.md
    - advanced/events.md
    - advanced/testing-websockets.md
    - advanced/testing-events.md
    - advanced/testing-dependencies.md
    - advanced/async-tests.md
    - advanced/settings.md
    - advanced/openapi-callbacks.md
    - advanced/openapi-webhooks.md
    - advanced/wsgi.md

    C --> F[Witness Protocol]
    D --> F
```

## Testing Strategy

### Unit Tests
- Individual component testing for each feature
- Mock-based testing for protocol interactions
- State machine validation

### Integration Tests
- Feature interaction testing
- Network failure simulation
- Performance benchmarking
- Compatibility testing with Windows Server 2016/2019/2022

    <suppress checks="JavadocPackage"
              files=".*[/\\]testing-jvm[/\\]src[/\\]main[/\\]java[/\\]org[/\\]gradle[/\\]jvm[/\\]plugins[/\\][^/\\]+"/>
    <suppress checks="JavadocPackage"
              files=".*[/\\]testing-jvm[/\\]src[/\\]main[/\\]java[/\\]org[/\\]gradle[/\\]api[/\\]tasks[/\\]testing[/\\][^/\\]+"/>
    <suppress checks="JavadocPackage"

pkg testing, method (*B) Chdir(string) #62516
pkg testing, method (*B) Context() context.Context #36532
pkg testing, method (*B) Loop() bool #61515
pkg testing, method (*F) Chdir(string) #62516
pkg testing, method (*F) Context() context.Context #36532
pkg testing, method (*T) Chdir(string) #62516
pkg testing, method (*T) Context() context.Context #36532
pkg testing, type TB interface, Chdir(string) #62516

        mockBhv.setTestData(testData);

        relatedContentHelper.load();

        String[] results = relatedContentHelper.getRelatedContents("testing");
        assertEquals(1, results.length);
        assertEquals("Test Content for testing", results[0]);

        results = relatedContentHelper.getRelatedContents("123");
        assertEquals(1, results.length);
        assertEquals("Number: 123", results[0]);