# **Disaggregated HDP Spark and Hive with MinIO**

## **1. Cloud-native Architecture**

![cloud-native](https://github.com/minio/minio/blob/master/docs/bigdata/images/image1.png?raw=true "cloud native architecture")

Kubernetes manages stateless Spark and Hive containers elastically on the compute nodes. Spark has native scheduler integration with Kubernetes. Hive, for legacy reasons, uses YARN scheduler on top of Kubernetes.

participant dep as Dep with yield
participant operation as Path Operation
participant tasks as Background tasks

    Note over client,tasks: Can raise exception for dependency, handled after response is sent
    Note over client,operation: Can raise HTTPException and can change the response
    client ->> dep: Start request
    Note over dep: Run code up to yield
    opt raise
        dep -->> handler: Raise HTTPException

        assertEquals("testuser", defaultUsername, "Should delegate default username");
        assertEquals("testpass", defaultPassword, "Should delegate default password");
        assertEquals("jCIFS", nativeLanMan, "Should delegate native LanMan");

        verify(mockDelegate).getOemEncoding();
        verify(mockDelegate).getNetbiosHostname();
        verify(mockDelegate).getDefaultDomain();
        verify(mockDelegate).getDefaultUsername();

- Finalize Daemon JVM toolchain support, including auto-provisioning.
- To stop requiring a pre-installed Java runtime for the Gradle Wrapper and Launcher, Gradle will need to find an alternative.

          native-image-job-reports: true

      - name: Setup Gradle
        uses: gradle/actions/setup-gradle@v5

      - name: Build okcurl
        run: ./gradlew okcurl:nativeBuild

      - name: Setup Gradle
        uses: gradle/actions/setup-gradle@v5

      - name: Run native-image tests
        run: ./gradlew -PgraalBuild=true native-image-tests:nativeTest

  android:

    } catch (IllegalArgumentException expected) {
      // Kotlin native, see above
    }

    try {
      UnsignedInts.parseUnsignedInt("0", Character.MAX_RADIX + 1);
      fail();
    } catch (NumberFormatException expected) {
    } catch (IllegalArgumentException expected) {
      // Kotlin native, see above
    }

    // The radix is used as an array index, so try a negative value.

     *
     * @return remote key
     */
    protected abstract int generateRemoteKey();

    /**
     * Get native memory address of the buffer
     *
     * @param buffer buffer to get address for
     * @return native memory address
     */
    protected abstract long getBufferAddress(ByteBuffer buffer);

    @Override
    public void close() {
        invalidate();

    }

    private
    fun toCategory(version: String, gradleModule: String) = when {
        gradleModule.endsWith("-native") || gradleModule in listOf("model-core", "platform-base", "testing-base") -> "Software Model and Native"
        else -> "Incubating since $version"
    }

    private
    fun generateHtmlReport(data: Map<String, ProjectNameToProblems>) {

            // - Testing basic RDMA operations
            // - Checking for required native libraries

            return true;
        } catch (ClassNotFoundException e) {
            log.debug("DiSNI not available: {}", e.getMessage());
            return false;
        } catch (UnsatisfiedLinkError e) {
            log.debug("DiSNI native libraries not available: {}", e.getMessage());
            return false;
        }
    }

        #}
    }
    # - - - - - - - - - -/
}
# ----------------/
#
# Default mapping as follows:
# --------------------------------------------------------
# | JDBC Type     | Java Native          | CSharp Native |
# | ------------------------------------------------------
# | CHAR          | java.lang.String     | String        |
# | VARCHAR       | java.lang.String     | String        |