Search Options

Results per page
Sort
Preferred Languages
Advance

Results 1 - 7 of 7 for Committer (0.32 sec)

  1. docs/bigdata/README.md

    spark.hadoop.fs.s3a.committer.magic.enabled false
    spark.hadoop.fs.s3a.committer.name directory
    spark.hadoop.fs.s3a.committer.staging.abort.pending.uploads true
    spark.hadoop.fs.s3a.committer.staging.conflict-mode append
    spark.hadoop.fs.s3a.committer.staging.tmp.path /tmp/staging
    spark.hadoop.fs.s3a.committer.staging.unique-filenames true
    spark.hadoop.fs.s3a.committer.threads 2048 # number of threads writing to MinIO
    Plain Text
    - Registered: Sun May 05 19:28:20 GMT 2024
    - Last Modified: Thu Sep 29 04:28:45 GMT 2022
    - 14.7K bytes
    - Viewed (0)
  2. internal/event/target/kafka.go

    func (target *KafkaTarget) SendFromStore(key store.Key) error {
    	if err := target.init(); err != nil {
    		return err
    	}
    
    	// If batch is enabled, the event will be batched in memory
    	// and will be committed once the batch is full.
    	if target.batch != nil {
    		return target.addToBatch(key)
    	}
    
    	eventData, eErr := target.store.Get(key.Name)
    	if eErr != nil {
    Go
    - Registered: Sun May 05 19:28:20 GMT 2024
    - Last Modified: Tue Feb 20 08:16:35 GMT 2024
    - 13K bytes
    - Viewed (0)
  3. Makefile

    	@(env bash $(PWD)/buildscripts/cross-compile.sh)
    
    verifiers: lint check-gen
    
    check-gen: ## check for updated autogenerated files
    	@go generate ./... >/dev/null
    	@(! git diff --name-only | grep '_gen.go$$') || (echo "Non-committed changes in auto-generated code is detected, please commit them to proceed." && false)
    
    lint: getdeps ## runs golangci-lint suite of linters
    	@echo "Running $@ check"
    Plain Text
    - Registered: Sun May 05 19:28:20 GMT 2024
    - Last Modified: Thu Apr 25 21:55:41 GMT 2024
    - 10.3K bytes
    - Viewed (1)
  4. cmd/erasure-server-pool.go

    		//
    		// This happens repeatedly for all objects that are created concurrently() avoiding this
    		// as a List() call is an important performance improvement.
    		//
    		// Spark based s3a committers are a  big enough use-case to have this optimization.
    		//
    		// A sample code to see the improvements is as follows, this sample code is
    		// simply a read on JSON from MinIO and write it back as "parquet".
    		//
    Go
    - Registered: Sun May 05 19:28:20 GMT 2024
    - Last Modified: Fri May 03 20:08:20 GMT 2024
    - 80.5K bytes
    - Viewed (0)
  5. docs/bucket/versioning/README.md

    to optimize versioning behavior for some specific applications. MinIO experts will evaluate and guide on the benefits for your application, please reach out to us on <https://subnet.min.io>.**
    
    Spark/Hadoop workloads which use Hadoop MR Committer v1/v2 algorithm upload objects to a temporary prefix in a bucket. These objects are 'renamed' to a different prefix on Job commit. Object storage admins are forced to configure separate ILM policies to expire these objects and their versions to reclaim...
    Plain Text
    - Registered: Sun May 05 19:28:20 GMT 2024
    - Last Modified: Thu May 04 21:43:52 GMT 2023
    - 11.9K bytes
    - Viewed (1)
  6. CONTRIBUTING.md

    ```
    git commit -am 'Add some feature'
    ```
    
    ### Push to the branch
    
    Push your locally committed changes to the remote origin (your fork)
    
    ```
    git push origin my-new-feature
    ```
    
    ### Create a Pull Request
    
    Plain Text
    - Registered: Sun May 05 19:28:20 GMT 2024
    - Last Modified: Sat Feb 12 00:51:25 GMT 2022
    - 2.8K bytes
    - Viewed (0)
  7. CREDITS

     */
    
    
    --------------------------------------------------
    For lib/py/compat/win32/stdint.h
    
    // ISO C9x  compliant stdint.h for Microsoft Visual Studio
    // Based on ISO/IEC 9899:TC2 Committee draft (May 6, 2005) WG14/N1124
    //
    //  Copyright (c) 2006-2008 Alexander Chemeris
    //
    // Redistribution and use in source and binary forms, with or without
    Plain Text
    - Registered: Sun May 05 19:28:20 GMT 2024
    - Last Modified: Fri Apr 26 06:31:35 GMT 2024
    - 1.6M bytes
    - Viewed (0)
Back to top