Search Options

Results per page
Sort
Preferred Languages
Advance

Results 41 - 50 of 785 for rounding (0.07 sec)

  1. guava-tests/test/com/google/common/math/LongMathTest.java

            assertEquals(LongMath.pow(i, exp), valueOf(i).pow(exp).longValue());
          }
        }
      }
    
      @J2ktIncompatible // J2kt BigDecimal.divide also has the rounding bug
      @GwtIncompatible // TODO
      @AndroidIncompatible // TODO(cpovirk): File BigDecimal.divide() rounding bug.
      public void testDivNonZero() {
        for (long p : NONZERO_LONG_CANDIDATES) {
          for (long q : NONZERO_LONG_CANDIDATES) {
    Registered: Fri Nov 01 12:43:10 UTC 2024
    - Last Modified: Fri Oct 18 15:00:32 UTC 2024
    - 30.6K bytes
    - Viewed (0)
  2. android/guava/src/com/google/common/math/PairedStatsAccumulator.java

        checkState(xSumOfSquaresOfDeltas > 0.0);
        checkState(ySumOfSquaresOfDeltas > 0.0);
        // The product of two positive numbers can be zero if the multiplication underflowed. We
        // force a positive value by effectively rounding up to MIN_VALUE.
        double productOfSumsOfSquaresOfDeltas =
            ensurePositive(xSumOfSquaresOfDeltas * ySumOfSquaresOfDeltas);
        return ensureInUnitRange(sumOfProductsOfDeltas / Math.sqrt(productOfSumsOfSquaresOfDeltas));
    Registered: Fri Nov 01 12:43:10 UTC 2024
    - Last Modified: Fri May 12 17:02:53 UTC 2023
    - 10.3K bytes
    - Viewed (0)
  3. android/guava-tests/test/com/google/common/math/IntMathTest.java

            for (RoundingMode mode : ALL_SAFE_ROUNDING_MODES) {
              // Skip some tests that fail due to GWT's non-compliant int implementation.
              // TODO(cpovirk): does this test fail for only some rounding modes or for all?
              if (p == -2147483648 && q == -1 && intsCanGoOutOfRange()) {
                continue;
              }
              int expected =
    Registered: Fri Nov 01 12:43:10 UTC 2024
    - Last Modified: Sat Oct 19 00:26:48 UTC 2024
    - 23.1K bytes
    - Viewed (0)
  4. guava-tests/test/com/google/common/math/IntMathTest.java

            for (RoundingMode mode : ALL_SAFE_ROUNDING_MODES) {
              // Skip some tests that fail due to GWT's non-compliant int implementation.
              // TODO(cpovirk): does this test fail for only some rounding modes or for all?
              if (p == -2147483648 && q == -1 && intsCanGoOutOfRange()) {
                continue;
              }
              int expected =
    Registered: Fri Nov 01 12:43:10 UTC 2024
    - Last Modified: Sat Oct 19 00:26:48 UTC 2024
    - 23.1K bytes
    - Viewed (0)
  5. guava/src/com/google/common/math/Stats.java

       * values in between the two calls, or if one is obtained from the other after round-tripping
       * through java serialization. However, floating point rounding errors mean that it may be false
       * for some instances where the statistics are mathematically equal, including instances
       * constructed from the same values in a different order... or (in the general case) even in the
    Registered: Fri Nov 01 12:43:10 UTC 2024
    - Last Modified: Wed Oct 23 16:45:30 UTC 2024
    - 24.9K bytes
    - Viewed (0)
  6. doc/go1.17_spec.html

    from the value obtained by executing and rounding the instructions individually.
    An explicit floating-point type <a href="#Conversions">conversion</a> rounds to
    the precision of the target type, preventing fusion that would discard that rounding.
    </p>
    
    <p>
    For instance, some architectures provide a "fused multiply and add" (FMA) instruction
    that computes <code>x*y + z</code> without rounding the intermediate result <code>x*y</code>.
    Registered: Tue Nov 05 11:13:11 UTC 2024
    - Last Modified: Thu Oct 10 18:25:45 UTC 2024
    - 211.6K bytes
    - Viewed (0)
  7. android/guava/src/com/google/common/math/Quantiles.java

            low = mid;
          } else {
            return mid; // allRequired[mid] = centerFloor, so we can't get closer than that
          }
        }
    
        // Now pick the closest of the two candidates. Note that there is no rounding here.
        if (from + to - allRequired[low] - allRequired[high] > 0) {
          return high;
        } else {
          return low;
        }
      }
    
      /** Swaps the values at {@code i} and {@code j} in {@code array}. */
    Registered: Fri Nov 01 12:43:10 UTC 2024
    - Last Modified: Fri May 12 17:02:53 UTC 2023
    - 29.9K bytes
    - Viewed (0)
  8. src/cmd/asm/internal/asm/parse.go

    		}
    		for {
    			tok = p.nextToken()
    			if len(operands) == 0 && len(items) == 0 {
    				if p.arch.InFamily(sys.ARM, sys.ARM64, sys.AMD64, sys.I386, sys.RISCV64) && tok == '.' {
    					// Suffixes: ARM conditionals, RISCV rounding mode or x86 modifiers.
    					tok = p.nextToken()
    					str := p.lex.Text()
    					if tok != scanner.Ident {
    						p.errorf("instruction suffix expected identifier, found %s", str)
    					}
    					cond = cond + "." + str
    Registered: Tue Nov 05 11:13:11 UTC 2024
    - Last Modified: Wed Sep 04 18:16:59 UTC 2024
    - 36.9K bytes
    - Viewed (0)
  9. doc/go_spec.html

    fused operation, possibly across statements, and produce a result that differs
    from the value obtained by executing and rounding the instructions individually.
    An explicit <a href="#Numeric_types">floating-point type</a> <a href="#Conversions">conversion</a> rounds to
    the precision of the target type, preventing fusion that would discard that rounding.
    </p>
    
    <p>
    For instance, some architectures provide a "fused multiply and add" (FMA) instruction
    Registered: Tue Nov 05 11:13:11 UTC 2024
    - Last Modified: Wed Oct 02 00:58:01 UTC 2024
    - 282.5K bytes
    - Viewed (0)
  10. src/cmd/asm/internal/asm/testdata/amd64enc_extra.s

    	VPEXTRW $127, X20, (SP)(AX*2)     // 62e37d081524447f or 62e3fd081524447f
    	// EVEX: embedded zeroing.
    	VADDPD.Z X30, X1, K7, X0  // 6291f58f58c6
    	VMAXPD.Z (AX), Z2, K1, Z1 // 62f1edc95f08
    	// EVEX: embedded rounding.
    	VADDPD.RU_SAE Z3, Z2, K1, Z1   // 62f1ed5958cb
    	VADDPD.RD_SAE Z3, Z2, K1, Z1   // 62f1ed3958cb
    	VADDPD.RZ_SAE Z3, Z2, K1, Z1   // 62f1ed7958cb
    	VADDPD.RN_SAE Z3, Z2, K1, Z1   // 62f1ed1958cb
    Registered: Tue Nov 05 11:13:11 UTC 2024
    - Last Modified: Tue Apr 11 18:32:50 UTC 2023
    - 57.6K bytes
    - Viewed (0)
Back to top