- Sort Score
- Result 10 results
- Languages All
Results 1 - 2 of 2 for update_kv_cache (0.19 sec)
-
tensorflow/compiler/mlir/lite/stablehlo/tests/legalize-stablehlo-tfl-composite.mlir
%0:2 = stablehlo.composite "odml.update_kv_cache" %arg0, %arg1, %arg2, %arg3, %arg4 {composite_attributes = {kv_cache_max = 500 : i64}, decomposition = @odml.update_kv_cache.impl_0} : (tensor<1x500x4x4xf32>, tensor<1x500x4x4xf32>, tensor<100xi64>, tensor<1x100x4x4xf32>, tensor<1x100x4x4xf32>) -> (tensor<1x500x4x4xf32>, tensor<1x500x4x4xf32>)
Registered: Sun Jun 16 05:45:23 UTC 2024 - Last Modified: Thu May 02 09:41:17 UTC 2024 - 5.7K bytes - Viewed (0) -
tensorflow/compiler/mlir/lite/stablehlo/transforms/legalize_stablehlo_composite_to_tfl_custom.cc
// List of supported composites to represent using CustomOp. return llvm::is_contained( {"odml.update_kv_cache", "odml.scaled_dot_product_attention"}, op.getName()); } bool IsKVCacheCompositeOp(::mlir::stablehlo::CompositeOp op) { return op.getName() == "odml.update_kv_cache"; } TFL::ConstBytesAttr CustomOption(OpBuilder* builder, const std::string& content) {
Registered: Sun Jun 16 05:45:23 UTC 2024 - Last Modified: Thu Apr 25 16:01:03 UTC 2024 - 6.8K bytes - Viewed (0)