SE1992

由于CUDA OOM，对XLA(HLO)内存分配过程的一点总结

单卡（A800, 80GB）测试llama7B时出现CUDA OOM，从日志看，是分配preallocated temp allocation时，出现了OOM。从结果上看，XLA module需要的临时内存，需要一次性分配出来，这导致图还未真正执行即OOM：

分析

一个XLA module对应一个BufferAssignment对象，而一个BufferAssignment对应多个BufferAllocation。
BufferAssignment主要负责分配4类内存，它们相加得到总的内存：

parameter allocation computation的参数
maybe_live_out allocation 生命周期超过computation的，例如返回结果 参考 tensorflow/compiler/xla/service/buffer_assignment.h:333
preallocated temp allocation 中间算子用到的临时内存
constant allocation 常量

Buffer Assignment Stats for Conv2D.9
BufferAssignment stats:
             parameter allocation:    1.25MiB
              constant allocation:         0B
        maybe_live_out allocation:    9.00MiB
     preallocated temp allocation:   19.25MiB
  preallocated temp fragmentation:       112B (0.00%)
                 total allocation:   29.50MiB
              total fragmentation:    8.00MiB (27.12%)

对应到HLO图

可与下节HLO对应查看

HLO (after opt)

HloModule Conv2D.9, entry_computation_layout={(f32[512,2,2,128]{3,2,1,0},f32[1,1,128,512]{3,2,1,0})->f32[512,3,3,512]{3,2,1,0}}

ENTRY main.4 {
  Arg_0.1 = f32[512,2,2,128]{3,2,1,0} parameter(0)
  copy = f32[512,2,2,128]{2,1,0,3} copy(Arg_0.1)
  Arg_1.2 = f32[1,1,128,512]{3,2,1,0} parameter(1)
  bitcast = f32[1,1,128,512]{1,0,3,2} bitcast(Arg_1.2)
  cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(copy, bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"2\":\"0\",\"5\":\"2\",\"14\":\"3\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
  get-tuple-element = f32[512,3,3,512]{2,1,0,3} get-tuple-element(cudnn-conv-bw-filter), index=0, metadata={op_name="Conv2D"}
  ROOT copy.2 = f32[512,3,3,512]{3,2,1,0} copy(get-tuple-element), metadata={op_name="Conv2D"}
}

示例脚本

import tensorflow as tf
import os

x = tf.ones(shape=(512,2,2,128), dtype=tf.float32)
kernel = tf.ones(shape=(1,1,128,512), dtype=tf.float32)

with tf.device("/$XLA_DEVICE_STR:0"):
  lhs = tf.nn.conv2d(
    input=x,
    filters=kernel,
    strides=[1,1],
    padding=[[0,0],[1,0],[1,0],[0,0]],
    dilations=[2,2],
  )

rhs = tf.nn.conv2d(
  input=x,
  filters=kernel,
  strides=[1,1],
  padding=[[0,0],[1,0],[1,0],[0,0]],
  dilations=[2,2],
)

tf.debugging.assert_near(lhs, rhs)

tensorflow日志

based on v2.11.1

TF_CPP_VMODULE=gpu_compiler=2,gpu_executable=2,buffer_assignment=3 python conv2d.py

root@4f07101da743:/data/jack/workspace# TF_CPP_VMODULE=gpu_compiler=2,gpu_executable=2,buffer_assignment=3 python conv2d.py
2023-12-20 09:11:16.272031: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  SSE3 SSE4.1 SSE4.2 AVX AVX2 AVX512F AVX512_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-12-20 09:11:17.076645: I tensorflow/core/util/port.cc:104] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
2023-12-20 09:11:18.633291: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  SSE3 SSE4.1 SSE4.2 AVX AVX2 AVX512F AVX512_VNNI FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-12-20 09:11:18.691364: I tensorflow/compiler/xla/service/service.cc:173] XLA service 0x1fa40c0 initialized for platform Poplar (this does not guarantee that XLA will be used). Devices:
2023-12-20 09:11:18.691438: I tensorflow/compiler/xla/service/service.cc:181]   StreamExecutor device (0): Poplar,
2023-12-20 09:11:25.048037: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1613] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 77507 MB memory:  -> device: 0, name: NVIDIA Graphics Device, pci bus id: 0000:10:00.0, compute capability: 8.0
2023-12-20 09:11:25.049987: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1613] Created device /job:localhost/replica:0/task:0/device:GPU:1 with 77507 MB memory:  -> device: 1, name: NVIDIA Graphics Device, pci bus id: 0000:16:00.0, compute capability: 8.0
2023-12-20 09:11:25.051409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1613] Created device /job:localhost/replica:0/task:0/device:GPU:2 with 77507 MB memory:  -> device: 2, name: NVIDIA Graphics Device, pci bus id: 0000:49:00.0, compute capability: 8.0
2023-12-20 09:11:25.052813: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1613] Created device /job:localhost/replica:0/task:0/device:GPU:3 with 77507 MB memory:  -> device: 3, name: NVIDIA Graphics Device, pci bus id: 0000:4d:00.0, compute capability: 8.0
2023-12-20 09:11:25.054282: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1613] Created device /job:localhost/replica:0/task:0/device:GPU:4 with 77507 MB memory:  -> device: 4, name: NVIDIA Graphics Device, pci bus id: 0000:8a:00.0, compute capability: 8.0
2023-12-20 09:11:25.055458: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1613] Created device /job:localhost/replica:0/task:0/device:GPU:5 with 77507 MB memory:  -> device: 5, name: NVIDIA Graphics Device, pci bus id: 0000:8f:00.0, compute capability: 8.0
2023-12-20 09:11:25.056505: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1613] Created device /job:localhost/replica:0/task:0/device:GPU:6 with 77507 MB memory:  -> device: 6, name: NVIDIA Graphics Device, pci bus id: 0000:c6:00.0, compute capability: 8.0
2023-12-20 09:11:25.057600: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1613] Created device /job:localhost/replica:0/task:0/device:GPU:7 with 76606 MB memory:  -> device: 7, name: NVIDIA Graphics Device, pci bus id: 0000:ca:00.0, compute capability: 8.0
2023-12-20 09:11:27.962269: I tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:428] Loaded cuDNN version 8100
2023-12-20 09:11:49.371683: I tensorflow/compiler/xla/service/gpu/gpu_compiler.cc:656] HLO Fusion Stats:
Number of fusion ops: 0
Number of kLoop fusions: 0

Number of kInput fusions: 0

2023-12-20 09:11:49.382673: I tensorflow/compiler/xla/service/gpu/gpu_compiler.cc:848] GpuCompiler::RunHloPasses time: 22.5 s (cumulative: 22.5 s, max: 22.5 s, #called: 1)
2023-12-20 09:11:49.382728: I tensorflow/compiler/xla/service/gpu/gpu_compiler.cc:1388] Starting to compile HLO module Conv2D.9
2023-12-20 09:11:49.383544: I tensorflow/compiler/xla/service/gpu/gpu_compiler.cc:1406] HLO memory read+written: 21.25MiB
2023-12-20 09:11:49.389876: I tensorflow/compiler/xla/service/buffer_assignment.cc:1693] Assigning buffers to module Conv2D.9
2023-12-20 09:11:49.390982: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694] HloModule Conv2D.9, entry_computation_layout={(f32[512,2,2,128]{3,2,1,0},f32[1,1,128,512]{3,2,1,0})->f32[512,3,3,512]{3,2,1,0}}
2023-12-20 09:11:49.391008: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]
2023-12-20 09:11:49.391016: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694] ENTRY %main.4 (Arg_0.1: f32[512,2,2,128], Arg_1.2: f32[1,1,128,512]) -> f32[512,3,3,512] {
2023-12-20 09:11:49.391048: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]   %Arg_0.1 = f32[512,2,2,128]{3,2,1,0} parameter(0)
2023-12-20 09:11:49.391075: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]   %copy = f32[512,2,2,128]{2,1,0,3} copy(f32[512,2,2,128]{3,2,1,0} %Arg_0.1)
2023-12-20 09:11:49.391108: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]   %Arg_1.2 = f32[1,1,128,512]{3,2,1,0} parameter(1)
2023-12-20 09:11:49.391116: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]   %bitcast = f32[1,1,128,512]{1,0,3,2} bitcast(f32[1,1,128,512]{3,2,1,0} %Arg_1.2)
2023-12-20 09:11:49.391133: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]   %cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.391170: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]   %get-tuple-element = f32[512,3,3,512]{2,1,0,3} get-tuple-element((f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) %cudnn-conv-bw-filter), index=0, metadata={op_name="Conv2D"}
2023-12-20 09:11:49.391209: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]   ROOT %copy.2 = f32[512,3,3,512]{3,2,1,0} copy(f32[512,3,3,512]{2,1,0,3} %get-tuple-element), metadata={op_name="Conv2D"}
2023-12-20 09:11:49.391217: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694] }
2023-12-20 09:11:49.391223: I tensorflow/compiler/xla/service/buffer_assignment.cc:1694]
2023-12-20 09:11:49.391438: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695] HloAliasAnalysis, module Conv2D.9
2023-12-20 09:11:49.391454: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]   Buffers at each position:
2023-12-20 09:11:49.391464: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     Arg_0.1:
2023-12-20 09:11:49.391473: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       HloBuffer 0, values: <0 Arg_0.1>
2023-12-20 09:11:49.391484: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     Arg_1.2:
2023-12-20 09:11:49.391493: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       HloBuffer 2, values: <2 Arg_1.2>
2023-12-20 09:11:49.391500: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     copy:
2023-12-20 09:11:49.391506: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       HloBuffer 1, values: <1 copy>
2023-12-20 09:11:49.391514: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     copy.2:
2023-12-20 09:11:49.391528: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       HloBuffer 6, values: <6 copy.2>
2023-12-20 09:11:49.391534: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     bitcast:
2023-12-20 09:11:49.391542: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       HloBuffer 2, values: <2 Arg_1.2>
2023-12-20 09:11:49.391555: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     cudnn-conv-bw-filter:
2023-12-20 09:11:49.391563: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       tuple index {}:
2023-12-20 09:11:49.391571: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         HloBuffer 3, values: <3 cudnn-conv-bw-filter{}>
2023-12-20 09:11:49.391578: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       tuple index {0}:
2023-12-20 09:11:49.391584: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         HloBuffer 4, values: <4 cudnn-conv-bw-filter{0}>
2023-12-20 09:11:49.391591: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       tuple index {1}:
2023-12-20 09:11:49.391602: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         HloBuffer 5, values: <5 cudnn-conv-bw-filter{1}>
2023-12-20 09:11:49.391611: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     get-tuple-element:
2023-12-20 09:11:49.391617: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       HloBuffer 4, values: <4 cudnn-conv-bw-filter{0}>
2023-12-20 09:11:49.391626: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]   Buffers:
2023-12-20 09:11:49.391634: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     HloBuffer 0, values: <0 Arg_0.1>
2023-12-20 09:11:49.391644: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       positions:
2023-12-20 09:11:49.391662: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         Arg_0.1
2023-12-20 09:11:49.391674: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     HloBuffer 1, values: <1 copy>
2023-12-20 09:11:49.391681: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       positions:
2023-12-20 09:11:49.391689: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         copy
2023-12-20 09:11:49.391701: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     HloBuffer 2, values: <2 Arg_1.2>
2023-12-20 09:11:49.391714: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       positions:
2023-12-20 09:11:49.391727: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         Arg_1.2
2023-12-20 09:11:49.391735: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         bitcast
2023-12-20 09:11:49.391751: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     HloBuffer 3, values: <3 cudnn-conv-bw-filter{}>
2023-12-20 09:11:49.391760: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       positions:
2023-12-20 09:11:49.391769: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         cudnn-conv-bw-filter {}
2023-12-20 09:11:49.391786: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     HloBuffer 4, values: <4 cudnn-conv-bw-filter{0}>
2023-12-20 09:11:49.391798: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       positions:
2023-12-20 09:11:49.391808: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         cudnn-conv-bw-filter {0}
2023-12-20 09:11:49.391823: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         get-tuple-element
2023-12-20 09:11:49.391835: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     HloBuffer 5, values: <5 cudnn-conv-bw-filter{1}>
2023-12-20 09:11:49.391843: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       positions:
2023-12-20 09:11:49.391853: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         cudnn-conv-bw-filter {1}
2023-12-20 09:11:49.391872: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]     HloBuffer 6, values: <6 copy.2>
2023-12-20 09:11:49.391879: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]       positions:
2023-12-20 09:11:49.391891: I tensorflow/compiler/xla/service/buffer_assignment.cc:1695]         copy.2
2023-12-20 09:11:49.392151: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696] HloDataflowAnalysis, module Conv2D.9
2023-12-20 09:11:49.392165: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   Instruction value sets:
2023-12-20 09:11:49.392172: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696] Instruction:
2023-12-20 09:11:49.392183: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   Arg_0.1:
2023-12-20 09:11:49.392195: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       <0 Arg_0.1> (def)
2023-12-20 09:11:49.392202: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696] Instruction:
2023-12-20 09:11:49.392208: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   Arg_1.2:
2023-12-20 09:11:49.392215: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       <2 Arg_1.2> (def)
2023-12-20 09:11:49.392224: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696] Instruction:
2023-12-20 09:11:49.392237: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   copy:
2023-12-20 09:11:49.392246: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       <1 copy> (def)
2023-12-20 09:11:49.392253: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696] Instruction:
2023-12-20 09:11:49.392262: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   copy.2:
2023-12-20 09:11:49.392278: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       <6 copy.2> (def)
2023-12-20 09:11:49.392288: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696] Instruction:
2023-12-20 09:11:49.392300: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   bitcast:
2023-12-20 09:11:49.392311: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       <2 Arg_1.2>
2023-12-20 09:11:49.392322: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696] Instruction:
2023-12-20 09:11:49.392329: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   cudnn-conv-bw-filter:
2023-12-20 09:11:49.392335: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       tuple index {}:
2023-12-20 09:11:49.392345: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]         <3 cudnn-conv-bw-filter{}> (def)
2023-12-20 09:11:49.392353: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       tuple index {0}:
2023-12-20 09:11:49.392360: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]         <4 cudnn-conv-bw-filter{0}> (def)
2023-12-20 09:11:49.392374: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       tuple index {1}:
2023-12-20 09:11:49.392383: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]         <5 cudnn-conv-bw-filter{1}> (def)
2023-12-20 09:11:49.392392: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696] Instruction:
2023-12-20 09:11:49.392403: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   get-tuple-element:
2023-12-20 09:11:49.392415: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       <4 cudnn-conv-bw-filter{0}>
2023-12-20 09:11:49.392423: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]   HloValues:
2023-12-20 09:11:49.392432: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]     <0 Arg_0.1>
2023-12-20 09:11:49.392442: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      positions:
2023-12-20 09:11:49.392449: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       Arg_0.1
2023-12-20 09:11:49.392455: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      uses:
2023-12-20 09:11:49.392468: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       copy, operand 0
2023-12-20 09:11:49.392477: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      from instruction:%Arg_0.1 = f32[512,2,2,128]{3,2,1,0} parameter(0)
2023-12-20 09:11:49.392487: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]     <1 copy>
2023-12-20 09:11:49.392497: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      positions:
2023-12-20 09:11:49.392510: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       copy
2023-12-20 09:11:49.392518: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      uses:
2023-12-20 09:11:49.392524: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       cudnn-conv-bw-filter, operand 0
2023-12-20 09:11:49.392535: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      from instruction:%copy = f32[512,2,2,128]{2,1,0,3} copy(f32[512,2,2,128]{3,2,1,0} %Arg_0.1)
2023-12-20 09:11:49.392542: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]     <2 Arg_1.2>
2023-12-20 09:11:49.392549: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      positions:
2023-12-20 09:11:49.392556: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       Arg_1.2
2023-12-20 09:11:49.392566: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       bitcast
2023-12-20 09:11:49.392578: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      uses:
2023-12-20 09:11:49.392593: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       bitcast, operand 0
2023-12-20 09:11:49.392604: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       cudnn-conv-bw-filter, operand 1
2023-12-20 09:11:49.392612: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      from instruction:%Arg_1.2 = f32[1,1,128,512]{3,2,1,0} parameter(1)
2023-12-20 09:11:49.392624: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]     <3 cudnn-conv-bw-filter{}>
2023-12-20 09:11:49.392636: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      positions:
2023-12-20 09:11:49.392649: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       cudnn-conv-bw-filter {}
2023-12-20 09:11:49.392657: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      uses:
2023-12-20 09:11:49.392668: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       get-tuple-element, operand 0 {}
2023-12-20 09:11:49.392678: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.392694: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]     <4 cudnn-conv-bw-filter{0}>
2023-12-20 09:11:49.392702: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      positions:
2023-12-20 09:11:49.392716: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       cudnn-conv-bw-filter {0}
2023-12-20 09:11:49.392727: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       get-tuple-element
2023-12-20 09:11:49.392739: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      uses:
2023-12-20 09:11:49.392749: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       copy.2, operand 0
2023-12-20 09:11:49.392756: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.392764: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]     <5 cudnn-conv-bw-filter{1}>
2023-12-20 09:11:49.392771: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      positions:
2023-12-20 09:11:49.392783: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       cudnn-conv-bw-filter {1}
2023-12-20 09:11:49.392791: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      uses:
2023-12-20 09:11:49.392808: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.392819: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]     <6 copy.2>
2023-12-20 09:11:49.392831: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      positions:
2023-12-20 09:11:49.392838: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]       copy.2
2023-12-20 09:11:49.392848: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      uses:
2023-12-20 09:11:49.392870: I tensorflow/compiler/xla/service/buffer_assignment.cc:1696]      from instruction:%copy.2 = f32[512,3,3,512]{3,2,1,0} copy(f32[512,3,3,512]{2,1,0,3} %get-tuple-element), metadata={op_name="Conv2D"}
2023-12-20 09:11:49.392887: I tensorflow/compiler/xla/service/buffer_assignment.cc:1697] Number of buffers to assign: 7
2023-12-20 09:11:49.392927: I tensorflow/compiler/xla/service/buffer_assignment.cc:1709] After coloring:
2023-12-20 09:11:49.393153: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710] HloDataflowAnalysis, module Conv2D.9
2023-12-20 09:11:49.393161: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   Instruction value sets:
2023-12-20 09:11:49.393165: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710] Instruction:
2023-12-20 09:11:49.393169: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   Arg_0.1:
2023-12-20 09:11:49.393173: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       <0 Arg_0.1 @0> (def)
2023-12-20 09:11:49.393177: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710] Instruction:
2023-12-20 09:11:49.393180: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   Arg_1.2:
2023-12-20 09:11:49.393185: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       <2 Arg_1.2 @0> (def)
2023-12-20 09:11:49.393189: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710] Instruction:
2023-12-20 09:11:49.393193: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   copy:
2023-12-20 09:11:49.393196: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       <1 copy @0> (def)
2023-12-20 09:11:49.393200: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710] Instruction:
2023-12-20 09:11:49.393204: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   copy.2:
2023-12-20 09:11:49.393208: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       <6 copy.2 @0> (def)
2023-12-20 09:11:49.393212: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710] Instruction:
2023-12-20 09:11:49.393216: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   bitcast:
2023-12-20 09:11:49.393220: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       <2 Arg_1.2 @0>
2023-12-20 09:11:49.393224: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710] Instruction:
2023-12-20 09:11:49.393228: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   cudnn-conv-bw-filter:
2023-12-20 09:11:49.393232: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       tuple index {}:
2023-12-20 09:11:49.393236: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]         <3 cudnn-conv-bw-filter{} @0> (def)
2023-12-20 09:11:49.393240: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       tuple index {0}:
2023-12-20 09:11:49.393244: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]         <4 cudnn-conv-bw-filter{0} @0> (def)
2023-12-20 09:11:49.393249: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       tuple index {1}:
2023-12-20 09:11:49.393252: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]         <5 cudnn-conv-bw-filter{1} @0> (def)
2023-12-20 09:11:49.393256: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710] Instruction:
2023-12-20 09:11:49.393260: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   get-tuple-element:
2023-12-20 09:11:49.393264: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       <4 cudnn-conv-bw-filter{0} @0>
2023-12-20 09:11:49.393269: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]   HloValues:
2023-12-20 09:11:49.393273: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]     <0 Arg_0.1 @0>
2023-12-20 09:11:49.393277: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      positions:
2023-12-20 09:11:49.393281: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       Arg_0.1
2023-12-20 09:11:49.393285: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      uses:
2023-12-20 09:11:49.393289: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       copy, operand 0
2023-12-20 09:11:49.393293: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      from instruction:%Arg_0.1 = f32[512,2,2,128]{3,2,1,0} parameter(0)
2023-12-20 09:11:49.393297: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]     <1 copy @0>
2023-12-20 09:11:49.393301: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      positions:
2023-12-20 09:11:49.393305: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       copy
2023-12-20 09:11:49.393309: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      uses:
2023-12-20 09:11:49.393313: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       cudnn-conv-bw-filter, operand 0
2023-12-20 09:11:49.393317: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      from instruction:%copy = f32[512,2,2,128]{2,1,0,3} copy(f32[512,2,2,128]{3,2,1,0} %Arg_0.1)
2023-12-20 09:11:49.393322: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]     <2 Arg_1.2 @0>
2023-12-20 09:11:49.393326: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      positions:
2023-12-20 09:11:49.393330: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       Arg_1.2
2023-12-20 09:11:49.393333: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       bitcast
2023-12-20 09:11:49.393337: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      uses:
2023-12-20 09:11:49.393341: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       bitcast, operand 0
2023-12-20 09:11:49.393345: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       cudnn-conv-bw-filter, operand 1
2023-12-20 09:11:49.393349: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      from instruction:%Arg_1.2 = f32[1,1,128,512]{3,2,1,0} parameter(1)
2023-12-20 09:11:49.393354: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]     <3 cudnn-conv-bw-filter{} @0>
2023-12-20 09:11:49.393358: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      positions:
2023-12-20 09:11:49.393362: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       cudnn-conv-bw-filter {}
2023-12-20 09:11:49.393366: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      uses:
2023-12-20 09:11:49.393370: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       get-tuple-element, operand 0 {}
2023-12-20 09:11:49.393393: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.393399: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]     <4 cudnn-conv-bw-filter{0} @0>
2023-12-20 09:11:49.393403: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      positions:
2023-12-20 09:11:49.393407: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       cudnn-conv-bw-filter {0}
2023-12-20 09:11:49.393413: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       get-tuple-element
2023-12-20 09:11:49.393417: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      uses:
2023-12-20 09:11:49.393422: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       copy.2, operand 0
2023-12-20 09:11:49.393427: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.393434: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]     <5 cudnn-conv-bw-filter{1} @0>
2023-12-20 09:11:49.393439: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      positions:
2023-12-20 09:11:49.393444: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       cudnn-conv-bw-filter {1}
2023-12-20 09:11:49.393448: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      uses:
2023-12-20 09:11:49.393452: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.393458: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]     <6 copy.2 @0>
2023-12-20 09:11:49.393468: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      positions:
2023-12-20 09:11:49.393481: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]       copy.2
2023-12-20 09:11:49.393493: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      uses:
2023-12-20 09:11:49.393501: I tensorflow/compiler/xla/service/buffer_assignment.cc:1710]      from instruction:%copy.2 = f32[512,3,3,512]{3,2,1,0} copy(f32[512,3,3,512]{2,1,0,3} %get-tuple-element), metadata={op_name="Conv2D"}
2023-12-20 09:11:49.394199: I tensorflow/compiler/xla/service/buffer_assignment.cc:1350] =================================================
2023-12-20 09:11:49.394235: I tensorflow/compiler/xla/service/buffer_assignment.cc:1351] Assigning buffer for HloBuffer 5, values: <5 cudnn-conv-bw-filter{1} @0>
2023-12-20 09:11:49.394289: I tensorflow/compiler/xla/service/buffer_assignment.cc:1232] Delaying assignment of temp buffer: <5 cudnn-conv-bw-filter{1} @0>
2023-12-20 09:11:49.394301: I tensorflow/compiler/xla/service/buffer_assignment.cc:1350] =================================================
2023-12-20 09:11:49.394312: I tensorflow/compiler/xla/service/buffer_assignment.cc:1351] Assigning buffer for HloBuffer 6, values: <6 copy.2 @0>
2023-12-20 09:11:49.394437: I tensorflow/compiler/xla/service/buffer_assignment.cc:526] HloBuffer lives out: HloBuffer 6, values: <6 copy.2 @0>
2023-12-20 09:11:49.394486: I tensorflow/compiler/xla/service/buffer_assignment.cc:527] Set maybe live out: allocation 0: size 9437184, output shape is |f32[512,3,3,512]|, preallocated-temp:
 value: <6 copy.2 @0> (size=9437184,offset=0): f32[512,3,3,512]{3,2,1,0}

2023-12-20 09:11:49.394514: I tensorflow/compiler/xla/service/buffer_assignment.cc:1242] New allocation #0 for: HloBuffer 6, values: <6 copy.2 @0>
2023-12-20 09:11:49.394528: I tensorflow/compiler/xla/service/buffer_assignment.cc:1350] =================================================
2023-12-20 09:11:49.394541: I tensorflow/compiler/xla/service/buffer_assignment.cc:1351] Assigning buffer for HloBuffer 4, values: <4 cudnn-conv-bw-filter{0} @0>
2023-12-20 09:11:49.394615: I tensorflow/compiler/xla/service/buffer_assignment.cc:1232] Delaying assignment of temp buffer: <4 cudnn-conv-bw-filter{0} @0>
2023-12-20 09:11:49.394628: I tensorflow/compiler/xla/service/buffer_assignment.cc:1350] =================================================
2023-12-20 09:11:49.394639: I tensorflow/compiler/xla/service/buffer_assignment.cc:1351] Assigning buffer for HloBuffer 0, values: <0 Arg_0.1 @0>
2023-12-20 09:11:49.394737: I tensorflow/compiler/xla/service/buffer_assignment.cc:1154] New allocation #1 marked as entry computation parameter: HloBuffer 0, values: <0 Arg_0.1 @0>
2023-12-20 09:11:49.394751: I tensorflow/compiler/xla/service/buffer_assignment.cc:1350] =================================================
2023-12-20 09:11:49.394762: I tensorflow/compiler/xla/service/buffer_assignment.cc:1351] Assigning buffer for HloBuffer 1, values: <1 copy @0>
2023-12-20 09:11:49.394888: I tensorflow/compiler/xla/service/buffer_assignment.cc:1203] Reusing allocation #0 for: HloBuffer 1, values: <1 copy @0>
2023-12-20 09:11:49.394903: I tensorflow/compiler/xla/service/buffer_assignment.cc:1350] =================================================
2023-12-20 09:11:49.394913: I tensorflow/compiler/xla/service/buffer_assignment.cc:1351] Assigning buffer for HloBuffer 2, values: <2 Arg_1.2 @0>
2023-12-20 09:11:49.395007: I tensorflow/compiler/xla/service/buffer_assignment.cc:1154] New allocation #2 marked as entry computation parameter: HloBuffer 2, values: <2 Arg_1.2 @0>
2023-12-20 09:11:49.395022: I tensorflow/compiler/xla/service/buffer_assignment.cc:1350] =================================================
2023-12-20 09:11:49.395034: I tensorflow/compiler/xla/service/buffer_assignment.cc:1351] Assigning buffer for HloBuffer 3, values: <3 cudnn-conv-bw-filter{} @0>
2023-12-20 09:11:49.395091: I tensorflow/compiler/xla/service/buffer_assignment.cc:1174] New allocation #3 for tuple-shaped buffer: HloBuffer 3, values: <3 cudnn-conv-bw-filter{} @0>
2023-12-20 09:11:49.395127: I tensorflow/compiler/xla/service/buffer_assignment.cc:1732] Running whole module heap simulation: 1
2023-12-20 09:11:49.395138: I tensorflow/compiler/xla/service/buffer_assignment.cc:1736] Multiheap per heap size limit: -1
2023-12-20 09:11:49.395148: I tensorflow/compiler/xla/service/buffer_assignment.cc:1451] Running whole-module heap simulation
2023-12-20 09:11:49.395230: I tensorflow/compiler/xla/service/buffer_assignment.cc:1467] Simulating heap for color 0
2023-12-20 09:11:49.396053: I tensorflow/compiler/xla/service/buffer_assignment.cc:1648] Result size from heap simulator: 20185216
2023-12-20 09:11:49.396218: I tensorflow/compiler/xla/service/buffer_assignment.cc:1529] Compute peak memory logical buffers
2023-12-20 09:11:49.396361: I tensorflow/compiler/xla/service/buffer_assignment.cc:1664] allocation 4: size 20185216, preallocated-temp:
2023-12-20 09:11:49.396378: I tensorflow/compiler/xla/service/buffer_assignment.cc:1664]  value: <4 cudnn-conv-bw-filter{0} @0> (size=9437184,offset=10748032): f32[512,3,3,512]{2,1,0,3}
2023-12-20 09:11:49.396386: I tensorflow/compiler/xla/service/buffer_assignment.cc:1664]  value: <5 cudnn-conv-bw-filter{1} @0> (size=10747920,offset=0): u8[10747920]{0}
2023-12-20 09:11:49.396451: I tensorflow/compiler/xla/service/buffer_assignment.cc:1763] maybe_live_out LogicalBuffer: HloBuffer 6, values: <6 copy.2 @0>
2023-12-20 09:11:49.396500: I tensorflow/compiler/xla/service/buffer_assignment.cc:1768] maybe_live_out BufferAllocation: allocation 0: size 9437184, output shape is |f32[512,3,3,512]|, maybe-live-out:
 value: <1 copy @0> (size=1048576,offset=0): f32[512,2,2,128]{2,1,0,3}
 value: <6 copy.2 @0> (size=9437184,offset=0): f32[512,3,3,512]{3,2,1,0}

2023-12-20 09:11:49.396524: I tensorflow/compiler/xla/service/buffer_assignment.cc:549] CombineTempAllocations()
2023-12-20 09:11:49.396565: I tensorflow/compiler/xla/service/buffer_assignment.cc:574] Combined temp allocation for color 0 is: allocation 3: size 16, preallocated-temp:
 value: <3 cudnn-conv-bw-filter{} @0> (size=16,offset=0): (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0})

2023-12-20 09:11:49.396651: I tensorflow/compiler/xla/service/buffer_assignment.cc:592] Combined allocation absorbing temp allocation: allocation 4: size 20185216, preallocated-temp:
 value: <4 cudnn-conv-bw-filter{0} @0> (size=9437184,offset=10748032): f32[512,3,3,512]{2,1,0,3}
 value: <5 cudnn-conv-bw-filter{1} @0> (size=10747920,offset=0): u8[10747920]{0}

2023-12-20 09:11:49.397043: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] BufferAssignment:
2023-12-20 09:11:49.397064: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] allocation 0: size 9437184, output shape is |f32[512,3,3,512]|, maybe-live-out:
2023-12-20 09:11:49.397072: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  value: <1 copy @0> (size=1048576,offset=0): f32[512,2,2,128]{2,1,0,3}
2023-12-20 09:11:49.397083: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  value: <6 copy.2 @0> (size=9437184,offset=0): f32[512,3,3,512]{3,2,1,0}
2023-12-20 09:11:49.397099: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] allocation 1: size 1048576, parameter 0, shape |f32[512,2,2,128]| at ShapeIndex {}:
2023-12-20 09:11:49.397110: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  value: <0 Arg_0.1 @0> (size=1048576,offset=0): f32[512,2,2,128]{3,2,1,0}
2023-12-20 09:11:49.397117: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] allocation 2: size 262144, parameter 1, shape |f32[1,1,128,512]| at ShapeIndex {}:
2023-12-20 09:11:49.397128: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  value: <2 Arg_1.2 @0> (size=262144,offset=0): f32[1,1,128,512]{3,2,1,0}
2023-12-20 09:11:49.397140: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] allocation 3: size 20185344, preallocated-temp:
2023-12-20 09:11:49.397150: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  value: <3 cudnn-conv-bw-filter{} @0> (size=16,offset=0): (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0})
2023-12-20 09:11:49.397163: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  value: <4 cudnn-conv-bw-filter{0} @0> (size=9437184,offset=10748160): f32[512,3,3,512]{2,1,0,3}
2023-12-20 09:11:49.397175: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  value: <5 cudnn-conv-bw-filter{1} @0> (size=10747920,offset=128): u8[10747920]{0}
2023-12-20 09:11:49.397187: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]
2023-12-20 09:11:49.397194: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] Total bytes used: 30933248 (29.50MiB)
2023-12-20 09:11:49.397204: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]
2023-12-20 09:11:49.397221: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] Used values:
2023-12-20 09:11:49.397231: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] <0 Arg_0.1 @0>
2023-12-20 09:11:49.397238: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  positions:
2023-12-20 09:11:49.397249: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   Arg_0.1
2023-12-20 09:11:49.397258: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  uses:
2023-12-20 09:11:49.397269: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   copy, operand 0
2023-12-20 09:11:49.397276: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  from instruction:%Arg_0.1 = f32[512,2,2,128]{3,2,1,0} parameter(0)
2023-12-20 09:11:49.397285: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] <1 copy @0>
2023-12-20 09:11:49.397296: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  positions:
2023-12-20 09:11:49.397304: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   copy
2023-12-20 09:11:49.397312: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  uses:
2023-12-20 09:11:49.397323: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   cudnn-conv-bw-filter, operand 0
2023-12-20 09:11:49.397333: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  from instruction:%copy = f32[512,2,2,128]{2,1,0,3} copy(f32[512,2,2,128]{3,2,1,0} %Arg_0.1)
2023-12-20 09:11:49.397344: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] <2 Arg_1.2 @0>
2023-12-20 09:11:49.397356: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  positions:
2023-12-20 09:11:49.397368: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   Arg_1.2
2023-12-20 09:11:49.397379: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   bitcast
2023-12-20 09:11:49.397391: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  uses:
2023-12-20 09:11:49.397399: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   bitcast, operand 0
2023-12-20 09:11:49.397411: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   cudnn-conv-bw-filter, operand 1
2023-12-20 09:11:49.397422: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  from instruction:%Arg_1.2 = f32[1,1,128,512]{3,2,1,0} parameter(1)
2023-12-20 09:11:49.397433: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] <3 cudnn-conv-bw-filter{} @0>
2023-12-20 09:11:49.397444: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  positions:
2023-12-20 09:11:49.397456: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   cudnn-conv-bw-filter {}
2023-12-20 09:11:49.397469: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  uses:
2023-12-20 09:11:49.397476: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   get-tuple-element, operand 0 {}
2023-12-20 09:11:49.397486: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.397500: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] <4 cudnn-conv-bw-filter{0} @0>
2023-12-20 09:11:49.397513: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  positions:
2023-12-20 09:11:49.397524: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   cudnn-conv-bw-filter {0}
2023-12-20 09:11:49.397536: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   get-tuple-element
2023-12-20 09:11:49.397548: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  uses:
2023-12-20 09:11:49.397557: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   copy.2, operand 0
2023-12-20 09:11:49.397564: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.397576: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] <5 cudnn-conv-bw-filter{1} @0>
2023-12-20 09:11:49.397587: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  positions:
2023-12-20 09:11:49.397597: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   cudnn-conv-bw-filter {1}
2023-12-20 09:11:49.397609: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  uses:
2023-12-20 09:11:49.397618: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  from instruction:%cudnn-conv-bw-filter = (f32[512,3,3,512]{2,1,0,3}, u8[10747920]{0}) custom-call(f32[512,2,2,128]{2,1,0,3} %copy, f32[1,1,128,512]{1,0,3,2} %bitcast), window={size=3x3 stride=2x2 pad=1_1x1_1}, dim_labels=f01b_i01o->01bf, custom_call_target="__cudnn$convBackwardFilter", metadata={op_name="Conv2D"}, backend_config="{\"algorithm\":{\"algo_id\":\"22\",\"math_type\":\"DEFAULT_MATH\",\"tuning_knobs\":{\"5\":\"2\",\"14\":\"3\",\"2\":\"0\"},\"is_cudnn_frontend\":true,\"workspace_size\":\"10747920\"},\"conv_result_scale\":1,\"activation_mode\":\"0\",\"side_input_scale\":0}"
2023-12-20 09:11:49.397630: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779] <6 copy.2 @0>
2023-12-20 09:11:49.397640: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  positions:
2023-12-20 09:11:49.397652: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]   copy.2
2023-12-20 09:11:49.397662: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  uses:
2023-12-20 09:11:49.397674: I tensorflow/compiler/xla/service/buffer_assignment.cc:1779]  from instruction:%copy.2 = f32[512,3,3,512]{3,2,1,0} copy(f32[512,3,3,512]{2,1,0,3} %get-tuple-element), metadata={op_name="Conv2D"}
2023-12-20 09:11:49.399450: I tensorflow/compiler/xla/service/buffer_assignment.cc:1781] BufferAssignment stats:
2023-12-20 09:11:49.399473: I tensorflow/compiler/xla/service/buffer_assignment.cc:1781]              parameter allocation:    1.25MiB
2023-12-20 09:11:49.399481: I tensorflow/compiler/xla/service/buffer_assignment.cc:1781]               constant allocation:         0B
2023-12-20 09:11:49.399491: I tensorflow/compiler/xla/service/buffer_assignment.cc:1781]         maybe_live_out allocation:    9.00MiB
2023-12-20 09:11:49.399504: I tensorflow/compiler/xla/service/buffer_assignment.cc:1781]      preallocated temp allocation:   19.25MiB
2023-12-20 09:11:49.399514: I tensorflow/compiler/xla/service/buffer_assignment.cc:1781]   preallocated temp fragmentation:       112B (0.00%)
2023-12-20 09:11:49.399527: I tensorflow/compiler/xla/service/buffer_assignment.cc:1781]                  total allocation:   29.50MiB
2023-12-20 09:11:49.399539: I tensorflow/compiler/xla/service/buffer_assignment.cc:1781]               total fragmentation:    8.00MiB (27.12%)
2023-12-20 09:11:49.399553: I tensorflow/compiler/xla/service/buffer_assignment.cc:1782] Buffer assignment done.
2023-12-20 09:11:49.399597: I tensorflow/compiler/xla/service/gpu/gpu_compiler.cc:1049] Buffer Assignment Stats for Conv2D.9
BufferAssignment stats:
             parameter allocation:    1.25MiB
              constant allocation:         0B
        maybe_live_out allocation:    9.00MiB
     preallocated temp allocation:   19.25MiB
  preallocated temp fragmentation:       112B (0.00%)
                 total allocation:   29.50MiB
              total fragmentation:    8.00MiB (27.12%)

2023-12-20 09:11:49.407472: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for copy.2 [{}]
2023-12-20 09:11:49.407521: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <6 copy.2 @0>
2023-12-20 09:11:49.407542: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.408162: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for bitcast [{}]
2023-12-20 09:11:49.408205: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <2 Arg_1.2 @0>
2023-12-20 09:11:49.408228: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.408249: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for Arg_1.2 [{}]
2023-12-20 09:11:49.408266: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <2 Arg_1.2 @0>
2023-12-20 09:11:49.408296: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.408474: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for Arg_0.1 [{}]
2023-12-20 09:11:49.408503: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <0 Arg_0.1 @0>
2023-12-20 09:11:49.408521: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.408924: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for copy [{}]
2023-12-20 09:11:49.408966: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <1 copy @0>
2023-12-20 09:11:49.408983: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.410060: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for bitcast [{}]
2023-12-20 09:11:49.410110: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <2 Arg_1.2 @0>
2023-12-20 09:11:49.410132: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.410497: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for cudnn-conv-bw-filter [{0}]
2023-12-20 09:11:49.410542: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <4 cudnn-conv-bw-filter{0} @0>
2023-12-20 09:11:49.410559: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.410890: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for cudnn-conv-bw-filter [{1}]
2023-12-20 09:11:49.410933: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <5 cudnn-conv-bw-filter{1} @0>
2023-12-20 09:11:49.410950: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.411450: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for get-tuple-element [{}]
2023-12-20 09:11:49.411493: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <4 cudnn-conv-bw-filter{0} @0>
2023-12-20 09:11:49.411511: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.411821: I tensorflow/compiler/xla/service/buffer_assignment.cc:413] Trying to find unique slice for copy.2 [{}]
2023-12-20 09:11:49.411863: I tensorflow/compiler/xla/service/buffer_assignment.cc:418] Examining value <6 copy.2 @0>
2023-12-20 09:11:49.411880: I tensorflow/compiler/xla/service/buffer_assignment.cc:420] Has allocation
2023-12-20 09:11:49.425292: I tensorflow/compiler/xla/service/gpu/gpu_compiler.cc:1103] GpuCompiler::RunBackend - IR emission time: 9.68 ms (cumulative: 9.68 ms, max: 9.68 ms, #called: 1)
2023-12-20 09:11:49.427762: I tensorflow/compiler/xla/service/gpu/gpu_compiler.cc:1168] GpuCompiler::RunBackend - Running LLVM verifier time: 1.63 ms (cumulative: 1.63 ms, max: 1.63 ms, #called: 1)
2023-12-20 09:11:50.128260: I tensorflow/compiler/xla/service/gpu/gpu_compiler.cc:1389] GpuCompiler::RunBackend time: 745 ms (cumulative: 745 ms, max: 745 ms, #called: 1)
2023-12-20 09:11:50.129347: I tensorflow/compiler/jit/xla_compilation_cache.cc:477] Compiled cluster using XLA!  This line is logged at most once for the lifetime of the process.
2023-12-20 09:11:50.135349: I tensorflow/compiler/xla/service/gpu/gpu_executable.cc:755] Buffer 0 -> 0x7fafda655200 (1048576 B)Buffer 1 -> 0x7fafda755200 (262144 B)Buffer 2 -> 0x7fafdb200000 (9437184 B)Buffer 3 -> 0x7fafdbc00000 (20185344 B)
2023-12-20 09:11:50.135767: I tensorflow/compiler/xla/service/gpu/gpu_executable.cc:365] Executing the thunk for Thunk:#hlo_op=copy,hlo_module=Conv2D.9,program_id=1#
2023-12-20 09:11:50.135863: I tensorflow/compiler/xla/service/gpu/gpu_executable.cc:365] Executing the thunk for Thunk:#hlo_op=cudnn-conv-bw-filter,hlo_module=Conv2D.9,program_id=1#
2023-12-20 09:11:50.136771: I tensorflow/compiler/xla/service/gpu/gpu_executable.cc:365] Executing the thunk for Thunk:#hlo_op=copy.2,hlo_module=Conv2D.9,program_id=1#
2023-12-20 09:11:50.137562: I tensorflow/compiler/xla/service/gpu/gpu_executable.cc:724] GpuExecutable::ExecuteAsyncOnStreamImpl(Conv2D.9) time: 4.88 ms (cumulative: 4.88 ms, max: 4.88 ms, #called: 1)

你可能感兴趣的:(deep,learning,tensorflow,XLA)

C++学习笔记（lambda函数） __TAT__ C&C++c++学习笔记
C++learningnote1、lambda函数的语法2、lambda函数的几种用法1、lambda函数的语法lambda函数的一般语法如下：[capture_clause](parameters)->return_type{function_body}capture_clause：需要捕获的变量，但要求该变量必须在这个作用域中。通常的捕获方式有以下几种：[]：不捕获任何变量[&]：按引用捕获变
ES-LTR粗排模块 poins jenkins 运维
ES-LTR粗排模块官方资源：https://github.com/HeiBoWang/elasticsearch-learning-to-rankElasticsearch学习排名插件使用机器学习提高搜索相关性排名。它为维基媒体基金会和Snagajob等地方的搜索提供了动力！这个插件有什么功能此插件：允许您在Elasticsearch中存储特征（Elasticsearch查询模板）记录特征得分（
VGG16滤镜可视化和类激活图 LIjin_1006 人工智能神经网络深度学习 cnn
这个用keras2.2.4+tensorflow1.15.0importkeraskeras.__version__fromkeras.applicationsimportVGG16fromkerasimportbackendasKimportnumpyasnpfromkerasimportmodelsimportmatplotlib.pyplotaspltimporttensorflowastf
DCGAN中的生成器和识别器代码详解 YYLin-AI DCGAN 深度学习 celeba tensorflow
#DCGAN中的生成器我自己写的有一个封装好的用于生成器和识别器的卷积操作但是在这个代码中我没有使用我自己的代码#原因想绍一下tensorflow自带的函数所以找了一个以前在书上的代码申明一下这个不是原创但是原来代码中有几处不符合DCGAN的要求所以就做了一些修改转载链接没有就直接写成原创建议看代码之前先看看DCGAN的特点，然后再看代码中如何实这些特点的这样会更有帮助DCGAN（深度卷积的对抗生
【早安心语】壹典心理咨询
【2021-5-17】早安春夏秋冬Lifeishappybecauseofgiving,happinessisincreasedbysharing,thesoulhasahome,lifehasaway,onlybylearningtobealonewithoneself,thesoulwillbeclean,themindwillbemature,andtheheartwillbebroad.B
Android 实现照片抠出人像。 No Promises﹉ android
谢谢阅览、关注！！一、各平台的实现方式：1.Android实现方式：使用图像处理库（如OpenCV）：集成OpenCV库，利用其图像处理功能进行边缘检测和图像分割；使用机器学习模型（如TensorFlowLite）：集成TensorFlowLite和预训练的人像分割模型；使用第三方API服务：利用如百度AI、腾讯AI等提供的在线API进行图像处理。步骤：集成必要的库或API、加载和处理图像、应用抠
Python机器学习笔记：CART算法实战战争热诚
完整代码及其数据，请移步小编的GitHub传送门：请点击我如果点击有误：https://github.com/LeBron-Jian/MachineLearningNote前言在python机器学习笔记：深入学习决策树算法原理一文中我们提到了决策树里的ID3算法，C4.5算法，并且大概的了
Vue监视属性 pilgrim11
监视属性watch：1、当被监视的属性变化时，回调函数自动调用，进行相关操作。2、监视的属性必须存在，才能进行监视。3、监视的两种写法：（1）newVue时传入watch配置（2）通过vm.$watch监视。深度监视：（1）Vue中的watch默认不监测对象内部值的改变（一层）。（2）配置deep：true可以监测对象内部值的改变（多层）。备注：（1）Vue自身可以监测对象内部值的改变，但Vue提
二十二、elasticSearch的most-fields策略书写只为分享
1、most-fields策略best-fields策略，主要是说将某一个field匹配尽可能多的关键词的doc优先返回回来most-fields策略，主要是说尽可能返回更多field匹配到某个关键词的doc，优先返回回来，用法和上面的一样当我们相查找与learningcourses相关的数据时如果数据如下：{"update":{"_id":"1"}}{"doc":{"sub_title":"le
Arduino使用TinyML实现水果识别亚图跨际物联网编程 Arduino tensorflow arduino tinyml
在本文中，板载手势传感器将用于收集对象识别数据，这些数据将用于创建TensorFlowLite模型，该模型可用于识别特定对象。电路板的接近传感器功能将用于识别物体何时靠近电路板，而RGB传感器用于首先收集物体的颜色数据，然后正确识别物体。这是一个简单的示例，但确实显示了在小型设备上运行TinyML的潜力以及传感器丰富的Arduino蓝牙传感器的强大功能。硬件水果ArduinoIDE准备安装库文件捕
机器学习常用框架碧落&凡尘机器学习人工智能
机器学习是人工智能的一个重要分支，它通过让计算机系统利用数据自我学习来改进任务执行的能力。在机器学习领域，有许多成熟的框架被广泛使用，这些框架提供了构建和训练机器学习模型的工具。以下是一些常用的机器学习框架：TensorFlow：由Google开发，是一个开源的软件库，用于数据流编程，广泛应用于各类机器学习任务。它支持分布式计算，能够在大规模数据集上训练复杂的模型。PyTorch：由Faceboo
TensorFlow的介绍和简单案例科学的N次方人工智能 tensorflow 人工智能 python
TensorFlow是一个开源的机器学习框架，由Google开发和维护。它旨在使构建和训练机器学习模型变得更加容易，同时提供高度灵活性和可扩展性。TensorFlow基于数据流图的概念。数据流图是一个由节点和边组成的有向图，其中节点表示操作，边表示数据的流动。TensorFlow通过在数据流图中定义操作和变量来表示机器学习模型，并使用图的计算能力进行训练和推理。TensorFlow支持多种机器学习
DeePhage：预测噬菌体的生活方式 CAAS_IFR_zp 生活
GitHub-shufangwu/DeePhage:Atoolfordistinguishtemperatephage-derivedandvirulentphage-derivedsequenceinmetaviromedatausingdeeplearning安装condacreate-ndeephagecondaactivatedeephagepipinstallnumpypipinstal
前端开发小技巧【Vue篇】 - 样式穿透 + 绑定变量禁止摆烂-才浅 Vue3 Vue2 vue.js 前端 javascript
前言样式穿透Vue都是通过深度选择器来样式穿透的。当我们在写项目的时候，经常会导入第三方库，有些特殊的情况，就是在导入第三方库后，呈现的样式并不是我们想要的样式，所以我们需要对第三方的样式进行修改；如果按照传统的修改方式，会发现我们新加的样式不生效，此时就需要进行样式穿透操作；一、样式穿透的几种方式对比如果使用后CSS，没有使用CSS预处理器，则可以使用>>>、/deep/、::v-deep这三种
2018-12-13 JennietheQueen
补12.12每日一词1.ItisalarmingthatsuicideinAmericahasbeenontheriseinthepastfewyears.2.Itisalarmingthatmyfriendspentfivesyears'learningFrenchbutnevermadeprogress.太震惊了，我有一个朋友学了五年法语但是从未进步。
Simple and Scalable Strategies to Continually Pre-train Large Language Models liferecords LLM 语言模型深度学习神经网络
SimpleandScalableStrategiestoContinuallyPre-trainLargeLanguageModels相关链接：arxiv关键字：LargeLanguageModels、Pre-training、ContinualLearning、DistributionShift、Adaptation摘要大型语言模型(LLMs)通常会在数十亿个tokens上进行预训练，然后新数
TypeError: parse() got an unexpected keyword argument 'transport_encoding' 凌川江雪
有点尴尬，自安装了ANACONDA和TensorFlow之后，首次在ANACONDAPrompt中用pip命令安装第三方库，然而一大片刺眼的红字就扑面而来，在ANACONDAPrompt中没法用pip命令安装第三方库了？搞了一会儿，没得搞定，最后在CSDN上找到一个简单粗暴而效果拔群的办法：直接在ANACONDAPrompt中安装pip，解决问题！即：condainstallpip
阿里云分布式深度学习训练架构Whale qwfys200 Reading 阿里云分布式深度学习
阿里云分布式深度学习训练架构Whale阿里云分布式深度学习训练架构Whale参考文献Whale基于Tensorflow深度学习分布式训练框架|学习笔记Whale:EfficientGiantModelTrainingoverHeterogeneousGPUs阿里云机器学习平台PAI论文高效大模型训练框架Whale入选USENIXATC’22
计算机设计大赛酒店评价的情感倾向分析 iuerfee python
前言优质竞赛项目系列，今天要分享的是酒店评价的情感倾向分析该项目较为新颖，适合作为竞赛课题方向，学长非常推荐！更多资料,项目分享：https://gitee.com/dancheng-senior/postgraduate概述本文基于7K条携程酒店评价数据为文本数据，将其导入到Keras的模型架构然后进行训练出一个可用于实际场所预测情感的模型。项目所需模块importtensorflowastfi
机器学习、深度学习、神经网络之间的关系你好，工程师 AI 机器学习
机器学习（MachineLearning）、深度学习（DeepLearning）和神经网络（NeuralNetworks）之间存在密切的关系，它们可以被看作是一种逐层递进的关系。下面简要介绍它们之间的关系：机器学习（MachineLearning）：机器学习是一种人工智能的分支，关注如何通过数据让计算机系统从经验中学习，提高性能。机器学习算法可以分为监督学习、无监督学习、半监督学习和强化学习等不同
beam search原理与常见实现，与直接sample的区别 samoyan LLM 面试 transformer 面试
目录BeamSearch原理1.基本概念2.工作流程3.特点BeamSearch与直接Sample的区别1.确定性与随机性2.结果多样性3.性能与效率4.应用场景常见的BeamSearch实现1.TensorFlow库2.PyTorch库3.HuggingFace的Transformers库算法库和工具BeamSearch原理1.基本概念BeamSearch是一种启发式图搜索算法，常用于自然语言处
随机森林原理&sklearn实现一稻道人机器学习算法&预测模型 Python 随机森林 sklearn 算法
原理定义随机森林就是通过集成学习的思想将多棵树集成的一种算法，它的基本单元是决策树，而它的本质属于机器学习的一大分支——集成学习（EnsembleLearning）方法。随机森林的名称中有两个关键词，一个是“随机”，一个就是“森林”。随机森林应该是机器学习算法时最先接触到的集成算法，集成学习的家族：Bagging：个体评估器之间不存在强依赖关系，一系列个体学习器可以并行生成。代表算法：随机森林（R
认识小波-DWT CWT Scattering 闪闪发亮的小星星数字信号处理与分析计算机视觉人工智能信号处理
这里写自定义目录标题小波变换的种类连续小波变换（CWT）DWTANexampleapplicationofDWTANexampleofCWT5.MachineLearningandDeepLearningwithWaveletScattering小波散射网络大家好。在本次介绍性课程中，我将介绍一些基本的小波概念。我将主要使用一维示例，但相同的概念也可以应用于图像。首先，我们回顾一下什么是小波。现实
Mastering Convolutional Neural Networks: A Comprehensive Practical Exploration Bio大恐龙人工智能深度学习数据可视化机器学习
ConvolutionalNeuralNetworks(CNNs)haverevolutionizedthefieldofcomputervisionandimagerecognition,enablinggroundbreakingadvancementsinvariousdomains.Thesepowerfuldeeplearningmodelshaveproventheirprowessi
R语言统计学书记推荐热衷组培的二货潜
https://learningstatisticswithr.com/lsr-0.6.pdf图片发自App
你说什么是机器学习呢 guguguyuan 人工智能
机器学习这个词是让人疑惑的，首先它是英文名称MachineLearning(简称ML)的直译，在计算界Machine一般指计算机。这个名字使用了拟人的手法，说明了这门技术是让机器“学习”的技术。但是计算机是死的，怎么可能像人类一样“学习”呢？传统上如果我们想让计算机工作，我们给它一串指令，然后它遵照这个指令一步步执行下去。有因有果，非常明确。但这样的方式在机器学习中行不通。机器学习根本不接受你输入
Python 递归迭代器实现全排列算法 JHC000000 python java 前端
defpermutations(lis,ind=0):#保存原始列表old_lis=copy.deepcopy(lis)ifind==len(lis):yieldold_lisforiinrange(ind,len(lis)):#交换lis[ind],lis[i]=lis[i],lis[ind]yieldfrompermutations(lis,ind+1)#恢复原来的列表lis=old_lisl
精读《深度学习 - 函数式之美》可口可乐Vip 前端深度学习人工智能
1引言函数式语言在深度学习领域应用很广泛，因为函数式与深度学习模型的契合度很高，TheBeautyofFunctionalLanguagesinDeepLearning — ClojureandHaskell就很好的诠释了这个道理。通过这篇文章可以加深我们对深度学习与函数式编程的理解。2概述与精读深度学习是机器学习中基于人工神经网络模型的一个分支，通过模拟多层神经元的自编码神经网络，将特征逐步抽象
elementUI 样式小总结前端开发小陈 elementui vue.js javascript
样式代码小总结1.弹窗居中显示，内容过高自行滚动。.dialog/deep/.el-dialog{display:flex;flex-direction:column;margin:0!important;position:absolute;top:50%;left:50%;transform:translate(-50%,-50%);max-height:calc(100%-200px);max
vue中elementUI样式无法修改的问题 /deep/ >>> 小白快跑true webpack scoped scss
最近在开发中发现了修改elementUI样式的时候，添加了scoped的组件无法修改的样式，去掉scoped就可以了。这里我们就先看一下scoped这个属性的作用以及原理。一：scoped的作用和原理scoped的作用：当标签有scoped属性时，它的CSS只作用于当前组件中的元素。这类似于ShadowDOM中的样式封装。它有一些注意事项，但不需要任何polyfill。它通过使用PostCSS来实
插入表主键冲突做更新 a-john
有以下场景：用户下了一个订单，订单内的内容较多，且来自多表，首次下单的时候，内容可能会不全（部分内容不是必须，出现有些表根本就没有没有该订单的值）。在以后更改订单时，有些内容会更改，有些内容会新增。问题：如果在sql语句中执行update操作，在没有数据的表中会出错。如果在逻辑代码中先做查询，查询结果有做更新，没有做插入，这样会将代码复杂化。解决： mysql中提供了一个sql语
Android xml资源文件中@、@android:type、@*、？、@+含义和区别 Cb123456 @+@?@*
一.@代表引用资源 1.引用自定义资源。格式：@[package:]type/name android：text="@string/hello" 2.引用系统资源。格式：@android:type/name android:textColor="@android:color/opaque_red"
数据结构的基本介绍天子之骄数据结构散列表树、图线性结构价格标签
数据结构的基本介绍数据结构就是数据的组织形式，用一种提前设计好的框架去存取数据，以便更方便，高效的对数据进行增删查改。正确选择合适的数据结构，对软件程序的高效执行的影响作用不亚于算法的设计。此外，在计算机系统中数据结构的作用也是非同小可。例如常常在编程语言中听到的栈，堆等，就是经典的数据结构。经典的数据结构大致如下：一：线性数据结构 (1)：列表 a
通过二维码开放平台的API快速生成二维码一炮送你回车库 api
现在很多网站都有通过扫二维码用手机连接的功能，联图网(http://www.liantu.com/pingtai/)的二维码开放平台开放了一个生成二维码图片的Api,挺方便使用的。闲着无聊，写了个前台快速生成二维码的方法。 html代码如下:(二维码将生成在这div下) ? 1 &nbs
ImageIO读取一张图片改变大小 3213213333332132 java IO image BufferedImage
package com.demo; import java.awt.image.BufferedImage; import java.io.File; import java.io.IOException; import javax.imageio.ImageIO; /** * @Description 读取一张图片改变大小 * @author FuJianyon
myeclipse集成svn（一针见血） 7454103 eclipse SVN MyEclipse
&n
装箱与拆箱----autoboxing和unboxing darkranger J2SE
4.2　自动装箱和拆箱基本数据(Primitive)类型的自动装箱(autoboxing)、拆箱(unboxing)是自J2SE 5.0开始提供的功能。虽然为您打包基本数据类型提供了方便，但提供方便的同时表示隐藏了细节，建议在能够区分基本数据类型与对象的差别时再使用。 4.2.1　autoboxing和unboxing 在Java中，所有要处理的东西几乎都是对象(Object)
ajax传统的方式制作ajax aijuans Ajax
//这是前台的代码 <%@ page language="java" import="java.util.*" pageEncoding="UTF-8"%> <% String path = request.getContextPath(); String basePath = request.getScheme()+
只用jre的eclipse是怎么编译java源文件的？ avords java eclipse jdk tomcat
eclipse只需要jre就可以运行开发java程序了，也能自动编译java源代码，但是jre不是java的运行环境么，难道jre中也带有编译工具？还是eclipse自己实现的？谁能给解释一下呢问题补充：假设系统中没有安装jdk or jre，只在eclipse的目录中有一个jre，那么eclipse会采用该jre，问题是eclipse照样可以编译java源文件，为什么呢？ &nb
前端模块化 bee1314 模块化
背景：前端JavaScript模块化，其实已经不是什么新鲜事了。但是很多的项目还没有真正的使用起来，还处于刀耕火种的野蛮生长阶段。 JavaScript一直缺乏有效的包管理机制，造成了大量的全局变量，大量的方法冲突。我们多么渴望有天能像Java（import），Python (import)，Ruby(require)那样写代码。在没有包管理机制的年代，我们是怎么避免所
处理百万级以上的数据处理 bijian1013 oracle sql 数据库大数据查询
一.处理百万级以上的数据提高查询速度的方法： 1.应尽量避免在 where 子句中使用!=或<>操作符，否则将引擎放弃使用索引而进行全表扫描。 2.对查询进行优化，应尽量避免全表扫描，首先应考虑在 where 及 o
mac 卸载 java 1.7 或更高版本征客丶 java OS
卸载 java 1.7 或更高 sudo rm -rf /Library/Internet\ Plug-Ins/JavaAppletPlugin.plugin 成功执行此命令后，还可以执行 java 与 javac 命令 sudo rm -rf /Library/PreferencePanes/JavaControlPanel.prefPane 成功执行此命令后，还可以执行 java
【Spark六十一】Spark Streaming结合Flume、Kafka进行日志分析 bit1129 Stream
第一步，Flume和Kakfa对接，Flume抓取日志，写到Kafka中第二部，Spark Streaming读取Kafka中的数据，进行实时分析本文首先使用Kakfa自带的消息处理（脚本）来获取消息，走通Flume和Kafka的对接 1. Flume配置 1. 下载Flume和Kafka集成的插件，下载地址：https://github.com/beyondj2ee/f
Erlang vs TNSDL bookjovi erlang
TNSDL是Nokia内部用于开发电信交换软件的私有语言，是在SDL语言的基础上加以修改而成，TNSDL需翻译成C语言得以编译执行，TNSDL语言中实现了异步并行的特点，当然要完整实现异步并行还需要运行时动态库的支持，异步并行类似于Erlang的process（轻量级进程），TNSDL中则称之为hand，Erlang是基于vm(beam)开发，
非常希望有一个预防疲劳的java软件, 预防过劳死和眼睛疲劳,大家一起努力搞一个 ljy325 企业应用
　非常希望有一个预防疲劳的java软件，我看新闻和网站，国防科技大学的科学家累死了，太疲劳，老是加班，不休息，经常吃药，吃药根本就没用，根本原因是疲劳过度。我以前做java,那会公司垃圾，老想赶快学习到东西跳槽离开，搞得超负荷，不明理。深圳做软件开发经常累死人，总有不明理的人，有个软件提醒限制很好，可以挽救很多人的生命。相关新闻：（1）IT行业成五大疾病重灾区：过劳死平均37.9岁
读《研磨设计模式》-代码笔记-原型模式 bylijinnan java 设计模式
声明：本文只为方便我个人查阅和理解，详细的分析以及源代码请移步原作者的博客http://chjavach.iteye.com/ /** * Effective Java 建议使用copy constructor or copy factory来代替clone()方法： * 1.public Product copy(Product p){} * 2.publi
配置管理---svn工具之权限配置 chenyu19891124 SVN
今天花了大半天的功夫，终于弄懂svn权限配置。下面是今天收获的战绩。安装完svn后就是在svn中建立版本库，比如我本地的是版本库路径是C:\Repositories\pepos。pepos是我的版本库。在pepos的目录结构 pepos component webapps 在conf里面的auth里赋予的权限配置为 [groups]
浅谈程序员的数学修养 comsci 设计模式编程算法面试招聘
浅谈程序员的数学修养
批量执行 bulk collect与forall用法 daizj oracle sql bulk collect forall
BULK COLLECT 子句会批量检索结果，即一次性将结果集绑定到一个集合变量中，并从SQL引擎发送到PL/SQL引擎。通常可以在SELECT INTO、 FETCH INTO以及RETURNING INTO子句中使用BULK COLLECT。本文将逐一描述BULK COLLECT在这几种情形下的用法。有关FORALL语句的用法请参考：批量SQL之 F
Linux下使用rsync最快速删除海量文件的方法 dongwei_6688 OS
1、先安装rsync：yum install rsync 2、建立一个空的文件夹：mkdir /tmp/test 3、用rsync删除目标目录：rsync --delete-before -a -H -v --progress --stats /tmp/test/ log/这样我们要删除的log目录就会被清空了，删除的速度会非常快。rsync实际上用的是替换原理，处理数十万个文件也是秒删。
Yii CModel中rules验证规格 dcj3sjt126com rules yii validate
Yii cValidator主要用法分析： yii验证rulesit 分类： Yii yii的rules验证 cValidator主要属性 attributes ,builtInValidators,enableClientValidation,message,on,safe,skipOnError
基于vagrant的redis主从实验 dcj3sjt126com vagrant
平台: Mac 工具: Vagrant 系统: Centos6.5 实验目的: Redis主从实现思路制作一个基于sentos6.5, 已经安装好reids的box, 添加一个脚本配置从机, 然后作为后面主机从机的基础box 制作sentos6.5+redis的box mkdir vagrant_redis cd vagrant_
Memcached(二)、Centos安装Memcached服务器 frank1234 centos memcached
一、安装gcc rpm和yum安装memcached服务器连接没有找到，所以我使用的是make的方式安装，由于make依赖于gcc，所以要先安装gcc 开始安装，命令如下，[color=red][b]顺序一定不能出错[/b][/color]：建议可以先切换到root用户，不然可能会遇到权限问题：su root 输入密码...... rpm -ivh kernel-head
Remove Duplicates from Sorted List hcx2013 remove
Given a sorted linked list, delete all duplicates such that each element appear only once. For example,Given 1->1->2, return 1->2.Given 1->1->2->3->3, return&
Spring4新特性——JSR310日期时间API的支持 jinnianshilongnian spring4
Spring4新特性——泛型限定式依赖注入 Spring4新特性——核心容器的其他改进 Spring4新特性——Web开发的增强 Spring4新特性——集成Bean Validation 1.1(JSR-349)到SpringMVC Spring4新特性——Groovy Bean定义DSL Spring4新特性——更好的Java泛型操作API Spring4新
浅谈enum与单例设计模式 247687009 java 单例
在JDK1.5之前的单例实现方式有两种(懒汉式和饿汉式并无设计上的区别故看做一种)，两者同是私有构造器，导出静态成员变量，以便调用者访问。第一种 package singleton; public class Singleton { //导出全局成员 public final static Singleton INSTANCE = new S
使用switch条件语句需要注意的几点 openwrt c break switch
1. 当满足条件的case中没有break，程序将依次执行其后的每种条件（包括default）直到遇到break跳出 int main() { int n = 1; switch(n) { case 1: printf("--1--\n"); default: printf("defa
配置Spring Mybatis JUnit测试环境的应用上下文 schnell18 spring mybatis JUnit
Spring-test模块中的应用上下文和web及spring boot的有很大差异。主要试下来差异有：单元测试的app context不支持从外部properties文件注入属性 @Value注解不能解析带通配符的路径字符串解决第一个问题可以配置一个PropertyPlaceholderConfigurer的bean。第二个问题的具体实例是：
Java 定时任务总结一 tuoni java spring timer quartz timertask
Java定时任务总结一.从技术上分类大概分为以下三种方式： 1.Java自带的java.util.Timer类，这个类允许你调度一个java.util.TimerTask任务; 说明： java.util.Timer定时器，实际上是个线程，定时执行TimerTask类 &
一种防止用户生成内容站点出现商业广告以及非法有害等垃圾信息的方法 yangshangchuan rank 相似度计算文本相似度词袋模型余弦相似度
本文描述了一种在ITEYE博客频道上面出现的新型的商业广告形式及其应对方法，对于其他的用户生成内容站点类型也具有同样的适用性。最近在ITEYE博客频道上面出现了一种新型的商业广告形式，方法如下： 1、注册多个账号（一般10个以上）。 2、从多个账号中选择一个账号，发表1-2篇博文