[Bug]: ditto

[dz12123]

Issue Type

Build/Install

Modules Involved

SPU compiler

Have you reproduced the bug with SPU HEAD?

Yes

Have you searched existing issues?

Yes

SPU Version

ditto分支

OS Platform and Distribution

Ubuntu22.04

Python Version

3.8

Compiler Version

No response

Current Behavior?

各位老师好，我准备在ditto分支下复现这篇论文，但是在启动SPU出现错误，我看之前的问题说过在main分支下修复了，请问ditto分支会修复吗

Standalone code to reproduce the issue

print("A bug")

Relevant log output

(ditto) root@autodl-container-95524e95d1-fbb01379:~/spu-ditto_icml24# bazel run -c opt //examples/python/utils:nodectl -- --config `pwd`/examples/python/ml/experimental_mp/3pc_nExp.json up
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/xla/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'tf_runtime' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/xla/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'llvm-raw' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_absl' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'pybind11_bazel' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_protobuf' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_google_googletest' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_github_gflags_gflags' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'com_github_grpc_grpc' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'zlib' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'rules_python' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'pybind11' because it already exists.
DEBUG: /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/tsl/third_party/repo.bzl:132:14: 
Warning: skipping import of repository 'upb' because it already exists.
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:algebraic_simplifier'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:batch_dot_simplification'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:batchnorm_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:bitcast_dtypes_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:call_inliner'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:cholesky_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:conditional_simplifier'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:conditional_to_select'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:convolution_4d_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:convolution_group_converter'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:dot_decomposer'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:eigh_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:float_normalization'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:gather_simplifier'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:hlo_constant_folding'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:hlo_cse'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:hlo_dce'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:hlo_pass_pipeline'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:map_inliner'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:operand_upcaster'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:qr_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:real_imag_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:reshape_mover'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:result_caster'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:scatter_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:slice_sinker'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:sort_simplifier'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:stable_sort_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:triangular_solve_expander'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:while_loop_constant_sinking'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:while_loop_simplifier'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service:zero_sized_hlo_elimination'. Continuing because --nocheck_visibility is active
WARNING: /root/spu-ditto_icml24/libspu/compiler/front_end/BUILD.bazel:17:15: in cc_library rule //libspu/compiler/front_end:hlo_importer: Target '//libspu/compiler/front_end:hlo_importer' violates visibility of target '@xla//xla/service/gpu:dot_dimension_sorter'. Continuing because --nocheck_visibility is active
INFO: Repository com_github_intel_ipp instantiated at:
  /root/spu-ditto_icml24/WORKSPACE:28:10: in <toplevel>
  /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/yacl/bazel/repositories.bzl:46:26: in yacl_deps
  /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/yacl/bazel/repositories.bzl:257:10: in _com_github_intel_ipp
  /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/bazel_tools/tools/build_defs/repo/utils.bzl:233:18: in maybe
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in <toplevel>
WARNING: Download from https://github.com/intel/ipp-crypto/archive/refs/tags/ippcp_2021.8.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException Checksum was d70f42832337775edb022ca8ac1ac418f272e791ec147778ef7942aede414cdc but wanted 1ecfa70328221748ceb694debffa0106b92e0f9bf6a484f8e8512c2730c7d730
ERROR: An error occurred during the fetch of repository 'com_github_intel_ipp':
   Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
                download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/intel/ipp-crypto/archive/refs/tags/ippcp_2021.8.tar.gz] to /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/com_github_intel_ipp/temp7140360268495703913/ippcp_2021.8.tar.gz: Checksum was d70f42832337775edb022ca8ac1ac418f272e791ec147778ef7942aede414cdc but wanted 1ecfa70328221748ceb694debffa0106b92e0f9bf6a484f8e8512c2730c7d730
ERROR: /root/spu-ditto_icml24/WORKSPACE:28:10: fetching http_archive rule //external:com_github_intel_ipp: Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/bazel_tools/tools/build_defs/repo/http.bzl", line 132, column 45, in _http_archive_impl
                download_info = ctx.download_and_extract(
Error in download_and_extract: java.io.IOException: Error downloading [https://github.com/intel/ipp-crypto/archive/refs/tags/ippcp_2021.8.tar.gz] to /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/com_github_intel_ipp/temp7140360268495703913/ippcp_2021.8.tar.gz: Checksum was d70f42832337775edb022ca8ac1ac418f272e791ec147778ef7942aede414cdc but wanted 1ecfa70328221748ceb694debffa0106b92e0f9bf6a484f8e8512c2730c7d730
ERROR: /root/spu-ditto_icml24/libspu/psi/cryptor/BUILD.bazel:47:15: //libspu/psi/cryptor:ipp_ecc_cryptor depends on @com_github_intel_ipp//:ipp in repository @com_github_intel_ipp which failed to fetch. no such package '@com_github_intel_ipp//': java.io.IOException: Error downloading [https://github.com/intel/ipp-crypto/archive/refs/tags/ippcp_2021.8.tar.gz] to /root/.cache/bazel/_bazel_root/03104160270e9f5ba784f5c75c286357/external/com_github_intel_ipp/temp7140360268495703913/ippcp_2021.8.tar.gz: Checksum was d70f42832337775edb022ca8ac1ac418f272e791ec147778ef7942aede414cdc but wanted 1ecfa70328221748ceb694debffa0106b92e0f9bf6a484f8e8512c2730c7d730
ERROR: Analysis of target '//examples/python/utils:nodectl' failed; build aborted: 
INFO: Elapsed time: 26.360s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (285 packages loaded, 19357 targets configured)
ERROR: Build failed. Not running target

[w-gc]

将使用patch即可： #972

[dz12123]

非常感谢老师 已经成功启动SPU后端了