From Fedora Project Wiki

< SIGs‎ | PyTorch

(initial pytorch dependency list)
 
(→‎Dependency List: updating dependency list with much more detail)
Line 11: Line 11:
|+ PyTorch Dependency List
|+ PyTorch Dependency List
|-
|-
! PyTorch Name !!  Upstream URL !! Status !! Packager !! Fedora Package Name !! Fedora Package URL !! EPEL !! Notes
! PyTorch Name !!  Version !! Status !! Packager !! Fedora Package Name !! Fedora Package URL !! EPEL !! Notes
|-
|-
| FP16 || || Packaged ||  || FP16 || [https://src.fedoraproject.org/rpms/FP16 FP16] ||  ||
| [https://github.com/Maratyszcza/FP16 FP16]  || [https://github.com/Maratyszcza/FP16/tree/4dfe081cf6bcd15db339cf2680b9281b8451eeb3 4dfe081] (2020-05-14) || Packaged? ||  || FP16 || [https://src.fedoraproject.org/rpms/FP16 FP16] ||  ||
|-
|-
| FXdiv || ||  ||  ||  ||  ||  ||
| [https://github.com/Maratyszcza/FXdiv FXdiv]  || [https://github.com/Maratyszcza/FXdiv/tree/b408327ac2a15ec3e43352421954f5b1967701d1 b408327] (2020-04-17) ||  ||  ||  ||  ||  ||
|-
|-
| NNPACK || ||  ||  ||  ||  ||  ||
| [https://github.com/Maratyszcza/NNPACK NNPACK] || [https://github.com/Maratyszcza/NNPACK/tree/c07e3a0400713d546e0dea2d5466dd22ea389c73 c07e3a0] (2020-12-21) ||  ||  ||  ||  ||  ||
|-
|-
| QNNPACK || ||  ||  ||  ||  ||  ||
| [https://github.com/pytorch/qnnpack QNNPACK] || [https://github.com/pytorch/QNNPACK/tree/7d2a4e9931a82adc3814275b6219a03e24e36b4c 7d2a4e9] (2019-08-28) ||  ||  ||  ||  ||  || Archived upstream on 2020-10-01
|-
|-
| VulkanMemoryAllocator || || '''''In Progress''''' || [[User:Mystro256|Jeremy Newton]] ||  ||  ||  ||
| [https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator VulkanMemoryAllocator] || [https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator/tree/a6bfc237255a6bac1513f7c1ebde6d8aed6b5191 v3.0.1] || '''''In Progress''''' || [[User:Mystro256|Jeremy Newton]] ||  ||  ||  ||
|-
|-
| benchmark || || Packaged ||  || google-benchmark || [https://src.fedoraproject.org/rpms/google-benchmark google-benchmark]  ||  ||
| [https://github.com/google/benchmark benchmark] || [https://github.com/google/benchmark/tree/0d98dba29d66e93259db7daa53a9327df767a415 v1.6.1] || Packaged? ||  || google-benchmark || [https://src.fedoraproject.org/rpms/google-benchmark google-benchmark]  ||  ||
|-
|-
| cpuinfo || || Packaged ||  || cpuinfo || [https://src.fedoraproject.org/rpms/cpuinfo cpuinfo] ||  ||
| [https://github.com/pytorch/cpuinfo cpuinfo] || [https://github.com/pytorch/cpuinfo/tree/6481e8bef08f606ddd627e4d3be89f64d62e1b8a 6481e8b] (2023-01-13) || Packaged? ||  || cpuinfo || [https://src.fedoraproject.org/rpms/cpuinfo cpuinfo] ||  ||
|-
|-
| cub || ||  ||  ||  ||  ||  ||
| [https://github.com/NVIDIA/cub cub] || [https://github.com/NVlabs/cub/tree/d106ddb991a56c3df1b6d51b2409e36ba8181ce4 d106ddb] (2020-05-12) ||  ||  ||  ||  ||  || the linked repo is marked as moved, this could be a mess. [https://github.com/NVIDIA/cub/commit/d106ddb991a56c3df1b6d51b2409e36ba8181ce4 equivalent commit in NVIDIA/cub?] might be [https://github.com/NVIDIA/cub/commit/2a231db3226a9bfcd008bb6120bec12fe0a98cd1 cub 1.10.0] but the tags don't seem to correlate with versions mentioned in commit messages
|-
|-
| cudnn_frontend || ||  ||  ||  ||  ||  ||
| [https://github.com/NVIDIA/cudnn-frontend cudnn_frontend] || [https://github.com/NVIDIA/cudnn-frontend/tree/12f35fa2be5994c1106367cac2fba21457b064f4 v0.9.2] (2023-07-13) ||  ||  ||  ||  ||  ||
|-
|-
| cutlass || ||  ||  ||  ||  ||  ||
| [https://github.com/NVIDIA/cutlass cutlass] || [https://github.com/NVIDIA/cutlass/tree/6f47420213f757831fae65c686aa471749fa8d60 3.1] ||  ||  ||  ||  ||  ||
|-
|-
| eigen || || Packaged ||  || eigen3 || [https://src.fedoraproject.org/rpms/eigen3 eigen3] ||  ||
| [https://eigen.tuxfamily.org/index.php?title=Main_Page eigen] || [https://gitlab.com/libeigen/eigen/-/tree/3147391d946bb4b6c68edd901f2add6ac1f31f8c 3.4.0] (2021-08-18) || Packaged? ||  || eigen3 || [https://src.fedoraproject.org/rpms/eigen3 eigen3] ||  ||
|-
|-
| fbgemm ||  ||  ||  ||  ||  ||  ||
| [https://github.com/pytorch/FBGEMM fbgemm] || [https://github.com/pytorch/fbgemm/tree/d0ee798b1f198cc51b6ddae20cf6063f6380ba3f d0ee798 ||  ||  ||  ||  ||  || post v0.4.1
|-
|-
| flatbuffers ||  || Packaged ||  || flatbuffers || [https://src.fedoraproject.org/rpms/flatbuffers flatbuffers] ||  ||
| [https://flatbuffers.dev/ flatbuffers] || [https://github.com/google/flatbuffers/tree/01834de25e4bf3975a9a00e816292b1ad0fe184b 23.3.3] || Packaged ||  || flatbuffers || [https://src.fedoraproject.org/rpms/flatbuffers flatbuffers] ||  ||
|-
|-
| fmt || || Packaged ||  || fmt || [https://src.fedoraproject.org/rpms/fmt fmt] ||  ||
| [https://github.com/fmtlib/fmt fmt] || [https://github.com/fmtlib/fmt/tree/f5e54359df4c26b6230fc61d38aa294581393084 10.1.1] || Packaged? ||  || fmt || [https://src.fedoraproject.org/rpms/fmt fmt] ||  ||
|-
|-
| foxi || ||  ||  ||  ||  ||  ||
| [https://github.com/houseroad/foxi foxi] || [https://github.com/houseroad/foxi/tree/c278588e34e535f0bb8f00df3880d26928038cad c278588] (2021-05-26) ||  ||  ||  ||  ||  || master/HEAD, appears to be an extension of [https://xadupre.github.io/draft/onnxcustom/onnxmd/onnx_docs/ONNXIFI.html ONNX Interface for Framework Integration]
|-
|-
| gemmlowp || ||  ||  ||  ||  ||  ||
| [https://github.com/google/gemmlowp gemmlowp] || [https://github.com/google/gemmlowp/tree/3fb5c176c17c765a3492cd2f0321b0dab712f350 3fb5c17] (2018-11-26) ||  ||  ||  ||  ||  ||
|-
|-
| gloo || ||  ||  ||  ||  ||  ||
| [https://github.com/facebookincubator/gloo gloo] || [https://github.com/facebookincubator/gloo/tree/cf1e1abc95d0b961222ee82b6935f76250fbcf16 cf1e1ab] (2023-07-19) ||  ||  ||  ||  ||  ||
|-
|-
| googletest || || Packaged ||  || gtest || [https://src.fedoraproject.org/rpms/gtest gtest] ||  ||
| [https://github.com/google/googletest googletest] || [https://github.com/google/googletest/commits/e2239ee6043f73722e7aa812a459f54a28552929 v1.11.0] (2021-06-11) || Packaged? ||  || gtest || [https://src.fedoraproject.org/rpms/gtest gtest] ||  ||
|-
|-
| ideep ||  ||  ||  ||  ||  ||  ||
| [https://github.com/intel/ideep ideep] || [https://github.com/intel/ideep/commits/13dd1fdc6217c9eccfa7166798dd81a0476e63dd 13dd1fd] ||  ||  ||  ||  ||  || master branch appears dead - there appear to be two current branches: ideep_dev and ideep_pytorch and the 13dd1fd commit appearst to only be in the ideep_pytorch branch
|-
|-
| ios-cmake || ||  ||  ||  ||  ||  ||
| [https://github.com/Yangqing/ios-cmake ios-cmake] || [https://github.com/Yangqing/ios-cmake/tree/8abaed637d56f1337d6e1d2c4026e25c1eade724 8abaed6] (2017-11-15)||  ||  ||  ||  ||  || fork of [https://github.com/ollef/ios-cmake ollef/ios-cmake] which is a fork of [https://github.com/cristeab/ios-cmake cristeab/ios-cmake]
|-
|-
| ittapi || ||  ||  ||  ||  ||  ||
| [https://github.com/intel/ittapi ittapi] || [https://github.com/intel/ittapi/tree/5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42 5b8a7d7] (2022-04-12) ||  ||  ||  ||  ||  || before ittapi's first release
|-
|-
| kineto || ||  ||  ||  ||  ||  ||
| [https://github.com/pytorch/kineto kineto] || [https://github.com/pytorch/kineto/tree/49e854d805d916b2031e337763928d2f8d2e1fbf 49e854d] (2023-08-08) ||  ||  ||  ||  ||  || well after last release (v0.4.0)
|-
|-
| mimalloc || ||  ||  ||  ||  ||  ||
| [https://github.com/microsoft/mimalloc mimalloc] || [https://github.com/microsoft/mimalloc/tree/b66e3214d8a104669c2ec05ae91ebc26a8f5ab78 b66e321] (2023-04-24) ||  ||  ||  ||  ||  ||
|-
|-
| miniz-2.1.0 || || Packaged ||  || miniz || [https://src.fedoraproject.org/rpms/miniz miniz]  ||  ||
| [https://github.com/richgel999/miniz miniz-2.1.0] || [https://github.com/pytorch/pytorch/tree/main/third_party/miniz-2.1.0 Forked in PyTorch Upstream] || Packaged? ||  || miniz || [https://src.fedoraproject.org/rpms/miniz miniz]  ||  ||  
|-
|-
| nccl || ||  ||  ||  ||  ||  ||
| [https://github.com/NVIDIA/nccl nccl] || [https://github.com/NVIDIA/nccl/tree/559b70f86c190a0d8f67f0d7a0f2c9810dd1e8c7 2.18.5-1] (2023-08-23) ||  ||  ||  ||  ||  ||
|-
|-
| neon2sse || ||  ||  ||  ||  ||  ||
| [https://github.com/intel/ARM_NEON_2_x86_SSE neon2sse] || [https://github.com/intel/ARM_NEON_2_x86_SSE/tree/97a126f08ce318023be604d03f88bf0820a9464a 97a126f] (2018-09-17) ||  ||  ||  ||  ||  ||
|-
|-
| nlohmann || ||  ||  ||  ||  ||  ||
| [https://github.com/nlohmann/json nlohmann/json] || [https://github.com/nlohmann/json/tree/87cda1d6646592ac5866dc703c8e1839046a6806 87cda1d] (2022-06-18) ||  ||  ||  ||  ||  || between 3.10.5 and 3.11.0
|-
|-
| nvfuser || ||  ||  ||  ||  ||  ||
| [https://pytorch.org/blog/introducing-nvfuser-a-deep-learning-compiler-for-pytorch/ nvfuser] || [https://github.com/pytorch/pytorch/tree/main/third_party/nvfuser in pytorch tree] ||  ||  ||  ||  ||  ||
|-
|-
| onnx || || Packaged ||  || onnx || [https://src.fedoraproject.org/rpms/onnx onnx] ||  ||
| [https://github.com/onnx/onnx onnx] || [https://github.com/onnx/onnx/commits/1014f41f17ecc778d63e760a994579d96ba471ff 1.14.1] || Packaged ||  || onnx || [https://src.fedoraproject.org/rpms/onnx onnx] ||  ||
|-
|-
| onnx-tensorrt || ||  ||  ||  ||  ||  ||
| onnx-tensorrt || [https://github.com/onnx/onnx-tensorrt/commits/c153211418a7c57ce071d9ce2a41f8d1c85a878f 6.0] (2019-09-16) ||  ||  ||  ||  ||  ||
|-
|-
| pocketfft || ||  ||  ||  ||  ||  ||
| [https://github.com/mreineck/pocketfft pocketfft] || [https://github.com/mreineck/pocketfft/tree/ea778e37710c07723435b1be58235996d1d43a5a release_for_eigen] (2021-03-12) ||  ||  ||  ||  ||  ||
|-
|-
| protobuf || || ||  || || ||  ||
| [https://github.com/protocolbuffers/protobuf protobuf] || [https://github.com/protocolbuffers/protobuf/tree/d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a d1eca4e] (2020-10-08)|| Packaged? ||  || protobuf || [https://src.fedoraproject.org/rpms/protobuf protobuf] ||  || after v3.13.0, before v3.14.0-rc1
|-
|-
| psimd || || Packaged ||  || psimd || [https://src.fedoraproject.org/rpms/psimd psimd] ||  ||
| [https://github.com/Maratyszcza/psimd psimd] || [https://github.com/Maratyszcza/psimd/tree/072586a71b55b7f8c584153d223e95687148a900 current master/HEAD] (2020-05-17) || Packaged? ||  || psimd || [https://src.fedoraproject.org/rpms/psimd psimd] ||  ||
|-
|-
| pthreadpool ||  ||  ||  ||  ||  ||  ||
| pthreadpool || [https://github.com/Maratyszcza/pthreadpool/tree/a134dd5d4cee80cce15db81a72e7f929d71dd413 a134dd5] (2021-04-13) ||  ||  ||  ||  ||  ||
|-
|-
| pybind11 || || Packaged ||  || pybind11 || [https://src.fedoraproject.org/rpms/pybind11 pybind11] ||  ||
| [https://github.com/pybind/pybind11 pybind11] || [https://github.com/pybind/pybind11/tree/8a099e44b3d5f85b20f05828d919d2332a8de841 2.11.1] || Packaged? ||  || pybind11 || [https://src.fedoraproject.org/rpms/pybind11 pybind11] ||  ||
|-
|-
| python-peachpy || ||  ||  ||  ||  ||  ||
| [https://github.com/malfet/PeachPy python-peachpy] || [https://github.com/malfet/PeachPy/tree/f45429b087dd7d5bc78bb40dc7cf06425c252d67 f45429b] ||  ||  ||  ||  ||  || This is a fork of [https://github.com/Maratyszcza/PeachPy Maratyszcza/PeachPy]
|-
|-
| six || || Packaged ||  || python-six || [https://src.fedoraproject.org/rpms/python-six python-six]  ||  ||
| six || [https://github.com/pytorch/pytorch/blob/main/BUILD.bazel#L1767 no specified version] || Packaged? ||  || python-six || [https://src.fedoraproject.org/rpms/python-six python-six]  ||  ||
|-
|-
| sleef || || Packaged ||  || sleef || [https://src.fedoraproject.org/rpms/sleef sleef] ||  ||
| [https://github.com/shibatch/sleef sleef] || [https://github.com/shibatch/sleef/tree/e0a003ee838b75d11763aa9c3ef17bf71a725bff e0a003e] (2020-12-21) || Packaged ||  || sleef || [https://src.fedoraproject.org/rpms/sleef sleef] ||  ||
|-
|-
| tbb || || Packaged ||  || tbb || [https://src.fedoraproject.org/rpms/tbb tbb] ||  ||
| [https://github.com/oneapi-src/oneTBB tbb] || [https://github.com/oneapi-src/oneTBB/tree/a51a90bc609bb73db8ea13841b5cf7aa4344d4a9 TBB 2018 U6?] (2018-10-09)|| Packaged? ||  || tbb || [https://src.fedoraproject.org/rpms/tbb tbb] ||  ||
|-
|-
| tensorflow_cuda_bazel_build ||  ||  ||  ||  ||  ||
| [https://github.com/pytorch/pytorch/tree/main/third_party/tensorflow_cuda_bazel_build/cuda tensorflow_cuda_bazel_build] ||  ||  ||  ||  ||  || || might be part of the pytorch build process
|-
|-
| tensorpipe || ||  ||  ||  ||  ||  ||
| [https://github.com/pytorch/tensorpipe/ tensorpipe] || [https://github.com/pytorch/tensorpipe/tree/52791a2fd214b2a9dc5759d36725909c1daa7f2e 52791a2] ||  ||  ||  ||  ||  || Archived upstream on 2023-07-01
|-
|-
| valgrind-headers || || Packaged ||  || valgrind-devel || [https://src.fedoraproject.org/rpms/valgrind valgrind] ||  ||
| valgrind-headers || [https://github.com/pytorch/pytorch/tree/main/third_party/valgrind-headers forked] || Packaged? ||  || valgrind-devel || [https://src.fedoraproject.org/rpms/valgrind valgrind] ||  ||
|-
|-
| XNNPACK || ||  ||  ||  ||  ||  ||
| [https://github.com/google/XNNPACK XNNPACK] || [https://github.com/google/XNNPACK/tree/51a987591a6fc9f0fc0707077f53d763ac132cbf 51a9875] ||  ||  ||  ||  ||  ||
|-
|-
| zstd || || Packaged ||  || zstd || [https://src.fedoraproject.org/rpms/zstd zstd] ||  ||
| [https://github.com/facebook/zstd zstd] || [https://github.com/facebook/zstd/tree/aec56a52fbab207fc639a1937d1e708a282edca8 v1.3.2 + 1 month] || Packaged? ||  || zstd || [https://src.fedoraproject.org/rpms/zstd zstd] ||  ||
|}
|}

Revision as of 17:31, 14 September 2023

PyTorch Dependency Packaging

This page was created for the purpose of tracking the effort for packaging PyTorch in Fedora.

If you start working on a package in this list, please mark it as In Progress and put your name under the packager column.

If you find errors in this list (package that aren't actually needed or missing dependencies), feel free to add them to this list.

Dependency List

PyTorch Dependency List
PyTorch Name Version Status Packager Fedora Package Name Fedora Package URL EPEL Notes
FP16 4dfe081 (2020-05-14) Packaged? FP16 FP16
FXdiv b408327 (2020-04-17)
NNPACK c07e3a0 (2020-12-21)
QNNPACK 7d2a4e9 (2019-08-28) Archived upstream on 2020-10-01
VulkanMemoryAllocator v3.0.1 In Progress Jeremy Newton
benchmark v1.6.1 Packaged? google-benchmark google-benchmark
cpuinfo 6481e8b (2023-01-13) Packaged? cpuinfo cpuinfo
cub d106ddb (2020-05-12) the linked repo is marked as moved, this could be a mess. equivalent commit in NVIDIA/cub? might be cub 1.10.0 but the tags don't seem to correlate with versions mentioned in commit messages
cudnn_frontend v0.9.2 (2023-07-13)
cutlass 3.1
eigen 3.4.0 (2021-08-18) Packaged? eigen3 eigen3
fbgemm [https://github.com/pytorch/fbgemm/tree/d0ee798b1f198cc51b6ddae20cf6063f6380ba3f d0ee798 post v0.4.1
flatbuffers 23.3.3 Packaged flatbuffers flatbuffers
fmt 10.1.1 Packaged? fmt fmt
foxi c278588 (2021-05-26) master/HEAD, appears to be an extension of ONNX Interface for Framework Integration
gemmlowp 3fb5c17 (2018-11-26)
gloo cf1e1ab (2023-07-19)
googletest v1.11.0 (2021-06-11) Packaged? gtest gtest
ideep 13dd1fd master branch appears dead - there appear to be two current branches: ideep_dev and ideep_pytorch and the 13dd1fd commit appearst to only be in the ideep_pytorch branch
ios-cmake 8abaed6 (2017-11-15) fork of ollef/ios-cmake which is a fork of cristeab/ios-cmake
ittapi 5b8a7d7 (2022-04-12) before ittapi's first release
kineto 49e854d (2023-08-08) well after last release (v0.4.0)
mimalloc b66e321 (2023-04-24)
miniz-2.1.0 Forked in PyTorch Upstream Packaged? miniz miniz
nccl 2.18.5-1 (2023-08-23)
neon2sse 97a126f (2018-09-17)
nlohmann/json 87cda1d (2022-06-18) between 3.10.5 and 3.11.0
nvfuser in pytorch tree
onnx 1.14.1 Packaged onnx onnx
onnx-tensorrt 6.0 (2019-09-16)
pocketfft release_for_eigen (2021-03-12)
protobuf d1eca4e (2020-10-08) Packaged? protobuf protobuf after v3.13.0, before v3.14.0-rc1
psimd current master/HEAD (2020-05-17) Packaged? psimd psimd
pthreadpool a134dd5 (2021-04-13)
pybind11 2.11.1 Packaged? pybind11 pybind11
python-peachpy f45429b This is a fork of Maratyszcza/PeachPy
six no specified version Packaged? python-six python-six
sleef e0a003e (2020-12-21) Packaged sleef sleef
tbb TBB 2018 U6? (2018-10-09) Packaged? tbb tbb
tensorflow_cuda_bazel_build might be part of the pytorch build process
tensorpipe 52791a2 Archived upstream on 2023-07-01
valgrind-headers forked Packaged? valgrind-devel valgrind
XNNPACK 51a9875
zstd v1.3.2 + 1 month Packaged? zstd zstd
Retrieved from "https://fedoraproject.org/w/index.php?title=SIGs/PyTorch/packagingStatus&oldid=689165"