From Fedora Project Wiki

< SIGs‎ | PyTorch

(VulkanMemoryAllocator is done)
Line 62: Line 62:
| [https://github.com/google/gemmlowp gemmlowp] || [https://github.com/google/gemmlowp/tree/3fb5c176c17c765a3492cd2f0321b0dab712f350 3fb5c17] (2018-11-26) ||  ||  ||  ||  ||  ||
| [https://github.com/google/gemmlowp gemmlowp] || [https://github.com/google/gemmlowp/tree/3fb5c176c17c765a3492cd2f0321b0dab712f350 3fb5c17] (2018-11-26) ||  ||  ||  ||  ||  ||
|-
|-
| [https://github.com/facebookincubator/gloo gloo] || [https://github.com/facebookincubator/gloo/tree/cf1e1abc95d0b961222ee82b6935f76250fbcf16 cf1e1ab] (2023-07-19) || In review 2240302 || trix ||  ||  ||  ||
| [https://github.com/facebookincubator/gloo gloo] || [https://github.com/facebookincubator/gloo/tree/cf1e1abc95d0b961222ee82b6935f76250fbcf16 cf1e1ab] (2023-07-19) || Packaged || trix ||  ||  ||  ||
|-
|-
| [https://github.com/google/googletest googletest] || [https://github.com/google/googletest/commits/e2239ee6043f73722e7aa812a459f54a28552929 v1.11.0] (2021-06-11) || Packaged? ||  || gtest || [https://src.fedoraproject.org/rpms/gtest gtest] ||  ||
| [https://github.com/google/googletest googletest] || [https://github.com/google/googletest/commits/e2239ee6043f73722e7aa812a459f54a28552929 v1.11.0] (2021-06-11) || Packaged? ||  || gtest || [https://src.fedoraproject.org/rpms/gtest gtest] ||  ||
Line 112: Line 112:
| [https://github.com/pytorch/tensorpipe/ tensorpipe] || [https://github.com/pytorch/tensorpipe/tree/52791a2fd214b2a9dc5759d36725909c1daa7f2e 52791a2] ||  ||  ||  ||  ||  || Archived upstream on 2023-07-01
| [https://github.com/pytorch/tensorpipe/ tensorpipe] || [https://github.com/pytorch/tensorpipe/tree/52791a2fd214b2a9dc5759d36725909c1daa7f2e 52791a2] ||  ||  ||  ||  ||  || Archived upstream on 2023-07-01
|-
|-
| valgrind-headers || [https://github.com/pytorch/pytorch/tree/main/third_party/valgrind-headers forked] || Packaged? ||  || valgrind-devel || [https://src.fedoraproject.org/rpms/valgrind valgrind] ||  || these are forked in pytorch upstream
| [https://github.com/google/XNNPACK XNNPACK] || [https://github.com/google/XNNPACK/tree/51a987591a6fc9f0fc0707077f53d763ac132cbf 51a9875] || In review 2242399 || trix ||  ||  ||  ||
|-
| [https://github.com/google/XNNPACK XNNPACK] || [https://github.com/google/XNNPACK/tree/51a987591a6fc9f0fc0707077f53d763ac132cbf 51a9875] || Needs a review 2242399 || trix ||  ||  ||  ||
|-
|-
| [https://github.com/facebook/zstd zstd] || [https://github.com/facebook/zstd/tree/aec56a52fbab207fc639a1937d1e708a282edca8 v1.3.2 + 1 month] || Packaged? ||  || zstd || [https://src.fedoraproject.org/rpms/zstd zstd] ||  ||
| [https://github.com/facebook/zstd zstd] || [https://github.com/facebook/zstd/tree/aec56a52fbab207fc639a1937d1e708a282edca8 v1.3.2 + 1 month] || Packaged? ||  || zstd || [https://src.fedoraproject.org/rpms/zstd zstd] ||  ||
|}
|}

Revision as of 11:13, 12 October 2023

PyTorch Dependency Packaging

This page was created for the purpose of tracking the effort for packaging PyTorch in Fedora.

If you start working on a package in this list, please mark it as In Progress and put your name under the packager column. Also, have your review request block the ML-SIG Review Tracker and send a link to the review request in at least the AI-ML matrix room.

If you find errors in this list (package that aren't actually needed or missing dependencies), feel free to add them to this list.

Status Key

When updating the dependency table, please use one of the values in the table below. If the status is really not encompassed by the existing statuses, please add a new value and description for the current state.

Package Status Key
Value Meaning
Packaged? Software is packaged in Fedora but it may not be a version that is compatible with PyTorch
Packaged Software is packaged in Fedora and is compatible with building PyTorch
In Progress Someone is currently working to package an appropriate version of the software

Dependency List

The upstream links and versions were extracted from pytorch's third_party directory upstream on 2023-09-14.

PyTorch Dependency List
PyTorch Name Version Status Packager Fedora Package Name Fedora Package URL EPEL Notes
FP16 4dfe081 (2020-05-14) Packaged trix FP16 FP16
FXdiv b408327 (2020-04-17) Packaged trix fxdiv fxdiv
NNPACK c07e3a0 (2020-12-21) In Progress thunderbirdtr
QNNPACK 7d2a4e9 (2019-08-28) Archived upstream on 2020-10-01
VulkanMemoryAllocator v3.0.1 Packaged Jeremy Newton VulkanMemoryAllocator VulkanMemoryAllocator
benchmark v1.6.1 Packaged? google-benchmark google-benchmark
cpuinfo 6481e8b (2023-01-13) Packaged trix cpuinfo cpuinfo
cub d106ddb (2020-05-12) the linked repo is marked as moved, this could be a mess. equivalent commit in NVIDIA/cub? might be cub 1.10.0 but the tags don't seem to correlate with versions mentioned in commit messages
cudnn_frontend v0.9.2 (2023-07-13) this requires CUDA and is likely not package-able for Fedora
cutlass 3.1 this requires CUDA and is likely not package-able for Fedora. we'll have to figure out how to build pytorch without it.
eigen 3.4.0 (2021-08-18) Packaged? eigen3 eigen3
fbgemm d0ee798 post v0.4.1
flatbuffers 23.3.3 Packaged? flatbuffers flatbuffers
fmt 10.1.1 Packaged? fmt fmt
foxi c278588 (2021-05-26) master/HEAD, appears to be an extension of ONNX Interface for Framework Integration
gemmlowp 3fb5c17 (2018-11-26)
gloo cf1e1ab (2023-07-19) Packaged trix
googletest v1.11.0 (2021-06-11) Packaged? gtest gtest
ideep 13dd1fd master branch appears dead - there appear to be two current branches: ideep_dev and ideep_pytorch and the 13dd1fd commit appearst to only be in the ideep_pytorch branch
ios-cmake 8abaed6 (2017-11-15) fork of ollef/ios-cmake which is a fork of cristeab/ios-cmake
ittapi 5b8a7d7 (2022-04-12) before ittapi's first release
kineto 49e854d (2023-08-08) well after last release (v0.4.0)
mimalloc b66e321 (2023-04-24)
miniz-2.1.0 Forked in PyTorch Upstream Packaged? miniz miniz
nccl 2.18.5-1 (2023-08-23)
neon2sse 97a126f (2018-09-17)
nlohmann/json 87cda1d (2022-06-18) between 3.10.5 and 3.11.0
nvfuser in pytorch tree
onnx 1.14.1 Packaged? onnx onnx
onnx-tensorrt 6.0 (2019-09-16)
pocketfft release_for_eigen (2021-03-12) Packaged trix pocketfft pocketfft
protobuf d1eca4e (2020-10-08) Packaged? protobuf protobuf after v3.13.0, before v3.14.0-rc1
psimd current master/HEAD (2020-05-17) Packaged trix psimd psimd
pthreadpool a134dd5 (2021-04-13) Packaged trix
pybind11 2.11.1 Packaged? pybind11 pybind11
python-peachpy f45429b This is a fork of Maratyszcza/PeachPy
six no specified version Packaged? python-six python-six
sleef e0a003e (2020-12-21) Packaged? sleef sleef
tbb TBB 2018 U6? (2018-10-09) Packaged? tbb tbb
tensorflow_cuda_bazel_build might be part of the pytorch build process
tensorpipe 52791a2 Archived upstream on 2023-07-01
XNNPACK 51a9875 In review 2242399 trix
zstd v1.3.2 + 1 month Packaged? zstd zstd