Introduction
Besides being implementations, BLAS and LAPACK are also API standards for basic linear algebra operations (such as vector and matrix multiplication). Many implementations of these API exist. The reference implementation of BLAS and LAPACK from Netlib is very stable but is not as fast as optimized ones such as ATLAS and OpenBLAS.
Implementations of BLAS:
- blas - Reference implementation from Netlib.
- atlas - Automatically Tuned Linear Algebra Software.
- blis - BLAS-like Library Instantiation Software framework.
- openblas - OpenBLAS, an optimized BLAS based on GotoBLAS2.
Both BLIS and OpenBLAS provide several flavors: a sequential version, a threaded one, and another with OpenMP support (all of them with or without support for 64-bit integers).
Implementations of LAPACK:
- lapack - Reference implementation from Netlib.
- ATLAS, BLIS and OpenBLAS provide an optimized subset of LAPACK.
Due to implementation differences, it is important that all components of a particular software stack link to the same BLAS/LAPACK implementation. Also, users may want to choose a particular implementation that works best for them at run time. This guideline gives a structure that can enforce the first while allowing the second, as well as providing a transparent fallback mechanism to Netlib's reference implementation for those symbols not included in the selected backend.
BLAS/LAPACK wrapper
FlexiBLAS is a framework that wraps both BLAS and LAPACK APIs in a single library. BLAS/LAPACK consumers must link against FlexiBLAS, and this wrapper is able to redirect calls to a selected optimized backend with negligible overhead. It also provides transparent fallback to Netlib's reference implementation if a certain symbol is not present in the selected backend. These are the main features:
- Provides a 100% BLAS and LAPACK compatible ABI/API, with interfaces for both 32- and 64-bit integers.
- Runtime exchangeable BLAS and LAPACK backend without recompilation via an environment variable.
- Integration of user-owned BLAS libraries without administrator privileges, even in system-wide installed programs.
- Works with OpenBLAS, ATLAS, Intel MKL, ACML, ...
- Flexible per-system/user/host configuration files.
- Basic profiling support.
FlexiBLAS provides a common interface,
%files wrapper %{_libdir}/flexiblas.so.x %files wrapper64 %{_libdir}/flexiblas64.so.x
as well as fallbacks to Netlib's reference implementation,
%files wrapper %{_libdir}/flexiblas/libflexiblas_netlib.so %{_libdir}/flexiblas/libflexiblas_fallback_lapack.so %files wrapper64 %{_libdir}/flexiblas64/libflexiblas_netlib.so %{_libdir}/flexiblas64/libflexiblas_fallback_lapack.so
and, finally, several wrappers for different implementations under different names:
%files atlas %{_libdir}/flexiblas/libflexiblas_atlas.so %files blis-serial %{_libdir}/flexiblas/libflexiblas_blis-serial.so %files blis-threads %{_libdir}/flexiblas/libflexiblas_blis-threads.so %files blis-openmp %{_libdir}/flexiblas/libflexiblas_blis-openmp.so %files openblas-serial %{_libdir}/flexiblas/libflexiblas_openblas-serial.so %files openblas-threads %{_libdir}/flexiblas/libflexiblas_openblas-threads.so %files openblas-openmp %{_libdir}/flexiblas/libflexiblas_openblas-openmp.so
plus the 64-bit versions for BLIS and OpenBLAS under %{_libdir}/flexiblas64 in 64-bit architectures. These are sub-packaged separately to avoid pulling the whole stack of implementations. The wrapper and wrapper64 sub-packages require a default implementation that is currently set to openblas-serial:
%global default_backend openblas-serial %package wrapper Requires: %{name}%{?_isa} = %{version}-%{release} Requires: %{name}-%{default_backend}%{?_isa} = %{version}-%{release} %package wrapper64 Requires: %{name}%{?_isa} = %{version}-%{release} Requires: %{name}-%{default_backend}64%{?_isa} = %{version}-%{release}
Packaging guidelines
BLAS/LAPACK implementations
Implementations of BLAS and/or LAPACK available in Fedora do not need to change anything.
BLAS/LAPACK dependent packages
Consumers of any subset of BLAS and/or LAPACK must compile against FlexiBLAS:
BuildRequires: pkgconfig(flexiblas)
if the package uses the 32-bit interface (this is the most common case), or
BuildRequires: pkgconfig(flexiblas64)
if the package uses the 64-bit interface. Furthermore, if the package only supports this 64-bit interface, then 32-bit architectures must be excluded. Otherwise, the package may depend conditionally on the 64-bit version when available, and on the 32-bit one otherwise (as e.g. packages petsc and suitesparse currently do).
In any case, by compiling against FlexiBLAS, they will automatically use the system-wide default backend, and will benefit from any other system/user/host-selected optimized subset of routines.
Backend selection
System-level selection
A package compiled against FlexiBLAS pulls out the corresponding flexiblas-wrapper(64) subpackage, which in turn requires the default optimized backend, e.g., flexiblas-openblas-serial(64). This is set via the "default=IMPLEMENTATION-NAME" key (by default, default=openblas-serial), present in the main configuration file shipped in the wrapper subpackages:
%files wrapper %config(noreplace) %{_sysconfdir}/flexiblasrc %files wrapper64 %config(noreplace) %{_sysconfdir}/flexiblas64rc
To allow system-level selection of other BLAS/LAPACK implementations, more backends must be installed in the first place (e.g., flexiblas-atlas, flexiblas-blis-serial...), and then they can be swapped system-wide via the flexiblas CLI tool, or just by modifying the "default" key in the configuration file by hand.
User-level selection
Persistent user-level selection of system-provided BLAS/LAPACK implementations can be done via the CLI tool:
$ flexiblas set IMPLEMENTATION-NAME $ flexiblas64 set IMPLEMENTATION-NAME
provided the sub-package for IMPLEMENTATION-NAME is installed.
Non-persistent user-level selection can be triggered via an environment variable:
$ FLEXIBLAS=IMPLEMENTATION-NAME ./yourapp $ FLEXIBLAS64=IMPLEMENTATION-NAME ./yourapp64
User-level selection of user-owned BLAS/LAPACK libraries can be achieved just by changing IMPLEMENTATION-NAME with a path to any custom BLAS/LAPACK-compatible library in the examples above.