From Fedora Project Wiki

(Add link to the tests page)
Line 25: Line 25:
Tests may be written all sorts of different ways, but have to be exposed and invoked in a standard way. They are stored or wrapped in the <code>tests/</code> directory in a dist-git repository. There is a detailed description of how this is done:
Tests may be written all sorts of different ways, but have to be exposed and invoked in a standard way. They are stored or wrapped in the <code>tests/</code> directory in a dist-git repository. There is a detailed description of how this is done:


* [[CI/Tests|How to run, write and wrap tests]]
* [[Changes/InvokingTests|Standard Spec for Invoking Tests]]
* [[Changes/InvokingTests|Standard Spec for Invoking Tests]]
* Helpful [https://pagure.io/standard-test-roles standard-test-roles for wrapping or writing tests].
* Helpful [https://pagure.io/standard-test-roles standard-test-roles for wrapping or writing tests].

Revision as of 12:28, 21 July 2017

Continuous integration aims to ensure broken changes do not affect other developers, packagers, maintainers or users. Continuous delivery aims to ensure broken changes do not get delivered or released.

The Manifesto

Because there are several Continuous Integration efforts, we need to set the basic rules to make sure we’re all playing the same game. When we call a game “football” we need to agree on what that means.

Here is a Continuous Integration manifesto that helps describe the goals, terminology, and rules.

Tests locations

The tests to be executed are stored in the dist-git repositories]. The tests are stored or wrapped along-side the spec files that describe the software sources. The tests are branched, maintained along with the package or module they pertain to.

Package or RPM specific tests are stored in that package's dist-git repository. Such package repositories will have a rpms/ prefix in their name. Other tests refer to larger sets of functionality, called modules and are stored in a dist-git repository with modules/ prefix in their name.

Test format

Tests may be written all sorts of different ways, but have to be exposed and invoked in a standard way. They are stored or wrapped in the tests/ directory in a dist-git repository. There is a detailed description of how this is done:

Gating

When a test fails, continuous integration will be able to prevent the broken package change from affecting other changes. That gating will happen in Bodhi. Packages in the core operating system, such as those in Fedora Atomic Host are most interesting for gating, as when they break they affect the most users.

Testing pipeline

The pipeline is under development

Contact

To get involved:

  • #fedora-ci on FreeNode
  • Mailing list: ci@lists.fedoraproject.org
  • If you don't know where to go: Stef Walter