Run only a random subset of tests.

[אורי]

tests - add a new argument "--test-only" (int, >=0) and If run with this argument, run only this number of tests.

Sometimes there are thousands of tests, for example 6,000 tests, and I want to run only a random subset of them, for example 200 tests. It should be possible with Django.

The code needed to implement such a feature is:

In command test:

        parser.add_argument(
            "--test-only",
            action="store",
            help="If run with this argument, run only this number of tests.",
            type=int,
        )

In DiscoverRunner::init:

            self.test_only = kwargs.get('test_only', None)
            if (self.test_only is not None):
                assert (self.test_only >= 0)

In DiscoverRunner::test_suite:

        def test_suite(self, tests=()):
            if (self.test_only is not None):
                tests = tests[:self.test_only]
            return super().test_suite(tests=tests)

Usage:

python manage.py test --shuffle --test-only 200

(It makes more sense to use it with --shuffle, but you can also use it without it).

And that's all. :-)

[Mariusz Felisiak]

Thanks for this ticket, however, I think it's a bit of a niche case. The current thread is to keep Django a core framework, not providing every utility which might be useful.

Please first start a discussion on the DevelopersMailingList, where you'll reach a wider audience and see what other think, and ​follow the guidelines with regards to wontfix tickets.