Your plugin is great, im using it for my projects, it works good in one of them, but i have another similar project and its not working, all i can see is the exit status at 1 but it not shows the reason.

I also try the debug, verbosity and other options but any of them give me hints about whats wrong.

Hi, there are a few things you are doing that are not part of the publicly supported API of coverage.py, and one of them is breaking with 4.0a1. First, you should import "coverage" like this:

from coverage import coverage

Because you are importing from "coverage.control", it doesn't work with coverage.py 4.0a1. Secondly, I see you are calling _harvest_data directly. You shouldn't need to do this, as the leading underscore indicates. If I can help to get django-jenkins working using only the public APIs, please let me know.

Nose tests collector. Even if it's not the default django behaviour but nose is heavily use by the django community. And otherwise it create a difference between the local dev and the CI. The task is imperfect but it's a start.

When i configure to run csslint task, I get the following error:

teardown_test_environment signals.teardown_test_environment.send(sender=self) File "/home/jenkins/.virtualenvs/django-ca4/local/lib/python2.7/site-packages/django/dispatch/dispatcher.py", line 172, in send response = receiver(signal=self, sender=sender, **named) File "/home/jenkins/.virtualenvs/django-ca4/local/lib/python2.7/site-packages/django_jenkins/tasks/run_csslint.py", line 51, in teardown_test_environment csslint_output = check_output([self.intepreter, self.implementation, '--format=%s' % fmt] + files) File "/home/jenkins/.virtualenvs/django-ca4/local/lib/python2.7/site-packages/django_jenkins/functions.py", line 42, in check_output raise exception subprocess.CalledProcessError: Command '['rhino', '/home/jenkins/.virtualenvs/django-ca4/local/lib/python2.7/site-packages/django_jenkins/tasks/csslint/release/csslint-rhino.js', '--format=lint-xml']' returned non-zero exit status 1

Hi,

I had problems to run the test app for django-jenkins as the settingy.py seem to be for a different (older?) version of django.

Furthermore I added virtualenv support, so I can now use Jenkins with the test app - it works.

Maybe you want to use my changes as they'd improve django-jenkins.

Best regards, Achim.

Hi,

I'm working on a project where I need to do some specific business for the test database setup (mainly because I use django multi-db support), so I need to use a custom TestRunner class where I have overwritten the setup_databases method.

As I'm also using jenkins for CI, I need django_jenkins to be able to use my custom TestRunner class.

I think it does make sense to have it by default in your nice plugin.

Cheers, Christophe

Getting a lot of junk modules in the coverage report:

.var.lib.jenkins..virtualenvs.coursebook.lib.python2.6.site-packages.south.migration
.var.lib.jenkins..virtualenvs.coursebook.lib.python2.6.site-packages.django.core.mail

And a lot of other assorted Django project modules. Any way to get these excluded like with the tests?

I have all my apps located at project/apps/my_apps. I am facing a problem because Django Jenkins is collecting tests outside of PROJECT_APPS. I have unit tests and in a folder called scripts but this folder is out of the PROJECT_APPS context. Is it a bug or am I missing something?

Django-Jenkins version: 0.16.2 Django version: 1.6.5 Python version: 2.6

After update and run ./manage.py jenkins I got errors that table is missing. All settings are default.

Example log:

» ./manage.py jenkins 
Creating test database for alias 'default'...
E
======================================================================
ERROR: test_client_list_api (nutrimom.accounts.tests.AccountsTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/remik/Dropbox/workspace/nutrimom/nutrimom/accounts/tests.py", line 22, in setUp
    role='mom')
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/manager.py", line 157, in create
    return self.get_queryset().create(**kwargs)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/query.py", line 322, in create
    obj.save(force_insert=True, using=self.db)
  File "/Users/remik/Dropbox/workspace/nutrimom/nutrimom/accounts/models.py", line 98, in save
    self.timezone = Zipcode.objects.get(zipcode=self.zipcode).timezone
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/manager.py", line 151, in get
    return self.get_queryset().get(*args, **kwargs)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/query.py", line 304, in get
    num = len(clone)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/query.py", line 77, in __len__
    self._fetch_all()
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/query.py", line 857, in _fetch_all
    self._result_cache = list(self.iterator())
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/query.py", line 220, in iterator
    for row in compiler.results_iter():
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 713, in results_iter
    for rows in self.execute_sql(MULTI):
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 786, in execute_sql
    cursor.execute(sql, params)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/backends/util.py", line 53, in execute
    return self.cursor.execute(sql, params)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/utils.py", line 99, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/backends/util.py", line 53, in execute
    return self.cursor.execute(sql, params)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/django/db/backends/mysql/base.py", line 124, in execute
    return self.cursor.execute(query, args)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/MySQLdb/cursors.py", line 205, in execute
    self.errorhandler(self, exc, value)
  File "/Users/remik/Envs/nutrimom/lib/python2.7/site-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
    raise errorclass, errorvalue
ProgrammingError: (1146, "Table 'test_yd_nutrimom.accounts_zipcode' doesn't exist")

----------------------------------------------------------------------
Ran 1 tests in 0.102s

FAILED (errors=1)
Destroying test database for alias 'default'...

Leveraging what django_behave already provided, this change lets you add 'django_jenkins.tasks.behave_tests' as a task and run Behave tests that are located in your apps. Given that the django_behave project is out of date and doesn't seem to have much velocity I've moved all of the relevant parts into django-jenkins so that it can run standalone without that library (which currently will not work due to a package naming issue).

I tried to integrate this into my pipeline job on jenkins. See #351 for most recent documentation :books:. ;)

I'd like to add description on how to use this plugin with the new jenkins pipeline syntax.

There is this pull request on cubertura to add support for coverage.xml from pipeline. https://github.com/jenkinsci/cobertura-plugin/pull/55

I also commented on https://github.com/jenkinsci/cobertura-plugin/issues/50#issuecomment-262419362 where I described how to use https://github.com/cwacek/cobertura-clover-transform and use clover instead of cobertura as a temp workaround, but it failed on my side.

Here's how I managed to get coverage.xml and junit.xml to work in jenkins: I cloned https://github.com/mbarrien/cobertura-plugin/tree/pipeline (pipeline branch, that's the pr 55 above), compiled the plugin:

git clone https://github.com/mbarrien/cobertura-plugin/
cd cobertura-plugin
mvn install

This generated the .hpi plugin which I installed from Jenkins -> Manage Jenkins -> Configure Plugins -> Advanced and installed Cobertura plugin from there.

My app name is in PROJECT_APPS tuple as requested by django-jenkins. Here's what my Jenkinsfile looks like:

try {
sh '''
  #!/usr/bin/env sh
  source venv/bin/activate
  python manage.py jenkins --enable-coverage
'''
currentBuild.result = 'SUCCESS'
} catch(Exception err) {
currentBuild.result = 'FAILURE'
}

// Cobertura test coverage
step([$class: 'CoberturaPublisher', coberturaReportFile: 'reports/coverage.xml'])

// JUnit test results
step([$class: 'JUnitResultArchiver', testResults: 'reports/junit.xml'])

Everything seems to work fine:

But there's one thing left I'm still fighting with, I created an issue on Cobertura's side: https://github.com/jenkinsci/cobertura-plugin/issues/61 I'd be very happy if someone has an idea on this!

My setup is Django 4.0, Python 3.8.10 I came across this issue while working with django-jenkins:

Traceback (most recent call last):
  File "manage.py", line 22, in <module>
    main()
  File "manage.py", line 18, in main
    execute_from_command_line(sys.argv)
  File "C:\git\django-mssql\venv\lib\site-packages\django\core\management\__init__.py", line 425, in execute_from_command_line
    utility.execute()
  File "C:\git\django-mssql\venv\lib\site-packages\django\core\management\__init__.py", line 419, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "C:\git\django-mssql\venv\lib\site-packages\django\core\management\__init__.py", line 263, in fetch_command
    klass = load_command_class(app_name, subcommand)
  File "C:\git\django-mssql\venv\lib\site-packages\django\core\management\__init__.py", line 39, in load_command_class
    module = import_module('%s.management.commands.%s' % (app_name, name))
  File "C:\Users\AppData\Local\Programs\Python\Python38\lib\importlib\__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 783, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "C:\git\django-mssql\venv\lib\site-packages\django_jenkins\management\commands\jenkins.py", line 10, in <module>
    from django_jenkins.runner import CITestSuiteRunner
  File "C:\git\django-mssql\venv\lib\site-packages\django_jenkins\runner.py", line 9, in <module>
    from django.utils.encoding import smart_text
ImportError: cannot import name 'smart_text' from 'django.utils.encoding' (C:\git\django-mssql\venv\lib\site-packages\django\utils\encoding.py)

Upon doing some digging, it turns out that from django.utils.encoding has been rewritten a little. The only methods with "smart" in them are smart_str and smart_bytes. Thus, the solution is to change all occurences of smart_text to smart_str in runner.py

I just wanted to share this here in case anyone else came across this problem.

Hi. I have tried to use this module in a Django 3 project, written on python 3.8

This command works ok:

python manage.py jenkins

but this one fails:

python manage.py jenkins --enable-coverage

with the below weird error:

Traceback (most recent call last):
  File "/home/babis/Desktop/rais/web/rais/manage.py", line 21, in <module>
    main()
  File "/home/babis/Desktop/rais/web/rais/manage.py", line 17, in main
    execute_from_command_line(sys.argv)
  File "/home/babis/.virtualenvs/webEnv38/lib/python3.8/site-packages/django/core/management/__init__.py", line 401, in execute_from_command_line
    utility.execute()
  File "/home/babis/.virtualenvs/webEnv38/lib/python3.8/site-packages/django/core/management/__init__.py", line 377, in execute
    django.setup()
  File "/home/babis/.virtualenvs/webEnv38/lib/python3.8/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/babis/.virtualenvs/webEnv38/lib/python3.8/site-packages/django/apps/registry.py", line 83, in populate
    raise RuntimeError("populate() isn't reentrant")
RuntimeError: populate() isn't reentrant
Process finished with exit code 1

I have noticed that error before and it was something to do with wrong configuration with one of my apps. But here, what could that mean? Any ideas?

Is the package fully compatible with Django 3 and python 3.8?

Steps to reproduce

python manage.py jenkins --enable-coverage

Current behavior

(venv) D:\Repository\GIT\VICAS\api>python manage.py jenkins --enable-coverage System check identified no issues (0 silenced). ............................ Ran 28 tests in 239.656s

OK Storing coverage info... Executing django_jenkins.tasks.run_pylint... Traceback (most recent call last): File "manage.py", line 21, in main() File "manage.py", line 17, in main execute_from_command_line(sys.argv) File "D:\Repository\GIT\VICAS\api\venv\lib\site-packages\django\core\management_init_.py", line 381, in execute_from_command_line utility.execute() File "D:\Repository\GIT\VICAS\api\venv\lib\site-packages\django\core\management_init_.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "D:\Repository\GIT\VICAS\api\venv\lib\site-packages\django_jenkins\management\commands\jenkins.py", line 47, in run_from_argv super(Command, self).run_from_argv(argv) File "D:\Repository\GIT\VICAS\api\venv\lib\site-packages\django\core\management\commands\test.py", line 23, in run_from_argv super().run_from_argv(argv) File "D:\Repository\GIT\VICAS\api\venv\lib\site-packages\django\core\management\base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "D:\Repository\GIT\VICAS\api\venv\lib\site-packages\django\core\management\base.py", line 364, in execute output = self.handle(*args, **options) File "D:\Repository\GIT\VICAS\api\venv\lib\site-packages\django_jenkins\management\commands\jenkins.py", line 116, in handle coverage.save(tested_locations, options) File "D:\Repository\GIT\VICAS\api\venv\lib\site-packages\django_jenkins\tasks\run_pylint.py", line 44, in run lint.Run(args, reporter=ParseableTextReporter(output=output), exit=False) TypeError: init() got an unexpected keyword argument 'exit'

Expected behavior

(venv) D:\Repository\GIT\VICAS\api>python manage.py jenkins --enable-coverage System check identified no issues (0 silenced). ............................ Ran 28 tests in 242.236s

OK Storing coverage info... Executing django_jenkins.tasks.run_pylint... Done

django-Jenkins --version output

0.110.0

FIX

I fixed the file manually by changing run_pylint.py

lint.Run(args, reporter=ParseableTextReporter(output=output), exit=False) changed to

lint.Run(args, reporter=ParseableTextReporter(output=output), do_exit=False)

The coverage module recently released v5 and since then, django-jenkins seems broken:

Storing coverage info...
Traceback (most recent call last):
  File "/.../local/lib/python2.7/site-packages/django/core/management/__init__.py", line 364, in execute_from_command_line
    utility.execute()
  File "/.../local/lib/python2.7/site-packages/django/core/management/__init__.py", line 356, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/.../local/lib/python2.7/site-packages/django_jenkins-0.110.0-py2.7.egg/django_jenkins/management/commands/jenkins.py", line 47, in run_from_argv
    super(Command, self).run_from_argv(argv)
  File "/.../local/lib/python2.7/site-packages/django/core/management/commands/test.py", line 29, in run_from_argv
    super(Command, self).run_from_argv(argv)
  File "/.../ocal/lib/python2.7/site-packages/django/core/management/base.py", line 283, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/.../local/lib/python2.7/site-packages/django/core/management/base.py", line 330, in execute
    output = self.handle(*args, **options)
  File "/.../local/lib/python2.7/site-packages/django_jenkins-0.110.0-py2.7.egg/django_jenkins/management/commands/jenkins.py", line 116, in handle
    coverage.save(tested_locations, options)
  File "/.../local/lib/python2.7/site-packages/django_jenkins-0.110.0-py2.7.egg/django_jenkins/tasks/with_coverage.py", line 29, in save
    self.coverage.stop()
  File "/.../local/lib/python2.7/site-packages/django_jenkins-0.110.0-py2.7.egg/django_jenkins/tasks/with_coverage.py", line 55, in get_morfs
    return [filename for filename in coverage.data.measured_files()
AttributeError: 'Coverage' object has no attribute 'data'