]> Frank Brehm's Git Trees - profitbricks/jenkins-build-scripts.git/log
profitbricks/jenkins-build-scripts.git
11 years agoMerge branch 'master' into feature/multipledists
Mathias Klette [Thu, 13 Jun 2013 09:42:49 +0000 (11:42 +0200)]
Merge branch 'master' into feature/multipledists

11 years agodebian_build: compatibility for 'remotes' objects in git library between squeeze...
Mathias Klette [Thu, 13 Jun 2013 09:40:42 +0000 (11:40 +0200)]
debian_build: compatibility for 'remotes' objects in git library between squeeze and wheezy

thanks to tobias, see https://redmine.pb.local/issues/356

11 years agodebian_build: show help instructions for chroot debugging on either case (success...
Mathias Klette [Fri, 7 Jun 2013 10:00:27 +0000 (12:00 +0200)]
debian_build: show help instructions for chroot debugging on either case (success AND error)

11 years agodebian_build: let cd command be part of copy&pasteble commands
Mathias Klette [Thu, 6 Jun 2013 15:13:53 +0000 (17:13 +0200)]
debian_build: let cd command be part of copy&pasteble commands

11 years agoextract_storage: fix apt sources for master and develop
Sebastian Riemer [Thu, 6 Jun 2013 14:35:45 +0000 (16:35 +0200)]
extract_storage: fix apt sources for master and develop

The master build job 'extract-storage-kernel-and-modules' extracts
the wrong sources. It takes the latest develop kernel as the apt
sources for 'production-proposed-updates' are missing.

So add the missing sources before installing the kernel and the
out-of-tree modules.

Fixes: DEVINF-379
11 years agodebian_build: log beautifying
root sagunt [Thu, 6 Jun 2013 10:54:41 +0000 (10:54 +0000)]
debian_build: log beautifying

11 years agogit_buildpackage: less logging
root sagunt [Thu, 6 Jun 2013 10:54:15 +0000 (10:54 +0000)]
git_buildpackage: less logging

11 years agocommon_code: use __file__ not __name__
root sagunt [Thu, 6 Jun 2013 10:53:37 +0000 (10:53 +0000)]
common_code: use __file__ not __name__

11 years agoMerge branch 'feature/multipledists' of http://git/so/jenkins_build_script into featu...
root sagunt [Wed, 5 Jun 2013 20:49:07 +0000 (20:49 +0000)]
Merge branch 'feature/multipledists' of http://git/so/jenkins_build_script into feature/multipledists

11 years agodebian_build: shorten name for log messages
Mathias Klette [Wed, 5 Jun 2013 20:48:24 +0000 (22:48 +0200)]
debian_build: shorten name for log messages

11 years agocommon_code: shorten log_name if not explicitely given
Mathias Klette [Wed, 5 Jun 2013 19:46:08 +0000 (21:46 +0200)]
common_code: shorten log_name if not explicitely given

11 years agodebian_build: just beatuifying the instructions
Mathias Klette [Wed, 5 Jun 2013 18:21:08 +0000 (20:21 +0200)]
debian_build: just beatuifying the instructions

11 years agodebian_build: fix map
Mathias Klette [Wed, 5 Jun 2013 18:17:23 +0000 (20:17 +0200)]
debian_build: fix map

11 years agodebian_build: fix gbp object usage
Mathias Klette [Wed, 5 Jun 2013 18:12:43 +0000 (20:12 +0200)]
debian_build: fix gbp object usage

11 years agodebian_build: let's skip trace for no-branch errors
Mathias Klette [Wed, 5 Jun 2013 18:10:32 +0000 (20:10 +0200)]
debian_build: let's skip trace for no-branch errors

11 years agodebian_build: PLEASE also exit with error if branch was not found!
Mathias Klette [Wed, 5 Jun 2013 18:08:55 +0000 (20:08 +0200)]
debian_build: PLEASE also exit with error if branch was not found!

11 years agodebian_build: some reorganization
Mathias Klette [Wed, 5 Jun 2013 18:07:51 +0000 (20:07 +0200)]
debian_build: some reorganization

11 years agodebian_build: add 'name' to local repo-obj, exit if branch is not found
Mathias Klette [Wed, 5 Jun 2013 17:59:54 +0000 (19:59 +0200)]
debian_build: add 'name' to local repo-obj, exit if branch is not found

11 years agodebian_build: change help instructions to be copy&pasteble
Mathias Klette [Wed, 5 Jun 2013 17:47:34 +0000 (19:47 +0200)]
debian_build: change help instructions to be copy&pasteble

11 years agodebian_build: fix typo
Mathias Klette [Wed, 5 Jun 2013 17:34:23 +0000 (19:34 +0200)]
debian_build: fix typo

11 years agodebian_build: show help instructions for package build failures
Mathias Klette [Wed, 5 Jun 2013 17:28:58 +0000 (19:28 +0200)]
debian_build: show help instructions for package build failures

11 years agogit_buildpackage: make env and command properties, usable by debian_build
Mathias Klette [Wed, 5 Jun 2013 17:28:17 +0000 (19:28 +0200)]
git_buildpackage: make env and command properties, usable by debian_build

11 years agodebian_build: less code for trigger handling
Mathias Klette [Tue, 4 Jun 2013 11:12:26 +0000 (13:12 +0200)]
debian_build: less code for trigger handling

11 years agodebian_build: abort if rebase failed
Mathias Klette [Tue, 4 Jun 2013 10:40:01 +0000 (12:40 +0200)]
debian_build: abort if rebase failed

11 years agodebian_build: add missing closing quotes
Mathias Klette [Tue, 4 Jun 2013 10:36:22 +0000 (12:36 +0200)]
debian_build: add missing closing quotes

11 years agodebian_build: change forgotten variable name
Mathias Klette [Tue, 4 Jun 2013 10:26:28 +0000 (12:26 +0200)]
debian_build: change forgotten variable name

11 years agodebian_build: os.environ object does not allow assignment of a list
Mathias Klette [Tue, 4 Jun 2013 10:14:51 +0000 (12:14 +0200)]
debian_build: os.environ object does not allow assignment of a list

11 years agodebian_build: include try/except for rebase operations
Mathias Klette [Tue, 4 Jun 2013 10:07:01 +0000 (12:07 +0200)]
debian_build: include try/except for rebase operations

11 years agodebian_build: use Jenkins parameter BUILD_TRIGGERS instead of commit message parsing
Mathias Klette [Tue, 4 Jun 2013 10:01:42 +0000 (12:01 +0200)]
debian_build: use Jenkins parameter BUILD_TRIGGERS instead of commit message parsing

commit message is still parsed for those triggers, but this happens through
call_jenkins instead. this way jobs can use triggers no matter if recent commit
message contains the requested trigger.

11 years agodebian_build: also remove "do_push" variable - it's obsolete now
Mathias Klette [Thu, 30 May 2013 14:10:33 +0000 (16:10 +0200)]
debian_build: also remove "do_push" variable - it's obsolete now

11 years agodebian_build: new fixes for new branching model, fix rebasing
Mathias Klette [Thu, 30 May 2013 12:33:49 +0000 (14:33 +0200)]
debian_build: new fixes for new branching model, fix rebasing

also pushing the rebased/merged branch should only be done if all tests have
passed! hence, we shouldn't push the merged branch already in debian_build.
instead, we will try to find solutions to make jenkins push the branch using
post-build actions

11 years agodebian_build: push the merged feature/-branch to integration upon successful build
Mathias Klette [Wed, 29 May 2013 13:46:19 +0000 (15:46 +0200)]
debian_build: push the merged feature/-branch to integration upon successful build

11 years agocommon_code: reset GIT_BRANCH if it differs from GIT_BRANCH_NAME
Mathias Klette [Wed, 29 May 2013 12:11:23 +0000 (14:11 +0200)]
common_code: reset GIT_BRANCH if it differs from GIT_BRANCH_NAME

Most jobs use GIT_BRANCH_NAME parameter to let user choose the branch to build
the package from while GIT_BRANCH contains the sha commit id of HEAD of most
recent commit (unconfirmed yet).

11 years agocommon_code: GIT_BRANCH_NAME = GIT_BRANCH only if not already given
Mathias Klette [Wed, 29 May 2013 12:07:56 +0000 (14:07 +0200)]
common_code: GIT_BRANCH_NAME = GIT_BRANCH only if not already given

11 years agodebian_build: do not merge if we are on integration already
Mathias Klette [Tue, 28 May 2013 16:07:57 +0000 (18:07 +0200)]
debian_build: do not merge if we are on integration already

11 years agodebian_build: change the way now to handle [merge] trigger
Mathias Klette [Tue, 28 May 2013 16:01:44 +0000 (18:01 +0200)]
debian_build: change the way now to handle [merge] trigger

11 years agodebian_build: accept integration jobs for experimental branches
Mathias Klette [Tue, 28 May 2013 15:41:22 +0000 (17:41 +0200)]
debian_build: accept integration jobs for experimental branches

11 years agodebian_build: fix: correct format() usage
Mathias Klette [Tue, 28 May 2013 15:28:05 +0000 (17:28 +0200)]
debian_build: fix: correct format() usage

11 years agodebian_build: fix: correct usage for format()
Mathias Klette [Tue, 28 May 2013 15:07:59 +0000 (17:07 +0200)]
debian_build: fix: correct usage for format()

11 years agodebian_build: fix: seperate format-method from string with .
Mathias Klette [Tue, 28 May 2013 15:01:51 +0000 (17:01 +0200)]
debian_build: fix: seperate format-method from string with .

11 years agodebian_build: extend gitrepo object with a dict of all remotes
Mathias Klette [Tue, 28 May 2013 14:40:22 +0000 (16:40 +0200)]
debian_build: extend gitrepo object with a dict of all remotes

this dict is then used to verify whether any package shall have auto-increment
enabled.

11 years ago* debian_build.py: pep8 compliance
Tobias von der Krone [Tue, 28 May 2013 12:28:14 +0000 (14:28 +0200)]
* debian_build.py: pep8 compliance
* debian_build.py: use more STRING.format()

11 years agodebian_build: ENV['GIT_BRANCH'] may include origin as prefix, use local_branch instead
Mathias Klette [Tue, 28 May 2013 11:56:51 +0000 (13:56 +0200)]
debian_build: ENV['GIT_BRANCH'] may include origin as prefix, use local_branch instead

11 years agodebian_build: fix - remove last occurences of obsolete var DISTRIBUTION
Mathias Klette [Tue, 28 May 2013 11:51:44 +0000 (13:51 +0200)]
debian_build: fix - remove last occurences of obsolete var DISTRIBUTION

11 years agodebian_build: include style and cleanup changes from tobias
Mathias Klette [Tue, 28 May 2013 11:48:23 +0000 (13:48 +0200)]
debian_build: include style and cleanup changes from tobias

11 years agodebian_build: fix variable usage and usage of check_call-method
Mathias Klette [Tue, 28 May 2013 09:48:49 +0000 (11:48 +0200)]
debian_build: fix variable usage and usage of check_call-method

we shall stay with DISTRIBUTION envionment variable yet: let's force the user to
provide the necessary distribution in Jenkins GUI or in call_jenkins.
in the next step we try to remove this parameter from jenkins and base the
decision of what distribution to use on what we find in the changelog. question
to be answered for this:
 stable -> squeeze?
 our old values like 'production', pau, ppu, ... -> ??
 wheezy -> wheezy?

the check_call() method from subprocess seems to return the exit code of command
ran as int. this doesn't behave well in current if-syntax, so we changed it to
match for success code "0" explicitely.

11 years agodebian_build: compatibility mode and error for job building from wrong branch
Mathias Klette [Mon, 27 May 2013 19:18:25 +0000 (21:18 +0200)]
debian_build: compatibility mode and error for job building from wrong branch

11 years agodebian_build: remove the choices from 'distribution' args, accept all of them
Mathias Klette [Sun, 26 May 2013 00:14:44 +0000 (02:14 +0200)]
debian_build: remove the choices from 'distribution' args, accept all of them

11 years agodebian_build: do not let a jenkins user start job builds from inapproriate branches
Mathias Klette [Sun, 26 May 2013 00:05:27 +0000 (02:05 +0200)]
debian_build: do not let a jenkins user start job builds from inapproriate branches

11 years agocommon_code: too intrusive too remove env GIT_BRANCH_NAME:
Mathias Klette [Sat, 25 May 2013 23:36:07 +0000 (01:36 +0200)]
common_code: too intrusive too remove env GIT_BRANCH_NAME:

let's just take the GIT_BRANCH env var exposed by default from jenkins git
plugin, this might confuse users if both variables uses different values

11 years agodebian_build: add some explanation for RE to collect triggers
Mathias Klette [Wed, 22 May 2013 17:59:06 +0000 (19:59 +0200)]
debian_build: add some explanation for RE to collect triggers

11 years agodebian_build: further changes intended to enable CI magic for vdc-bundles
Mathias Klette [Wed, 22 May 2013 17:53:34 +0000 (19:53 +0200)]
debian_build: further changes intended to enable CI magic for vdc-bundles

11 years agodebian_build: python-git needs special treatment
Mathias Klette [Wed, 22 May 2013 16:29:52 +0000 (18:29 +0200)]
debian_build: python-git needs special treatment

Available in
  wheezy:  git.Repo('.').commit(<COMMIT_ID>).hexsha
  squeeze: git.Repo('.').commit(<COMMIT_ID>).id

11 years agodo not tag 'integration'-builds!
Mathias Klette [Wed, 22 May 2013 16:00:27 +0000 (18:00 +0200)]
do not tag 'integration'-builds!

I missed the point in the requirement: tags should only be created upon a
complete successfull build. this means, that also all tests must complete
successfully in order to create a new tag.
as jenkins is taking care of evaluating test results we can't create the tag in
debian_build beforehand. we'll use git publisher plugin now, to only tag
'stable_$BUILD_NUMBER' if build succeeds!

11 years agouse a real git.Repo().commit() object
Mathias Klette [Wed, 22 May 2013 09:13:48 +0000 (11:13 +0200)]
use a real git.Repo().commit() object

as preparation for vdc-bundles-integration scheme:
requirements define to evaluate commit message for different triggers:
* [merge]: integrate all commits of currently committing branch into
           'integration'-branch by using 'rebase'
* [no-test]: package build should not run any tests

according to documentation, http://goo.gl/kS1rB,
* [no-test] will be ignored if [merge] is also given in the commit message
* [no-test] will be ignored for 'integration' branch at all - it must run the
            full set of tests!

we can access the commit message like this:

  >>> curr_commit.message
  <<< u'test commit\n'

11 years agodebian_build: handle integration branch of vdc-bundles
Mathias Klette [Tue, 21 May 2013 08:01:44 +0000 (10:01 +0200)]
debian_build: handle integration branch of vdc-bundles

11 years agocall_jenkins and other hooks are located in git-server-config repository now
Mathias Klette [Fri, 17 May 2013 17:23:40 +0000 (19:23 +0200)]
call_jenkins and other hooks are located in git-server-config repository now

11 years agocall_jenkins and other hooks are located in git-server-config repository now
Mathias Klette [Fri, 17 May 2013 17:23:40 +0000 (19:23 +0200)]
call_jenkins and other hooks are located in git-server-config repository now

11 years agovdc-bundles requires builds for 'integration' branch
Mathias Klette [Fri, 17 May 2013 11:58:06 +0000 (13:58 +0200)]
vdc-bundles requires builds for 'integration' branch

11 years agoMerge branch 'develop' into feature/multipledists
Mathias Klette [Tue, 14 May 2013 14:53:35 +0000 (16:53 +0200)]
Merge branch 'develop' into feature/multipledists

11 years agoMerge branch 'master' into develop
Mathias Klette [Tue, 14 May 2013 14:53:13 +0000 (16:53 +0200)]
Merge branch 'master' into develop

11 years agoliveboot_rsync: use dcmanager sync scheme also for PBB
Mathias Klette [Tue, 14 May 2013 14:52:36 +0000 (16:52 +0200)]
liveboot_rsync: use dcmanager sync scheme also for PBB

11 years agodebian_build: seperate branch and dist with dash in experimental packages
Mathias Klette [Mon, 13 May 2013 14:03:00 +0000 (16:03 +0200)]
debian_build: seperate branch and dist with dash in experimental packages

11 years agoliveboot_rsync: don't use archive option for rsync
Mathias Klette [Wed, 8 May 2013 17:31:31 +0000 (19:31 +0200)]
liveboot_rsync: don't use archive option for rsync

liveboot_rsync facilitates rsync module whileas dcmanager uses
a dedicated user to sync files via SSH. this causes rsync daemon
on mgmt1 to reset permissions in such a way that dcmanager isn't
capable of resetting the mtime value of "." (parent directory of
destination) and hence throws error in UI. dcmanager doesn't use
the same rsync options (yet), which could make sense to have both
sources operating the same way.

11 years agodput: remove trailing whitespaces
Mathias Klette [Tue, 7 May 2013 22:44:50 +0000 (00:44 +0200)]
dput: remove trailing whitespaces

11 years agodebian_build: make multiple dists work
Mathias Klette [Tue, 7 May 2013 22:42:07 +0000 (00:42 +0200)]
debian_build: make multiple dists work

11 years agodebian_build: frist steps to enable multiple distribution builds
Mathias Klette [Tue, 7 May 2013 19:30:24 +0000 (21:30 +0200)]
debian_build: frist steps to enable multiple distribution builds

11 years agoand include AGAIN .. why does it disappear?
Mathias Klette [Tue, 7 May 2013 15:56:31 +0000 (17:56 +0200)]
and include AGAIN .. why does it disappear?

11 years agoMerge branch 'develop' into feature/DEVINF-28
Mathias Klette [Fri, 3 May 2013 15:18:51 +0000 (17:18 +0200)]
Merge branch 'develop' into feature/DEVINF-28

11 years agoMerge branch 'feature/storage-auto-deploy'
Mathias Klette [Fri, 3 May 2013 15:17:05 +0000 (17:17 +0200)]
Merge branch 'feature/storage-auto-deploy'

11 years agoMerge branch 'feature/storage-auto-deploy' into develop
Mathias Klette [Fri, 3 May 2013 15:15:57 +0000 (17:15 +0200)]
Merge branch 'feature/storage-auto-deploy' into develop

11 years agoCheck if approval mail will be send.
Marjan Schiller [Fri, 3 May 2013 14:40:53 +0000 (16:40 +0200)]
Check if approval mail will be send.

11 years agofix: we must check for contents only when files are already updated
Mathias Klette [Fri, 3 May 2013 12:59:55 +0000 (14:59 +0200)]
fix: we must check for contents only when files are already updated

11 years agoinclude fix again for printing changelog
Mathias Klette [Fri, 3 May 2013 12:58:50 +0000 (14:58 +0200)]
include fix again for printing changelog

11 years agostorage_deploy: removed embarrassing 'set -x'
Thilo Fromm [Fri, 3 May 2013 12:55:04 +0000 (14:55 +0200)]
storage_deploy: removed embarrassing 'set -x'

Signed-off-by: Thilo Fromm <thilo.fromm@profitbricks.com>
11 years agostorage_deploy: now with autotest image provisioning
Thilo Fromm [Fri, 3 May 2013 12:45:28 +0000 (14:45 +0200)]
storage_deploy: now with autotest image provisioning

Signed-off-by: Thilo Fromm <thilo.fromm@profitbricks.com>
11 years agoRemoved local hdd mount from autotest execution.
Marjan Schiller [Fri, 3 May 2013 12:41:34 +0000 (14:41 +0200)]
Removed local hdd mount from autotest execution.

11 years agobugfixes for master branch builds
Mathias Klette [Fri, 3 May 2013 12:41:29 +0000 (14:41 +0200)]
bugfixes for master branch builds

11 years agosome beautifying
Mathias Klette [Fri, 3 May 2013 12:29:30 +0000 (14:29 +0200)]
some beautifying

11 years agobugfixing
Mathias Klette [Fri, 3 May 2013 11:48:45 +0000 (13:48 +0200)]
bugfixing

11 years agoFixed boolean comparison.
Marjan Schiller [Fri, 3 May 2013 11:31:40 +0000 (13:31 +0200)]
Fixed boolean comparison.

11 years agoAdded parameter for autotest call.
Marjan Schiller [Fri, 3 May 2013 11:24:55 +0000 (13:24 +0200)]
Added parameter for autotest call.

11 years agocleanup #6: too many changes (most likely completely broken)
Mathias Klette [Fri, 3 May 2013 08:50:01 +0000 (10:50 +0200)]
cleanup #6: too many changes (most likely completely broken)

11 years agocommon_code, debian_build: cleanup #5
Mathias Klette [Thu, 2 May 2013 17:00:52 +0000 (19:00 +0200)]
common_code, debian_build: cleanup #5

- added CWD to default ENV
- remove unused variables
- facilitate git submodule more
- change the way of tag handling
- beautifying some parts of the code

11 years agodebian_build, common_code: cleanup #4 - new figlet() function instead of using subprocess
Mathias Klette [Thu, 2 May 2013 11:42:39 +0000 (13:42 +0200)]
debian_build, common_code: cleanup #4 - new figlet() function instead of using subprocess

11 years agodebian_build: cleanup #3 - also move dput stuff into a own class
Mathias Klette [Thu, 2 May 2013 11:17:20 +0000 (13:17 +0200)]
debian_build: cleanup #3 - also move dput stuff into a own class

11 years agoMerge branch 'develop' into feature/DEVINF-28
Mathias Klette [Thu, 2 May 2013 10:34:32 +0000 (12:34 +0200)]
Merge branch 'develop' into feature/DEVINF-28

Conflicts:
debian_build.py

11 years agodebian_build: cleanup #2
Mathias Klette [Thu, 2 May 2013 10:28:54 +0000 (12:28 +0200)]
debian_build: cleanup #2

11 years agofix add_liveboot_request: use correct trigger URL for jenkins
Mathias Klette [Thu, 2 May 2013 10:10:21 +0000 (12:10 +0200)]
fix add_liveboot_request: use correct trigger URL for jenkins

11 years agofix add_liveboot_request: use correct trigger URL for jenkins
Mathias Klette [Thu, 2 May 2013 10:10:21 +0000 (12:10 +0200)]
fix add_liveboot_request: use correct trigger URL for jenkins

11 years agoMerge branch 'master' into develop
Mathias Klette [Thu, 2 May 2013 10:06:49 +0000 (12:06 +0200)]
Merge branch 'master' into develop

11 years agofix debian_build: try to fix correct exception printing
Mathias Klette [Thu, 2 May 2013 09:56:36 +0000 (11:56 +0200)]
fix debian_build: try to fix correct exception printing

11 years agofix debian_build: use correct variable name from ENV for JOB_NAME
Mathias Klette [Thu, 2 May 2013 09:50:47 +0000 (11:50 +0200)]
fix debian_build: use correct variable name from ENV for JOB_NAME

11 years agofix debian_build: match against int instead of relying on boolean values
Mathias Klette [Thu, 2 May 2013 09:41:28 +0000 (11:41 +0200)]
fix debian_build: match against int instead of relying on boolean values

11 years agofix debian_build: provide some dumb comment instead of failing with non-existing...
Mathias Klette [Thu, 2 May 2013 09:37:39 +0000 (11:37 +0200)]
fix debian_build: provide some dumb comment instead of failing with non-existing objects

11 years agopass '__file__' to logger_init whereever it is used
Mathias Klette [Thu, 2 May 2013 09:12:47 +0000 (11:12 +0200)]
pass '__file__' to logger_init whereever it is used

11 years agofix debian_build
Mathias Klette [Thu, 2 May 2013 09:10:55 +0000 (11:10 +0200)]
fix debian_build

11 years agofix debian_build: try to fix correct exception printing
Mathias Klette [Thu, 2 May 2013 09:56:36 +0000 (11:56 +0200)]
fix debian_build: try to fix correct exception printing

11 years agofix debian_build: use correct variable name from ENV for JOB_NAME
Mathias Klette [Thu, 2 May 2013 09:50:47 +0000 (11:50 +0200)]
fix debian_build: use correct variable name from ENV for JOB_NAME

11 years agofix debian_build: match against int instead of relying on boolean values
Mathias Klette [Thu, 2 May 2013 09:41:28 +0000 (11:41 +0200)]
fix debian_build: match against int instead of relying on boolean values