Meego Wiki
Views

Build Infrastructure/Sysadmin Distro/OBS1.8 setup openSUSE112

From MeeGo wiki
< Build Infrastructure | Sysadmin Distro
Revision as of 18:03, 16 June 2010 by Liam (Talk | contribs)
(diff) โ† Older revision | Latest revision (diff) | Newer revision โ†’ (diff)
Jump to: navigation, search

These steps are to setup Open Build Service 1.8 on an openSuSE 11.2 installation. Currently this document describes how to setup an evaluation/test setup and is not meant as a production setup.

Most users won't need to install their own OBS and can just use an account on a publicly accessible OBS. Once public access is allowed to the global MeeGo OBS, there will be a link to obtain access.

There are cases where vendors may rather have full control of their builds and keep source private due to licensing restrictions, etc. These instructions are for these special cases.

MeeGo will switch to version 1.8 of the Build Service which is to be released soon. These instructions will be updated for the new version as soon as possible.

Contents

Add Repositories

First, we have to add the openSUSE:Tools repository to zypper for qemu-svn and other updated tools.

     cd /etc/zypp/repos.d/;
     wget http://download.opensuse.org/repositories/openSUSE:/Tools/openSUSE_11.2/openSUSE:Tools.repo
     zypper ref

Accept the trust key. change priority to avoid installing obs 2.0:

     zypper mr -p 60 openSUSE_Tools_MeeGo
     zypper mr -r openSUSE_Tools_MeeGo
     zypper mr -d openSUSE_Tools
     zypper ref

Setup the Client

Install the Client Packages

  • For obs worker:

     zypper in obs-worker qemu-svn mount-static bash-static

Point To The Server

Edit the file /etc/sysconfig/obs-worker in order to point to correct repository server. (The example server is 192.168.1.1)

     # vi /etc/sysconfig/obs-worker
     OBS_SRC_SERVER="192.168.1.1:5352"
     OBS_REPO_SERVERS="192.168.1.1:5252"

Start the Client

Start the worker service

     chkconfig --add obsworker
     rcobsworker start

Setup the server

Install the Server packages

  • For server:

     zypper in obs-server obs-signer obs-utils createrepo nfs-client obs-api memcached lighttpd

MySQL Setup

Start daemon by default:

     chkconfig --add mysql
     rcmysql start

Secure the installation

     /usr/bin/mysql_secure_installation

Create the databases:

     mysql -u root -p
     mysql> create database api_production;
     mysql> create database webui_production;

Add the obs user for these databases (substitute the correct password in):

     GRANT all privileges
           ON api_production.* 
           TO 'obs'@'%', 'obs'@'localhost' IDENTIFIED BY '************';
     GRANT all privileges
           ON webui_production.* 
           TO 'obs'@'%', 'obs'@'localhost' IDENTIFIED BY '************';
     FLUSH PRIVILEGES;

Now, configure OBS to use MySQL, first the API server.

     vi /srv/www/obs/api/config/database.yml
     #change the production section
     production:
       adapter: mysql
       database: api_production
       username: obs
       password: ************

And setup the webui to use MySQL...

     vi /srv/www/obs/webui/config/database.yml
     #change the production section
     production:
       adapter: mysql
       database: webui_production
       username: obs
       password: ************

Populate the database

     cd /srv/www/obs/api/
     RAILS_ENV="production" rake db:migrate

     cd /srv/www/obs/webui/
     RAILS_ENV="production" rake db:migrate

If this fails, check /srv/www/obs/api/config/environments/production.rb and /srv/www/obs/webui/config/environments/production.rb for configuration of the SOURCE_HOST and FRONTEND_HOST.

Setup lighttpd for webui

Make sure vhosts are enabled by uncommenting the following line:

      # vi /etc/lighttpd/lighttpd.conf
      include_shell "cat /etc/lighttpd/vhosts.d/*.conf"

Setup the regular webui on 80, api on 81, and 82 is the repository.

      vi /etc/lighttpd/vhosts.d/obs.conf
      $SERVER["socket"] == ":80" {
        rails_app   = "webui"
        rails_root  = "/srv/www/obs/webui"
        rails_procs = 3
        # production/development are typical values here
        rails_mode  = "production"
        log_root = "/srv/www/obs/webui/log"
        include "vhosts.d/rails.inc"
      }
      $SERVER["socket"] == ":81" {
        rails_app   = "api"
        rails_root  = "/srv/www/obs/api"
        rails_procs = 3
        # production/development are typical values here
        rails_mode  = "production"
        log_root = "/srv/www/obs/api/log"

        include "vhosts.d/rails.inc"
      }
      $SERVER["socket"] == ":82" {
        server.name = "192.168.1.1"
        server.document-root = "/srv/obs/repos/"
        dir-listing.activate = "enable"
      }

lighttpd requires some extra modules to be enabled: mod_access, mod_rewrite, mod_magnet, and mod_fastcgi. Do so by editing /etc/lighttpd/modules.conf:

     # vi /etc/lighttpd/modules.conf
   server.modules = (
     "mod_access",
   #  "mod_alias",
   #  "mod_auth",
   #  "mod_evasive",
   #  "mod_redirect",
     "mod_rewrite",
   #  "mod_setenv",
   #  "mod_usertrack",
   )

   ##
   ## mod_magnet
   ##
   include "conf.d/magnet.conf"

   ##
   ## FastCGI (mod_fastcgi)
   ##
   include "conf.d/fastcgi.conf"

You need also to configure /srv/www/obs/webui/config/environments/production.rb to point to correct server names:

     # vi /srv/www/obs/webui/config/environments/production.rb
     FRONTEND_HOST = "192.168.1.1"
     FRONTEND_PORT = 81
     FRONTEND_PROTOCOL = 'http'
     BUGZILLA_HOST = nil
     DOWNLOAD_URL = "http://192.168.1.1:82"
     ICHAIN_MODE = "off"
     BASE_NAMESPACE = nil

Do the same for /srv/www/obs/api/config/environments/production.rb. As soon your backend is not on the same machine as the api (frontend), change the following:

     # vi /srv/www/obs/api/config/environments/production.rb
     SOURCE_HOST = "192.168.1.1"

Add the server to start by default.

     chkconfig --add memcached
     chkconfig --add lighttpd
     chkconfig --add obsapidelayed
     chkconfig --add obswebuidelayed

ligthttpd user and group need to be the onwer of api and webui dirs (as well as log and tmp):

     chown -R lighttpd.lighttpd /srv/www/obs/{api,webui}

BSConfig.pm

The file /usr/lib/obs/server/BSConfig.pm is used to configure several settings for the Build Service. One of the major components is setting up the $hostname variable to the correct value. Currently I have this set to the IP address of the server.

      my $hostname = '192.168.1.1';

The list of directories in /srv/obs/repos/ is the repositories, so I changed the $repodownload:

      our $repodownload = "http://$hostname:82/";

Verification

At this point you should be able to open a browser and go to your server and login to OBS. Port 80 should be the webui, port 81 should be the api, and port 82 should be the repository directory. The default username/password is Admin/opensuse.

Start By Default

The OBS should start automatically, so they should be added to chkconfig to do so:

      chkconfig --add obsrepserver obssrcserver obsscheduler obsdispatcher obspublisher obswarden obssigner

Setting up Cross Compile

Configure build types

To setup cross compile, add the appropriate machine types to /etc/sysconfig/obs-server. For example, the following will enable ARM builds.

      # vi /etc/sysconfig/obs-server
      OBS_SCHEDULER_ARCHITECTURES="i586 armv5el armv7elโ€œ

Cloning Repositories

prj and prjconf

The project settings and the project config is an important part of the project and should be copied to the local project setup.

     osc -A <remote API URL> meta prj <repository name> > prj.txt
     osc -A <remote API URL> meta prjconf <repository name> > prjconf.txt

Modify the prj.txt file to name valid users in the userid fields. Once modified, the settings and configuration can be applied to the local project.

     osc -A <local API URL> meta prj <repository name> -F prj.txt
     osc -A <local API URL> meta prjconf <repository name> -F prjconf.txt

Mirror

obs_mirror_project (/usr/sbin/obs_mirror_project) is used to copy an external OBS project. The script needed to be modified to use build.meego.com as apposed to the hard coded download.opensuse.org site. You need an login to build.meego.com to execute this script.

/usr/sbin/obs_mirror_project <repository name> <type> <arch>


Rescan Repository

Once the download of the project is complete, you have to rescan the local repository.

/usr/lib/obs/server/bs_admin --rescan-repository <repository name> <type> <arch>

Troubleshooting

Here are common issues that have been seen and how to resolve them.

HTTP Error 500

Check /srv/www/obs/api/config/environments/production.rb and /srv/www/obs/webui/config/environments/production.rb for configuration of the SOURCE_HOST and FRONTEND_HOST.

Cannot load person data for Admin in application_helper

Make sure you set the permissions on the api and webui directories.

     chown -R lighttpd.lighttpd /srv/www/obs/{api,webui}

If this doesn't work then try to recreate the databases:

     # mysql -u root -p
     mysql> drop database api_production;
     mysql> drop database webui_production;

Rerun the mysql database setup from above and re-run rake.


External Links


Liam

Dl9pf

Personal tools