1. 28 May, 2009 2 commits
    • Iustin Pop's avatar
      Change the bdev init signatures · 464f8daf
      Iustin Pop authored
      
      
      This patch changes all the bdev.BlockDev constructors to take an
      additional ‘size’ parameter, all the backend functions that call those
      functions to pass it and also changes backend.BlocdevCreate() to not use
      the size passed via the rpc call but instead directly disk.size (this is
      the only way it's called).
      
      Note that this patch doesn't do anything with this parameter, just
      stores it on the blockdev objects.
      
      With the patch, we actually have a more uniform init sequence (before
      create had the parameter, but the other functions not).
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      464f8daf
    • Iustin Pop's avatar
      Merge branch 'next' · 2cd855dd
      Iustin Pop authored
      
      
      * next: (34 commits)
        watcher: automatically restart noded/rapi
        watcher: handle full and drained queue cases
        rapi: rework error handling
        Fix backend.OSEnvironment be/hv parameters
        rapi: make tags query not use jobs
        Change failover instance when instance is stopped
        Export more instance information in hooks
        watcher: write the instance status to a file
        Fix the SafeEncoding behaviour
        Move more hypervisor strings into constants
        Add -H/-B startup parameters to gnt-instance
        call_instance_start: add optional hv/be parameters
        Fix gnt-job list argument handling
        Instance reinstall: don't mix up errors
        Don't check memory at startup if instance is up
        gnt-cluster modify: fix --no-lvm-storage
        LUSetClusterParams: improve volume group removal
        gnt-cluster info: show more cluster parameters
        LUQueryClusterInfo: return a few more fields
        Add the new DRBD test files to the Makefile
        ...
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      2cd855dd
  2. 27 May, 2009 1 commit
  3. 25 May, 2009 5 commits
    • Iustin Pop's avatar
      watcher: automatically restart noded/rapi · c4f0219c
      Iustin Pop authored
      
      
      This patch makes the watcher automatically restart the node and rapi
      daemons, if they are not running (as per the PID file).
      
      This is not an exhaustive test; a better one would be TCP connect to the
      port, and an even better one a simple protocol ping (e.g. get / for rapi
      and a rpc_call_alive for noded), but since we don't know how they've
      been started we can't implement it today. rapi would need to write the
      SSL/port to a file, and noded something similar, so that we know how to
      connect.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarMichael Hanselmann <hansmi@google.com>
      c4f0219c
    • Iustin Pop's avatar
      watcher: handle full and drained queue cases · 24edc6d4
      Iustin Pop authored
      
      
      Currently the watcher is broken when the queue is full, thus not
      fulfilling its job as a queue cleaner. It also doesn't handle nicely the
      queue drained status.
      
      This patch does a few changes:
        - first archive jobs, and only after submit jobs; this fixes the case
          where the queue is already full and there are jobs suited for
          archiving (but not the case where the jobs all too young to be
          archived)
        - handle nicely the job queue full and drained cases—instead of
          tracebacks, log such cases nicely
        - reverse the initial value and special cases for update_file; we now
          whitelist instead of blacklist cases, since we have much more
          blacklist cases than vice versa, and we set the flag to True only
          after the run is successful
      
      The last change, especially, is a significant one: now errors during the
      watcher run will not update the status file, and thus they won't be lost
      again in the logs.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarMichael Hanselmann <hansmi@google.com>
      24edc6d4
    • Iustin Pop's avatar
      rapi: rework error handling · 59b4eeef
      Iustin Pop authored
      
      
      Currently the rapi code doesn't have any custom error handling; any
      exceptions raised are simply converted into an HTTP 500 error, without
      much explanation.
      
      This patch adds a couple of generic SubmitJob/GetClient functions that
      handle some errors specially so that they are transformed into HTTP
      errors, with more detailed information.
      
      With this patch, the behaviour of rapi when the queue is full or
      drained, or when the master is down is more readable.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      59b4eeef
    • Iustin Pop's avatar
      Fix backend.OSEnvironment be/hv parameters · 030b218a
      Iustin Pop authored
      Commit 67fc3042
      
       added some more
      variables to be exported to OSEnvironment, but it has two bugs:
        - wrong variable name (env vs. result)
        - in OSEnvironment we don't have the automatic converstion to strings
          that we do in hooks, so we must manually enforce this
      
      With this patch instance creations work again.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      030b218a
    • Iustin Pop's avatar
      rapi: make tags query not use jobs · 25e39bfa
      Iustin Pop authored
      
      
      Currently the rapi tags query implementation is similar to the command
      line one: it submits OpGetTags jobs. This not good, since this being an
      API it can be used a lot and can pollute the job queue with many such
      trivial jobs.
      
      This patch converts it to use either queries (for nodes/instances) or
      direct read from ssconf (for the cluster case). For ssconf, we added a
      function to the ssconf.SimpleStore class for reading the tags.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarMichael Hanselmann <hansmi@google.com>
      25e39bfa
  4. 21 May, 2009 2 commits
    • Iustin Pop's avatar
      Change failover instance when instance is stopped · d27776f0
      Iustin Pop authored
      
      
      Currently, if the instance is stopped, we still check for enough memory
      on the target node. This is a little bit too strict, since in case too
      many nodes have failed and one is out of the memory, this prevents
      fixing the cluster (with the instances down).
      
      We change it to do the memory checks only when the instance will be
      started.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      d27776f0
    • Iustin Pop's avatar
      Export more instance information in hooks · 67fc3042
      Iustin Pop authored
      
      
      Currently we miss in hooks the instance's hypervisor, hypervisor
      parameters and backend parameters. This forces hooks to query back into
      ganeti, which is dangerous due to possible luxi sockets exhaustion.
      
      This patch adds these three as INSTANCE_HYPERVISOR, INSTANCE_HV_*,
      INSTANCE_BE_*. The hook environment prefixes all keys with “GANETI”, so
      a default settings for a xen-pvm instance would be:
      
        GANETI_INSTANCE_HV_initrd_path=
        GANETI_INSTANCE_HV_kernel_args=ro
        GANETI_INSTANCE_HV_kernel_path=/boot/vmlinuz-2.6-xenU
        GANETI_INSTANCE_HV_root_path=/dev/sda1
      
      Any dashes in parameter names are changed to underscores, since
      variables with dashes are not easy to access from the shell
      (alternatively we could deny those via an unittest for constants.py).
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      67fc3042
  5. 20 May, 2009 3 commits
  6. 19 May, 2009 6 commits
    • Iustin Pop's avatar
      Fix the SafeEncoding behaviour · d392fa34
      Iustin Pop authored
      
      
      Currently we have bad behaviour in SafeEncode:
        - binary strings are actually not handled correctly (ahem)
        - the encoding is not stable, due to use of string_escape
      
      For this reason, we replace the use of string_escape with part of the
      code of string escape (PyString_Repr in Objects/stringobject.c); we
      don't escape backslashes or single quotes, since that is that makes it
      nonstable. Furthermore, we only use the encode('ascii', ...) for unicode
      inputs.
      
      The patch also adds unittests for the function that test basic
      behaviour.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      d392fa34
    • Iustin Pop's avatar
      Move more hypervisor strings into constants · 835528af
      Iustin Pop authored
      
      
      This patch adds constants for the mouse and boot order strings; while
      there are still some issues remaining, we're trying to cleanup hardcoded
      strings from the hypervisors.
      
      Since the formatting of frozensets is currently wrong, we also add an
      utility function for this and change all the error messages to use it.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      835528af
    • Iustin Pop's avatar
      watcher: try to restart the master if down · 7dfb83c2
      Iustin Pop authored
      
      
      Bugs in either our code or in associated libraries can bring the master daemon
      down, and this (due to the 2.0 architecture) stops all work on the cluster.
      
      Since the watcher already does periodic checks on the cluster, we modify
      it to try to start the master automatically in case of failures to
      connect. This will be tried only once per cycle.
      
      Also, in this case, we modify the code so that the watcher status file
      is not updated - its timestamp will reflect thus the time of last
      successful connection to the master.
      
      Side note: the except errors.ConfigurationError part could be cleaned
      up, since in 2.0 we don't usually get that directly, and if we do it's
      an error and we shouldn't touch the file anyway; but that is not a rc5
      change.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      7dfb83c2
    • Iustin Pop's avatar
      IAllocator: export total disk size for instances · 88ae4f85
      Iustin Pop authored
      
      
      This patch adds for current instance a ‘disk_space_total’ key, similar
      to the key for the new instance in case of new allocations.
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      88ae4f85
    • Iustin Pop's avatar
      Add -H/-B startup parameters to gnt-instance · d04aaa2f
      Iustin Pop authored
      
      
      This patch modifies the start instance script, opcode and logical unit
      to support temporary startup parameters.
      
      Different from 1.2, where only the kernel arguments were supporting
      changes (and thus xen-pvm specific), this version supports changing all
      hypervisor and backend parameters (with appropriate checks).
      
      This is much more flexible, and allows for example:
        - start with different, temporary kernel
        - start with different memory size
      
      Note: in later versions, this should be extended to cover disk
      parameters as well (e.g. start with drbd without flushes, start with
      drbd in async mode, etc.).
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      d04aaa2f
    • Iustin Pop's avatar
      call_instance_start: add optional hv/be parameters · 0eca8e0c
      Iustin Pop authored
      
      
      This patch modifies the rpc.call_instance_start - the master side - to
      take optional hv/be parameters. The noded side is unchanged and
      oblivious to the change.
      
      This will allow implementation of single-user capability and such on
      startup (temporary, as opposed to permanent).
      Signed-off-by: default avatarIustin Pop <iustin@google.com>
      Reviewed-by: default avatarGuido Trotter <ultrotter@google.com>
      0eca8e0c
  7. 18 May, 2009 1 commit
  8. 15 May, 2009 2 commits
  9. 13 May, 2009 4 commits
  10. 12 May, 2009 2 commits
  11. 11 May, 2009 4 commits
  12. 09 May, 2009 2 commits
  13. 07 May, 2009 2 commits
  14. 06 May, 2009 3 commits
  15. 05 May, 2009 1 commit