GitLab

It only needs to be explicitly enabled in KVM hypervisor parameters, for
Xen it works out of the box.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Hrvoje Ribicic <riba@google.com>

* stable-2.11
  Postpone release of 2.11.4 by one day
  Remove known issues section for 2.11.4
  Add known issue to 2.11.4 NEWS file
  Bump version to 2.11.4
  Prepare NEWS file for 2.11.4

* stable-2.10
  Add non-cherry-pickable changes related to state "rb----"
  Add Xen nothing state '------'
  Add Xen paused state as a Ganeti running state
  Update usage string for 'gnt-network connect'

Conflicts:
	NEWS
	configure.ac
	lib/hypervisor/hv_xen.py
Resolution:
  NEWS - include additions from 2.11
  configure.ac - keep the 2.12 version
  lib/hypervisor/hv_xen.py - keep enhanced comments from 2.11
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Helga Velroyen <helgav@google.com>

Signed-off-by: Helga Velroyen <helgav@google.com>
Reviewed-by: Hrvoje Ribicic <riba@google.com>

As we will postpone the release for tomorrow, the bug will
be fixed in the release.
Signed-off-by: Helga Velroyen <helgav@google.com>
Reviewed-by: Hrvoje Ribicic <riba@google.com>

From stable-2.10:
  Add non-cherry-pickable changes related to state "rb----"
  Add Xen nothing state '------'
  Add Xen paused state as a Ganeti running state
  Update usage string for 'gnt-network connect'

Conflicts:
	lib/hypervisor/hv_xen.py - Taken the more complete 2.10 version
Signed-off-by: Hrvoje Ribicic <riba@google.com>
Reviewed-by: Helga Velroyen <helgav@google.com>

Ganeti versions 2.11 and 2.12 have both had patches related to strange
Xen domU states which are still legitimate running states, but Ganeti
did not recognize them as such. The previous two cherry-picked patches
bring some of these changes, but the final patch needed (79cb7ece

)
cannot be cherry-picked because of a conflict with the other two
patches. The changes were made on different branches, and merged
together at a later time.

This patch manually adds the change, merging together the descriptions
of why certain states are allowed, and putting all of this into the
function docstring.
Signed-off-by: Hrvoje Ribicic <riba@google.com>
Reviewed-by: Helga Velroyen <helgav@google.com>

... which means that a domain is in the queue behind other domains
waiting to be scheduled.  The domain is runnable but it is not
currently running.
Signed-off-by: Jose A. Lopes <jabolopes@google.com>
Reviewed-by: Hrvoje Ribicic <riba@google.com>

Cherry-picked from 30350df5

.
Signed-off-by: Hrvoje Ribicic <riba@google.com>
Reviewed-by: Helga Velroyen <helgav@google.com>

The QA test 'TestClusterBurnin' pauses instances and the Xen state
domain 'paused' was not being handled properly by Ganeti because it
was not being classified as either a running or shutdown state.  This
patch adds the 'paused' state to the set of running states by
extending the function 'ganeti.hypervisor.hv_xen._IsInstanceRunning'
with the corresponding Xen state string '--p---'.

This fixes the QA test 'TestClusterBurnin'.
Signed-off-by: Jose A. Lopes <jabolopes@google.com>
Reviewed-by: Helga Velroyen <helgav@google.com>

Cherry-picked from fd201010

.
Signed-off-by: Hrvoje Ribicic <riba@google.com>
Reviewed-by: Helga Velroyen <helgav@google.com>

Signed-off-by: Helga Velroyen <helgav@google.com>
Reviewed-by: Hrvoje Ribicic <riba@google.com>

Signed-off-by: Helga Velroyen <helgav@google.com>
Reviewed-by: Hrvoje Ribicic <riba@google.com>

Add the developments since 2.11.3.
Signed-off-by: Helga Velroyen <helgav@google.com>
Reviewed-by: Hrvoje Ribicic <riba@google.com>

The problem is that (at least) GHC 7.6.3 has a bug that leaks memory for
'handleToFd' calls. Hence as a workaround we open the file again using
just 'openFd'. The additional benefit is that it also works if the file
has been already close.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

On some architectures 'openTempFile' converts new-line symbols.
While the difference probably manifests only on Windows machines, we
should use the proper semantics anyway.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

This one is actually more important, as here we usually process more
data.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

- After a message is sent over the network (even UDS), it takes a
  non-trivial amount of time for a client to parse the message, reply
  and encode a new one. Therefore reading immediately from the network
  just wastes system calls. It has been observed that 'yield'-ing at
  this point saves these system calls, yielding to overall better
  performance.
  See http://www.yesodweb.com/blog/2014/02/new-warp


- Similarly, when an asynchronous writer finishes its job, it makes
  sense to give priority to other threads. This allows the other tasks
  to proceed, resulting in bigger batches of work for the asynchronous
  writer under higher loads.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

Otherwise the whole ByteString with the message (that has been already
processed) is retained until more data is received, unnecessarily
occupying memory, possibly for long time periods.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

In particular, what are its 'primary' and 'secondary'
parameters/variables.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

This prevents race errors, when an instance is removed while the
iallocator is gathering data.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

.. and not re-read it again.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

.. instead of requesting it inside a function.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

The detached configuration doesn't do any kind of locking or
communication with WConfd, it just holds a static snapshot of the
configuration.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

.. as they're not currently needed.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

Commit 2243b133

 removed the old, positional, passing of mode
and link arguments. Adapt the documentation string accordingly.
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Petr Pudlak <pudlak@google.com>

This code is scheduled to be removed any way (for a single job,
there is no point in managing a job queue) and the assertion does
not hold true any more in the new design. The problem with the
assertion is that it does not kill the process, so the job will
never be cleaned up. Hence remove the assertion and do a best effort
to get the job in an error state.
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Petr Pudlak <pudlak@google.com>

With jobs as processes, it is by design that WConfD might
be restarted while jobs are running. Therefore, retry any
attempt to connect to WConfD several times.
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Petr Pudlak <pudlak@google.com>

* stable-2.11
  (no changes)

* stable-2.10
  KVM: fix NIC configuration with absent NIC VLAN

Conflicts:
	lib/hypervisor/hv_kvm/__init__.py: follow code move
	    to lib/hypervisor/hv_base.py
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Petr Pudlak <pudlak@google.com>

Move the release statement for the BGL to the finally block
enclosing the statement that acquired it. In this way, we are
sure to always eventually release the BGL. Also replace the
freeing request by a FreeLocksLevel request, which also cancels
all pending requests that still might exist.
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Petr Pudlak <pudlak@google.com>

* stable-2.10
  KVM: fix NIC configuration with absent NIC VLAN
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Petr Pudlak <pudlak@google.com>

Commit 6b47261a

 exported the VLAN to the KVM NIC configuration scripts.
However, in doing so it assumed that the VLAN is always present in the
runtime, which is not true for instances being migrated but started on
Ganeti versions prior to 2.10.6.

We fix this by exporting the VLAN nicparam only if it actually exists.
This closes issue #893.
Signed-off-by: Apollon Oikonomopoulos <apoikos@gmail.com>
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

...hence move the design document from draft designs to
the implemented designs.
Signed-off-by: Klaus Aehlig <aehlig@google.com>
Reviewed-by: Petr Pudlak <pudlak@google.com>

Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

Add section for 2.12.0~beta1, document changes since 2.11 and known
issues.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

.. as it causes an instance to become unresponsive.

See 885: Network hotplugging on KVM sometimes makes an instance
unresponsive
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

- metad is only optional;
- Debian Jessie provides the rest of the required dependencies.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

If somebody tries to modify the meta-data, the daemon must be enabled
during configure time.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

In such a case, the UpdateMedatada function will just return.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

In particular, skip its compilation, if the required packages aren't
present.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

In particular, kvmd, luxid, metad and wconfd aren't dependent on
enabling confd.
Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Klaus Aehlig <aehlig@google.com>

Signed-off-by: Petr Pudlak <pudlak@google.com>
Reviewed-by: Helga Velroyen <helgav@google.com>