GitLab

Query Ganeti for getting the cluster name, instead of reading the
ssconf files.

Conflicts:
	snf-cyclades-gtools/synnefo/ganeti/eventd.py

Fix south migration files. In data migrations, access the Models from
the orm, instead importing Models from synnefo.db. This is necessary as
the orm provides access to the version of the models that existed when
the migration file was created.

Do not perform reconciliation for VMs that are hosted in Backends
that are currently offline, since it is impossible to get the
state of these VMs from the backend. Before this patch, the
reconciliation mechanism would report these VMs as stale (and with
--fix-* would also mark them as deleted in the DB).

Add new management command 'reconcile-pools' which checks the consistency of the
pools and the uniqueness of the associated resources. Currently this
commands detects the inconcistencies, without trying to resolve them.

In order to guarantee uniqueness of MAC address accross all backends,
synnefo assignes a unique mac prefix to each network in each backend.

A mac-prefix of 20 bits, which is picked from the MacPrefixPool, is
assigned to each Network. The mac-prefix of the network in each
backend results from combining the mac-prefix of the Network with the
unique index of the Backend, resulting in a 3-byte mac-prefix (up to 16
Backends).

Settings PRIVATE_MAC_FILTERED_BASE_MAC_PREFIX and
PRIVATE_MAC_FILTERED_MAX_PREFIX_NUMBER have been converted to
MAC_POOL_BASE and MAC_POOL_LIMIT, since mac-prefixes are now assigned to
all networks.

Assert that this is an 'real' deletion of a Network before releasing
it's resources. Without this patch, a resource used by an other Network
could be released, if someone called the Network.update_state function
explicitly.

Do not find the public network by the primary key, as the initial_data.json
is obsolete. Instead, ise the public attribute of the Network Model.
Currently only one public Network is supported, and the used can not
create or delete the public Network. But this can easily change in the
future.

Fix wrong reporting messages when adding a new backend.

snf-image needs snf-pithos-backend in all VM-capable nodes.
snf-pithos-backend is not a dependency. We install it manually.

Implement Singleton pattern inside synnefo.lib.singleton.

Whenever a class inherits from ArgBasedSingleton,
attempts to call the class do not always create a new
class instance, but return pre-existing, already made objects.

All of the arguments to the class call must match, to return a
pre-existing object. Rationale: when the ModularBackend from
snf-pithos-backend is converted to inherit from ArgBasedSingleton,
attempts to create a new backend instance with the same settings will
re-use the existing backend object.
Signed-off-by: Chris Stavrakakis <cstavr@grnet.gr>
Signed-off-by: Kostas Papadimitriou <kpap@grnet.gr>
Signed-off-by: Vangelis Koukis <vkoukis@grnet.gr>

Add PRIVATE_PHYSICAL_VLAN_TAGS setting

Check that nic has an ipv4 before trying to release it.

Introduce new setting 'PUBLIC_ROUTED_USE_POOL', to indicate whether
synnefo will be responsible for the IP management of the public network,
or this responsibility will be delegated to Ganeti.

Specially for create_instance and create_network methods, since a
VirtualMachine, Network object is created before sending the request
to the backend.

Implement ForUpdateManager that uses SELECT .. FOR UPDATE statement in
order to acquire row-level exclusive locks to DB. Essentially this
manager backports the select_for_update() method that is implemented in
Django >= 1.4.

Non-blocking reads are not implemented, and each query including a row
that is locked by another transaction will block until the lock is
released. Also care must be taken in order to avoid deadlocks or retry
transactions that abort due to deadlocks.

Also, update Network object to use this manager, in order to guarantee
consistency of the IP pool of each Network.