GitLab

Use NICs UUID instead of index to generate firewall tags. Make the
'set_firewall_profile' action to take the NICs ID as argument. Also,
update the firewall settings.

Do not process Ganeti NICs that do not have a valid ID and so are
unknown to Cyclades, because processing these NICs would require to
create them in DB and then rename them in Ganeti with the corresponding
identifier.

Also fix some typos

Override 'delete' method of NetworkInterface model, to clear the
'machine' flag of the corresponding NIC, if any.

Remove hard-coded timeouts from code and make them constants. Also do
not perform reconciliation for recent building NICs.

Parse the fields of the Ganeti command, to distinquish between
'CONNECT' and 'DISCONNECT' in case of 'OP_INSTANCE_SET_PARAMS'.

Make snf-ganeti-eventd send 'job_fields' for instance and network
opcodes, and modify the corresponding backend functions and
snf-dispatcher callbacks.

Callback functions of snf-dispatcher updated the NICs of a VM by
deleting all NICs from DB, and creating the new NICs that were described
in the message. However, since NICs have UUIDs, this is no longer
required. This commit update callbacks to update the NICs based on their
UUID.

Extend NetworkInterface model with the 'ip_type' attribute to show
whether the IP is a floating or fixed.
Signed-off-by: Christos Stavrakakis <cstavr@grnet.gr>

Since Ganeti 2.8, it is supported to refer to devices (NICs and Disks)
not only by their index but also by their name or UUID. This commit
updates Synnefo to refer to devices by their name. Synnefo will set the
name of the devices which will be a UUID. We do not use Ganeti's UUIDs
because the UUID can not be known, until the NIC is created in the VM.

Modify backend methods for connecting and removing a NIC from a VM, to
not refer to NICs by index, but use the NICs backend_uuid. Also, set the
name of the NIC to the backend_uuid, when creating a NIC.

API relevant methods, will create a NIC object in BUILDING state,
instead of creating the NIC when the message arrives from the backend.

Modify NetworkInterface model:
* remove 'dirty' attribute since it is no longer needed
* make index null, since when the NIC is in building state, the index
  can not be known.
* add property for getting the UUID of the NIC in the Ganeti backend.

Fix relevant tests.

Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Use opportunistic locking, introduced in Ganeti 2.7, to allow parallel creation
of VMs in the Ganeti backend. When this option is set, Ganeti iallocator
will allocate the VM only to nodes that not locked (e.g. by other VM
creation). This may result in unbalanced clusters, but `hbal` can be
used to rebalance the clusters again.

* SimpleConfigReader has been removed. Use SimpleStore
* QUEUE_DIR has been moven from ganeti.constants to ganeti.pathutils
* _QueuedJob.Restore takes 2 more arguments
* Group info is returned as list instead of string

Skip check if there are no externally reserved IPs in the Ganeti
backend.

Do not automatically release an externally reserved IP if it is released
from a Ganeti backend. The IP should be released with snf-manage
network-modify management commands.

Move reconciliation of IP pools from 'snf-manage reconcile-networks'
to 'snf-manage reconcile-pools'. Also change the way reconciliation
works: Instead of reconciling the IP pools in DB with the IP pools in
Ganeti, the new reconciliation just checks that:
* there is no IPv4 address that is used by more than one NICs
* the only reserved values in the pools are the ones that are currently
  used by NICs
The reason why reconciliation of pools with Ganeti has been removed is
that there are too many race conditions, and that it may result in
strange incosistencies. As far as external reservations is concerned,
the new reconciliation mechanism just checks that each IP that is
reserved in a Ganeti backend is also reserved in the Cyclades DB.

Add a unique constraint to NetworkInterface model. This constraint
asserts that the same IPv4 address from the same network will no be
assigned to more than one NICs.

Refactor snf-manage network-modify command. Remove options that modified
link, mac_prefix, mode, enable_dhcp or state of the network. This
options modified only the network in DB and resulted in incosistencies
between Cyclades DB and Ganeti.

Add --action option in server modify command, to start, stop or reboot
an instance.

Add the --flavor option in server-modify management command to resize a
server to a different flavor.

* Change --set-suspended and --unsuspended to --suspended=True|False
* Removed --set-deleted as snf-manage server-remove can be used.
* Removed option for modifying the state of a server.

Created function for renaming a server.

The 'disk_template' attribute for flavors of external disk template
included the name of the provider. The backend allocator tried to find a
backend with an enabled 'ext_$(provider)' disk template. This commit
fixes this by searching only for 'ext' in the enabled disk templates.

Implement server-remove management command that deletes an instance from
a Ganeti backend. The command will wait by default for the
OP_INSTANCE_REMOVE job to complete, except if --wait=False is used.

Add 'on_delete' argument to all ForeignKeys. The value of this
argument depends on the type of each relation.

Decorate 'update_cluster' callback with 'handle_message_delivery' to
handle acknowledgement of messages.

Remove custom ProtectedDeletedManager. Instead use the
ForeignKey.on_delete attribute that has been introduced in Django 1.4.

Remove custom manager that implemented select_for_update(), since this
is already implemented in Django 1.4.

QUEUE_CLUSTER must be included in QUEUES.

'enabled_disk_templates' cluster attribute has been added in Ganeti 2.8.
If this attribute is missing, return the ipolicy disk templates.