GitLab

* Add a function logic/utils.py to check the length of a string and
raise an API fault with the corresponding message.
* Check the length of the name of servers/ports/networks/subnets

Do not have a default value from 'link' attribute of IP_LESS_ROUTED
networks. Instead if the admin does not specify a value in
network-create command, uniquely name the networks by with the
BACKEND_PREFIX_ID and network id, e.g. snf-link-42.

Introduce command enforce-resources-cyclades, which checks for quota
violations and applies actions to enforce the limits. By default, it
operates only on these resources: cpu, ram, floating_ip.

Add 'name' attribute to newly created NICs. Currently, the name of the
NICs will not be used to refer to NICs, as it will be in Synnefo 0.15.
Names are added only to ease the migration to version 0.15. Also, this
commit updates snf-dispatcher to preserve the name of the NIC, if any,
when updating instance NICs.

Finally, the commit updates handling of firewall tags by adding a second
tag that contains the name of the NIC. The tags with the name of the
NICs will be kept in Synnefo 0.15, and the old tags with the index of
the NIC will be removed.

Use 'models.PROTECT' for 'on_delete' attribute for some ForeignKey
relationship between networking models. This will create a more "strict"
database and protect for unexpected data loss.

When ports are created from the API they do not have an IPv6 address.
The IPv6 address is only available after the MAC address of the
NIC(port) is known which is only available after the message from the
Ganeti backend has been received. However, dispatcher did not created
correctly the IPv6 addresses. This commit fixes this issue along with
some small code refactoring.

* Do not delete the network from the DB if it has associated floating
  IPs. This should never be the case because a check is made before
  deleting the network, however this check is added for safety.
* Do not allow deleting a network if there are still ports configured on
  on that network. Until now this check was for machines, but there may
  be ports that are not connected to any machine.
* Delete subnet IP pools when network is deleted.
* Get network in locked mode in network-remove cmd.
* Log error if trying to release an IPv4 address that does not belong to
  any of the IP pools of the associated subnet.
* Excluded deleted IPv4 addresses when reconciling IP pools.
* Do not set the network action to destroy when removing network from
  some backend.

Allow creation of ports that are not connected to any instance. Such
ports will be in 'DOWN' state. To allow this, 'machine' attribute of
NetworkInterface model has been made to allow null values. Finally, the
'logic.ports' module has been remove, and the corresponding code has
been merged into 'logic.servers' module.

Create IPAddressLog DB table to hold information about allocation of IP
addresses to virtual servers. The information that is currently saved
contains the IP address, the ID of the virtual server, the ID of the
virtual network along with the datetime that the address has been
allocated and released from the server.

An entry in this table is created every time a NetworkInterface card
that has an associated IP address is created in DB. The entry is updated
with the 'released_at' timestamp when the NIC is destroyed in Ganeti.
Currently, only IP addresses from public networks (network.public=True)
are stored in this table.

This commit also includes a DB data migration for all already allocated
IP addresses. However, the 'allocated_at' timestamp of this entries will
not be correct.

 Neutron API defines the 'BUILD' status. This commit renames BUILDING
 state of NIC to BUILD.

Fix default value for 'external' argument of release_address method of
Network model. Also fix how is checked whether an IP pool contains an
address.

Fix reconciliation to work with multiple IP pools per network:
* Fix reconcile-networks command to check if a reserved_ip in a Ganeti
  network is reserved in the pool that contains this IP (if any)
* Fix reconcile-pools to reconcile each of the networks IP pools and
  take into account only those IP address that are contained in the
  pool.

This reverts commit 69dadbe4e3223dc4d8cbaa5b09dde755c15679ed. Temporary
remove the /routers API.

* Add support for /routers api calls
* Add tests for the api

snf-manage floating-ip-attach <address> --machine <server_id/router_id>

* Fix network-list to properly display networks. Add optionally
  'subnets' fields to display the IDs of all subnets
* Fix network-modify to externally reserve the IPs in DB
* Fix network-create to not require a name and subnet4 or subnet6
  options.

* Optimize DB queries by using prefetch related for NIC IPs.
* Do not try to construct new NIC if it does not exist in Cyclades DB.
* Update tests

Extend Network model with a method to get the number of free and total
IPv4 addresses of the network. Also, add method to IPAddress model to
release its IPv4 address if any. Finally, update backend-list management
command to use 'ip_count' method of Network object.

Use 'prefetch_related' attribute of Django queryset to prefetch the
NetworkInterface and IPaddress objects that are related with a
VirtualMachine object. Also, modify functions that operate on server
NICs and IPs, to to use only the prefetched objects, which means that
they can perform further filtering or ordering on objects because this
is considered a new DB query and so will not get the cached objects.

Also, return empty 'fqdn' and 'port_forwarding' attributes if the
server has no public IP address.

Refactor Cyclades code so that it follows the new models for Networks,
Subnets and IPAddresses. This refactor is not complete. Instead is the
necessary refactor for making tests for server API calls succeed.

Refactor Cyclades code so that it follows the new models for Networks,
Subnets and IPAddresses. This refactor is not complete. Instead is the
necessary refactor for making tests for server API calls succeed.

Temporary commit to make IPPool manager work. This will work only if
there is only one allocation pool for each subnet.

Use a constant for declaring the max length of the name of a
model

Remove unused 'ipv4' and 'ipv6' attributes from NetworkInterface model
and totally remove FloatingIP model. This information has been moved
in commit 972a428 to IPAddress model.

Major refactor on db models concerning NetworkInterface models. A new
table, namely 'IPAddress' has been created to represent an IPAddress
(IPv4 or IPv6). Each IPAddress is related with a network and the subnet
from which it has been allocated. Also it contains 'floating_ip' attribute
to indicate whether it is a floating or static IP.

Also the dummy SecurityGroup model has been created, although it will
not currently be used.

The NetworkInterface model has been extended with the 'name',
'device_owner' and 'security_groups' attributes.
Signed-off-by: Marios Kogias <marioskogias@grnet.gr>

Remove unused fields from Network: subnet, subnet6, gateway, gateway6,
dhcp and pool. The following attributes have been moved to Subnet model
in commit 779c887. Also extend model with the 'external_router'
attribute.
Signed-off-by: Marios Kogias <marioskogias@grnet.gr>

Add Subnet model containing Layer-3 characteristics for networks. Also,
extend IPPoolTable object to hold a reference to the Subnet that the
pool belongs to.
Signed-off-by: Dionysis Grigoropoulos <dgrig@grnet.gr>

Remove on delete CASCADE for floating IPs if the VirtualMachine is
deleted.

Override 'delete' method of NetworkInterface model, to clear the
'machine' flag of the corresponding NIC, if any.

Extend NetworkInterface model with the 'ip_type' attribute to show
whether the IP is a floating or fixed.
Signed-off-by: Christos Stavrakakis <cstavr@grnet.gr>

Since Ganeti 2.8, it is supported to refer to devices (NICs and Disks)
not only by their index but also by their name or UUID. This commit
updates Synnefo to refer to devices by their name. Synnefo will set the
name of the devices which will be a UUID. We do not use Ganeti's UUIDs
because the UUID can not be known, until the NIC is created in the VM.

Modify backend methods for connecting and removing a NIC from a VM, to
not refer to NICs by index, but use the NICs backend_uuid. Also, set the
name of the NIC to the backend_uuid, when creating a NIC.

API relevant methods, will create a NIC object in BUILDING state,
instead of creating the NIC when the message arrives from the backend.

Modify NetworkInterface model:
* remove 'dirty' attribute since it is no longer needed
* make index null, since when the NIC is in building state, the index
  can not be known.
* add property for getting the UUID of the NIC in the Ganeti backend.

Fix relevant tests.