GitLab

Emails sent to Astakos Users do not  contain greek translations any more.
Minor verbal corrections are made and title attribute are added to logos
links.

Do not create private networks when adding a new backend. Since,
"lazy networks" this is no longer needed.

Implement "lazy networks", which are not created to all Ganeti backends
upon creation, but only when an instance that resides in a Ganeti is
connected to that network.

Update 'create_network' to create the Network object in DB without
creating network in Ganeti, or correspoding BackendNetwork entries. The
state of the Network becomes 'ACTIVE' upon creation, instead of
'PENDING' that was until now. Also, update 'delete_network' function to
delete the network only from the backends that it is not in 'DELETED'
state. The state of the network will become 'DELETED' only when all
corresponding backend networks become 'DELETED' (including offline
backends).

Extend code that connects a VM to a network to check if the network
already exists and is in 'ACTIVE' state in the Ganeti backend that hosts
the VM.  If not, it will create the network and then connect the VM
(using Ganeti chained-jobs to ensure correct ordering of jobs).

Update 'reconcile-networks' management command to work with lazy
networks. Specifically, do not check if private networks exist in all
backends.

Update 'network-add' management command to create the network in the
Ganeti, only if a backend is specified.

Finally, when using Ganeti chained-jobs to impose ordering of jobs, do
not depend only on 'success' of a job, but also on 'error' and 'cancel'.
This is needed to cover case that a job fails (e.g. create network)
because the resource already exists.

Update create/remove management commands to issue commission when
needed.

Refs: #3340

Use 'urljoin' to compute the 'config_url' parameter.

- Removed /userdata/quota view in respect of astakos quotas api delegate
  views served in the same urls used by astakos api (/astakos/api/quotas,
  /astakos/api/resources). Base url is configurable using the
  UI_ACCOUNTS_API_URL (defaults to /astakos/api).
- Refactored quotas js client to use backbone Collection/Model
  mechanisms.
- Refresh quotas using the common api update mechanism used by vms and
  networks (deprecated UI_QUOTAS_UPDATE_INTERVAL setting)
- Extended main view initialization steps to include quotas/resources
  loading before the initial layout renedring

Use commission name "RECONCILE" to distinguish such operations
in the quotaholder provision log.

Refer to astakosclient instead of quotaholder

Rename 'qh_resolve_commissions' function to 'resolve_commissions'.

Implement managemtn command to export cyclades resources in JSON format,
in order to be imported to Astakos.

Remove the following obsolete settings, since their usage is covered
by Quotaholder:
- MAX_VMS_PER_USER
- MAX_NETWORKS_PER_USER
- VMS_USER_QUOTA
- NETWORKS_USER_QUOTA

Also remove 'cyclades-export-quota' management command.

When creating a server, we commit the VM model in DB and reserve the
corresponding quotas in Quotaholder before enqueuing the
OP_INSTANCE_CREATE job (because messages from dispatcher may arrive
before committing). In case enqueuing job to Ganeti fails we must
restore the quotas to their previous value. This commit achieves this by
issuing a "delete" commission for the VM. Also, instead of deleting the
VM entry, we mark the VM as deleted, in order to keep the relation
with the Quotaholder serial.

Check Quotaholder response to see if the commissions were accepted or
rejected as requested, or failed for some reason.

Accepting or rejecting a commission will fail if the commission was
already resolved. Since this is sometimes accepted, like when
reconciling commissions, this commit extends 'qh_resolve_commissions'
function with the 'strict' argument, denoting whether the function
should fail if resolving a commissions fails.

Create 'mocked_quotaholder' context manager to bypass commission and use
it in Cyclades tests. Also this commit does some various fixes to other
tests.

Extend 'issue_and_accept_commission' function to resolve previous
unresolved commission, if exists. In order to resolve it, the
commission must not be pending, because if it is there is not
enough information to resolve it.

Refactor Cyclades code that handles commissioning with Quotaholder. This
commit removes the 'uses_commission' decorator. Instead it introduces
the 'issue_and_accept_commission' function that is responsible for
implenting the commission workflow. This function  must be called
exactly after and in the same transaction that creates/modifies the
resource, because resource creation/modification must happen in the same
transaction with issuing and storing the serial in the DB.

* Merge 'accepted' and 'rejected' field to 'accept' field.
* Add 'resolved' field, indicating whether this commission has been
  accepted/rejected to Quotaholder
* Remove custom save() method. Handle 'pending' field manually.

Also add the corresponding database migrations.

Do not consider 0 usage for users and resources that are not included in
Quotaholder resources list, since Quotaholder returns zero usage for all
users and all resources. If a user/resource does not belong to QH
respond then it can not be an Astakos user.

Refs #3606 #3491 #3661

Rename 'cyclades-reconcile-commissions' to 'reconcile-commissions-cyclades.'
Rename 'cyclades-usage-verify' to 'reconcile-resources-cyclades.'

Extend 'cyclades-usage-verify' management command to cover the usage of
'cyclades-reset-usage' and remove the second one. The new command
reconciles resources(usage) by detecting inconsistencies between the
usage of resources in Astakos and Cyclades DB and fixing them by issuing
a commission with the difference of the usage in DB and Astakos. If
there is a pending commission for a resource, reconciliation for this
resource is skipped. Refs #3627

Also, make this command do not consider only users that exist in
Cyclades DB, but also users that exist in Quotaholder. For such users,
it is assumed that they have zero usage for all Cyclades resources.
Refs #3606 #3491

Remove from cyclades all settings that were relative with Quotaholder.
Remove CYCLADES_USE_QUOTAHOLDER settings, since Cyclades can not work
any more without quotas.
Remove CYCLADES_QUOTAHOLDER_URL and CYCLADES_QUOTAHOLDER_TOKEN since
Quotaholder is merged with Astakos.

Remove 'TRANSLATE_UUIDS' from plankton setting.

Remove 'CYCLADES_USER_CATALOG_URL' and 'CYCLADES_USER_FEEDBACK_URL'
settings, since both of them can be derived from 'ASTAKOS_URL' setting.