GitLab

Use NICs UUID instead of index to generate firewall tags. Make the
'set_firewall_profile' action to take the NICs ID as argument. Also,
update the firewall settings.

Remove the ARCHIPELAGO_BACKENDS setting. Instead allocate VMs based on
the disk-templates that are enabled and allowed in ipolicy for each
backend. The command 'snf-manage backend-update-status' can be used to
update the list of enabled disk templates for each backend.

Extend servers info API response with 'SNF:port_forwarding' attribute,
describing port fowarding rules (DNAT) that are applied to vms. The
description of such rules is done via the new CYCLADES_PORT_FORWARDING
setting. This setting can be either a dictionary mapping to ports to
tuples of (host, port), or a callable object that must return such a
tuple.   The caller will pass to the callable the following positional
arguments, in the following order:
* server_id: The ID of the VM in the DB
* ip_address: The IPv4 address of the public VM NIC
* fqdn: The FQDN of the VM
* user: The UUID of the owner of the VM

Extend the servers info API response with the 'SNF:fqdn' attribute,
containg the vm's domain name in a DNS. This attribue is configurable by
the 'CYCLADES_SERVERS_FQDN' setting. If this setting is set to None,
then then the first public IPv4 or IPv6 address is returned.

Set firewall profile per NIC, because since Floating IPs an instance can
have more than one NICs in a public network. Extend the API call to take
the NIC index as argument, and modify the Ganeti instance tags to be
formated with the NIC index.

use libguestfs naming convention

redhat -> rhel
suse -> opensuse (also cloned as sles)

Make the pool size of the pithos backends a configurable setting,
namely PITHOS_BACKEND_POOL_SIZE.

Rename reserved work for automatically choosing a public network from
"public" to "SNF:ANY_PUBLIC". Also add the setting description to conf
files.

Remove PUBLIC_USE_POOL setting, since in order to use floating IPs, the
cyclades must be responsible for managing all IP pools.

Remove obsolete GANETI_DISK_TEMPLATES and DEFAULT_GANETI_DISK_TEMPLATE
settings.

Rename ASTAKOS_POOLSIZE to CYCLADES_ASTAKOSCLIENT_POOLIZE;
expose it to the conf file.

Rename CYCLADES_ASTAKOS_SERVICE_TOKEN to CYCLADES_SERVICE_TOKEN for
uniformity.

automatically detect which cloudbar menu is active by matching the current
window location with the registered service url.

Also remove setting UI_ACCOUNTS_API_URL

/im/ renamed to /ui/.
Updated all references in default settings, documentation and constants.

- Removed most url's from ui conf file. Default values are dynamically set based
  on other settings (CYCLADES_BASE_URL, ASTAKOS_BASE_URL etc.). We still do
  service lookups to be able to change urls in *extraordinary* deployments.
- Moved url settings in ui.settings module

https://service.deployment.vendor.tld/service-base/api-prefix/hard/path
|___________________________________| |__________| |________| |_______|
             BASE_HOST                  BASE_PATH    PREFIX    Hardcoded
|_________________________________________________|
             SERVICE_BASE_URL

- Introduce <SERVICE>_BASE_URL setting, and <API>_PREFIX constants
  for all services. Extract BASE_HOST, BASE_PATH from the setting.

- Use settings and constants to construct top-level patterns
  (base-path/api-prefix) in services' urls.py

- Refactor/extend proxy() to be compatible with the above.

- Change URLs passed around (ui, e-mails) to be compatible.
  (needs more work)

Notes:

This configuration REQUIRES that any rewriting and proxying on the
front-end must eventually result in the application server (gunicorn)
getting the original path of the request, otherwise the view-generated
URLs will be different.

Changes:
- set top-level urlpatterns from <SERVICE>_BASE_URL
- rename setting: APP_INSTALL_URL to CYCLADES_BASE_URL
- rename setting: ASTAKOS_URL to ASTAKOS_BASE_URL everywhere
- introduce setting: PITHOS_BASE_URL
- update shipped .confs, quick install admin guide, upgrade guide
- fix urls/views/reverse()/other that were broken
- (more not listed)

get_menu is used only by astakos cloudbar:
it should not be under astakos api services

Support Ganeti backends with Xen hypervisor:
* Extend 'Backend' model with the 'hypervisor' attribute, which
  currently can be 'kvm' or 'xen'. Use 'kvm' as default value to
  easy database migration. Also add the corresponding schema migration.
* Do not use hotplug at Xen backends, since it is not
  implemented.
* Support different 'hvparams' for Xen and KVM backends. Update
  GANETI_CREATEINSTNACE_KWARGS setting to hold 'hvparams' for both
  Xen and KVM.
* When getting instance console, check 'serial_console' hvparam only
  for Xen instances.

Refs #3772

Refs: #3340

- Removed /userdata/quota view in respect of astakos quotas api delegate
  views served in the same urls used by astakos api (/astakos/api/quotas,
  /astakos/api/resources). Base url is configurable using the
  UI_ACCOUNTS_API_URL (defaults to /astakos/api).
- Refactored quotas js client to use backbone Collection/Model
  mechanisms.
- Refresh quotas using the common api update mechanism used by vms and
  networks (deprecated UI_QUOTAS_UPDATE_INTERVAL setting)
- Extended main view initialization steps to include quotas/resources
  loading before the initial layout renedring

Remove the following obsolete settings, since their usage is covered
by Quotaholder:
- MAX_VMS_PER_USER
- MAX_NETWORKS_PER_USER
- VMS_USER_QUOTA
- NETWORKS_USER_QUOTA

Also remove 'cyclades-export-quota' management command.

Remove from cyclades all settings that were relative with Quotaholder.
Remove CYCLADES_USE_QUOTAHOLDER settings, since Cyclades can not work
any more without quotas.
Remove CYCLADES_QUOTAHOLDER_URL and CYCLADES_QUOTAHOLDER_TOKEN since
Quotaholder is merged with Astakos.

Remove 'CYCLADES_USER_CATALOG_URL' and 'CYCLADES_USER_FEEDBACK_URL'
settings, since both of them can be derived from 'ASTAKOS_URL' setting.

Rename 'PITHOS_AUTHENTICATION_URL' setting to 'ASTAKOS_URL'. Also remove
'PITHOS_AUTHENTICATION_USERS' from docs (it was removed from code in
commit 8df4fae).

Modify 'ASTAKOS_URL' to point to the node hosting the Astakos service
instead of im endpoint, i.e. rename from
'accounts.example.org/im/authenticate' to 'accounts.example.org'.

Mimic pithos app/ui feedback handling to avoid duplicating boilerplate
code.

New settings:
CYCLADES_USER_FEEDBACK_URL

Deprecated (removed) settings:
FEEDBACK_CONTACTS
FEEDBACK_EMAIL_FROM

Allow per-service configuration of the (http) quotaholder client.
Kamaki is no longer needed in service (or ganeti) nodes,
because the client has been moved to snf-common.

Also fix the default quotaholder settings for pithos backend to be disabled
by default, and don't initialize quotaholder client when not needed.
This fixes crashes of non-user-facing pithos backend uses such as
pithcat from snf-image.

Refs #3421

cyclades now serve a delegate view for the astakos /user_catalog api
call. Cyclades UI app should use this endpoint to translate user uuids
to display names.

Astakos endpoint is configurable from the CYCALDES_USER_CATALOG_URL
setting.

Migrate default settings to files under conf/ for every
Synnefo component.

TODO: Obliterate snf-cyclades-app/synnefo/appt_settings/default/*
and similar files. Make import of synnefo settings common throughout
the code.