GitLab

Do not allow api to create public networks and type other
than PRIVATE_MAC_FILTERED/PRIVATE_PHYSICAL_VLAN.

Rename PUBLIC_ROUTED_USE_POOL setting to PUBLIC_USE_POOL.

Let synnefo do IP pool management only if network is private or
PUBLIC_USE_POOL is True.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Add BACKEND_PER_USER setting, a mapping from users to backends. This setting
can by used in order to bypass the default backend allocation process, and
allocate all the new VMs of a specific user to a specific Backend.

Add ForUpdateManager to the Backend model, in order to guarantee
exclusive order when allocating a VM.

Use manual transactions when allocating Backend and public IP for a new
VM, since these allocations need exclusive access (SELECT..FOR UPDATE)
and running them inside the same transaction with create_server would result
in backends and public networks to be locked until the job is sent to the Ganeti
backend.

Encapsulate in nic dict a public flag (network.public) and
remove twisted oldstyle identification way (network_id == 'public')
for retrieving public interfaces.
All network references are done via their network_id.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Implement multiple public networks in order to support:
- different public networks per backend
- non-consecutive IP ranges in each backend

To support this, public networks are treated different from private
ones. Namely, they are correlated with one backend (and so have
only one BackendNetwork entry) instead of private which are expanded
to all available backends.

Also the backend allocator is modified in order to exclude the backends
that have only full networks.

Finally GANETI_PUBLIC_NETWORK became obsolete, and so removed.

Currently, choice of public network is done by synnefo, but in the
future the user may be able to choose it (needs extension of the
api with network-id)

filter out deleted vms !!!!!!!

do not filter out deleted vms if valid changes-since parameter is set on
the request. This allows ui application to be able to identify and remove
deleted vms.

Specially for create_instance and create_network methods, since a
VirtualMachine, Network object is created before sending the request
to the backend.

Modify list_networks and list_servers to filter deleted entries when
if-modified-since HTTP header is used, because deleted entries can be
updated after deletion through the reconciliation mechanism.

- Reponses for servers and netowrks details (list or solo) are now
consistent to recent backend changes.
- Methods get_nic_from_index and construct_nic_id have been created
- Syntax for nic removal from network/vm has been adjusted

New module implementing instance allocation to one of the available
backends. Allocation is performed based on memory and disk utilization.
Statistics for each backend are stored in DB and updated periodically.

Allocation can be customized by creating a new allocation strategy
and declaring it in BACKEND_ALLOCATOR_MODULE setting.

Replace use of global RAPI client, with the cached client from the
VirtualMachine or Backend model.

Dispatch network actions to all backends.

Rename backend_id field of VirtualMachine model to avoid conflict between the
backend that hosts the VM and the id that the VM will have on the backend.

- New dict setting VMS_USER_QUOTA to allow setting per user quota
  (overrides MAX_VMS_PER_USER setting)
- Private networks quota mechanism (based on MAX_NETWORKS_PER_USER and
  NETWORKS_USER_QUOTA settings)
- Different response message for GANETI_MAX_LINK_NUMBER overlimit
  errors (To differentiate from user quota overlimit error). Backend
  not raises NetworkLink.NotAvailable exception when no available link
  can be created.
- Additional unittests for vms/networks quotas

* Added middleware to authenticate with Astakos
* Removed more legacy code
* Deleted Image and ImageMetadata models

Tests and admin still pending.

The backend is case insensitive and snf-image
uses all upper case keys.

Refs #1743

A database migration is needed.

Refs #1744

since more than one packages exist in repository root

Add support for owner, group and mode.

Refs #1645

Add support for owner, group and mode.

Refs #1645

Uses dictionary configuration back ported from
Python 2.7.

Refs #1033

Update Metadata methods for servers and images
used to ignore keys that did not exist. This patch
will create them instead.

Refs #1403
Refs #1399

Refs #1093

Use a JSON dump the follows OpenStack syntax (list of dictionaries with 'path' and 'contents' keys)
Contents are base64 encoded.

Refs #1093

Just log a warning for now.

Refs #1093

Enforce PEP8 requirement of two blank lines between
top-level functions in api/servers.py.

Re-raise exception when a CreateInstance() RAPI call fails,
to allow the traceback to propagate for debugging and logging purposes.