GitLab

Use '_get_domain_objects' function of Pithos backend, to list all
objects in a 'plankton' domain, instead of looping over all accessible
accounts, containers and objects. This function also returns metadata
and permissions for each object in order to avoid two extra calls for
each returned image.

This should provide a significant performance boost in listing available
images.

Note: Currently plankton API filters in 'list_images' are not
implemented.

Refs #3510

Major refactor in plankton APP and ImageBackend code:
* Remove unused code
* Remove 'plankton_method' decorator that added an ImageBackend to
  requests an replace it with 'image_backend' context manager. This
  context manager is responsible for opening and closing connections
  to PithosBackend and converting ImageBackend errors to cloud faults.
* Update plankton and images API methods and tests.

Rename and change it to backend method
(add the backend_method decorator)

Provide an alembic migration to add an index
on the attributes.domain field

Refs: #3510

Do not run 'backend-add' command inside transaction, because if
'snf-dispatcher' is running, it will receive messages that will arrive
from a Ganeti backend that does not exist in the DB and will not be able
to process them.

Refs: #3573 
Correct onclick functionality in project create page.
Discover missing div tag in project details page.

Refs: #3580

The query was submitted for execution without any prior transaction
setup, which caused:

1. psycopg2 to implicitly start a transaction
2. the new transaction to remain unknown to the sqlalchemy layer
   since it was implicit
3. the pooling cleanup to think that the connection was clean
4. the backend to be pooled with a transaction active

Refs: #3580

Set PITHOS_BACKEND_CONTAINER_QUOTA to 0
(to disable by default the container quota check)
instead of setting to something big

Refs: #3543

Pithos backend before performing the quota violation checks
creates a new version of object and updates the
usage of the ancestor nodes (the container).

In Postgresql SELECT does see the effects
of previous updates executed within its own transaction
even though they are not yet committed.
(regardless of the Transaction Isolation Level)
http://www.postgresql.org/docs/8.4/static/transaction-iso.html

As a result, during the quota checks the backend sees
the updated usage of the container,
so it should not add to this the size difference.

Refs: #3543

* Substitute the PITHOS_BACKEND_QUOTA setting with two
distinct settings: PITHOS_BACKEND_ACCOUNT_QUOTA &
PITHOS_BACKEND_CONTAINER_QUOTA
* Set PITHOS_BACKEND_CONTAINER_QUOTA default value
to something big (50 TB)
* Pass account and container policies as backend
arguments arguments instead of setting them
after each backend instantiation.

Pithos in case of missing blocks during smart object write
(using hashmap) used to raise an api fault with payload
the list with the missing blocks serialized in json format.

However, the common api_method decorator in case of api fault
returns a different response content format containing details about
the fault.

This causes problem to pithos clients which expect
a specific response content format in that case.

The solution was adopted is:
when pithos server detects such a case returns directly
an HttpResponse with the same status code (409) as before
and the expected content.

Remove check for response Content-Type, since 'django.http.HttpResponse'
has always a default Content-Type of 'text/html; charset=utf-8'. Views
defining their response 'Content-Type' should set the
'override_serialization' attribute of response to 'True'.

provide --fix option for the pithos-reconcile-commissions command

Refs: #3594

Refs: #3591

Refs: #3591

Get pending commissions specifically for pithos

Refs: #3594

Refs: #3594

Refs: #3594

Rename 'PITHOS_AUTHENTICATION_URL' setting to 'ASTAKOS_URL'. Also remove
'PITHOS_AUTHENTICATION_USERS' from docs (it was removed from code in
commit 8df4fae).

Modify 'ASTAKOS_URL' to point to the node hosting the Astakos service
instead of im endpoint, i.e. rename from
'accounts.example.org/im/authenticate' to 'accounts.example.org'.

* Compute statistics only for the current object versions
(not history and deleted)
* Deactivate by default the statistics table consistency
verification (use --verify option to enable it)

Conflicts:
	docs/older/Changelog.pithos-app
	snf-astakos-app/astakos/im/api/__init__.py
	snf-pithos-app/pithos/api/util.py

Conflicts:
	snf-astakos-app/astakos/im/messages.py

use the new synnefo.user method `get_username` to populate
personal/shared images.

kvm-vif-bridge is provided by snf-network. Remove it from the synnefo
repo to avoid confusion.