GitLab

Since archipelago is the pithos backend, the NFS dir /srv/pithos
is useless. Cleanup everything related to it.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Since 0.4~rc2, archipelago creates archipelago user and group
upon package installation. In order not to run as root we
have to:

 - chown and chmod /srv/archip dirs and file
 - let gunicorn run as www-data.archipelago
 - chown /etc/synnefo and /var/log/gunicorn

Additionally archipelago introduces an new dir to store locks.
Create this dir on the nfs node.

NOTE: In case of a multinode setup using NFS as archipelago
backend, the archipelago user must have a common group id across
all nodes. Currently snf-deploy does not take that into account
since it practically setups a single node installation.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

- Add the ability to choose the visible filters in standard view
- Refactor filters functionality
- Store user's preferences regarding filters in cookie
- Store the state of main tables in local storage
- Refactor the way the user can switch between compact and standard
  view of filters
- Refactor the way the state of checkboxes, radiobuttons and
  arrow-buttons changes.

- Modify style of filters
- Add style rules in order to change the state of checkboxes,
  radiobuttons and arrow-buttons by css
- Fix rendering bugs noticed in Firefox

- Modify html structure of filters.
- Modify html of checkboxes, radiobuttons and arrow-buttons
- Add a dropdown list with all the available filters in each page
- Minor rewording

Update Gunicorn conf file and relevant files.

Rename pithos.conf.py to gunicorn-archipelago.py and move it
to snf-webproject under the directory gunicorn-hooks to
make it wide accessible.

Remove shared memory file, /dev/shm/wid, and use a
shared memory mapping instead for the Gunicorn worker
ID bookkeeping.

When we cannot send a Ganeti job for a snapshot, we must re-raise the
exception after setting the snapshot's status to error.

The proper delimiter for SYNNEFO_EXCLUDE_PACKAGES should be ":", not
" ". Also, exclude the snf-admin-app when testing Pithos.

Use the newly introduced 'get_object_by_uuid' method to get a Pithos
object by its UUID, instead of mapping a UUID to a (account, container,
name) tuple.

Also, remove the '--user' and '--public' options from 'image-show' and
'snapshot-show' management commands. Instead, use the
'check_permissions' option to bypass Pithos permission check.

Finally, fix plankton tests to mock the 'get_object_by_uuid' method.

Snapshot properties are stored in lowercase in Pithos DB. It is the
image/plaknton API that converts them to uppercase.

Do not use only file disk templates, since an archipelago disk template
is required for snapshot tests.

Include 'ERROR' in the states for which we check if the NIC exists in
the Ganeti instance.

If the VM has just been started, the cpustats collectd plugin might try
to read /proc/<pid>/fd/ for VCPUs fds, before qemu has initialized /
created the VCPUs. This led to a ZeroDivision error in the collectd
plugin. Make sure to skip that particular VM until the VCPUs have been
created.

Document the usage of '*_RECIPIENTS' settings in Astakos to control the
lists were Astakos sends notifications. These lists used to be
preconfigured.

Use *_RECIPIENTS settings and sent email notifications to the
appropriate lists.

Astakos accepts three lists of people who receive application
notifications, namely 'ADMINS', 'HELPDESK' and 'MANAGERS'. Then it sends
email notifications in a preconfigured way in these lists (ie. project
creation notifications are always sent to the 'HELPDESK' and 'MANAGERS'
email lists).

We would like to enable Astakos to specify explicitly the lists in which
every notification will be sent. This commit adds the corresponding
settings that will enable this feature.

For convenience, Astakos groups the notifications in three categories
and let the user define the recipients for these.
  - ACCOUNT_NOTIFICATIONS_RECIPIENTS receive notifications for 'account
    pending moderation' and 'account activated' actions.
  - FEEDBACK_NOTIFICATIONS_RECIPIENTS receive feedback notifications
  - PROJECT_NOTIFICATIONS_RECIPIENTS receive notifications for 'project
    creations' and 'project modification' actions.

Furthermore, one can explicitly specify the recipients for a specific
notification by using one of the following settings:
  - ACCOUNT_PENDING_MODERATION_RECIPIENTS
  - ACCOUNT_ACTIVATED_RECIPIENTS
  - PROJECT_CREATION_RECIPIENTS
  - PROJECT_MODIFICATION_RECIPIENTS
By default, these settings are not exposed to the config file.

This method gets two keyword arguments: user and check_permissions.
If check_permissions is True returns only the object accessible to the user.
Otherwise list all the objects for the specific domain ignoring
permissions.
The latter case is only meaningful if user is not provided,
therefore in that case it raises AssertionError.

Provide an additional backend method 'get_object_by_uuid'
which gets the object's UUID as an input
and return metadata and permission information
about the object.

If a filter has not been given an input, then django-filter should
normally not call its function. However, it seems this is not the case
with the index Volume filter, whose function is called with no value and
as a result, it returns an empty QuerySet.

Fix this issue by checking in filter_index if it has been passed with
any parameters. Also, since this issue may appear in other filter
functions too, add the same check in every function that doesn't have
it.

NOTE: Model filters have a decorator that automatically does this check
for them.

Using this tag we explicitly set the Compatibility mode for Internet
Explorer to 'Standard'.

Function '_get_list_of_sys_images' should not return registered
snapshots.

Provide tests for spawning a VM from a snapshot.