GitLab

'snf-manage' command wraps the 'stdout' in an EncodedStream objects,
which encodes all unicode objects to bytestrings using the user's
preferred encoding. This commit wraps 'stderr' as well.

* Catch a potential 500 error, when registering a file as an Image, while
trying to decode "Image name" into unicode.
* Add corresponding test case

Extend the SynnefoCommand to override the 'run_from_argv' function in
order to decode command line arguments and options, using the user's
preferred encoding.

Some options of snf-manage commands may be list or tuples. Applying
'smart_unicode' to them will convert them to unicode object. Instead
of recursively converting data, we convert the arguments to unicodes
before being parsed.

Add helper functions to handle unicode objects from 'snf-manage' using
the user's preferred encoding. Also add a 'safe_string' function to
escape control characters from strings and unicode objects.

Improve the handling of all the image parameters that are
requested/returned as HTTP headers. All parameters must be 'utf-8'
encoded. User provided values like the image name and image properties
must also be properly quoted. Lower all image properties(HTTP header
keys) and replace all punctuation characters with underscore.

Finally, add section in the image API guide, explaining the required
format for the image metadata.

Add __str__ method to all DB models, that simply calls __unicode__
method. Because __str__ will return a unicode string it will be ignored,
and the result from __unicode__ will be used. Also, make all __unicode__
methods to return unicode strings.

Replace use of 'uenc' and 'udec' functions from 'synnefo.util.text'
module with the 'smart_decode' and 'smart_unicode' functions from
'django.utils.encoding' module.

The uenc/udec functions depend on the locale category LC_CTYPE, which is not
appropriate for the Synenefo API. We explicitly use the
smart_unicode/smart_str functions to decode to unicode and encode to
bytestring objects, always using the utf-8 encoding.

Explicitly set the request encoding to UTF-8 instead of relying to
the DEFAULT_CHARSET setting. See:
https://docs.djangoproject.com/en/1.4/ref/unicode/#form-submission

Catch unicode errors when doing JSON de-serialization of the body of a request.
Also, rename 'get_request_dict' function to 'get_json_body', as it is a
more representative name for what the function is doing.

Add support for volumes & snapshots

This patch set extends Cyclades and Pithos to support Volumes and Snapshots.
Each virtual server can have multiple virtual disks (of the same disk
template), which can be dynamically created or removed. Also, in case of
Archipelago volumes, the user can create snapshots of an instance's volumes
which are stored as files on Pithos. The volumes and snapshots are handled
via the OpenStack Cinder API, which is exposed by the Cyclades 'volume' service.

Add tool to add a unique name to the disks of all Ganeti instances.

Fix various issues after rebasing branch.

..and use 2G for ci.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Since archipelago-ganeti installs the provider under
/usr/share/ganeti/extstorage we can/should not clone our repo in the
same dir. Thus we clone it under /usr/local/lib/ganeti/ which is
also in ExtStorage search path.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

..because git clone needs a clean dir and archipelago-ganeti
installs archipelago ext provider under /usr/share/ganeti/extstorage
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Clone extstorage repo to /usr/share/ganeti/extstorage.
and add ext_vlmc flavor_storage.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Currently cyclades and pithos require a specific gunicorn setup
with GeventArchipelagoWorker. Plus they require a config
file that is included in snf-pithos-app; pithos.conf.py

This file must be installed both in pithos and cyclades. Therefore
we have it as a template and install it under /etc/archipelago.

Add archipelago.conf template in order to customize SEGMENT_SIZE.

For the above responsible is Archip component.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

..since adding it to setup.py results to:

pkg_resources.DistributionNotFound: svipc

Note that `pip search svipc` does not return any python module.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Extend snf-deploy to support installation and configuration of
Archipelago.

Archipelago related packages are found in apt.dev unstable an in
ceph's repo, which are added to the source.list.

A new nfs mount point is created /srv/archip and two new components,
Archip and ArchipGaneti are added to be included in pithos, cyclades,
ganeti and master roles.

while sorting images collection

by placing owner in a separate row

Conflicts:

	snf-cyclades-app/synnefo/ui/static/snf/js/ui/web/ui_create_view.js
	snf-cyclades-app/synnefo/ui/templates/partials/create_vm.html

Conflicts:

	snf-cyclades-app/synnefo/ui/static/snf/js/ui/web/ui_create_view.js

snapshots feature introduced the requirement for updating images displayed on
vm creation view, every time the view is accessed by the user. Since updating
the registered images call might take a while an additional 'loading images'
indicator is displayed prior to rendering the vm create wizard images list.

- New overlay view to handle vm snapshot creation
- Snapshot action available from vm single view

Conflicts:

	snf-cyclades-app/synnefo/ui/templates/partials/machines.html
	snf-cyclades-app/synnefo/ui/templates/partials/machines_single.html