GitLab

Update the url for the Synnefo repo and add a flavor with more RAM as
default.

Choose from the user list of an Image the first user as the admin user.

Allow to test only an app of a component, if the input has the following
form:

    component.app

e.g. astakos.im

According to the decision of the GRNET Board of Directors,
switch license to GPLv3.

This commit will be propagated to the release
and master branches based on git flow, and the next
release will be licensed as GPLv3.

Extend the 'volume-create' management command with the '--source' option
which can be used to create a volume which is initialized with data from
an image, snapshot or volume. Currently, this option is useful only
for volumes that have been created with the 'ext_archipelago' disk template.

Closes: #45

Format arguments were applied to the last part of the string which contained
no % format operators. Concat strings before applying format.

This patch-set fixes a number of issues relative with handling unicode strings.
These commits try to avoid mixing bytestrings and unicode objects, by decoding
bytestrings as early as possible (Input) and encoding unicodes as late as
possible (Ouput). In the API the encoding that is used is always 'UTF-8'. In
the CLI the encoding that is used is the user's preferred encoding.

Besides unicode issues, this patch-set fixes handling of image metadata
(Plankton) which are views as HTTP headers. Since, image metadata must be valid
HTTP headers, metadata keys and values which contain user defined values must
be properly quoted and unquoted where needed.

When writing Pithos+ mapfiles with direct I/O enabled Archipelago takes
care to use properly aligned and sized I/O based on the basic block unit,
which is 512 bytes. The result is to pad the file with zeros and finally
produce the wrong mapfile.

Use the 'get_json_body' function, which takes care of encoding errors.
Also, check that the POST body is a dictionary, where needed.

Define a custom CommandError, which applies smart_locale_str() in its
__str__ method. Use this custom CommandError in Astakos management
commands.

Use recipe from http://docs.python.org/2/library/csv.html to write unicode
in csv format.

Define __unicode__ in astakos models rather than __str__.

'snf-manage' command wraps the 'stdout' in an EncodedStream objects,
which encodes all unicode objects to bytestrings using the user's
preferred encoding. This commit wraps 'stderr' as well.

* Catch a potential 500 error, when registering a file as an Image, while
trying to decode "Image name" into unicode.
* Add corresponding test case

Extend the SynnefoCommand to override the 'run_from_argv' function in
order to decode command line arguments and options, using the user's
preferred encoding.

Some options of snf-manage commands may be list or tuples. Applying
'smart_unicode' to them will convert them to unicode object. Instead
of recursively converting data, we convert the arguments to unicodes
before being parsed.

Add helper functions to handle unicode objects from 'snf-manage' using
the user's preferred encoding. Also add a 'safe_string' function to
escape control characters from strings and unicode objects.

Improve the handling of all the image parameters that are
requested/returned as HTTP headers. All parameters must be 'utf-8'
encoded. User provided values like the image name and image properties
must also be properly quoted. Lower all image properties(HTTP header
keys) and replace all punctuation characters with underscore.

Finally, add section in the image API guide, explaining the required
format for the image metadata.

Add __str__ method to all DB models, that simply calls __unicode__
method. Because __str__ will return a unicode string it will be ignored,
and the result from __unicode__ will be used. Also, make all __unicode__
methods to return unicode strings.

Replace use of 'uenc' and 'udec' functions from 'synnefo.util.text'
module with the 'smart_decode' and 'smart_unicode' functions from
'django.utils.encoding' module.

The uenc/udec functions depend on the locale category LC_CTYPE, which is not
appropriate for the Synenefo API. We explicitly use the
smart_unicode/smart_str functions to decode to unicode and encode to
bytestring objects, always using the utf-8 encoding.

Explicitly set the request encoding to UTF-8 instead of relying to
the DEFAULT_CHARSET setting. See:
https://docs.djangoproject.com/en/1.4/ref/unicode/#form-submission

Catch unicode errors when doing JSON de-serialization of the body of a request.
Also, rename 'get_request_dict' function to 'get_json_body', as it is a
more representative name for what the function is doing.

Add support for volumes & snapshots

This patch set extends Cyclades and Pithos to support Volumes and Snapshots.
Each virtual server can have multiple virtual disks (of the same disk
template), which can be dynamically created or removed. Also, in case of
Archipelago volumes, the user can create snapshots of an instance's volumes
which are stored as files on Pithos. The volumes and snapshots are handled
via the OpenStack Cinder API, which is exposed by the Cyclades 'volume' service.

Add tool to add a unique name to the disks of all Ganeti instances.

Fix various issues after rebasing branch.

..and use 2G for ci.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

Since archipelago-ganeti installs the provider under
/usr/share/ganeti/extstorage we can/should not clone our repo in the
same dir. Thus we clone it under /usr/local/lib/ganeti/ which is
also in ExtStorage search path.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>

..because git clone needs a clean dir and archipelago-ganeti
installs archipelago ext provider under /usr/share/ganeti/extstorage
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>