1. 25 Feb, 2010 2 commits
  2. 22 Feb, 2010 1 commit
  3. 07 Jan, 2010 1 commit
    • Iustin Pop's avatar
      Switch the text file format to single-file · 16c2369c
      Iustin Pop authored
      This patch changes from the two separate files to a single file, with
      sections separated by a blank line. Currently only the node and instance
      data is accepted, later the cluster tags will be read too via this
      format.
      
      This makes all the programs accept the new format, but hscan doesn't yet
      generate it.
      16c2369c
  4. 27 Nov, 2009 1 commit
  5. 24 Nov, 2009 1 commit
    • Iustin Pop's avatar
      hspace: quote non-alphanum values in shell output · 9739b6b8
      Iustin Pop authored
      The tiered allocation output which contains spaces makes the output of
      hspace non-sourceable. This patch adds a new function to ensure
      non-alphanumeric values are quoted such that the output can be parsed
      easily via the shell.
      
      The patch also fixes a bug in the DSK_AVAIL key (found after adding the
      quoting) which added an extra space at the end of these keys.
      9739b6b8
  6. 11 Nov, 2009 1 commit
    • Iustin Pop's avatar
      Add a tags attribute to instances · 17e7af2b
      Iustin Pop authored
      … and read it in all the loaders. hscan is modified to save it to the
      files it generates.
      
      The attribute is not yet used in any place.
      17e7af2b
  7. 10 Nov, 2009 1 commit
    • Iustin Pop's avatar
      Allow overriding the field list in -p · e98fb766
      Iustin Pop authored
      The print nodes option can now accept an optional field list to
      customise the output. This is ugly, since the field names do not match
      the header names, but it is at least barely customisable (at runtime).
      e98fb766
  8. 06 Nov, 2009 4 commits
  9. 30 Oct, 2009 2 commits
    • Iustin Pop's avatar
      hspace: Abstract the instance listing · 366a7c89
      Iustin Pop authored
      This also converts it to formatTable from hardcoded listing.
      366a7c89
    • Iustin Pop's avatar
      Rework the instance spec CLI options · 1f9066c0
      Iustin Pop authored
      This patch reworks the internal handling of the instance spec CLI
      option, and adds a tiered spec option that will be used in hspace to
      enable the (auxiliary) tiered-spec allocation mode.
      
      It also introduces a new data type for holding the instance
      specification.
      1f9066c0
  10. 14 Oct, 2009 2 commits
  11. 28 Sep, 2009 1 commit
    • Iustin Pop's avatar
      Split the exernal data loader out of CLI.hs · e8f89bb6
      Iustin Pop authored
      Currently the external data loader is in CLI.hs, which makes all
      programs that need cli functionality (options, etc.) link against the
      network modules (most importantly curl). This patch splits this
      functionality into a new module such that (for example) hail which only
      deals with file I/O doesn't link against these libraries.
      e8f89bb6
  12. 18 Aug, 2009 1 commit
  13. 15 Jul, 2009 1 commit
    • Iustin Pop's avatar
      Unify the command line options and structures · 0427285d
      Iustin Pop authored
      This patch moves all the command line options and their internal
      representation into CLI.hs. This means that duplicated options between
      any two binaries are no longer declared twice, and that we no longer
      need the two *Option classes.
      0427285d
  14. 14 Jul, 2009 2 commits
  15. 09 Jul, 2009 2 commits
    • Iustin Pop's avatar
      hspace: fix failure handling of tryAlloc results · 31e7ac17
      Iustin Pop authored
      Currently hspace doesn't handle failures from tryAlloc correctly; this
      patch changes the iterateDepth function in hspace to return a Result (…)
      so that errors can be propagated correctly.
      
      The patch also changes one output key to be more clear and a typo in
      Cluster.hs
      31e7ac17
    • Iustin Pop's avatar
      Change the tryAlloc/tryReloc workflow · 478df686
      Iustin Pop authored
      Currently, the tryAlloc and tryReloc function return a list with all the
      results, both failures and successes. This is fine for hail, which does
      one round of allocations, but is not so good for hspace, which does
      iterative rounds; since at each (successful) step we only take the best
      solution, it means that we're using lots of heap space to compute and
      store node lists which are thrown away at the end of the step.
      
      This patch changes these two functions and their callers in hail/hspace
      to only return the best solution, and error/success counters. This
      allows hspace to run in a much smaller space, and reduces GC cost
      greatly.
      
      Overall, it is a cleanup, as hail/hspace did a lot of work to chose this
      best solution, whereas now it's automatically promoted within
      Cluster.concatAllocs.
      478df686
  16. 08 Jul, 2009 3 commits
    • Iustin Pop's avatar
      Slight change to the internal allocation results · 8880d889
      Iustin Pop authored
      Currently the Cluster.AllocSolution type is defined as a list of
      ‘(OpResult Node.list, …)’ and the results for applyMove are defined as
      ‘(OpResult Node.List, …)’. Both these means that the failure/success
      indication is hidden in the first elements of this tuple, which makes is
      harder to add other elements depending on the success/failure (like the
      score for the new node list).
      
      This patch moves the OpResult to outside of the tuple, in effect making
      all these ‘OpResult (…)’ which makes the internal tuple elements
      consistent. The patch is affecting the applyMove, tryAlloc and
      tryRealloc functions, and only briefly the hail and hspace programs.
      8880d889
    • Iustin Pop's avatar
      hspace: switch output to shell-script format · 2bbf77cc
      Iustin Pop authored
      This (big) patch changes the output of hspace from text-format
      (separated by ‘: ’) to a shell-snippet, in ‘key=value’ format.
      
      This will allow sourcing the output or parsing it via awk/sed/etc.
      2bbf77cc
    • Iustin Pop's avatar
      hspace: move instance count and score into CStats · de4ac2c2
      Iustin Pop authored
      Currently the instance count and cluster score are separated from the
      other initial/final phase stats, even though they are very similar. This
      patch moves computation of these two into totalResources/CStats and
      removes special printing in hspace.
      de4ac2c2
  17. 07 Jul, 2009 5 commits
    • Iustin Pop's avatar
      Export more stats in hspace · 8c4c6a8a
      Iustin Pop authored
      This patch changes Cluster.totalResources to compute more resources and
      prints them in hspace.
      8c4c6a8a
    • Iustin Pop's avatar
      Show errors on stderr instead of stdout · 2795466b
      Iustin Pop authored
      Currently many of the exit and warning conditions mistakenly display error
      messages on stdout, which makes parsing the output of programs harder. This
      patch attempts to fix such occurrences.
      2795466b
    • Iustin Pop's avatar
      hspace: convert N1 error exit into FailN1 result · dca7f396
      Iustin Pop authored
      Currently hspace exits with an error if the cluster is not N+1 compliant
      at the beginning of the run. This patch changes hspace such that this
      condition is instead treated as a zero-allocation-possible, FailN1 mode.
      This allows the same stats to be reported in this case as in the normal
      case.
      dca7f396
    • Iustin Pop's avatar
      Some docstring updates · 58631b72
      Iustin Pop authored
      58631b72
    • Iustin Pop's avatar
      hspace: add display of instance spec · 7e74e7db
      Iustin Pop authored
      This is mostly for user-friendliness in the default mode, when we don't
      specify the instance parameters.
      7e74e7db
  18. 06 Jul, 2009 1 commit
    • Iustin Pop's avatar
      Fix hlint-generated warnings · 9f6dcdea
      Iustin Pop authored
      This big patch cleans up the code per hlint indications. Many removals
      of extra parentheses, replacements of concat . map with concabtMap,
      extra dollar signs, eta reductions, etc. were performed.
      
      The code still compiles and passes a couple of manual tests on sample
      files. The individual changes are also small enough as to be visually
      easy to confirm.
      9f6dcdea
  19. 05 Jul, 2009 2 commits
    • Iustin Pop's avatar
      Add computation of the failure reason in hspace · 44763b51
      Iustin Pop authored
      This patch enhances hspace to report why the allocation sequence
      stopped, both in absolute error count and for the top reason.
      44763b51
    • Iustin Pop's avatar
      Introduce a new type for allocation results · f2280553
      Iustin Pop authored
      Currently the allocation/move operations workflow return ‘Maybe a’,
      which is very convenient but loses all details about the failure mode.
      
      This patch introduces a new data type which encodes the specific failure
      mode. It is not yet used correctly (e.g. all node operations result in
      FailN1), but the workflow is updated. Most of the changes are in the
      hail/hspace tools, the library code required only trivial adjustments.
      f2280553
  20. 03 Jul, 2009 2 commits
  21. 02 Jul, 2009 3 commits
    • Iustin Pop's avatar
      Add a new type for cluster statistics · 1a7eff0e
      Iustin Pop authored
      Currently totalResources returns a 5-tuple of integers. This is not easy
      to handle, as each change on the return type means that each caller must
      be updated.
      
      This patch adds a new type for cluster stats and uses that instead as
      its return type. This simplifies its callers while complicating only a
      little the computation of the stats.
      1a7eff0e
    • Iustin Pop's avatar
      Enhance hspace resource display · 621de5b7
      Iustin Pop authored
      The display of cluster resources is extracted into a separate function
      and enhanced to display more stats.
      621de5b7
    • Iustin Pop's avatar
      Add display of more stats in hspace · e2af3156
      Iustin Pop authored
      This patch changes Cluster.totalResources to compute more details about
      the cluster status, and enhances hspace to display more of these.
      e2af3156
  22. 12 Jun, 2009 1 commit