Merge branch 'master' into associate-heuristic-with-extension

2015-07-04 22:48:06 +02:00 · 2015-07-04 22:48:06 +02:00 · e688c865bc
--- a/.gitmodules
+++ b/.gitmodules
@ -629,6 +629,9 @@
 [submodule "vendor/grammars/jflex.tmbundle"]
 	path = vendor/grammars/jflex.tmbundle
 	url = https://github.com/jflex-de/jflex.tmbundle.git
+[submodule "vendor/grammars/Sublime-Modula-2"]
+	path = vendor/grammars/Sublime-Modula-2
+	url = https://github.com/harogaston/Sublime-Modula-2
 [submodule "vendor/grammars/ada.tmbundle"]
 	path = vendor/grammars/ada.tmbundle
 	url = https://github.com/textmate/ada.tmbundle
@ -647,3 +650,6 @@
 [submodule "vendor/grammars/atom-fsharp"]
 	path = vendor/grammars/atom-fsharp
 	url = https://github.com/fsprojects/atom-fsharp
+[submodule "vendor/grammars/SMT.tmbundle"]
+	path = vendor/grammars/SMT.tmbundle
+	url = https://github.com/SRI-CSL/SMT.tmbundle.git
--- a/CONTRIBUTING.md
+++ b/CONTRIBUTING.md
@ -2,9 +2,27 @@

 Hi there! We're thrilled that you'd like to contribute to this project. Your help is essential for keeping it great. The majority of contributions won't need to touch any Ruby code at all.

+
+## Adding an extension to a language
+
+We try only to add new extensions once they have some usage on GitHub. In most cases we prefer that extensions be in use in hundreds of repositories before supporting them in Linguist.
+
+To add support for a new extension:
+
+0. Add your extension to the language entry in [`languages.yml`][languages].
+0. Add at least one sample for your extension to the [samples directory][samples] in the correct subdirectory.
+0. Open a pull request, linking to a [GitHub search result](https://github.com/search?utf8=%E2%9C%93&q=extension%3Aboot+NOT+nothack&type=Code&ref=searchresults) showing in-the-wild usage.
+
+In addition, if this extension is already listed in [`languages.yml`][languages] then sometimes a few more steps will need to be taken:
+
+0. Make sure that example `.yourextension` files are present in the [samples directory][samples] for each language that uses `.yourextension`.
+0. Test the performance of the Bayesian classifier with a relatively large number (1000s) of sample `.yourextension` files. (ping @arfon or @bkeepers to help with this) to ensure we're not misclassifying files.
+0. If the Bayesian classifier does a bad job with the sample `.yourextension` files then a [heuristic](https://github.com/github/linguist/blob/master/lib/linguist/heuristics.rb) may need to be written to help.
+
+
 ## Adding a language

-We try only to add languages once they have some usage on GitHub. In most cases we prefer that languages be in use in hundreds of repositories before supporting them in Linguist.
+We try only to add languages once they have some usage on GitHub. In most cases we prefer that each new file extension be in use in hundreds of repositories before supporting them in Linguist.

 To add support for a new language:

@ -23,12 +41,14 @@ In addition, if your new language defines an extension that's already listed in

 Remember, the goal here is to try and avoid false positives!

+
 ## Fixing a misclassified language

 Most languages are detected by their file extension defined in [languages.yml][languages].  For disambiguating between files with common extensions, linguist applies some [heuristics](/lib/linguist/heuristics.rb) and a [statistical classifier](lib/linguist/classifier.rb). This process can help differentiate between, for example, `.h` files which could be either C, C++, or Obj-C.

 Misclassifications can often be solved by either adding a new filename or extension for the language or adding more [samples][samples] to make the classifier smarter.

+
 ## Fixing syntax highlighting

 Syntax highlighting in GitHub is performed using TextMate-compatible grammars. These are the same grammars that TextMate, Sublime Text and Atom use. Every language in [languages.yml][languages] is mapped to its corresponding TM `scope`. This scope will be used when picking up a grammar for highlighting.
@ -55,6 +75,7 @@ Sometimes getting the tests running can be too much work, especially if you don'

 Here's our current build status: [![Build Status](https://secure.travis-ci.org/github/linguist.png?branch=master)](http://travis-ci.org/github/linguist)

+
 ## Releasing

 If you are the current maintainer of this gem:
--- a/github-linguist.gemspec
+++ b/github-linguist.gemspec
@ -16,7 +16,7 @@ Gem::Specification.new do |s|
  s.add_dependency 'charlock_holmes', '~> 0.7.3'
  s.add_dependency 'escape_utils',    '~> 1.1.0'
  s.add_dependency 'mime-types',      '>= 1.19'
-  s.add_dependency 'rugged',          '~> 0.23.0b1'
+  s.add_dependency 'rugged',          '>= 0.23.0b'

  s.add_development_dependency 'minitest', '>= 5.0'
  s.add_development_dependency 'mocha'
--- a/grammars.yml
+++ b/grammars.yml
@ -85,6 +85,8 @@ vendor/grammars/Racket:
 - source.racket
 vendor/grammars/SCSS.tmbundle:
 - source.scss
+vendor/grammars/SMT.tmbundle:
+- source.smt
 vendor/grammars/Scalate.tmbundle:
 - source.scaml
 - text.html.ssp
@ -107,6 +109,8 @@ vendor/grammars/Sublime-Logos:
 - source.logos
 vendor/grammars/Sublime-Loom:
 - source.loomscript
+vendor/grammars/Sublime-Modula-2/:
+- source.modula2
 vendor/grammars/Sublime-Nit:
 - source.nit
 vendor/grammars/Sublime-QML:
--- a/lib/linguist/generated.rb
+++ b/lib/linguist/generated.rb
@ -69,8 +69,9 @@ module Linguist
      generated_protocol_buffer? ||
      generated_apache_thrift? ||
      generated_jni_header? ||
-      generated_unity3d_meta? ||
-      vcr_cassette?
+      vcr_cassette? ||
+      generated_module? ||
+      generated_unity3d_meta?
    end

    # Internal: Is the blob an Xcode file?
@ -324,6 +325,24 @@ module Linguist
      return lines[0].include?("Generated by Cython")
    end

+    # Internal: Is it a KiCAD or GFortran module file?
+    #
+    # KiCAD module files contain:
+    # PCBNEW-LibModule-V1  yyyy-mm-dd h:mm:ss XM
+    # on the first line.
+    #
+    # GFortran module files contain:
+    # GFORTRAN module version 'x' created from 
+    # on the first line.
+    #
+    # Return true of false
+    def generated_module?
+      return false unless extname == '.mod'
+      return false unless lines.count > 1
+      return lines[0].include?("PCBNEW-LibModule-V") || 
+              lines[0].include?("GFORTRAN module version '")
+    end
+
    # Internal: Is this a metadata file from Unity3D?
    #
    # Unity3D Meta files start with:
--- a/lib/linguist/heuristics.rb
+++ b/lib/linguist/heuristics.rb
@ -285,6 +285,16 @@ module Linguist
      end
    end

+    disambiguate ".mod" do |data|
+      if data.include?('<!ENTITY ')
+        Language["XML"]
+      elsif /MODULE\s\w+\s*;/i.match(data) || /^\s*END \w+;$/i.match(data)
+        Language["Modula-2"]
+      else
+        [Language["Linux Kernel Module"], Language["AMPL"]]
+      end
+    end
+
    disambiguate ".nl" do |data|
      if /^(b|g)[0-9]+ /.match(data)
        Language["NL"]
--- a/lib/linguist/languages.yml
+++ b/lib/linguist/languages.yml
@ -49,6 +49,7 @@ AMPL:
  color: "#E6EFBB"
  extensions:
  - .ampl
+  - .mod
  tm_scope: source.ampl
  ace_mode: text

@ -1359,7 +1360,7 @@ Haskell:
 Haxe:
  type: programming
  ace_mode: haxe
-  color: "#f7941e"
+  color: "#df7900"
  extensions:
  - .hx
  - .hxsl
@ -1475,6 +1476,14 @@ Isabelle:
  tm_scope: source.isabelle.theory
  ace_mode: text

+Isabelle ROOT:
+  type: programming
+  group: Isabelle
+  filenames:
+  - ROOT
+  tm_scope: source.isabelle.root
+  ace_mode: text
+
 J:
  type: programming
  color: "#9EEDFF"
@ -1638,7 +1647,7 @@ Kit:

 Kotlin:
  type: programming
-  color: "#EA4DFA"
+  color: "#F18E33"
  extensions:
  - .kt
  - .ktm
@ -1759,6 +1768,13 @@ Linker Script:
  tm_scope: none
  ace_mode: text

+Linux Kernel Module:
+  type: data
+  extensions:
+  - .mod
+  tm_scope: none
+  ace_mode: text
+
 Liquid:
  type: markup
  extensions:
@ -2025,6 +2041,13 @@ Modelica:
  tm_scope: source.modelica
  ace_mode: text

+Modula-2:
+  type: programming
+  extensions:
+  - .mod
+  tm_scope: source.modula2
+  ace_mode: text
+
 Module Management System:
  type: programming
  extensions:
@ -2768,7 +2791,7 @@ Racket:

 Ragel in Ruby Host:
  type: programming
-  color: "#e17600"
+  color: "#9d5200"
  extensions:
  - .rl
  aliases:
@ -2919,6 +2942,25 @@ SCSS:
  extensions:
  - .scss

+SMT:
+  type: programming
+  extensions:
+  - .smt2
+  - .smt
+  interpreters:
+  - boolector
+  - cvc4
+  - mathsat5
+  - opensmt
+  - smtinterpol
+  - smt-rat
+  - stp
+  - verit
+  - yices2
+  - z3
+  tm_scope: source.smt
+  ace_mode: text
+
 SPARQL:
  type: data
  tm_scope: source.sparql
@ -3506,6 +3548,7 @@ XML:
  - .launch
  - .mdpolicy
  - .mm
+  - .mod
  - .mxml
  - .nproj
  - .nuspec
--- a/lib/linguist/repository.rb
+++ b/lib/linguist/repository.rb
@ -150,9 +150,10 @@ module Linguist
        next if delta.binary

        if [:added, :modified].include? delta.status
-          # Skip submodules
+          # Skip submodules and symlinks
          mode = delta.new_file[:mode]
-          next if (mode & 040000) != 0
+          mode_format = (mode & 0170000)
+          next if mode_format == 0120000 || mode_format == 040000 || mode_format == 0160000

          blob = Linguist::LazyBlob.new(repository, delta.new_file[:oid], new, mode.to_s(8))

--- a/lib/linguist/vendor.yml
+++ b/lib/linguist/vendor.yml
@ -70,6 +70,7 @@
 - 3rd[-_]?party/
 - vendors?/
 - extern(al)?/
+- (^|/)[Vv]+endor/

 # Debian packaging
 - ^debian/
@ -172,6 +173,13 @@
 # Sparkle
 - (^|/)Sparkle/

+# Crashlytics
+- Crashlytics.framework/
+
+# Fabric
+- Fabric.framework/
+
+
 ## Groovy ##

 # Gradle
--- a/lib/linguist/version.rb
+++ b/lib/linguist/version.rb
@ -1,3 +1,3 @@
 module Linguist
-  VERSION = "4.5.6"
+  VERSION = "4.5.7"
 end
--- a/samples/AMPL/CT2.mod
+++ b/samples/AMPL/CT2.mod
@ -0,0 +1,58 @@
+param num_beams;                  # number of beams
+
+param num_rows >= 1, integer;     # number of rows
+param num_cols >= 1, integer;     # number of columns 
+
+set BEAMS   := 1 .. num_beams;    # set of beams
+
+set ROWS    := 1 .. num_rows;	  # set of rows
+set COLUMNS := 1 .. num_cols;	  # set of columns
+
+# values for entries of each beam
+param beam_values {BEAMS, ROWS, COLUMNS} >= 0; 
+
+# values of tumor
+param tumor_values {ROWS, COLUMNS} >= 0; 
+
+# values of critical area
+param critical_values {ROWS, COLUMNS} >= 0; 
+
+# critical maximum dosage requirement
+param critical_max;
+
+# tumor minimum dosage requirement
+param tumor_min;
+
+# dosage scalar of each beam
+var X {i in BEAMS} >= 0;
+
+
+# define the tumor area which includes the locations where tumor exists
+set tumor_area := {k in ROWS, h in COLUMNS: tumor_values[k,h] > 0};
+
+# define critical area 
+set critical_area := {k in ROWS, h in COLUMNS: critical_values[k,h] > 0};
+
+var S {(k,h) in tumor_area} >= 0;
+var T {(k,h) in critical_area} >= 0;
+
+# maximize total dosage in tumor area
+maximize total_tumor_dosage: sum {i in BEAMS} sum {(k,h) in tumor_area} X[i] * beam_values[i,k,h];
+
+# minimize total dosage in critical area
+minimize total_critical_dosage: sum {i in BEAMS} sum {(k,h) in critical_area} X[i] * beam_values[i,k,h];
+
+# minimize total tumor slack
+minimize total_tumor_slack: sum {(k,h) in tumor_area} S[k,h];
+
+# minimize total critical area slack
+minimize total_critical_slack: sum {(k,h) in critical_area} T[k,h];
+
+# total dosage at each tumor location [k,h] should be >= min tumor dosage with slack variable
+subject to tumor_limit {(k,h) in tumor_area} : sum {i in BEAMS} X[i] * beam_values[i,k,h] == tumor_min - S[k,h];
+
+# total dosage at each critical location [k,h] should be = max critical dosage with slack variable
+subject to critical_limit {(k,h) in critical_area} : sum {i in BEAMS} X[i] * beam_values[i,k,h] == critical_max + T[k,h];
+
+
+
--- a/samples/G-code/lm.g
+++ b/samples/G-code/lm.g
--- a/samples/G-code/rm.g
+++ b/samples/G-code/rm.g
--- a/ROOT/filenames/ROOT
+++ b/ROOT/filenames/ROOT
--- a/Module/bcm4334x.mod
+++ b/Module/bcm4334x.mod
@ -0,0 +1,2 @@
+/data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/bcm4334x.ko
+/data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_pno.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_common.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_ip.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_custom_gpio.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_linux.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_linux_sched.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_cfg80211.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_linux_wq.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/aiutils.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/bcmevent.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/bcmutils.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/bcmwifi_channels.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/hndpmu.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/linux_osl.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/sbutils.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/siutils.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/wl_android.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/wl_cfg80211.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/wl_cfgp2p.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/wl_cfg_btcoex.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/wldev_common.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/wl_linux_mon.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_linux_platdev.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/bcmsdh.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/bcmsdh_linux.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/bcmsdh_sdmmc.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/bcmsdh_sdmmc_linux.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_cdc.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_wlfc.o /data/israel/edison/poky/meta-edison/recipes-kernel/bcm43340/driver_bcm43x/dhd_sdio.o
--- a/Module/mbcache.mod
+++ b/Module/mbcache.mod
@ -0,0 +1,2 @@
+fs/mbcache.ko
+fs/mbcache.o
--- a/Module/md5.mod
+++ b/Module/md5.mod
@ -0,0 +1,2 @@
+crypto/md5.ko
+crypto/md5.o
--- a/samples/Modula-2/HuffChan.mod
+++ b/samples/Modula-2/HuffChan.mod
@ -0,0 +1,329 @@
+IMPLEMENTATION MODULE HuffChan;
+
+(*
+ This module shows how to redefine standard IO file functions. It provides
+ functions for reading and writing packed files opened in Raw mode.
+*)
+
+IMPORT IOChan, IOLink, ChanConsts, IOConsts, SYSTEM, Strings;
+FROM Storage IMPORT ALLOCATE, DEALLOCATE;
+
+CONST
+  rbldFrq = 512;	(* means: every 512 bytes rebuild table *)
+
+TYPE
+  charTap  = POINTER TO ARRAY [0..MAX(INTEGER)-1] OF CHAR;
+  smbTp = POINTER TO smbT;
+
+  smbT = RECORD			(* Huffman's tree *)
+    ch			: CHAR;
+    n			: CARDINAL; (* frequncy of char ch *)
+    left,right,next	: smbTp;
+  END;
+
+  tblT = RECORD		(* bit sequence for code *)
+    vl		: CARDINAL;	(* bit sequence *)
+    cnt		: INTEGER;	(* it length *)
+  END;
+
+  lclDataT = RECORD	(* channel's local data *)
+    tRoot 	: smbTp;
+    htbl	: ARRAY [0..255] OF tblT;     (* code -> bit sequence table *)
+    ftbl  	: ARRAY [0..255] OF CARDINAL; (* frequncey table *)
+    wBf,rb1,rb2	: CARDINAL;
+    wbc,rbc,smc	: INTEGER;
+    chid	: IOChan.ChanId;
+  END;
+  lclDataTp = POINTER TO lclDataT;
+  charp     = POINTER TO CHAR;
+
+VAR
+  did	: IOLink.DeviceId;
+  ldt	: lclDataTp;
+
+
+PROCEDURE Shf(a:CARDINAL; b : INTEGER) : CARDINAL; (* shl a,b (or shr) *)
+BEGIN
+  RETURN SYSTEM.CAST(CARDINAL,SYSTEM.SHIFT(SYSTEM.CAST(BITSET,a),b));
+END Shf;
+
+PROCEDURE wrDword(a:CARDINAL);	(* write 4 bytes to file *)
+BEGIN
+  IOChan.RawWrite(ldt^.chid,SYSTEM.ADR(a),4);
+END wrDword;
+
+PROCEDURE rdDword() : CARDINAL;  (* read 4 bytes from file *)
+VAR
+  a,z : CARDINAL;
+BEGIN
+  a:=0;
+  IOChan.RawRead(ldt^.chid,SYSTEM.ADR(a),4,z);
+  RETURN a;
+END rdDword;
+
+PROCEDURE wrSmb(ch : CHAR);	(* write bit sequence for code ch *)
+VAR
+  v,h : CARDINAL;
+  b,c : INTEGER;
+BEGIN
+  WITH ldt^ DO
+    v:=htbl[ORD(ch)].vl;
+    c:=htbl[ORD(ch)].cnt;
+    IF c+wbc<=32 THEN
+      wBf:=Shf(wBf,c);
+      wBf:=wBf+v;
+      wbc:=wbc+c;
+      IF wbc=32 THEN
+	wrDword(wBf);
+	wBf:=0; wbc:=0;
+      END;
+      RETURN;
+    END;
+    b:=c+wbc-32;
+    h:=Shf(v,-b);
+    wBf:=Shf(wBf,32-wbc)+h;
+    wrDword(wBf);
+    wBf:=v-Shf(h,b);
+    wbc:=b;
+  END;
+END wrSmb;
+
+PROCEDURE flush();	(* write data in buffer *)
+BEGIN
+  WITH ldt^ DO
+    wBf:=Shf(wBf,32-wbc);
+    wrDword(wBf);
+  END;
+END flush;
+
+PROCEDURE getSym() : CHAR; (* find code for first bit sequence in buffer *)
+VAR
+  t,i : CARDINAL;
+  b   : INTEGER;
+BEGIN
+  WITH ldt^ DO
+    IF rbc<=32 THEN
+      rb2:=rdDword();
+      t:=Shf(rb2,-rbc);
+      IF rbc=32 THEN t:=0; END;
+      rb1:=rb1+t;
+      rb2:=Shf(rb2,32-rbc);
+      IF rbc=0 THEN rb2:=0; END;
+      rbc:=rbc+32;
+    END;
+    FOR i:=0 TO 255 DO
+      t:=Shf(rb1,htbl[i].cnt-32);
+      IF t=htbl[i].vl THEN
+	rb1:=Shf(rb1,htbl[i].cnt);
+	b:=32-htbl[i].cnt;
+	t:=Shf(rb2,-b);
+	rb1:=rb1+t;
+	rb2:=Shf(rb2,32-b);
+	rbc:=rbc+b-32;
+	RETURN CHR(i);
+      END;
+    END;
+  END;
+END getSym;
+
+PROCEDURE Insert(s : smbTp); (* insert new character in Huffman's tree *)
+VAR
+  cr : smbTp;
+BEGIN
+  WITH ldt^ DO
+    IF tRoot=NIL THEN
+      cr:=tRoot;
+      tRoot:=s;
+      s^.next:=cr;
+      RETURN;
+    ELSIF tRoot^.n<=s^.n THEN
+      cr:=tRoot;
+      tRoot:=s;
+      s^.next:=cr;
+      RETURN;
+    END;
+    cr:=tRoot;
+    WHILE (cr^.next<>NIL) & (cr^.next^.n>s^.n) DO
+      cr:=cr^.next;
+    END;
+    s^.next:=cr^.next;
+    cr^.next:=s;
+  END;
+END Insert;
+
+PROCEDURE BuildTree(); (* build Huffman's tree *)
+VAR
+  cr,ocr,ncr : smbTp;
+BEGIN
+  WITH ldt^ DO
+    LOOP
+      ocr:=NIL; cr:=tRoot;
+      WHILE cr^.next^.next<>NIL  DO
+	ocr:=cr; cr:=cr^.next;
+      END;
+      NEW(ncr);
+      ncr^.n:=cr^.n+cr^.next^.n;
+      ncr^.left:=cr;
+      ncr^.right:=cr^.next;
+      IF ocr<>NIL THEN
+	ocr^.next:=NIL;
+	Insert(ncr);
+      ELSE
+	tRoot:=NIL;
+	Insert(ncr);
+	EXIT;
+      END;
+    END;
+  END;
+END BuildTree;
+
+PROCEDURE BuildTable(cr: smbTp; vl,n: CARDINAL); (* build table: code -> bit sequence *)
+BEGIN
+  WITH ldt^ DO
+    IF cr^.left=NIL THEN
+      htbl[ORD(cr^.ch)].vl:=vl;
+      htbl[ORD(cr^.ch)].cnt:=n;
+      DISPOSE(cr);
+      RETURN;
+    END;
+    vl:=vl*2;
+    BuildTable(cr^.left,vl,n+1);
+    BuildTable(cr^.right,vl+1,n+1);
+    DISPOSE(cr);
+  END;
+END BuildTable;
+
+PROCEDURE clcTab(); (* build code/bitseq. table from frequency table *)
+VAR
+  i : CARDINAL;
+  s : smbTp;
+BEGIN
+  WITH ldt^ DO
+    tRoot:=NIL;
+    FOR i:=0 TO 255 DO
+      NEW(s);
+      s^.ch:=CHR(i);
+      s^.n:=ftbl[i];
+      s^.left:=NIL; s^.right:=NIL; s^.next:=NIL;
+      Insert(s);
+    END;
+    BuildTree();
+    BuildTable(tRoot,0,0);
+  END;
+END clcTab;
+
+PROCEDURE iniHuf();
+VAR
+  i : CARDINAL;
+BEGIN
+  WITH ldt^ DO
+    FOR i:=0 TO 255 DO
+      ftbl[i]:=1;
+    END;
+    wBf:=0; wbc:=0; rb1:=0; rb2:=0; rbc:=0;
+    smc:=0;
+    clcTab();
+  END;
+END iniHuf;
+
+
+PROCEDURE RawWrite(x: IOLink.DeviceTablePtr; buf: SYSTEM.ADDRESS;
+		len: CARDINAL);
+VAR
+  i	: CARDINAL;
+  ch	: CHAR;
+  cht	: charTap;
+BEGIN
+  IF len = 0 THEN RETURN; END;
+  ldt:=SYSTEM.CAST(lclDataTp,x^.cd);
+  cht:=SYSTEM.CAST(charTap,buf);
+  WITH ldt^ DO
+    FOR i:=0 TO len-1 DO
+      ch:=cht^[i];
+      wrSmb(ch);
+      IF ch = 377C THEN wrSmb(ch); END;
+      ftbl[ORD(ch)]:=ftbl[ORD(ch)]+1; smc:=smc+1;
+      IF smc=rbldFrq THEN
+	clcTab();
+	smc:=0;
+      END;
+    END;
+  END;
+  x^.result:=IOChan.ReadResult(ldt^.chid);
+END RawWrite;
+
+PROCEDURE RawRead(x: IOLink.DeviceTablePtr; buf: SYSTEM.ADDRESS;
+		blen: CARDINAL; VAR len: CARDINAL);
+VAR
+  i	: CARDINAL;
+  cht	: charTap;
+  ch	: CHAR;
+BEGIN
+  ldt:=SYSTEM.CAST(lclDataTp,x^.cd);
+  cht:=SYSTEM.CAST(charTap,buf);
+  IF (blen=0) OR (x^.result<>IOConsts.allRight) THEN len:=0; RETURN; END;
+  WITH ldt^ DO
+    FOR i:=0 TO blen-1 DO
+      ch:=getSym();
+      IF ch = 377C THEN
+	ch:=getSym();
+	IF ch = 0C THEN
+	  x^.result:=IOConsts.endOfInput;
+	  len:=i; cht^[i]:=0C;
+	  RETURN;
+	END;
+      END;
+      cht^[i]:=ch;
+      ftbl[ORD(ch)]:=ftbl[ORD(ch)]+1; smc:=smc+1;
+      IF smc=rbldFrq THEN
+	clcTab();
+	smc:=0;
+      END;
+    END;
+    len:=blen;
+  END;
+END RawRead;
+
+PROCEDURE CreateAlias(VAR cid: ChanId; io: ChanId; VAR res: OpenResults);
+VAR
+  x	: IOLink.DeviceTablePtr;
+BEGIN
+  IOLink.MakeChan(did,cid);
+  IF cid = IOChan.InvalidChan() THEN
+    res:=ChanConsts.outOfChans
+  ELSE
+    NEW(ldt);
+    IF ldt=NIL THEN
+      IOLink.UnMakeChan(did,cid);
+      res:=ChanConsts.outOfChans;
+      RETURN;
+    END;
+    x:=IOLink.DeviceTablePtrValue(cid,did,IOChan.notAvailable,"");
+    ldt^.chid:=io;
+    x^.cd:=ldt;
+    x^.doRawWrite:=RawWrite;
+    x^.doRawRead:=RawRead;
+    res:=ChanConsts.opened;
+    iniHuf();
+    x^.result:=IOConsts.allRight;
+  END;
+END CreateAlias;
+
+PROCEDURE DeleteAlias(VAR cid: ChanId);
+VAR
+  x	: IOLink.DeviceTablePtr;
+BEGIN
+  x:=IOLink.DeviceTablePtrValue(cid,did,IOChan.notAvailable,"");
+  ldt:=x^.cd;
+  IF ldt^.rbc=0 THEN
+    wrSmb(377C);
+    wrSmb(0C);
+    flush();
+  END;
+  DISPOSE(ldt);
+  IOLink.UnMakeChan(did,cid);
+END DeleteAlias;
+
+BEGIN
+  IOLink.AllocateDeviceId(did);
+END HuffChan.
--- a/samples/PHP/root.php
+++ b/samples/PHP/root.php
@ -0,0 +1,6 @@
+<?php
+  ////////////////////////////////////
+  // I am not Isabelle ROOT         //
+  ////////////////////////////////////
+
+?>
--- a/samples/Perl/strict.t
+++ b/samples/Perl/strict.t
@ -1,4 +1,5 @@
 use Test::Base;
+use Test::More;

 __DATA__
 === Strict Test
--- a/samples/Perl6/test.p6
+++ b/samples/Perl6/test.p6
@ -73,26 +73,6 @@ Here's some POD!  Wooo

 say('this is not!');

-=table
-    Of role things
-
-say('not in your table');
-#= A single line declarator "block" (with a keyword like role)
-#| Another single line declarator "block" (with a keyword like role)
-#={}
-    A declarator block (with a keyword like role)
-  }
-#|{}
-    Another declarator block (with a keyword like role)
-  }
-#= { A single line declarator "block" with a brace (with a keyword like role)
-#=«»
-    More declarator blocks! (with a keyword like role)
-  »
-#|«»
-    More declarator blocks! (with a keyword like role)
-  »
-
 say 'Moar code!';

 my $don't = 16;
--- a/samples/SMT/bignum_lia1.smt2
+++ b/samples/SMT/bignum_lia1.smt2
@ -0,0 +1,20 @@
+(set-logic QF_LIA)
+(set-info :source | SMT-COMP'06 organizers |)
+(set-info :smt-lib-version 2.0)
+(set-info :category "check")
+(set-info :status unsat)
+(set-info :notes |This benchmark is designed to check if the DP supports bignumbers.|)
+(declare-fun x1 () Int)
+(declare-fun x2 () Int)
+(declare-fun x3 () Int)
+(declare-fun x4 () Int)
+(declare-fun x5 () Int)
+(declare-fun x6 () Int)
+(assert (and (or (>= x1 1000) (>= x1 1002)) 
+             (or (>= x2 (* 1230 x1)) (>= x2 (* 1003 x1))) 
+			 (or (>= x3 (* 1310 x2)) (>= x3 (* 1999 x2)))
+			 (or (>= x4 (* 4000 x3)) (>= x4 (* 8000 x3))) 
+			 (or (<= x5 (* (- 4000) x4)) (<= x5 (* (- 8000) x4)))
+			 (or (>= x6 (* (- 3) x5)) (>= x6 (* (- 2) x5))) (< x6 0)))
+(check-sat)
+(exit)
--- a/samples/SMT/list4.smt2
+++ b/samples/SMT/list4.smt2
@ -0,0 +1,20 @@
+(set-logic AUFLIRA)
+(set-info :source | Buggy list theorem |)
+(set-info :smt-lib-version 2.0)
+(set-info :category "crafted")
+(set-info :status sat)
+(declare-sort List 0)
+(declare-fun cons (Real List) List)
+(declare-fun nil () List)
+(declare-fun car (List) Real)
+(declare-fun cdr (List) List)
+(declare-fun len (List) Int)
+(assert (forall ((?x Real) (?y List)) (= (car (cons ?x ?y)) ?x)))
+(assert (forall ((?x Real) (?y List)) (= (cdr (cons ?x ?y)) ?y)))
+(assert (= (len nil) 0))
+(assert (forall ((?x Real) (?y List)) (= (len (cons ?x ?y)) (+ (len ?y) 1))))
+(declare-fun append (List List) List)
+(assert (forall ((?x Real) (?y1 List) (?y2 List)) (= (append (cons ?x ?y1) ?y2) (cons ?x (append ?y1 ?y2)))))
+(assert (not (forall ((?x Real) (?y List)) (= (append (cons ?x nil) ?y) (cons ?x ?y)))))
+(check-sat)
+(exit)
--- a/samples/SMT/queen10-1.smt2
+++ b/samples/SMT/queen10-1.smt2
@ -0,0 +1,123 @@
+(set-logic QF_IDL)
+(set-info :source |
+Queens benchmarks generated by Hyondeuk Kim in SMT-LIB format.
+|)
+(set-info :smt-lib-version 2.0)
+(set-info :category "crafted")
+(set-info :status sat)
+(declare-fun x0 () Int)
+(declare-fun x1 () Int)
+(declare-fun x2 () Int)
+(declare-fun x3 () Int)
+(declare-fun x4 () Int)
+(declare-fun x5 () Int)
+(declare-fun x6 () Int)
+(declare-fun x7 () Int)
+(declare-fun x8 () Int)
+(declare-fun x9 () Int)
+(declare-fun x10 () Int)
+(assert 
+  (let 
+    ((?v_0 (- x0 x10)) 
+     (?v_1 (- x1 x10)) 
+     (?v_2 (- x2 x10))
+     (?v_3 (- x3 x10))
+     (?v_4 (- x4 x10))
+     (?v_5 (- x5 x10))
+     (?v_6 (- x6 x10))
+     (?v_7 (- x7 x10))
+     (?v_8 (- x8 x10)) 
+     (?v_9 (- x9 x10)) 
+     (?v_10 (- x0 x1))
+     (?v_11 (- x0 x2))
+     (?v_12 (- x0 x3)) 
+     (?v_13 (- x0 x4))
+     (?v_14 (- x0 x5))
+     (?v_15 (- x0 x6))
+     (?v_16 (- x0 x7))
+     (?v_17 (- x0 x8))
+     (?v_18 (- x0 x9))
+     (?v_19 (- x1 x2))
+     (?v_20 (- x1 x3))
+     (?v_21 (- x1 x4))
+     (?v_22 (- x1 x5))
+     (?v_23 (- x1 x6))
+     (?v_24 (- x1 x7)) 
+     (?v_25 (- x1 x8)) 
+     (?v_26 (- x1 x9))
+     (?v_27 (- x2 x3)) 
+     (?v_28 (- x2 x4))
+     (?v_29 (- x2 x5))
+     (?v_30 (- x2 x6))
+     (?v_31 (- x2 x7))
+     (?v_32 (- x2 x8))
+     (?v_33 (- x2 x9))
+     (?v_34 (- x3 x4))
+     (?v_35 (- x3 x5))
+     (?v_36 (- x3 x6))
+     (?v_37 (- x3 x7))
+     (?v_38 (- x3 x8))
+     (?v_39 (- x3 x9))
+     (?v_40 (- x4 x5))
+     (?v_41 (- x4 x6))
+     (?v_42 (- x4 x7))
+     (?v_43 (- x4 x8))
+     (?v_44 (- x4 x9))
+     (?v_45 (- x5 x6))
+     (?v_46 (- x5 x7))
+     (?v_47 (- x5 x8)) 
+     (?v_48 (- x5 x9))
+     (?v_49 (- x6 x7))
+     (?v_50 (- x6 x8))
+     (?v_51 (- x6 x9))
+     (?v_52 (- x7 x8))
+     (?v_53 (- x7 x9)) 
+     (?v_54 (- x8 x9))) 
+  (and (<= ?v_0 9) (>= ?v_0 0) (<= ?v_1 9) (>= ?v_1 0) (<= ?v_2 9) (>= ?v_2 0) 
+       (<= ?v_3 9) (>= ?v_3 0) (<= ?v_4 9) (>= ?v_4 0) (<= ?v_5 9) (>= ?v_5 0) 
+       (<= ?v_6 9) (>= ?v_6 0) (<= ?v_7 9) (>= ?v_7 0) (<= ?v_8 9) (>= ?v_8 0) 
+       (<= ?v_9 9) (>= ?v_9 0)
+       (not (= x0 x1)) (not (= x0 x2)) (not (= x0 x3)) (not (= x0 x4))
+       (not (= x0 x5)) (not (= x0 x6)) (not (= x0 x7)) (not (= x0 x8)) 
+       (not (= x0 x9)) (not (= x1 x2)) (not (= x1 x3)) (not (= x1 x4)) 
+       (not (= x1 x5)) (not (= x1 x6)) (not (= x1 x7)) (not (= x1 x8)) 
+       (not (= x1 x9)) (not (= x2 x3)) (not (= x2 x4)) (not (= x2 x5)) 
+       (not (= x2 x6)) (not (= x2 x7)) (not (= x2 x8)) (not (= x2 x9))
+       (not (= x3 x4)) (not (= x3 x5)) (not (= x3 x6)) (not (= x3 x7)) 
+       (not (= x3 x8)) (not (= x3 x9)) (not (= x4 x5)) (not (= x4 x6)) 
+       (not (= x4 x7)) (not (= x4 x8)) (not (= x4 x9)) (not (= x5 x6)) 
+       (not (= x5 x7)) (not (= x5 x8)) (not (= x5 x9)) (not (= x6 x7)) 
+       (not (= x6 x8)) (not (= x6 x9)) (not (= x7 x8)) (not (= x7 x9)) 
+       (not (= x8 x9)) 
+       (not (= ?v_10 1)) (not (= ?v_10 (- 1))) (not (= ?v_11 2)) 
+       (not (= ?v_11 (- 2))) (not (= ?v_12 3)) (not (= ?v_12 (- 3))) 
+       (not (= ?v_13 4)) (not (= ?v_13 (- 4))) (not (= ?v_14 5)) 
+       (not (= ?v_14 (- 5))) (not (= ?v_15 6)) (not (= ?v_15 (- 6)))
+       (not (= ?v_16 7)) (not (= ?v_16 (- 7))) (not (= ?v_17 8)) 
+       (not (= ?v_17 (- 8))) (not (= ?v_18 9)) (not (= ?v_18 (- 9))) 
+       (not (= ?v_19 1)) (not (= ?v_19 (- 1))) (not (= ?v_20 2)) 
+       (not (= ?v_20 (- 2))) (not (= ?v_21 3)) (not (= ?v_21 (- 3))) 
+       (not (= ?v_22 4)) (not (= ?v_22 (- 4))) (not (= ?v_23 5)) 
+       (not (= ?v_23 (- 5))) (not (= ?v_24 6)) (not (= ?v_24 (- 6))) 
+       (not (= ?v_25 7)) (not (= ?v_25 (- 7))) (not (= ?v_26 8)) 
+       (not (= ?v_26 (- 8))) (not (= ?v_27 1)) (not (= ?v_27 (- 1))) 
+       (not (= ?v_28 2)) (not (= ?v_28 (- 2))) (not (= ?v_29 3)) 
+       (not (= ?v_29 (- 3))) (not (= ?v_30 4)) (not (= ?v_30 (- 4))) 
+       (not (= ?v_31 5)) (not (= ?v_31 (- 5))) (not (= ?v_32 6))
+       (not (= ?v_32 (- 6))) (not (= ?v_33 7)) (not (= ?v_33 (- 7))) 
+       (not (= ?v_34 1)) (not (= ?v_34 (- 1))) (not (= ?v_35 2)) 
+       (not (= ?v_35 (- 2))) (not (= ?v_36 3)) (not (= ?v_36 (- 3)))
+       (not (= ?v_37 4)) (not (= ?v_37 (- 4))) (not (= ?v_38 5)) 
+       (not (= ?v_38 (- 5))) (not (= ?v_39 6)) (not (= ?v_39 (- 6))) 
+       (not (= ?v_40 1)) (not (= ?v_40 (- 1))) (not (= ?v_41 2)) 
+       (not (= ?v_41 (- 2))) (not (= ?v_42 3)) (not (= ?v_42 (- 3)))
+       (not (= ?v_43 4)) (not (= ?v_43 (- 4))) (not (= ?v_44 5))
+       (not (= ?v_44 (- 5))) (not (= ?v_45 1)) (not (= ?v_45 (- 1))) 
+       (not (= ?v_46 2)) (not (= ?v_46 (- 2))) (not (= ?v_47 3)) 
+       (not (= ?v_47 (- 3))) (not (= ?v_48 4)) (not (= ?v_48 (- 4))) 
+       (not (= ?v_49 1)) (not (= ?v_49 (- 1))) (not (= ?v_50 2)) 
+       (not (= ?v_50 (- 2))) (not (= ?v_51 3)) (not (= ?v_51 (- 3))) 
+       (not (= ?v_52 1)) (not (= ?v_52 (- 1))) (not (= ?v_53 2)) 
+       (not (= ?v_53 (- 2))) (not (= ?v_54 1)) (not (= ?v_54 (- 1))))))
+(check-sat)
+(exit)
--- a/samples/SMT/shufflevector.smt
+++ b/samples/SMT/shufflevector.smt
--- a/samples/XML/xhtml-struct-1.mod
+++ b/samples/XML/xhtml-struct-1.mod
@ -0,0 +1,125 @@
+<!-- ...................................................................... -->
+<!-- XHTML Structure Module  .............................................. -->
+<!-- file: xhtml-struct-1.mod
+
+     This is XHTML, a reformulation of HTML as a modular XML application.
+     Copyright 1998-2000 W3C (MIT, INRIA, Keio), All Rights Reserved.
+     Revision: $Id: xhtml-struct-1.mod,v 1.1.1.1 2006/01/09 19:23:30 rcrews Exp $ SMI
+
+     This DTD module is identified by the PUBLIC and SYSTEM identifiers:
+
+       PUBLIC "-//W3C//ELEMENTS XHTML Document Structure 1.0//EN"
+       SYSTEM "http://www.w3.org/TR/xhtml-modulatization/DTD/xhtml-struct-1.mod"
+
+     Revisions:
+     (none)
+     ....................................................................... -->
+
+<!-- Document Structure
+
+        title, head, body, html
+
+     The Structure Module defines the major structural elements and 
+     their attributes.
+
+     Note that the content model of the head element type is redeclared 
+     when the Base Module is included in the DTD.
+
+     The parameter entity containing the XML namespace URI value used 
+     for XHTML is '%XHTML.xmlns;', defined in the Qualified Names module.
+-->
+
+<!-- title: Document Title ............................. -->
+
+<!-- The title element is not considered part of the flow of text.
+     It should be displayed, for example as the page header or
+     window title. Exactly one title is required per document.
+-->
+
+<!ENTITY % title.element  "INCLUDE" >
+<![%title.element;[
+<!ENTITY % title.content  "( #PCDATA )" >
+<!ENTITY % title.qname  "title" >
+<!ELEMENT %title.qname;  %title.content; >
+<!-- end of title.element -->]]>
+
+<!ENTITY % title.attlist  "INCLUDE" >
+<![%title.attlist;[
+<!ATTLIST %title.qname;
+      %XHTML.xmlns.attrib; 
+      %I18n.attrib;
+>
+<!-- end of title.attlist -->]]>
+
+<!-- head: Document Head ............................... -->
+
+<!ENTITY % head.element  "INCLUDE" >
+<![%head.element;[
+<!ENTITY % head.content
+    "( %HeadOpts.mix;, %title.qname;, %HeadOpts.mix; )"
+>
+<!ENTITY % head.qname  "head" >
+<!ELEMENT %head.qname;  %head.content; >
+<!-- end of head.element -->]]>
+
+<!ENTITY % head.attlist  "INCLUDE" >
+<![%head.attlist;[
+<!-- reserved for future use with document profiles
+-->
+<!ENTITY % profile.attrib
+     "profile      %URI.datatype;           '%XHTML.profile;'"
+>
+
+<!ATTLIST %head.qname;
+      %XHTML.xmlns.attrib; 
+      %I18n.attrib;
+      %profile.attrib;
+>
+<!-- end of head.attlist -->]]>
+
+<!-- body: Document Body ............................... -->
+
+<!ENTITY % body.element  "INCLUDE" >
+<![%body.element;[
+<!ENTITY % body.content
+     "( %Block.mix; )+"
+>
+<!ENTITY % body.qname  "body" >
+<!ELEMENT %body.qname;  %body.content; >
+<!-- end of body.element -->]]>
+
+<!ENTITY % body.attlist  "INCLUDE" >
+<![%body.attlist;[
+<!ATTLIST %body.qname;
+      %Common.attrib;
+>
+<!-- end of body.attlist -->]]>
+
+<!-- html: XHTML Document Element ...................... -->
+
+<!ENTITY % html.element  "INCLUDE" >
+<![%html.element;[
+<!ENTITY % html.content  "( %head.qname;, %body.qname; )" >
+<!ENTITY % html.qname  "html" >
+<!ELEMENT %html.qname;  %html.content; >
+<!-- end of html.element -->]]>
+
+<!ENTITY % html.attlist  "INCLUDE" >
+<![%html.attlist;[
+<!-- version attribute value defined in driver
+-->
+<!ENTITY % XHTML.version.attrib
+     "version      %FPI.datatype;           #FIXED '%XHTML.version;'"
+>
+
+<!-- see the Qualified Names module for information 
+     on how to extend XHTML using XML namespaces 
+-->
+<!ATTLIST %html.qname;
+      %XHTML.xmlns.attrib; 
+      %XHTML.version.attrib;
+      %I18n.attrib;
+>
+<!-- end of html.attlist -->]]>
+
+<!-- end of xhtml-struct-1.mod -->
--- a/test/fixtures/Generated/ABM8G.mod
+++ b/test/fixtures/Generated/ABM8G.mod
@ -0,0 +1,50 @@
+PCBNEW-LibModule-V1  Wed 10 Aug 2011 05:57:27 PM COT
+# encoding utf-8
+$INDEX
+ABM8G
+$EndINDEX
+$MODULE ABM8G
+Po 0 0 0 15 4E430CBD 4E430CC5 ~~
+Li ABM8G
+Sc 4E430CC5
+AR 
+Op 0 0 0
+T0 591 -1378 354 354 0 39 N V 21 N "ABM8G"
+T1 0 787 354 354 0 39 N V 21 N "VAL**"
+DS -591 394 1299 394 79 21
+DS 1299 394 1299 -1063 79 21
+DS 1299 -1063 -472 -1063 79 21
+DS -472 -1063 -472 472 79 21
+DS -472 472 -472 551 79 21
+DS -472 551 -591 551 79 21
+DS -591 551 -591 433 79 21
+$PAD
+Sh "1" R 551 472 0 0 0
+Dr 0 0 0
+At SMD N 00888000
+Ne 0 ""
+Po 0 0
+$EndPAD
+$PAD
+Sh "2" R 551 472 0 0 0
+Dr 0 0 0
+At SMD N 00888000
+Ne 0 ""
+Po 866 0
+$EndPAD
+$PAD
+Sh "3" R 551 472 0 0 0
+Dr 0 0 0
+At SMD N 00888000
+Ne 0 ""
+Po 866 -669
+$EndPAD
+$PAD
+Sh "4" R 551 472 0 0 0
+Dr 0 0 0
+At SMD N 00888000
+Ne 0 ""
+Po 0 -669
+$EndPAD
+$EndMODULE  ABM8G
+$EndLIBRARY
--- a/test/fixtures/Generated/ms2.mod
+++ b/test/fixtures/Generated/ms2.mod
@ -0,0 +1,19 @@
+GFORTRAN module version '0' created from ms2.f90 on Thu Sep  5 10:09:19 2013
+MD5:8a80cd5db1bc612a28603959302dbf37 -- If you edit this, you'll get what you deserve.
+
+(() () () () () () () () () () () () () () () () () () () () () () () ()
+() () ())
+
+()
+
+()
+
+()
+
+()
+
+(2 'ms2' 'ms2' 'ms2' 1 ((MODULE UNKNOWN-INTENT UNKNOWN-PROC UNKNOWN
+UNKNOWN) (UNKNOWN 0 0 0 UNKNOWN ()) 0 0 () () 0 () () () 0 0)
+)
+
+('ms2' 0 2)
--- a/test/fixtures/SVG/alg_schema.link.svg
+++ b/test/fixtures/SVG/alg_schema.link.svg
@ -0,0 +1 @@
+alg_schema.svg
--- a/test/fixtures/SVG/alg_schema.svg
+++ b/test/fixtures/SVG/alg_schema.svg
@ -0,0 +1,269 @@
+<?xml version="1.0" encoding="UTF-8" standalone="no"?>
+<!-- Created with Inkscape (http://www.inkscape.org/) -->
+
+<svg
+   xmlns:dc="http://purl.org/dc/elements/1.1/"
+   xmlns:cc="http://creativecommons.org/ns#"
+   xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
+   xmlns:svg="http://www.w3.org/2000/svg"
+   xmlns="http://www.w3.org/2000/svg"
+   xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
+   xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
+   width="744.09448819"
+   height="1052.3622047"
+   id="svg2"
+   version="1.1"
+   inkscape:version="0.48.0 r9654"
+   sodipodi:docname="alg_schema.svg">
+  <defs
+     id="defs4" />
+  <sodipodi:namedview
+     id="base"
+     pagecolor="#ffffff"
+     bordercolor="#666666"
+     borderopacity="1.0"
+     inkscape:pageopacity="0.0"
+     inkscape:pageshadow="2"
+     inkscape:zoom="0.834386"
+     inkscape:cx="409.42881"
+     inkscape:cy="681.83774"
+     inkscape:document-units="px"
+     inkscape:current-layer="g3759"
+     showgrid="false"
+     inkscape:window-width="1280"
+     inkscape:window-height="993"
+     inkscape:window-x="1280"
+     inkscape:window-y="31"
+     inkscape:window-maximized="0"
+     showguides="true"
+     inkscape:snap-global="false">
+    <inkscape:grid
+       type="xygrid"
+       id="grid3914" />
+  </sodipodi:namedview>
+  <metadata
+     id="metadata7">
+    <rdf:RDF>
+      <cc:Work
+         rdf:about="">
+        <dc:format>image/svg+xml</dc:format>
+        <dc:type
+           rdf:resource="http://purl.org/dc/dcmitype/StillImage" />
+        <dc:title></dc:title>
+      </cc:Work>
+    </rdf:RDF>
+  </metadata>
+  <g
+     inkscape:label="Layer 1"
+     inkscape:groupmode="layer"
+     id="layer1">
+    <g
+       id="g3759"
+       transform="translate(-3.3909149,-21.218048)">
+      <rect
+         ry="11.855058"
+         rx="14.468504"
+         y="138.58023"
+         x="108.08632"
+         height="66.263969"
+         width="247.48737"
+         id="rect2985"
+         style="fill:#1f3d55;fill-opacity:1;fill-rule:evenodd;stroke:#3f5d75;stroke-width:5;stroke-linecap:round;stroke-linejoin:miter;stroke-miterlimit:4;stroke-opacity:1;stroke-dasharray:none;stroke-dashoffset:0" />
+      <text
+         sodipodi:linespacing="125%"
+         id="text3755"
+         y="163.58023"
+         x="238.39091"
+         style="font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;font-stretch:normal;line-height:125%;letter-spacing:0px;word-spacing:0px;fill:#ffffff;fill-opacity:1;stroke:none;font-family:Bitstream Vera Sans;-inkscape-font-specification:Bitstream Vera Sans"
+         xml:space="preserve"><tspan
+           style="font-size:24px;text-align:center;text-anchor:middle;fill:#ffffff;fill-opacity:1"
+           y="163.58023"
+           x="238.39091"
+           id="tspan3757"
+           sodipodi:role="line">Sequence KEY</tspan><tspan
+           style="font-size:24px;text-align:center;text-anchor:middle;fill:#ffffff;fill-opacity:1"
+           y="193.58023"
+           x="238.39091"
+           sodipodi:role="line"
+           id="tspan4055">256 bits</tspan></text>
+    </g>
+    <g
+       id="g3870"
+       transform="translate(-0.73178617,29.27145)">
+      <g
+         id="g3759-5"
+         transform="translate(-0.40143056,286.32219)">
+        <rect
+           style="fill:#1f3d55;fill-opacity:1;fill-rule:evenodd;stroke:#3f5d75;stroke-width:5;stroke-linecap:round;stroke-linejoin:miter;stroke-miterlimit:4;stroke-opacity:1;stroke-dasharray:none;stroke-dashoffset:0"
+           id="rect2985-5"
+           width="247.48737"
+           height="74.751289"
+           x="108.08632"
+           y="130.09291"
+           rx="14.468504"
+           ry="13.373494" />
+        <flowRoot
+           transform="translate(2.4712344,-292.01415)"
+           style="font-size:24px;font-style:normal;font-variant:normal;font-weight:normal;font-stretch:normal;text-align:center;line-height:125%;letter-spacing:0px;word-spacing:0px;text-anchor:middle;fill:#ffffff;fill-opacity:1;stroke:none;font-family:Bitstream Vera Sans;-inkscape-font-specification:Bitstream Vera Sans"
+           id="flowRoot3797"
+           xml:space="preserve"><flowRegion
+             id="flowRegion3799"><rect
+               style="font-size:24px;text-align:center;text-anchor:middle;fill:#ffffff;fill-opacity:1"
+               y="428.79074"
+               x="125"
+               height="58.346195"
+               width="86.479271"
+               id="rect3801" /></flowRegion><flowPara
+             id="flowPara3805">Salt</flowPara><flowPara
+             id="flowPara3841">96 bits</flowPara></flowRoot>        <flowRoot
+           transform="translate(115.26831,-291.40674)"
+           style="font-size:24px;font-style:normal;font-variant:normal;font-weight:normal;font-stretch:normal;text-align:center;line-height:125%;letter-spacing:0px;word-spacing:0px;text-anchor:middle;fill:#ffffff;fill-opacity:1;stroke:none;font-family:Bitstream Vera Sans;-inkscape-font-specification:Bitstream Vera Sans"
+           id="flowRoot3797-6"
+           xml:space="preserve"><flowRegion
+             id="flowRegion3799-5"><rect
+               style="font-size:24px;text-align:center;text-anchor:middle;fill:#ffffff;fill-opacity:1"
+               y="428.79074"
+               x="125"
+               height="60.933453"
+               width="104.07261"
+               id="rect3801-6" /></flowRegion><flowPara
+             id="flowPara3805-9">Counter</flowPara><flowPara
+             id="flowPara3809-3">32 bits</flowPara></flowRoot>        <path
+           inkscape:connector-curvature="0"
+           id="path3845"
+           d="m 229.11476,138.88943 0,57.95451"
+           style="fill:none;stroke:#ffffff;stroke-width:3;stroke-linecap:butt;stroke-linejoin:miter;stroke-miterlimit:4;stroke-opacity:1;stroke-dasharray:none" />
+      </g>
+    </g>
+    <g
+       transform="matrix(0.6979728,0,0,0.6979728,71.363842,197.71804)"
+       id="g3759-7">
+      <rect
+         ry="13.373494"
+         rx="14.297379"
+         y="130.09291"
+         x="108.08632"
+         height="74.751289"
+         width="244.56023"
+         id="rect2985-4"
+         style="fill:#1f3d55;fill-opacity:1;fill-rule:evenodd;stroke:#3f5d75;stroke-width:7.16360283;stroke-linecap:round;stroke-linejoin:miter;stroke-miterlimit:4;stroke-opacity:1;stroke-dasharray:none;stroke-dashoffset:0" />
+      <text
+         sodipodi:linespacing="125%"
+         id="text3755-5"
+         y="178.58023"
+         x="141.31805"
+         style="font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;font-stretch:normal;line-height:125%;letter-spacing:0px;word-spacing:0px;fill:#beff83;fill-opacity:1;stroke:none;font-family:Bitstream Vera Sans;-inkscape-font-specification:Bitstream Vera Sans"
+         xml:space="preserve"><tspan
+           style="font-size:32px;fill:#beff83;fill-opacity:1"
+           y="178.58023"
+           x="141.31805"
+           id="tspan3757-2"
+           sodipodi:role="line">AES Cipher</tspan></text>
+    </g>
+    <path
+       style="fill:#6ea1cc;stroke:#000000;stroke-width:1px;stroke-linecap:butt;stroke-linejoin:miter;stroke-opacity:1;fill-opacity:1"
+       d="m 225,437.36218 0,-50 -15,5 25,-35 25,35 -15,-5 0,50 z"
+       id="path3912"
+       inkscape:connector-curvature="0"
+       sodipodi:nodetypes="cccccccc" />
+    <path
+       style="fill:#6ea1cc;fill-opacity:1;stroke:#000000;stroke-width:1px;stroke-linecap:butt;stroke-linejoin:miter;stroke-opacity:1"
+       d="m 340,302.36218 50,0 -5,-15 35,25 -35,25 5,-15 -50,0 z"
+       id="path3912-5"
+       inkscape:connector-curvature="0"
+       sodipodi:nodetypes="cccccccc" />
+    <path
+       style="fill:#6ea1cc;fill-opacity:1;stroke:#000000;stroke-width:1px;stroke-linecap:butt;stroke-linejoin:miter;stroke-opacity:1"
+       d="m 245,192.36218 0,50 15,-5 -25,35 -25,-35 15,5 0,-50 z"
+       id="path3912-4"
+       inkscape:connector-curvature="0"
+       sodipodi:nodetypes="cccccccc" />
+    <g
+       transform="matrix(0.6979728,0,0,0.6979728,361.36384,197.71804)"
+       id="g3759-7-7">
+      <rect
+         ry="13.373494"
+         rx="17.857012"
+         y="130.09291"
+         x="108.08632"
+         height="74.751289"
+         width="305.44867"
+         id="rect2985-4-4"
+         style="fill:#1f3d55;fill-opacity:1;fill-rule:evenodd;stroke:#3f5d75;stroke-width:7.16360283;stroke-linecap:round;stroke-linejoin:miter;stroke-miterlimit:4;stroke-opacity:1;stroke-dasharray:none;stroke-dashoffset:0" />
+      <text
+         sodipodi:linespacing="125%"
+         id="text3755-5-4"
+         y="159.80484"
+         x="255.9357"
+         style="font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;font-stretch:normal;line-height:125%;letter-spacing:0px;word-spacing:0px;fill:#beff83;fill-opacity:1;stroke:none;font-family:Bitstream Vera Sans;-inkscape-font-specification:Bitstream Vera Sans"
+         xml:space="preserve"><tspan
+           style="font-size:25.78897095px;text-align:center;text-anchor:middle;fill:#beff83;fill-opacity:1"
+           y="159.80484"
+           x="255.9357"
+           sodipodi:role="line"
+           id="tspan3979">Secure random data</tspan><tspan
+           style="font-size:25.78897095px;text-align:center;text-anchor:middle;fill:#beff83;fill-opacity:1"
+           y="192.04105"
+           x="255.9357"
+           sodipodi:role="line"
+           id="tspan3983">128 bits</tspan></text>
+    </g>
+    <path
+       style="fill:#6ea1cc;fill-opacity:1;stroke:#000000;stroke-width:1px;stroke-linecap:butt;stroke-linejoin:miter;stroke-opacity:1;opacity:0.45614035"
+       d="m 550,352.36218 0,50 15,-5 -25,35 -25,-35 15,5 0,-50 z"
+       id="path3912-5-0"
+       inkscape:connector-curvature="0"
+       sodipodi:nodetypes="cccccccc" />
+    <text
+       xml:space="preserve"
+       style="font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;font-stretch:normal;line-height:125%;letter-spacing:0px;word-spacing:0px;fill:#000000;fill-opacity:1;stroke:none;font-family:Bitstream Vera Sans;-inkscape-font-specification:Bitstream Vera Sans"
+       x="540"
+       y="382.36218"
+       id="text4003"
+       sodipodi:linespacing="125%"><tspan
+         sodipodi:role="line"
+         x="540"
+         y="382.36218"
+         id="tspan4007"
+         style="font-size:16px;text-align:center;text-anchor:middle">Division by alphabet length</tspan><tspan
+         sodipodi:role="line"
+         x="540"
+         y="402.36218"
+         style="font-size:16px;text-align:center;text-anchor:middle"
+         id="tspan4053">repeated passcode-length times.</tspan></text>
+    <g
+       transform="matrix(0.6979728,0,0,0.6979728,344.55869,369.3865)"
+       id="g3759-7-7-7">
+      <g
+         id="g4045"
+         transform="translate(-1.21417,-6.070852)">
+        <rect
+           style="fill:#1f3d55;fill-opacity:1;fill-rule:evenodd;stroke:#3f5d75;stroke-width:7.16360283;stroke-linecap:round;stroke-linejoin:miter;stroke-miterlimit:4;stroke-opacity:1;stroke-dasharray:none;stroke-dashoffset:0"
+           id="rect2985-4-4-8"
+           width="305.44867"
+           height="74.751289"
+           x="131.15555"
+           y="130.09291"
+           rx="17.857012"
+           ry="13.373494" />
+        <text
+           xml:space="preserve"
+           style="font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;font-stretch:normal;line-height:125%;letter-spacing:0px;word-spacing:0px;fill:#beff83;fill-opacity:1;stroke:none;font-family:Bitstream Vera Sans;-inkscape-font-specification:Bitstream Vera Sans"
+           x="283.77673"
+           y="158.71724"
+           id="text3755-5-4-6"
+           sodipodi:linespacing="125%"><tspan
+             id="tspan3983-8"
+             sodipodi:role="line"
+             x="283.77673"
+             y="158.71724"
+             style="font-size:25.78897095px;text-align:center;text-anchor:middle;fill:#beff83;fill-opacity:1">Passcode</tspan><tspan
+             id="tspan4043"
+             sodipodi:role="line"
+             x="283.77673"
+             y="190.95346"
+             style="font-size:25.78897095px;text-align:center;text-anchor:middle;fill:#beff83;fill-opacity:1">2-16 characters</tspan></text>
+      </g>
+    </g>
+  </g>
+</svg>
--- a/test/test_blob.rb
+++ b/test/test_blob.rb
@ -279,6 +279,9 @@ class TestBlob < Minitest::Test
    # Rails vendor/
    assert sample_blob("vendor/plugins/will_paginate/lib/will_paginate.rb").vendored?

+    # Vendor/
+    assert sample_blob("Vendor/my_great_file.h").vendored?
+
    # 'thirdparty' directory
    assert sample_blob("thirdparty/lib/main.c").vendored?

@ -480,6 +483,12 @@ class TestBlob < Minitest::Test

    # Vagrant
    assert sample_blob("puphpet/file.pp").vendored?
+
+    # Fabric.io
+    assert sample_blob("Fabric.framework/Fabric.h").vendored?
+
+    # Crashlytics
+    assert sample_blob("Crashlytics.framework/Crashlytics.h").vendored?
  end

  def test_documentation
@ -551,6 +560,8 @@ class TestBlob < Minitest::Test
        blob = fixture_blob(filepath)
        if language == 'Data'
          assert blob.language.nil?, "A language was found for #{filepath}"
+        elsif language == 'Generated'
+          assert blob.generated?, "#{filepath} is not a generated file"
        else
          assert blob.language, "No language for #{filepath}"
          assert_equal language, blob.language.name, blob.name
--- a/vendor/grammars/Handlebars
+++ b/vendor/grammars/Handlebars
@ -1 +1 @@
-Subproject commit e331daf0597f9df978403520ee8583e08892e9eb
+Subproject commit 60532f35cf89ce8d7e3354ed2f81cc131e80b614
--- a/vendor/grammars/NimLime
+++ b/vendor/grammars/NimLime
@ -1 +1 @@
-Subproject commit 4ab90608c10745de2cacba7490082ba7871f01e1
+Subproject commit 4acce8b67be537df6e23e9aab92c0427c37437a5
--- a/vendor/grammars/SMT.tmbundle
+++ b/vendor/grammars/SMT.tmbundle
@ -0,0 +1 @@
+Subproject commit 5b8231f5165f0a2147445783705e99f468be7a84
--- a/vendor/grammars/Sublime-Modula-2
+++ b/vendor/grammars/Sublime-Modula-2
@ -0,0 +1 @@
+Subproject commit f30f2fbe3b103bef939b830261bcd595f8951c28
--- a/vendor/grammars/atom-fsharp
+++ b/vendor/grammars/atom-fsharp
@ -1 +1 @@
-Subproject commit 919a4d895a8be3d97a8dd6eb197350d97b8e1ed1
+Subproject commit 55785b6af0115aa49ed3fc2b3c3edb02a5305068
--- a/vendor/grammars/carto-atom
+++ b/vendor/grammars/carto-atom
@ -1 +1 @@
-Subproject commit 60c8774b025cf5baa2de7d1b31a965f05d01af51
+Subproject commit 989590932359d32462c4904c5a71180aeda409d2
--- a/vendor/grammars/css.tmbundle
+++ b/vendor/grammars/css.tmbundle
@ -1 +1 @@
-Subproject commit 2ce91736ca17bbf72ca13ef82ff23c90cc01bf8f
+Subproject commit 94f7111c2953ac7b4cc42d313d9ad9b8701b8468
--- a/vendor/grammars/d.tmbundle
+++ b/vendor/grammars/d.tmbundle
@ -1 +1 @@
-Subproject commit ccb8b6ba11def16841d22852cb6e942cbcdd8974
+Subproject commit f7953e41fdf40e49113852b07146478783f08139
--- a/vendor/grammars/factor
+++ b/vendor/grammars/factor
@ -1 +1 @@
-Subproject commit 3705d6e387aea3f065581c76e0e0f32eaf1c51ef
+Subproject commit 0124e630f014071a35bbea43db745e3aaa3491a6
--- a/vendor/grammars/haxe-sublime-bundle
+++ b/vendor/grammars/haxe-sublime-bundle
@ -1 +1 @@
-Subproject commit 7fb8855dd62691b63aa4e6023780aeaaef7cb977
+Subproject commit 810b34b259f04e6dc30a03096d3cfe16b70f4ba9
--- a/vendor/grammars/jade-tmbundle
+++ b/vendor/grammars/jade-tmbundle
@ -1 +1 @@
-Subproject commit 4197de8b70bce0b58202d28f5f824b3ba1cec5a7
+Subproject commit 9ad91309a4e5bbe87fdc0e1e660a82aa94be1794
--- a/vendor/grammars/language-clojure
+++ b/vendor/grammars/language-clojure
@ -1 +1 @@
-Subproject commit 81e089cc55b6526aca10133372df83b13cd3f6bc
+Subproject commit 04e308ae4c70d00eb38cb4d4211b5c27ae5bdce5
--- a/vendor/grammars/language-javascript
+++ b/vendor/grammars/language-javascript
@ -1 +1 @@
-Subproject commit 601cb6cb8f80e03e7eaa5695515d6366fb2b6d18
+Subproject commit e26b8c50a3ee02cb1d922d82ca66c9b75d06f052
--- a/vendor/grammars/language-jsoniq
+++ b/vendor/grammars/language-jsoniq
@ -1 +1 @@
-Subproject commit 20214d61b412d53c2624f1a385ad27236f05a375
+Subproject commit 7a971acf1c2001e6b2e9afc7b69b6ff8a2ae39ce
--- a/vendor/grammars/language-python
+++ b/vendor/grammars/language-python
@ -1 +1 @@
-Subproject commit db14372b475bf41f0f01032076ba53b3940fb80a
+Subproject commit 7271315c858451ad302ebce2c5db2eee528013cc
--- a/vendor/grammars/perl.tmbundle
+++ b/vendor/grammars/perl.tmbundle
@ -1 +1 @@
-Subproject commit 4b768e2ce11adc7926fd31cf5c9a3b83e05d05ca
+Subproject commit fd81fe586b928b4c2852b43472b37bdc45a6d074
--- a/vendor/grammars/sas.tmbundle
+++ b/vendor/grammars/sas.tmbundle
@ -1 +1 @@
-Subproject commit a9689f436f49b1aa8f882119bdd8d77172af0501
+Subproject commit 43a05b10fc76b34946a1188fd2a9c2171dbf3fe4
--- a/vendor/grammars/sublime-mask
+++ b/vendor/grammars/sublime-mask
@ -1 +1 @@
-Subproject commit a7f3baacf61d168c59554ccea07e89df016dbfb9
+Subproject commit bd37c4e7537f0fae03d55c02891a5f2500562faf
--- a/vendor/grammars/sublime-text-ox
+++ b/vendor/grammars/sublime-text-ox
@ -1 +1 @@
-Subproject commit 10ca88362c6e4853744fc6b17ed06cc45dc033fa
+Subproject commit ed96fb6afc0321c7d3ce219d69b56c591f0938a0
				`@ -0,0 +1 @@`
				`Subproject commit 5b8231f5165f0a2147445783705e99f468be7a84`
				`@ -0,0 +1 @@`
				`Subproject commit f30f2fbe3b103bef939b830261bcd595f8951c28`