Complex multi-level statement annotations are not correctly parsed

[chrfrantz]

Example:

[stmt=isprov,isprod,isout,iscoll;poly=dopint;fchar=y;fchartrue=0]{[stmt=isprov,isout;poly=0;fchar=y;fchartrue=0]A[atype=int](Contracting Governments) D[str=4](shall) I[rtype=info](provide) Bind,p([to]) Bind[atype=int]([Secretariat]) the Secretary to the International Whaling Commission with Bdir,p(proposed) Bdir[ctx=approp,exempt](scientific permits) Cex[ctx=evt,tmp](before [scientific permits] are issued [AND] in sufficient time to allow the Scientific Committee to (review [AND] comment) on [scientific permits]) [AND]

{[stmt=isprov,isout;poly=dopint;fchar=y;fchartrue=0]A[atype=int]([Secretariat]) D[str=4]([shall]) I[rtype=info]([send]) Bdir[ctx=approp,exempt]([scientific permits]) Bdir,p([received from Contracting Governments]) Bind,p([to]) Bind[atype=int]([Scientific Committee]) [AND]
{[stmt=iscoll,isprod,isout;poly=dopint;fchar=y;fchartrue=1]A[atype=int](Scientific Committee) is required D[str=4]([shall]) to I[rtype=agg,info](review [AND] comment) on Bdir,p(proposed) Bdir[ctx=approp,exempt](scientific permits) Bind,p([received from]) Bind[atype=int]([Secretariat]) Cex[ctx=prc](as stipulated under paragraph 30 of the Schedule to the Convention), [AND]

and that it is appropriate for the 
{[stmt=iscoll,isprod,isout;poly=dopint;fchar=y;fchartrue=1]A[atype=int](Commission) to D[str=4]([shall]) I[rtype=info,agg](receive [AND] consider) the Bdir[exp,approp,exempt,cmpl](reports [AND] recommendations) Bdir,p(of the Scientific Committee) Bind,p([received from]) Bind[atype=int]([Secretariat]) [AND] 

[stmt=iscoll,isprod,isout;poly=dopint;fchar=y;fchartrue=1]A[atype=int]([Commission]) D[str=4]([shall]) I[rtype=agg](make) Bdir,p(such) Bdir[ctx=exp,approp,exempt,cmpl](recommendations) Bdir,p(under Article VI of the Convention) Bind,p([to]) Bind[atype=int]([Contracting Governments]) Cex[ctx=dom](as it sees fit)}}}};

This statement contains component, statement-level and meta-level annotations (i.e., annotations spanning across different statements). In visual output, the statement-level annotations are retained and displayed, while the meta-level annotation is lost. In the tabular output, no annotation is present. However, if separating the annotation by whitespace from the rest (i.e., [stmt=isprov,isprod,isout,iscoll;poly=dopint;fchar=y;fchartrue=0] { ...), this annotation presents in tabular output. Similarly, it is then also reflected in the visual output. However, in visual output, it is concatenated with statement-level annotations.

Desired behavior:

• Robustly parse statement-level annotations to make them analytically useful in either output format (see below)
• In tabular output: Concatenate top-level and lower-level statement annotations and output those in column Statement Annotation. Syntax in tabular output: [top-level annotation][lower-level annotation]
• In visual output: Display statement-level annotations in accordance with level of annotation (top level vs. statement level), but do not combine/concatenate.

[chrfrantz]

This issue is probably interacting with #31

[chrfrantz]

Statement ID in original dataset: R2016-2_001

[chrfrantz]

Similar case for [ROP_013]:

Difference here is that no meta-level annotation exists, i.e., the visual output is correct (given that no top-level annotations exists). This statement should be used as an acid test for the fix in response to the above.

Raw statement:

2. Notwithstanding the advance notice requirements for draft Resolutions in Rule J.1, at the recommendation of the Chair in consultation with the Bureau, the Commission may decide to consider urgent draft Resolutions which arise after the 60-day deadline where there have been important developments that warrant action in the Commission. The full draft text of any such Resolution must be circulated to all Commissioners prior to the opening of the meeting at which the draft Resolution is to be considered.

Encoded statement:

{Cac[ctx=dom](at the recommendation of the [Commission] Chair [AND] in consultation with the Bureau), the A[atype=int](Commission) [stmt=iscoll;poly=dopint;fchar=n;fchartrue=0] D[str=3](may) I[rtype=choice](decide to consider) Bdir,p(urgent draft) Bdir[ctx=prc](Resolutions) Bdir,p(which arise after the 60-day deadline) Cac[ctx=dom](where there have been important developments that warrant action in the Commission) Bind,p([submitted by]) Bind[atype=int]([Contracting Party]). [AND] 
The A[atype=int]([Secretariat]) [stmt=isprov;poly=dopint;fchar=n;fchartrue=0] Bdir,p(full draft text of any [urgent]) such Bdir[ctx=prc](Resolution) D[str=4](must) be I[rtype=info]([circulate]) circulated Bind,p(to all) Bind[atype=int](Commissioners) Cex[ctx=tmp](prior to the opening of the meeting at which the draft Resolution is to be considered)}