You will be annotating the corpus of documents with 5 classes describing the elements found inside historical documents: illustration, ornament, initial, stamp and table.
The class "illustration" should be understood as a generic class encompassing all graphic elements. An illustration can be functional or artistic; its function is then to inform, illustrate, or entertain the reader.
Examples of illustrations within an image include paintings, photographs, drawings, mathematical graphs, charts, diagrams, symbols, and maps. What distinguishes an illustration from an ornament is its own semantics: it has a meaning that is interpreted in relation to the text, unlike an ornament which is purely decorative.
(a) A geometry manuscript that illustrates angle calculations.
(b) A handwritten bestiary with an illustration of a snake.
(c) A handwritten book of hours with an illustration amidst floral ornamentation.
(d) An astronomy manuscript with mathematical diagrams.
Figure 1. Illustration examples.
The annotation of illustrations can be affected by the layout of the page: they can be grouped, and it is hard to understand which ones need to be annotated alone and which ones need to be annotated together.
(a) Two illustrations annotated together because they touch and share the same frame.
(b) Two illustrations (red) that do not touch but are annotated together because they share a frame.
Figure 2. Edge cases for illustrations.
Figure 3. A printer's mark on a title page.
(a) A manuscript that shows how to annotate illustration and ornamentation.
(b) An illustration with an ornamented frame around it.
Figure 4. Illustration and ornament relationships.
An ornament is a graphic element that decorates or embellishes a document without adding informational value.
An ornament is most often an abstract form of illustration, composed of classical patterns (plant ornaments, abstract headpieces, "cul-de-lampe") or repetitive motifs with no meaning other than their intrinsic value as ornaments.
Annotating ornaments is inherently complex, because they frequently interact with and wrap around other elements on the page. Therefore, most ornaments cannot be annotated with a single bounding box. Instead, when an ornament wraps around a visual element (an illustration, a table, a block of text, etc.), it must be split into several separate boxes that follow the contour of the underlying element, rather than being enclosed in one large box that also captures unrelated content.
The following rules apply:
(a) Example of ornament annotations.
(b) We do not care if there is text inside the ornamentation.
(c) When cutting out ornamentation, pieces that are linked together should be marked with overlaps so that they can be reconstructed later.
(d) Ornamentation can be used to separate elements like illustrations or tables.
(e) In manuscripts, the end of a line can be ornamented.
Figure 5. Ornament examples.
In a written or manuscript work, an initial is a letter at the beginning of a word, a chapter, or a paragraph that is larger than the rest of the text. An initial is often several lines in height and, in older books or manuscripts, may take the form of a historiated initial.
(a) Example of initial annotations.
(b) Example of the relationship between the initial letter and the ornamentation, and how to annotate them.
(c) Example of a printed pilcrow (¶).
(d) Example of a manuscript pilcrow (¶).
Figure 6. Examples of initials.
An initial is annotated as such only if it is visually distinguishable from the body text, typically by a significantly larger size (spanning at least two lines of the surrounding text), a different script, colour, or decorative treatment. A letter that is only slightly enlarged compared to the running text should not be annotated as an initial; see Figure 6a.
Initials are letters and therefore can be tricky to annotate due to their textual nature.
Stamps are marks that identify the institutions that hold or held the documents (libraries, archives). These markings are not all the same, depending on the document and the date they were applied to the work. For bound documents (books, manuscripts, albums), the stamp is on the first page. For a stack of unbound documents, each loose page will be stamped.
(a) Example of a stamp covering an old bookplate.
(b) Example of a stamp on a title page.
(c) Example of a stamp on a first page.
(d) Example of a library label.
Figure 7. Examples of stamps and library labels.
A table is an arrangement of information or data, usually in rows and columns, or possibly according to a more complex structure. For tables, the header and the footer must be included in the annotation if they are present.
(a) Example of an annotated table with a title.
(b) Example of tables inserted into the text.
(c) Example of a table.
(d) Example of tables with ornaments.
(e) Example of a table with an initial.
Figure 8. Examples of tables.