Harlequin

Reference Manual
Version 8 – Revision 8 - English

SEA Vision S.r.l.

Via Folla di Sopra 21, 27100 Pavia, Italia
Tel +39,0382,529576 Fax +39,0382,527260 Ass. +39,0382,520658
Page 2

Contents

1. INTRODUCTION __________________________________________________________ 5
1.1. Optional Packs ________________________________________________________________________________ 5

1.2. Operational diagram ___________________________________________________________________________ 6

1.3. Operation principle ____________________________________________________________________________ 7

1.4. Harlequin features _____________________________________________________________________________ 8

1.5. The measured parameters______________________________________________________________________ 10

1.5.1. Geometrical parameters ____________________________________________________________________ 10
1.5.2. Pictorial parameters (RGB space) _____________________________________________________________ 11
1.5.3. Pictorial parameters (HSV space) _____________________________________________________________ 11

2. USER INTERFACE _______________________________________________________ 12

2.1. Tool bar ____________________________________________________________________________________ 12

2.2. Status bar ___________________________________________________________________________________ 13

2.3. Menu items __________________________________________________________________________________ 14

2.3.1. Work ___________________________________________________________________________________ 14
2.3.2. Archive _________________________________________________________________________________ 14
2.3.3. Configuration ____________________________________________________________________________ 15
2.3.4. Images __________________________________________________________________________________ 15
2.3.5. Help ____________________________________________________________________________________ 16

2.4. Dialogue pages _______________________________________________________________________________ 16

3. FUNCTIONS OF HARLEQUIN ______________________________________________ 17

3.1. Work Menu _________________________________________________________________________________ 17
3.1.1. Work Menu ______________________________________________________________________________ 17
3.1.2. Control drawings __________________________________________________________________________ 18
3.1.3. Rejection queues __________________________________________________________________________ 18
3.1.4. Messages window _________________________________________________________________________ 18
3.1.5. Counters window _________________________________________________________________________ 19
3.1.6. Manual Work ____________________________________________________________________________ 19
3.1.7. Vision System Disabled ____________________________________________________________________ 19
3.1.8. Test ____________________________________________________________________________________ 20
3.1.9. Measure Results Presentation ________________________________________________________________ 20
3.1.10. Batch Start ______________________________________________________________________________ 22
3.1.11. Batch End ______________________________________________________________________________ 22
3.1.12. View Batch _____________________________________________________________________________ 23
3.1.13. View Article ____________________________________________________________________________ 26
3.1.14. Former Article Versions ___________________________________________________________________ 26
3.1.15. View Log-File ___________________________________________________________________________ 26
3.1.16. Write on Log-File ________________________________________________________________________ 27
3.1.17. Exit Program ____________________________________________________________________________ 27
3.1.18. Restart Windows _________________________________________________________________________ 27
3.1.19. Shut down ______________________________________________________________________________ 27

3.2. Archive Menu ________________________________________________________________________________ 28

3.2.1. List of Articles ___________________________________________________________________________ 28
3.2.2. Linked Articles ___________________________________________________________________________ 28

SEA Vision s.r.l.

Harlequin – Reference Manual Page 3

3.2.3. New Article ______________________________________________________________________________ 29

3.2.4. Copy Article _____________________________________________________________________________ 29
3.2.5. Remove Article ___________________________________________________________________________ 29
3.2.6. Program Article ___________________________________________________________________________ 30
3.2.7. Search Parameters _________________________________________________________________________ 33
3.2.8. Special Parameters for Searching _____________________________________________________________ 35
3.2.9. Measure Parameters _______________________________________________________________________ 39
3.2.10. Colours ________________________________________________________________________________ 40
3.2.11. Special Parameters for Measure _____________________________________________________________ 42
3.2.12. Measure Window ________________________________________________________________________ 44
3.2.13. Capsule Model __________________________________________________________________________ 45
3.2.14. Powder and Stains Check __________________________________________________________________ 45
3.2.15. Colour Rings Check ______________________________________________________________________ 46
3.2.16. Program Linked Articles ___________________________________________________________________ 46
3.2.17. Article Wizard ___________________________________________________________________________ 47
3.2.18. Cavities Management _____________________________________________________________________ 50
3.2.19. Modification of the cavity windows through the mouse ___________________________________________ 52
3.2.20. Strip Management ________________________________________________________________________ 53
3.2.21. Critical Defects Management _______________________________________________________________ 56
3.2.22. Multi-Function Cameras Management, General Parameters _______________________________________ 58
3.2.23. Multi-Function Cameras Management, Window ________________________________________________ 59
3.2.24. Multi-Function Cameras Management, Codes __________________________________________________ 61
3.2.25. Multi-Function Cameras Management, Window, Codes, Datamatrix ECC200 _________________________ 64
3.2.26. Rejection Queues ________________________________________________________________________ 64
3.2.27. Adjusting the length of the rejection queues: a practical procedure __________________________________ 66
3.2.28. Rejection Auxiliary Input Signals ____________________________________________________________ 66
3.2.29. Asynchronous Shift Registers _______________________________________________________________ 67
3.2.30. Learning _______________________________________________________________________________ 71
3.2.31. Cavity Tolerances ________________________________________________________________________ 72
3.2.32. Strip Tolerances _________________________________________________________________________ 72

3.3. Configuration Menu __________________________________________________________________________ 73

3.3.1. Status Bar _______________________________________________________________________________ 73
3.3.2. Windows Display _________________________________________________________________________ 73
3.3.3. System Management _______________________________________________________________________ 73
3.3.4. Log-on / Log-off __________________________________________________________________________ 76
3.3.5. Password Modification _____________________________________________________________________ 76
3.3.6. Save and Restore Archive ___________________________________________________________________ 76
3.3.7. Save System Files _________________________________________________________________________ 77
3.3.8. Work Control Images ______________________________________________________________________ 77
3.3.9. Work Parameters __________________________________________________________________________ 80
3.3.10. Internal PLC ____________________________________________________________________________ 82
3.3.11. Partena blister machines with parallel rejections ________________________________________________ 82
3.3.12. Partena blister machines with serial rejections __________________________________________________ 84
3.3.13. Alarms _________________________________________________________________________________ 86
3.3.14. Inputs/Outputs Control ____________________________________________________________________ 86
3.3.15. Date and Time ___________________________________________________________________________ 87
3.3.16. Modify Configuration File _________________________________________________________________ 87

3.4. Images Menu ________________________________________________________________________________ 88

3.4.1. Acquisition ______________________________________________________________________________ 88
3.4.2. Continuous Acquisition _____________________________________________________________________ 88
3.4.3. Synchronised Acquisition ___________________________________________________________________ 88
3.4.4. Save Images on Disk (Article) _______________________________________________________________ 88
3.4.5. Save Images on Disk (Archive) ______________________________________________________________ 89
3.4.6. Save Images on External Device ______________________________________________________________ 89
3.4.7. Load Images from Disk (Article) _____________________________________________________________ 89
3.4.8. Load Images from Disk (Archive) ____________________________________________________________ 89
3.4.9. Load Images from External Device ___________________________________________________________ 89
3.4.10. Clear Screen ____________________________________________________________________________ 89
3.4.11. Display TV _____________________________________________________________________________ 89
3.4.12. Synoptic Display _________________________________________________________________________ 89

SEA Vision s.r.l.

Page 4

3.4.13. Display Red _____________________________________________________________________________ 89

3.4.14. Display Green ___________________________________________________________________________ 90
3.4.15. Display Blue ____________________________________________________________________________ 90
3.4.16. Display Colour __________________________________________________________________________ 90
3.4.17. Rotate Images ___________________________________________________________________________ 90
3.4.18. Reflect Images___________________________________________________________________________ 90

3.5. Help Menu __________________________________________________________________________________ 90

3.5.1. Article Cross Check _______________________________________________________________________ 90
3.5.2. Triangle of Colours ________________________________________________________________________ 91
3.5.3. Read Colours _____________________________________________________________________________ 92
3.5.4. Conversion RGB→HSV ____________________________________________________________________ 92
3.5.5. Call Service ______________________________________________________________________________ 92
3.5.6. Terminate Service _________________________________________________________________________ 93
3.5.7. Language choice __________________________________________________________________________ 93
3.5.8. Information on the System __________________________________________________________________ 93

4. ALARM MESSAGES ______________________________________________________ 94

5. BACK-UP AND RESTORE PROCEDURES ___________________________________ 101

5.1. Back-up procedure __________________________________________________________________________ 101

5.2. Restore procedure with hard-disk replacement ___________________________________________________ 101

6. SERVICE ______________________________________________________________ 103

6.1. Assistance through modem or Internet __________________________________________________________ 103

6.2. Telephone assistance _________________________________________________________________________ 103

6.2.1. Saving Work Images ______________________________________________________________________ 104
6.2.2. Saving the work archive ___________________________________________________________________ 104
6.2.3. Saving the oscilloscope file _________________________________________________________________ 104
6.2.4. Exporting a specific audit trail ______________________________________________________________ 104

SEA Vision s.r.l.

Harlequin – Reference Manual Page 5

1. Introduction
The version numbering and Harlequin manual revision are in no way correlated to the version of the
performable programme installed in the system. The two numberings are completely independent.
The Harlequin measuring system controls the products packaged on the blister machines; in particular
Harlequin can perform the following checks:
• check of blister-packaged products;
• check of components in trays;
• check of colour rings which are silk-screen printed on the vials and syringes.
Besides, Harlequin supports multi-functional cameras to check barcodes, 2D codes and alpha-numeric
codes on covering materials.

1.1. Optional Packs

The reference Manual describes all functionalities of the Harlequin system.
However some functionalities of Harlequin Lite are optional and should be separately purchased.
In any case the optional packs may be added at any time, requiring the licence to SEA Vision, without
changing the software version.
It is possible to control which optional packs are installed through the Information on System page that
is open from the Help menu.

There exist 4 optional packs, here listed with the items that each individual pack enables.

Components pack that allows the user to check colour rings, components in trays and to use the cross-
check function for parameters and articles
• Menu → Archive → Program Article → Measure Parameters → Special Parameters →
Colour Rings Check Enabling
• Menu → Help → Article Cross Check Enabling
• Menu → Help → Character Cross Check Enabling

Symmetry pack that allows the user to check object using the shapes 3 and 4 (to measure the
asymmetries of the shape), the broken and chipped tablets
• Menu → Archive → Cavity Tolerances → Shape 3 Enabling
• Menu → Archive → Cavity Tolerances → Shape 4 Enabling

Extra checks pack that allows the user to check double product in aluminium cavity, small fragments
near the product, product out of the cavity, dirty foil, machine step, black spots on the product, presence
of powder all around the product
• Menu → Archive → Program Article → Search Parameters → Special Parameters → Number
of Objects Enabling
• Menu → Archive → Program Article → Measure Parameters → Special Parameters →
Sensitivity of Search for Fragments Adjacent to the Product Enabling
• Menu → Archive → Program Article → Measure Parameters → Special Parameters →
Powder & Stains Check Enabling

Multi-product pack that allows the user to manage multi-product blisters

• Menu → Archive → Linked Articles Enabling
• Menu → Archive → Program Linked Articles Enabling

SEA Vision s.r.l.

Page 6

1.2. Operational diagram

The operational diagram of the machine is shown in the figure, which indicates the modules in different
colours according to type: blue for electronic components, purple for optical components, green for
mechanical components and yellow for software.

TV1 TV2 SOFTWARE

MONITOR

IMAGE
ACQUISITION
COMPUTER
LIGHTING SYSTEM CARDS

PRODUCT
ON BASE FOIL
I/O CARD MOUSE

CODE ON
LID FOIL ALUCODE BLISTER MACHINE
LOGIC AND/OR DEVICES

Harlequin consists of the following modules:

• computer
• cameras and lenses
• illumination systems
• image acquisition card
• monitor
• electronics for communicating with the production line
• mouse (or any other pointing device) for programming
• software

SEA Vision s.r.l.

Harlequin – Reference Manual Page 7

1.3. Operation principle

For each (group of) products reaching the control station, the computer acquires an image for every
installed camera. The term acquisition refers to two operations: digitising, i.e. converting the analogue
video signal received from the camera into a set of numbers, and saving these numbers in memory banks.
In case of digital cameras, the digitising is not performed because the image is already in numeric format.
The acquisition operation is obviously synchronised with the production line to ensure that blister images
are acquired always in the same position.
At this point, the program measures the images as the user programmed them. The values measured for
each object are compared to the reference values and, even if only one of these is outside the permissible
tolerance range, the product containing the defective object is physically rejected from the production
line.

In addition to the cavities, the strip itself is controlled and if Harlequin detects a defect in at least one
controlled area, all blisters controlled in connection with the strip defect are rejected.
If multi-functional cameras are installed, Harlequin is capable of checking the codes on the covering
material.
The figure shows an example of tablet control on PVC blisters. The result of the control is obtained from
the colour of the rectangles drawn over the image:
1. the green rectangles indicate product within the tolerance range (or strip zones free of defects)
2. the yellow rectangles indicate empty cavities
3. the red rectangles indicate defective product
4. the blue rectangles indicate critical defects caused by a mix of two different products: in this example,
the tablets are smaller and/or of a different colour.
The image processing chain is a concept that helps the understanding of how the control system works.
The chain is made by a sequence of operations, the last of which consists in the output of a binary result:
good blister, reject blister. In other words the processing chain is a machine that, through a number of
steps, transforms the information contained in the image until it is condensed in one bit only (0/1).

PROCESSING CHAIN
ACTION RESULT
1 image acquisition from camera image (matrix of numbers) in memory
2 search of the objects inside the search coloured dot showing the position of the object in the
windows (user drawn) image

SEA Vision s.r.l.

Page 8

3 measure: detection of the object edge set of points defining the object contour
4 measure: computation of the parameters set of number describing the object
describing the object (area, shape
parameters, colour levels, ...)
5 comparison between the measured values good object, defective object
and the nominal values (learned): the
object is good if all the differences are
less than the thresholds (tolerances)
6 output management: insertion and communication of the results
extraction from the rejection queues

1.4. Harlequin features

1. The program is developed in the MS-WINDOWS environment to facilitate article programming and
to make system immediate and intuitive for use. To this end, Harlequin was designed so that the user
utilises strictly a monitor or a pointing device: mouse or trackball or touch-screen.
2. Harlequin can share the monitor with the packaging machine.
3. Harlequin uses commercial hardware.
4. Harlequin uses multi-core CPU to perform parallel calculations.
5. The cameras (up to a maximum of sixteen) do not require any manual adjustment: they are installed
in sealed protective shells and controlled exclusively by the software.
6. Harlequin can operate on any support (aluminium, opaque PVC, transparent PVC, polypropylene,
etc.) with the same lighting system.
7. Harlequin can measure the following values of each object:
• the area of the object in the cavity, as shown in a plan view;
• four parameters describing the shape (circularity, elongation, symmetry);
• the length;
• the angle;
• the colour level and dispersion of colour levels for each of the three fundamental colours of
additive synthesis (red, green, blue), six parameters in all;
• colour hue, saturation and value; for two-colour objects, these parameters are calculated
separately for each of the two colours.
The completeness of the measures ensures detection of defects that cannot normally be detected with
systems based purely on measurement of the area. In particular, parameters describing shape, which
are asymmetry-sensitive, ensure that small splinters and imperfections are detected.
8. Harlequin detects also:
• double product in aluminium cavity
• small fragments near the product
• empty cavities: the completely empty blisters can be rejected in a bin different from the defective
blisters one.
9. Harlequin is able to discriminate defects according to their degree of danger and activate safety
procedures if critical defects (a mix of different products) are detected.
10. Harlequin is equipped with strip-control functions for detecting splices, products out of cavities, and
spots.
11. Harlequin can check the printing on the lid foil. This functionality allows the detections of the
geometrical and pictorial features of the artworks. An alarm is generated in case of either wrong or ill
printed foil.
12. Harlequin can check different products in the same blister (multi-product blister).
13. Harlequin adapts automatically to lighting variations in the work environment.

SEA Vision s.r.l.

Harlequin – Reference Manual Page 9

14. Harlequin has a watchdog device controlling the output signals. If there is a malfunction on the
appliance, this facility resets all outputs (in particular, the blister machine permitted to run bit) after a
maximum time of 1 second, thus stopping the blister machine movement.
15. Harlequin is provided with a self-programming tool for the work articles (Wizard), which allows also
the not skilful user to create a new work article.
16. Harlequin manages the production batches and produces a detailed production report for every
production batch. This report contains information on the defects encountered and on the performance
of the blister machine.
17. Harlequin can manage rejection auxiliary signals generated by outside events.
18. Harlequin can manage asynchronous shift registers to drive external devices.
19. Harlequin can make available its screen to external devices in order to show messages sent by such
devices.
20. Harlequin has software enabling it to execute PLC functions internally and therefore, does not need
additional devices for controlling blister rejection functions.
21. Harlequin accepts remote commands through a serial port. These commands can be used to change
the work article, begin a new production batch, and send information on the current batch. If remote
commands are used, the Operators are not required to intervene.
22. Harlequin can be assisted directly by the manufacturer through the Internet network or by a direct
modem connection. This service facilitates the remote programming of the work articles.
23. Harlequin programs directly the barcode readers connected to it.
24. Harlequin is compliant with the requirements of the regulation FDA 21 CFR part 11:
• the access to Harlequin is regulated by a system of identification
• all the operations made by the users and all the events generated by Harlequin are memorised in
the Log-File, which can be browsed by means of search filters
• Harlequin saves all the former versions of the work articles
25. Harlequin is endowed with validation documents drawn up in compliance with GAMP guide:
• quality, project and maintenance plan
• functional specifications
• mechanical and electrical design specifications
• hardware and software design specifications
• system factory tests
• system acceptance tests.

SEA Vision s.r.l.

Page 10

1.5. The measured parameters

Harlequin measures, for every object to check, a sub-set of the following parameters.

1.5.1. Geometrical parameters

The physical meaning of the geometrical parameters is shown in the table.

The four shape parameters are invariant to rotation, shift and scaling. Shape 3 and Shape 4 measure the
asymmetries of the shape, but with different sensitivity. In fact Shape 3 takes the minimum value if the
measured object has two orthogonal axes of symmetry: its value increases only when the object looses
one of the axes (see the example). The Shape 4, on the other hand, remains stable (at the minimum value)
if the object maintains at least one symmetry axis. For this reason it is less sensitive than shape 3 to small
variation of the object contour. The length is measured instead of Shape 1. The Hexagonality and the
Pentagonality are measured instead of Shape 2 (see the section about the special parameters for
measuring).

SEA Vision s.r.l.

Harlequin – Reference Manual Page 11

1.5.2. Pictorial parameters (RGB space)

Parameter Formula Examples

lr = [  nr(i)  i ] /
255 255
Red
Level i=0
[
i=0
nr(i) ]
255
dr = [  nr(i)  | i - lr| ] /
255
Red
Dispersion i=0
[
i=0
nr(i)  i ]

[
255
lv = [  nv(i)  i ] /
255
Green
nv(i) ]
Level i=0 i=0
255
dv = [  nv(i)  |i - lv| ] / [
255
Green
nv(i)  i ]
Dispersion i=0 i=0
255
[
255
lb = [  nb(i)  i ] /
Blue nb(i) ]
Level i=0 i=0
255 255
db = [  nb(i)  |i - lb| ] / [
Blue nb(i)  i ]
Dispersion i=0 i=0

The pictorial parameters are average values computed on all pixels belonging to the measured object. In
the RGB space a colour image is composed by three monochrome images, which, in every pixel, gives
the light intensity of the three fundamental colours of the additive synthesis: red, green, blue. Harlequin
computes the level and the dispersion separately on each image. In the monochrome systems there exists
only one image. Therefore the measured parameters are two instead of six.

1.5.3. Pictorial parameters (HSV space)

Parameter Meaning Examples

Hue Tone of the colour ?

Saturation Amount of the colour

Value Intensity of the colour

In the space HSV the colours are described by the three values Hue Saturation Value (see the section on
the colour triangle). The values HSV are computed starting from the RGB values for each pixel in the
image. When the measured object contains two colours (like, for instance, many hard-gelatine capsules),
Harlequin measures the values HSV separately on each colour, generating six parameters: Hue 1,
Saturation 1, Value 1, Hue 2, Saturation 2, Value 2.

SEA Vision s.r.l.

Page 12

2. User interface
The user can utilise a hierarchically organised menu of commands with which s/he can control all
machine functions. A tool bar and status bar are also available and are described below.
To communicate with the program, the user utilises only a simple pointing device, usually a mouse or a
trackball. Besides, all the systems are equipped with a touch-screen which makes it possible to perform
programming operations without the need to pointing devices.
The pointer, so-called cursor can be moved on the touch screen either with the fingers or with the use of a
pen. The cursor is represented on the screen by an arrow which indicates the operation to be performed.
To do this, both mouse and trackball are provided with a ball, which moves the cursor on the screen, and
two or three buttons with different functions. The left button is the one used most of all: it is used to
execute the action associated with the menu or with the button currently underneath the cursor. The right-
hand button is used in special circumstances only (selecting windows). The touch-screen also can emulate
the right hand side button. It is possible to shift from the left hand side buttons to the right hand side ones
by using the control panel at the lower right hand side part of the screen.
When present on the pointing device, the third button, at the centre, is used by Harlequin to simulate the
double click of the left button. So, pressing the central button is like rapidly pressing the left button twice.
As no keyboard is provided, if you are prompted to input alphanumeric texts (codes of new articles,
descriptions, or passwords), a keyboard appears on the screen emulating the functions of a real keyboard.
In this way, by using only the cursor on the video, you can input the characters as if you were using a
traditional keyboard.

The “Symbols…” button opens a second keyboard which contains other characters and different
alphabets (Cyrillic, Greek). The contents of this keyboard changes by pressing >> and <<. The pictures
show the default pages available in all Harlequin systems. The set of symbols are found in a UNICODE
file (symbols.txt). Therefore, other characters may be added to (or replaced by) those already existing
when the system has been installed.

2.1. Tool bar

The tool bar, as shown above, is located at the top of the screen under the main menu and is a quick
means of sending commands to the program as it associates a mnemonic key (icon) with a menu item. In
other words, if you press the icon or select the relevant menu item, the same function is executed.
For obvious reasons of space, not all commands available in the program could be included in the tool
bar, and therefore, only the most used commands were chosen.
The following is a list of icon-command combinations, starting from first item on the left.

SEA Vision s.r.l.

Harlequin – Reference Manual Page 13

Show article list with facility for selecting the work article

Execute automatic mode work cycle

Show measured numeric values

Request password to log-on / log-off the current user

Program work article parameters

Create and program a new article

Show image acquired by camera 1

Show image acquired by camera 2

Show images of all cameras simultaneously.

To execute the commands associated with the tool bar icons, locate the cursor over the icon associated
with the required command and press the left button of the pointing device. When the cursor is over an
icon for more than one second without pressing any button, a short text appears on the screen near the
cursor (tool-tip). It gives a brief explanation of the icon function.
There is a window on the right of the tool bar showing the code of the selected article (the code is UNO in

the preceding figure). To change the work article just move the cursor over the icon and press the
left button of the pointing device: a complete list of all articles stored in the archive is displayed. To select
the article you require, press the left button over the article code.

2.2. Status bar

The status bar is at the bottom of the screen. It contains messages briefly describing the menu item over
which you have pressed the left button of the pointing device (but without releasing it). You can remove
(or restore) the status bar from the screen by using the Status Bar item of the Configuration menu.

SEA Vision s.r.l.

Page 14

2.3. Menu items

The following is a list of menu items, in hierarchical order and with a brief explanation of their function.

2.3.1. Work
Automatic Work (corresponding icon: Execute automatic mode work cycle

)
Manual Work Work test with cameras or disk
Vision System Disabled Enable or disable control: blister machine can run
TestPerformance Measure Measure machine performances
TestGood Objects Measure Measurement of the machine performance when the product is
good
TestDefective Objects Measure Measurement of the machine performance when the product is
rejected
Measure Results Presentation Show measured numeric values

(corresponding icon: )
Batch Start Reset batch counters: begin production of a new batch
Batch End End of the current batch
View BatchCurrent Batch Data Show data on current batch
View BatchFormer Batch Data Show data on last complete batches
View BatchMeasure Results Files Show the page which contains the list of files showing the
selected article measurement results.
View Article Show data on current article
Former Article Versions Show the committed versions of the current article
View Log-File Show log-file containing messages
Write on Log-File Add log-file messages
Exit Program Harlequin terminates
Restart Windows Windows restarts: all files are saved on disk
Shut down System shut down: after shut down the system can be only
switched off

2.3.2. Archive
List of Articles (corresponding icon: Show article list with facility for selecting the work article

)
Linked Articles Show article list with facility for selecting the linked articles
New Article Enter new article in archive
Copy Article Copy work article in a new one
Remove Article Eliminate work article from archive
Program Article (corresponding icon: Program work article parameters

)
Program Linked Articles Programme parameters of articles linked to the work article
Article Wizard (corresponding icon: Create and program new article in archive

)
Cavities Management Manage cavity windows

SEA Vision s.r.l.

Harlequin – Reference Manual Page 15

Strip Management Manage strip control windows

Critical Defects Management Manage critical defects
Multi-Function Cameras Management Programme Multi-function TV parameters (Alucode)
Rejection Queues Manage the shift registers for blister rejection
Rejection Aux. Signals Manage the auxiliary signals for blister rejection
Asynchronous Shift Registers Manage the asynchronous shift registers
Learning Learning reference values
Cavity Tolerances Modify the work tolerances for product in cavity
Strip Tolerances Modify the work tolerances for the windows on strip

2.3.3. Configuration
Status Bar Show or Remove Status bar
Windows Display Enable or disable yellow windows drawings on screen
System Management Only for the Expert: users, archive and batch management
Log-on / Log-off (corresponding icon: Request password to log-on / log-off the current user

)
Password Modification Modify password of the current user
Save Article Saving data of article on external device
Save Archive Saving whole archive on external device
Restore Article Restore article data from external device
Restore Archive Restore data from external device
Save System Files Save system files on external device
Work Control Images Select drawings to execute during work
Work Parameters Program some configuration parameters for automatic work
mode
Internal PLC Program the parameters for the internal software PLC
Alarms Alarms setting: reset buttons and password
Inputs/Outputs Control Control input and output signals
Date and Time Modify system date and time
Modify Configuration File Editing of the file HARLE.INI containing the configuration
parameters for Harlequin

2.3.4. Images
Acquisition Immediate acquisition of an image from the cameras
Continuous Acquisition Continuous acquisition from cameras for preset time
Synchronised Acquisition Acquire image from cameras when phase signal is received
from blister machine
Save Images on Disk (Article) Save displayed images on a disk and link them to the work
article being used; it is possible to save three types of images
for each article (Work, Good, Empty)
Save Images on Disk (Archive) Save viewed images in a disk.
Save Images on External Device Save viewed images in an external device.
Load Images from Disk (Article) Display images linked to the work article and saved on a disk; it
is possible to load three types of images for each article (Work,
Good, Empty)
Load Images from Disk (Archive) Display images saved on a disk
Load Images from External Device Display images saved on an external device
Clear Screen Blank screen

SEA Vision s.r.l.

Page 16

Display TV (TV1....TV16) Display images acquired from selected camera (from TV1 to
TV16)
Synoptic Display (corresponding icon: Show images of all cameras simultaneously

)
High Resolution Display Images are displayed at maximum resolution
Display Red Show red band
Display Green Show green band
Display Blue Show blue band
Display Colour Simultaneous viewing of three colour bands
Rotate Images Rotate images: +90°, 180°, -90°, all angles
Reflect Images Reflect images: vertical, horizontal

2.3.5. Help
Article Cross Check Display table of articles cross-check table
Triangle of Colours Show triangle of colours
Read Colours Colour images read by using cursor
Convert RGB->HSV Convert image from Red-Green-Blue to Hue-Saturation-Value
Call Service Modem connection to remote Service (dial-up)
Terminate Service Close modem connection to remote Service (hang-up)
Language Choice Change language to Italian, English, German, French, Spanish,
Portuguese, Polish, Danish, Russian, Hungarian, Swedish,
Norwegian, Croatian, Turkish, Greek
Information on System Information on program, copyright and version

2.4. Dialogue pages

Harlequin programming pages have the following standard buttons:
• New: to create a new object;
• Remove: to cancel the currently selected object;
• Copy: to copy the object and create a new one in the same article;
• Extern Copy: to copy the selected object and create a new one in articles being selected in the
Extern Copy dialogue page;
• OK: to exit the dialogue page while confirming the modifications;
• Cancel: to exit the dialogue page without saving the modifications.

SEA Vision s.r.l.

Harlequin – Reference Manual Page 17

3. Functions of Harlequin
3.1. Work Menu

3.1.1. Work Menu

The menu item Automatic Work (corresponding icon ) brings the system in the automatic work
mode. In this state Harlequin does not accept commands from the operator except that to quit the
automatic work mode. For this purpose, when the blister machine is idle, a button appears at the bottom
right of the screen, with the message AUTO MODE EXIT. If the blister machine restarts the button
disappears.
During automatic work mode, blisters may be rejected for three different reasons:
• all blisters containing at least one defective object are rejected;
• all blisters controlled at a given moment are rejected if defects are detected on the strip outside the
cavities (see paragraph on strip management); this function is optional;
• all blisters controlled in n successive steps (n programmed for each work article) are rejected when an
event external to Harlequin occurs, and is communicated to it by input signals known as rejection
auxiliary signals; a rejection auxiliary signal is, for example, one received from a sensor detecting a
splice on the blister’s lid foil.
Some parameters influence the behaviour of the system during automatic work mode (see paragraph on
work parameters). They include the queues initial status, which can have three positions: normal, OK
and KO. The rejection queues are memory areas in which Harlequin stores control results for every
blister while waiting for the appropriate moment to communicate them to the blister machine, which
physically rejects the defective blisters. In most cases, the length of the rejection queue coincides with the
distance (in numbers of steps or rows) travelled by each blister to go from the control point to the
rejection point. When Harlequin accesses the automatic work mode, it initialises the rejection queues in a
different way according to the setting of the queues initial status parameter. Behaviour is as follows.

SEA Vision s.r.l.

Page 18

• Normal: when the system is powered up, the rejection queues are initialised as rejections. If the
automatic work mode is exited, the rejection queues are saved and restored on return to automatic
work mode. If, between two successive work sessions, the operator carries out certain operations (e.g.
disables control), for reasons of safety, the saved queues are not restored and the rejection queues are
initialised as rejections.
• OK: following OK selection of the parameter, when the automatic work mode is accessed for the first
time, the queues are initialised with values indicating good blisters. Moreover, for reasons of safety,
the parameter is returned to normal status.
• KO: the operation is identical to the previous case, with the exception of the queue initialisation value,
which, in this case, corresponds to rejected blisters.
If certain conditions occur during automatic work mode, Harlequin has the possibility of stopping the
blister machine by disabling the run permitted signal. When the blister machine is idle, a message is
shown on the monitor, reporting the cause of machine stop.
The screen of Harlequin, during the automatic work, offers information about the result of the product
control. The item Work Control Images (Configuration menu) selects the options for displaying the
control drawings, the rejection queues, the message window and the counters window.

3.1.2. Control drawings

The drawings appear in overlay to the acquired images at the end of the measure operations. They are of
three types:
• control drawing of object search inside cavity
• control drawing of measurement on object border
• control drawing of measurement result – this coincides with the rectangular window set by the user for
each cavity. The window is drawn with different colours according to the result:
yellow: empty cavity green: object within tolerance range red: defective object blue: object with critical
defect

3.1.3. Rejection queues

The rejection queues are visible inside a window, whose size and position can be adjusted. On the left
side there are the queues (shift registers) of the camera, of the auxiliary rejection signals, of the generic
shift registers. The movement of the data is from left to right. On the right side the shift register of the
internal PLC is drawn, but only if it is in use. Their number and message identify the auxiliary rejection
signals and the generic shift registers. If the shift registers are longer than 6 steps, only the initial portion
(data insertion) and the final portion (data extraction) are shown. The colours take the same meaning of
those used for the drawings.

3.1.4. Messages window

The messages window contains an area where all messages generated by Harlequin are reported.
Moreover it shows the counters of the alarms generated by the internal PLC and the web position gauge
(if it is enabled in the Work Parameters) given as difference with respect to the learned value.
SEA Vision s.r.l.
Harlequin – Reference Manual Page 19

3.1.5. Counters window

The counters window contains the values showing the number of produced pieces (blisters without
defects, in green) and rejected pieces, in red. The partial counters can be reset with the button.

3.1.6. Manual Work

Manual Work entails measurements taken on objects visible to the cameras, or on stored images.
All operations effected in manual mode do not interact with the production line and, consequently, no
pieces can be rejected.
Manual Work is normally used before going into production, to test if the measuring system is operating
correctly according to set parameters. To this end, a keyboard appears on the right of the screen, enabling
you to select the image source. Further, the graphic results are shown on the screen and the measured
numeric values are saved as a percentage difference with respect to the learned reference value.

The keyboard has four keys.

• The OK key finishes the manual work mode operations.
• The key with the drawing of a camera causes immediate acquisition of images from the cameras and
the start of the search and measure procedure, the results of which are immediately available in
graphic form. The numerical results can be checked with menu item Measure Results Presentation.
• The key with the drawing of the camera and the word Trigger causes acquisition (synchronised with
the arrival of the acquisition trigger) of images by the camera and the start of the search and measure
procedure. If the acquisition trigger is not received within 10 seconds after the key is pressed, the
command is cancelled.
• The key with the drawing of the diskette causes images to be transferred from the hard disk to the
monitor and the start of the search and measure procedure.

3.1.7. Vision System Disabled

When control is not disabled, i.e. under normal operating conditions, the blister machine is slaved to the
control system. This means that the blister machine cannot run without clearance from the control system.
This only happens during the automatic work mode, and with forced rejections, even during automatic
learning.
This menu item must be used to enable the blister machine to run without control. The item activates the
run permitted signal and, at the same time, sends the control disabled signal to the blister machine.
When control is disabled, blisters are either all rejected or all allowed to pass through according to
programming in the Outputs Status field of the Work Parameters page: blisters are NOT rejected only
if the Outputs Status is programmed to Always OK.

SEA Vision s.r.l.

Page 20

When control is disabled a window appears on the screen. The button End of disabling brings Harlequin
back to the idle status (main menu).
Another way to disable the control is through the input signal Disable control. If Harlequin, being in the
automatic work mode with the blister machine idle, receives this signal, it commutes to the disabling
condition, showing the message “Vision system disabled from external signal”.

3.1.8. Test

Performance Measure
This menu item is used to effect some acquisition steps from camera and measurement in order to assess
the overall calculation time required to control each blister (group). On completion, the result appears as
the cycle time required to execute all control functions and the relevant number of cycles per minute. The
latter values should be compared with the maximum speed of the blister machine.

Good Objects Measure

This menu item is used to measure the group of images collected in the DAT?????\Good directory of the
current article, where ? is a digit. The table with the results appears at the end of the measurement.

Defective Objects Measure

This menu item is used to measure the group of images collected in the DAT?????\Fail directory of the
current article, where ? is a digit. The table with the results appears at the end of the measurement.

3.1.9. Measure Results Presentation

All measurements taken by the control system are saved in a dedicated memory zone. If the available
memory is exhausted, data of the oldest measurements are over-written. By using this menu item you can
create a window showing the numeric values contained in the memory – from the oldest to the most
recent measurement.
Each line of the window contains data on an object or on a window on the strip (inspection window). The
first field of each line addresses strictly the object or the inspection window, as it contains the following
data for the object: three numbers that respectively indicate the measurement number (1 is the oldest), the
cavity group number, and the cavity number; for the inspection window, it contains just the number of the
measurement and of the window. Each column contains the data concerning one measured parameter.
From left to right: area, shape 1, shape 2, shape 3, shape 4, angle, red level, red dispersion, green level,
green dispersion, blue level, blue dispersion, hue 1, saturation 1, value 1, hue 2, saturation 2, value 2. If a
parameter is not enabled, its column appears blank. When the rings of colour check is enabled, the
columns have the following meaning, from left to right: RVB of the glass, TSI of the glass, RVB of ring
1, TSI of ring 1, RVB of ring 2, TSI of ring 2,...
The presented numeric values vary according to the type of measurement effected. In fact, for learning
and measurement test, the measured absolute numeric values are shown, whereas for work, (automatic or
manual) or for performance measurement, the percentage differences compared to nominal value are
shown. The exceptions are the angle of rotation and hues, with their deviations indicated in degrees.
In the event of a defect, the background colours of the boxes containing the deviations have the same
meaning as the colours used during work to draw the windows around the cavities:
yellow: empty cavity red: defective object blue: object with critical defect.
The followings are possible reasons for rejection:
• Value measured out of tolerance;
• Cavity empty;
• Measure not carried out;
• Foreign body in cavity;
• Fragment of tablet in cavity;
• Powder (stains) on product (if stains on the product check is enabled);
SEA Vision s.r.l.
Harlequin – Reference Manual Page 21

• Powder (stains) on blister (if stains on the blister check is enabled);

• Too many rings (if colour rings check is enabled);
• Too few rings (if colour rings check is enabled).
The window can be removed either by selecting the menu item again or by pressing the close button at the
top right corner.
When the work article has one or more linked articles, the table shows a window for each linked article;
when a title item of a single article has been selected, Harlequin will show the results relating to said
article; if all the title items have been selected, all the articles shall be displayed. When Harlequin uses
Multi-functional TV to check the lidding foil codes, a table with the following fields shall be displayed:
• Image: consecutive number which indicates the image (1 corresponds to the oldest image)
• TV: number of the camera with which the measurement has been performed
• Window: number which identifies the window
• Angle: used only for certain types of measurements; it stands for the measured object rotation angle.
• Time: indicates the time when the measurement has been performed; it is expressed in milliseconds
(ms) starting from the beginning of the work operations (it appears in the symbols key box)
• Code type: indicates the type of the code being read
• Code read: code value represented by a decoded string. The percentage value represents the number of
the research windows scans which correspond to the code being read. In 2D codes (Data Matrix
ECC200), the percentage is calculated as (10 – err)  10, where err is the number of bytes wrongly
read by the symbol.
With Harlequin it is possible to choose the type of results to be displayed: it is possible to show only
good objects or only faulty ones; it is also possible to display only results relating to the type of check
relating to one particular camera or to one single check window.
Depending on the suitably filtered results, it is possible to draw up a report that can be saved on an
external device or printed out.

Images Display
When faulty products images are saved (see paragraph regarding Work Control Images in the
Configuration menu), the window which shows the corresponding image opens up by clicking the
mouse once on the line which contains the numeric results. The title bar of the window contains the
numeric values taken from the table line. The window menu has three title items. The first title
shows/hides the image. The second copies the image on the screen at exactly the same position where the
image has been read. The third creates a file containing the image (BMP format). The last two functions,
which are not available in automatic works, allow the use of the image in further measurement tests.
Several windows may be simultaneously opened. These windows close when the main window (the one
showing numeric results) has been cancelled.

When the first column of the numeric results table has been clicked, the table disappears, and is replaced
by the images sequential display control page.
All the saved images can be displayed (with and without drawings in them) by choosing the number (the
numbers are arranged in time ascending order). As an alternative, arrow keys may be used to display the
images in time order, whether forwards or backwards. Besides, it is possible to save the selected images
in an archive or on an external device, and modify the parameters of the selected article.

SEA Vision s.r.l.

Page 22

Drawings overprinted during the work

The drawings printed over the image of the object to be controlled, represent great help in understanding
the check results. These images are divided into Windows and Contours. The former are the rectangles
which surround the objects being checked, and are green when the cavity is good, red when the cavity is
to be rejected, yellow if the cavity is empty, and blue if the cavity is a critical defect. The latter are
drawings of various types and they give different kinds of information, based on the type of check. The
drawings are viewable if the Measure Control Drawings option in Work Control Images page
(Configuration menu) is set on Windows and Borders.

3.1.10. Batch Start

Batch Start function makes it possible to enter the required production data, reset the production batch
counters, and allows Harlequin to enter into the Automatic Work Mode and start the production line. It
is not possible to start a new batch of the same product unless when the batch function in progress has
been terminated.
The Batch Start operation only concerns the currently selected work article.
Remember that articles are quite independent of each other, since each article has its own counters.
Therefore, a batch need not be an atomic production unit, as it can be alternated with that of other articles.
Each batch is marked by a means of identification (Batch Number). Additional information can also be
associated with a batch: expiry date, price and operator’s name.
Batch counters are always incremented only when Harlequin is in Automatic Work mode.
Production data always reach the batch counters, in other words, these counters can be reset but counting
cannot be stopped.
The counters are saved on the hard disk whenever the blister machine stops, i.e. whenever the button
Auto Mode Exit appears on the screen. Therefore, a sudden power cut while the blister machine is
running causes the loss of information on blisters controlled since the machine’s last stop up to the time
of the power cut.

Enter codes
If additional cameras are connected to Harlequin to check the covering material codes (Alucode), it shall
be necessary to enter the value of the code to be controlled). The page displayed shall change according
the to the code type.
Pharmacode and binary code page
It is possible to enter the code value by using the Numeric Value field, or by clicking the mouse
to modify each bar from narrow to broad and vice versa.
Data Matrix ECC200 page
It is necessary to enter the string of the code to be controlled. The symbol displayed at the right
hand side encodes the string being set.
General code page
It is necessary to enter the string of the code to be controlled.

3.1.11. Batch End

The function Batch End closes the current batch. In case of error the Batch End can be repeated. If the
batch management is enabled (Configuration → System Management) each end of batch operation
creates a new file containing the data of the batch just closed. The list of the produced batches is accessed
through the function View Former Batch Data.
If End of Batch with variable data clearance code window option has been enabled, the end-of-batch
function shall replace the checked code string value with the “00” string. This does not prevent the
products from moving on the production line, due to the rejection of even the objects considered in
conformity with the data of the just-terminated batch.

SEA Vision s.r.l.

Harlequin – Reference Manual Page 23

3.1.12. View Batch

Current Batch
The batch display function represents the page which contains the data of the batch in progress. The
following information is included in the page:
Batch number
this is included at the beginning of the batch;
Product code
work article;
Product description
the description associated with the article;
Price
can be included optionally at the beginning of the batch;
Expiry date
can be included optionally at the beginning of the batch;
Production date
can be included optionally at the beginning of the batch;
Number of pieces in the batch
can be included optionally at the beginning of the batch;
Checks to execute
programmed at the beginning of the batch;
Start of batch
production start date and time: this is the moment when the Batch Start function executed;
Start of batch operator
operator who executed the Batch Start function;
End of batch
production end date and time: this is the moment when the Batch End function executed;
End of batch operator
operator who executed the Batch End function;
Batch duration (end – start)
difference between the times of start and end of the batch, reported above; duration is in days
hours, minutes and seconds;
Total time of blister machine run
time spent with the blister machine running;
Number of machine stops caused by Harlequin
this is the numbers of stops of the blister machines due to Harlequin; (see the paragraph on the
machine stops);
Number of commit operations
this is the numbers of article modifications during the batch; it can be different from 0 only if the
archive management is enabled (System Management);
Inspected pieces
the overall number of pieces controlled by Harlequin; (inspected pieces = good pieces + rejected
pieces);
Rejected pieces
the number of pieces rejected by Harlequin, (rejected pieces = totally empty pieces + incomplete
pieces + pieces with defective products); the blister rejection percentage is indicated in brackets
(rejected pieces / inspected pieces) x 100;
Totally empty pieces
the number of pieces which were empty in all defined cavities; the totally empty percentage is
indicated in brackets (totally empty pieces / inspected pieces) x 100;

SEA Vision s.r.l.

Page 24

Incomplete pieces
the number of pieces with at least one missing object, but not all objects; the incomplete
percentage is indicated in brackets (incomplete pieces / inspected pieces) x 100;
Pieces with defective product
the number of pieces with at least one defective object, but no missing object; the defective
percentage is indicated in brackets (pieces with defective tablets / inspected pieces) x 100;
Good pieces
the number of pieces that have passed the check; the good percentage is indicated in brackets
(good pieces / inspected pieces) x 100;
Average production speed (pieces /minute)
good pieces / total time of blister machine run; is indicates the effective production speed of the
pieces machine, as it compares the quantity of good pieces produced with the time during which
the machine worked;
Productivity (pieces /minute)
good pieces / batch duration; shows the efficiency of the blister machine exploitation;
Inspected cavities
the total number of cavities controlled by Harlequin; (inspected cavities = good cavities + rejected
cavities);
Rejected cavities
the number of tablets rejected by Harlequin, (rejected cavities = empty cavities + cavities with
defective products); the rejected cavities percentage is indicated in brackets (rejected cavities /
inspected cavities) x 100;
Empty cavities
the number of cavities found to be empty; the empty percentage is indicated in brackets (empty
cavities / inspected cavities) x 100;
Cavities with defective product
the number of cavities containing a defective object; the defective product percentage is
indicated in brackets (cavities with defective products / inspected cavities) x 100;
Cavities with geometric defects
the number of cavities containing a defective object with geometric defects only (area, shape,
angle); the geometric defects percentage is indicated in brackets (cavities with geometric defects
/ cavities with defective tablets) x 100;
Cavities with pictorial defects
the number of cavities containing a defective object with pictorial defects only (levels,
dispersions, hues, saturations); the pictorial defects percentage is indicated in brackets (cavities
with pictorial defects / cavities with defective product) x 100;
Cavities with both types of defect
the number of cavities containing a defective object with both geometric and pictorial defects
only; the percentage with both types of defect is indicated in brackets (cavities with both types
of defect / cavities with defective tablets) x 100; the sum (Cavities with geometric defects +
Cavities with pictorial defects + Cavities with pictorial defects) in general is less than Cavities
with defective tablets because there exist other types of defects that are not counted: fragments,
foreign bodies, measures not carried out;
Good cavities
the number of cavities that have passed the check; the good cavities percentage is indicated in
brackets (good cavities / inspected cavities) x 100;
Critical defects
the number of defective objects with a defect identified as critical; critical defects are defined by a
dialogue page activated with the appropriate item in the Archive menu; the critical defects
percentage is indicated in brackets (number of critical defects / cavities with defective product) x
100;

SEA Vision s.r.l.

Harlequin – Reference Manual Page 25

Defects on strip
the number of defective strip control windows; when a defect on strip happens the blisters are
considered empty in the batch statistics;
Rejection auxiliary signals, Number of steps with high level of the signal
indicates the number of steps with high rejection auxiliary signal.

The batch data can be exported on an external device with the button Export File and printed with the
button Print (only if a printer is connected to Harlequin). The exported file is in text format (UNICODE).
Its name is current_batch.txt.

Former Batch Data

This function displays the page containing the list of the produced batches for the selected article.
The visualisation of a file produces the same page described for the current batch. When the batch data
are exported, the name of the file created on an external device is DAT?????.nnnnn.btc.txt, where ? is a
digit and nnnnn is the progressive number of the batches for the selected article.

Measure Results Files

The measure results display function represents the page which contains the list of files having the
selected article measurement results (csv file). A file is created for each production batch. The creation of
measurement results files is enabled at the Total Results Lot File Creation field in the HARLE.INI
configuration. The name of the created file is lot?????.xxxx.csv, where ? stands for the number which
represents the article, and x stands for the consecutive number of the batch. It is possible to save the
images related to the results by using the Total Results Lot Images Creation option in the configuration
file.
Show Data function gives the following information:
Company
description of the company;
Production line
description of the production line;
System
serial number of Harlequin system and software version;
Date and time
file creation date and time;
Batch number
identification entered at the beginning of the batch;
Article
name of selected article;
Description
description linked to article;
Price
optionally entered at the beginning of the batch;
Expiry date
optionally entered at the beginning of the batch;
Production date
optionally entered at the beginning of the batch;
Number of pieces in the batch
optionally entered at the beginning of the batch;
ROI TV
coordinates of the multi-functional camera control windows;
Checks to execute
programmed at the beginning of the batch;

SEA Vision s.r.l.

Page 26

Image, Camera, Window, Date and Time, Result, File Image

measurement result and image file of each image, TV, and window

The Export File push-button saves the .scs file on an external device.

3.1.13. View Article

This function displays the page containing all the parameters stored in the article file (file BLI). The
button Export File copies to an external device the text shown (file UNICODE). The name of the file
created on the external device is DAT?????.BLI.TXT, where ? is a digit. The button Print prints the text
shown (if a printer is connected to Harlequin).

3.1.14. Former Article Versions

This function is available only if the archive management is enabled (Configuration →System
Management). It displays the page containing the list of the previous versions of the selected article.
Each file in the list is generated by an operation of article committing. The committing is executed by a
user who signs the article (inserting his password). If the archive management is enabled only the
committed articles can be used for the automatic work. Any modification to the current article makes it
decommitted.
The visualisation of a file produces the same page described for the current article. If the article data are
exported, the file written in the external device takes the name DAT?????.nnnnn.bli.txt, where ? is a
digit and nnnnn is the progressive number of the article versions.
Moreover the difference between two files can be displayed. After having selected the two files with the
mouse (a click over the row), the button Show Differences opens the page containing only the parameters
that are different in the two files. The values belonging to the older file are shown in brackets ().When the
data are exported, the name of the file on the external device is DAT?????.mmmmm.nnnnn.bli.txt,
where ? is a digit, nnnnn is the progressive number of the younger file and mmmmm is the progressive
number of the older file.

3.1.15. View Log-File

The Log-File contains:
• self-diagnosis information generated at start-up of system
• space available on disk
• the start of automatic work
• the article used during automatic work
• the accesses to Harlequin made by the users
• the operations executed by the users
• the operations executed by the user EXPERT
• password modifications
• archive saving and restoring
• alarm messages generated by Harlequin
Every logging operation on the Log-File includes date and time.
There is a Log-File for each week. The Log-File name is in hww_yyyy.log format, where ww indicates
the weeks in numbers from 0 to 51, and yyyy stands for the year. Monday is the first day of the week.
The text is displayed applying two filters to the set of messages. The first filter is temporal: only the
messages generated in the specified time interval are shown.. The second filter is on the source of the
message. There are four choices:
• all messages, no matter which source they come from;
• only the messages generated by the system; the alarm messages displayed during the automatic work
belong to this set; also the messages concerning the self-diagnosis are system messages;
• only the messages generated by the users; it is the set of the actions executed by the users;

SEA Vision s.r.l.

Harlequin – Reference Manual Page 27

• only the messages generated by a specific user (chosen in the list).

The last case creates the so-called audit trail, i.e. the list of the activities executed by a users in a given
time interval.
The text displayed can be exported in a text file (on an external device). The name of the file is
log?????????.txt, where ? is a digit.

3.1.16. Write on Log-File

This function allows messages to be added to the Log file.

3.1.17. Exit Program

Exit from the program is a privileged operation available to the Expert user only. If the system is
protected (see the System Management), the exit from the program does not bring to the Desktop. This
implies that the file system is not accessible.

3.1.18. Restart Windows

The function Restart Windows terminates the application Harlequin, closes the current session of
Windows and restarts the operating system and the application.

3.1.19. Shut down

This function forces the Shut down of the operating system. After the shut down the system can only be
switched off.

SEA Vision s.r.l.

Page 28

3.2. Archive Menu

3.2.1. List of Articles

The List of Articles (corresponding icon ) enables you to view the list of all the articles stored in
the archive as well as the counters of pieces measured and rejected for each article. In this situation, if you
press the left button of the trackball or mouse (single click) over the line for the product in question, the
product is selected as the work article for the next operations. If images have been associated to the
article, they are shown on the screen. The OK key cancels the window, followed by return to the main
menu.

3.2.2. Linked Articles

This menu item opens the page showing the articles linked to the current article. If one or more articles
are linked to the base article, Harlequin, during the automatic work, checks the pieces using the base
article and its linked articles on all acquired images; this technique is used, for example, to check blisters
containing different products: an article for each product is created (with its own search and measure
parameters) and the automatic work is executed with all articles together; the rejection queues of the
articles are independent too: a blister is rejected if at least one of the values extracted from the different
queues shows a defective blister.
The windows of the cavities (search windows) show also the article number, from left to right: article
number (1 is the base article), blister number, cavity number. The windows on the strip (inspecting
windows) show the article number and the window number.
The following options make it possible to link articles to the basic one:
A+B+C... (AND multi-product): Harlequin performs the work on each image with all linked articles.
The piece is to be rejected if one of the articles indicates a defective blister.

SEA Vision s.r.l.

Harlequin – Reference Manual Page 29

ABC...ABC... (alternate multi-product): Harlequin, instead of using all articles at the same time on the
same image, uses only one of them on each image, taking in sequence the master article and the linked
ones. If, for examples, there are three different articles (A = master article, B = first article in the list of
linked articles, C = second linked article) Harlequin uses the article A for checking the first image, the
article B for the second image, the article C for the third image, then again A for the fourth image and so
on. Of course the sequence of the images must match the sequence of articles. A|B|C... (OR-ed multi-
product): Harlequin takes the best measure result among those obtained from the set of articles. This
option is used when, in the same cavity, there can be different products. In this case one article should be
created and programmed separately for each product. Then the articles are linked together in OR. A+B
+C (- Search): Harlequin considers the cavity as empty if at least one of the researches fails, otherwise, it
takes the worst measurement result from among those obtained from the group of articles.

3.2.3. New Article

New articles are created with this menu item. The code of the new article and an optional description are
requested. The description can, however, be added to or modified later by using the Description key in
the Article Programming Parameters page. The code can be any set of characters up to a maximum of
30, while the description may contain up to 45 characters. The article is created in empty state, i.e.
without either any pre-defined cavity or any inspection window on the strip. On the other hand, all
product search and measure values as well as processing tolerances are initialised with default values.
Steps for programming a new article:
1. acquire images of products
2. create the article with this menu item
3. select menu item Cavities Management and create a new group of cavities (initially empty)
4. create cavities windows belonging to the new group and position them on the cavities
5. repeat operations 3 and 4 for all groups to be controlled in the images
6. define one or more control windows on the strip (inspection window) with the Strip Management
function
7. select menu item Program Article and modify the search parameters until all elements are correctly
located
8. modify the measurement parameters until all elements are correctly measured
9. execute learning
10. set the tolerance values
11. take a few measurements (Manual work) to make sure programming is correct
12. if the operations at points 11 and 12 do not provide satisfactory results, repeat the operations at points
7, 8 and 9.

3.2.4. Copy Article

There is a quicker way of creating a new article similar to an existing one: copy the existing article,
creating a new one identical to the first, but with a different code, and then modify only some of the
programming parameters. Menu item Copy Article is available for this purpose. This copies an article in
the archive with all its associated data. Learned values too are transferred to the new article. Nevertheless,
the production statistics data calculated for the new article are not copied but are zero reset. Similarly to
the previous case (New Article), the code of the new article and its description are requested.

3.2.5. Remove Article

he Remove Article function eliminates the work article from the archive including all its cavities and
data. Confirmation is requested before deletion. After confirmation is given, deletion cannot be reversed,
because the files of the article have been physically eliminated from the hard disk. The only way you can
restore a deleted article is to restore the entire archive from the saving disk created with the function Save
Article (or Save Archive) of the Configuration menu. No article remains selected after the work article
has been deleted.

SEA Vision s.r.l.

Page 30

3.2.6. Program Article

If you select this menu item (corresponding icon ) the main window for entering the programming
parameters appears.
This operation can be executed only after you have positioned correctly all the cavities (and, if necessary,
all inspection windows on the strip) inside the images by using the functions Cavities Management and
Strip Management.
The dialogue window is split into two zones. The top part contains general data on the article, such as
description, camera and viewed colours. The lower part contains the keys for accessing programming
functions.
The window consists of the following fields:

Code
contains the name of the article selected with the list;

Description
a field with a maximum of 45 characters used to save any information; if the relevant button is
pressed, this opens the window for modifying the description itself;

Viewed TV
when several cameras are installed, you can choose which image to show on the screen; the screen
can show one image at a time or all images together, reducing them by a factor of two; numbers 1,
2, 3 and 4 refer to images received from cameras 1, 2, 3 and 4 respectively; zoom indicates
synoptic display (overview) of all images;

Viewed Colour
in addition to normal viewing of the colour image (colour), you can observe one of the three
colour components (Red, Green, and Blue) in grey tones; by additive synthesis, these three
components form the colour image on the screen;

Search and Measure

this indicates on which colour component the search and measure operations are to be executed;
therefore, if you select one of the three fundamental colours (R, G, B), the objects are measured
geometrically using the monochrome image for the selected component; this is possible when the
band which is utilised has sufficient contrast level; the pictorial measurements (levels, dispersions,
hues, and saturations) are taken, in all cases, on all the colour bands;

colour image red green blue

option L+C ensures that geometric measurements are taken on a mixture of intensity and
saturation; the composition of this mixture depends on the Colour Level value and on the
Normalisation parameter; the Transform Images button facilitates the choice of colour level and
of the normalisation option; in fact, with the L+C option, geometric measurements are taken on
the monochrome image obtained by pressing the Transform Images push-button; the result of
this conversion depends on the Colour Level, and is shown immediately on the screen.
Distance from Colour option makes it possible learn a colour and transform the image in
conformity with that colour; the Distance from Colour button is used to learn the reference
colour or colours.

SEA Vision s.r.l.

Harlequin – Reference Manual Page 31

Colour Level
when you select the L+C option in the Search and Measure field, the Colour Level indicates at
what proportion intensity and saturation are mixed together; this value can be in the range of 0
(intensity only) to 256 (saturation only);

Normalisation
forces normalisation of saturation with respect to intensity in order to equalise zones of different
luminosity;

Transform Images
transforms images associated with the article (saved with the Save Images function) into
monochrome images according to the Colour Level and Normalisation values; the images of the
result are immediately displayed on the screen;

colour image

transformation with level 0 (only intensity), 80, 160 e 256

colour image

transformation with level 256, without normalisation

transformation with level 256 and normalisation

Save Images
saves displayed images on hard disk; for each article, therefore, an image can be associated with
each camera, to be conserved either as a sample image or for the measure tests; this function is
equivalent to Save Images on Disk (Article) from Images menu; the images saved with this
function are accessed by all functions using images stored on disk (Load Images from Disk
(Article), search test, measure test, learning, manual work); they are also used by the Transform
Images function;

View Images
displays, on the screen, the images associated with the article; this function is equivalent to the
item Load Images from Disk (Article) of the Images menu;

Distance from Colour

Opens the distance from colour programming page. The source image is transformed into a binary
image.
The pixel values of the transformed image are based on the following parameters:
• red: (from 0 to 255): indicates the red component in the reference colour;
• green: (from 0 to 255): indicates the green component in the reference colour;
• blue: (from 0 to 255): indicates the blue component in the reference colour;
• colour range/ intensity: (from 0 to 255): extraction of pixels close to colour / reference
intensity up to the limit of this range;

SEA Vision s.r.l.

Page 32

This learning function makes it possible to define the values of the three colour components, in
order to identify the reference colour by clicking the mouse on a point on the monitor.
Permissible colour range definition is possible by modifying the ‘Intensity Range’ and ‘Colour
Range’ parameters.

Exposure Time
the exposure time value to be used for each camera acquisition for the given article;

Acquisition
this function acquires images from the cameras according to the exposure time associated with the
article; to establish the exposure time to use, we advise you to move the Article Programming
Parameters window to the right, taking it partly off screen so that the images are visible, and also
to enable you to change exposure time and the viewed camera;

Tablet Type
if the tablet is lighter than its surrounding area, select the first option, otherwise the second; the
surrounding area is the shadow near the border, therefore, even if the foil is white (and brighter
than the object) the option Bright on dark background should be used; moreover is must be
always used when the Search & Measure are executed with the option L+C;

Learned values (key with glasses)

shows or makes disappear the window containing the learned reference values;
a mouse click over a number opens the dialogue page for the value modification;

Dates & Users

shows the page containing the information about the dates of the article modifications:

Search Parameters
opens the programming page for the search parameters;

Measure Parameters
opens the programming page for the measurement parameters;

Super Article
identifies the article as a Super Article. A Super Article is used as a master article to define
formats; with the operator’s permissions, the user can display and select only the super articles
which are in the articles list. Besides, the operator may replace articles linked to the super article
with others belonging to the same family; yet the operator may not eliminate or add any linked
articles;

Container Article
when a super article is identified as a container article of other articles, it does not take part in
rejecting the piece. Container articles are not to have any cavities and strip windows; in all cases,
container articles may manage the multi-functional TV windows and rejection auxiliaries;

OK
to exit the Article Programming Parameters window, while saving any modifications in the
archive;

SEA Vision s.r.l.

Harlequin – Reference Manual Page 33

Cancel
to exit the Article Programming Parameters window, without saving any modifications in the
archive, not even those effected in the search and measure parameter windows; when you press
the Cancel key, you will be prompted to confirm before exiting the dialog window, but only if
some parameters has been modified:

3.2.7. Search Parameters

The Article Data on Search window is the tool for programming the search of the products inside the
windows defining the position of the cavities (search windows).
The window consists of the following fields:

Code
displays the name of the article selected from the list;

Description
displays the article description;

Search Type
the object search type inside the cavity can be selected with the following options:
one-dimensional horizontal:
the centre-of-object position is searched only in the horizontal direction; in this case, the
cavity window (search window) must be wider than the object horizontally, whereas
vertically, this does not matter; if the sub-sampling step (see Special Parameters for
Searching) is from 4 to 6, the centre-of-tablet vertical co-ordinate is still the same as that
of the centre of the search window; on the other hand, if the sub-sampling step is from 1 to
3, the vertical co-ordinate adapts to the dimensions of the object;
one-dimensional vertical:
the centre-of-object position is searched only in the vertical direction; the above comments
also apply here but in the vertical sense;
one-dimensional horizontal + vertical:
one dimensional searches are executed independently in both directions; the search
windows must therefore be sufficiently large in both directions; if even one of the two
searches fails, the cavity is considered empty;
two-dimensional:
the product is searched in both directions inside the cavity; the window must be
sufficiently large to include the entire zone in which the tablet could be located; this option
is used typically on aluminium supports with cavities that are larger than the product
dimensions, i.e. when the product is able to move inside the cavity;
two-dimensional capsule:
a similar search to the above; usually utilised for capsules on aluminium;
two colours horizontal capsule:
a search for the centre of a capsule consisting of two shell halves of different colours, one
lighter than the other – it is assumed that the capsule is positioned horizontally in the
image;
two colours vertical capsule:
a similar case to the previous one; it is assumed the capsule is positioned vertically;
level:
the product is found with a threshold operation on the grey levels; the threshold value is
the search contrast; the number of points above threshold must be inside the range defined
by the minimum and maximum number of internal points (see the special parameters for
the search);
SEA Vision s.r.l.
Page 34

total
the product is looked for in the all search window possible positions;
distance from colour
The source image is transformed into a binary one, where all extracted points have the
desired colour; learned values are used as reference colours in the search. The option
enables the Distance from Colour button, which opens the colour learning page. The
following parameters are saved for each learned colour:
• red: (from 0 to 255): indicates the red component in the reference colour;
• green: (from 0 to 255): indicates the green component in the reference colour;
• blue: (from 0 to 255): indicates the blue component in the reference colour;
• colour / intensity range: (from 0 to 255): extracts of pixels close to the reference
colour / intensity up to the limit of this range;
This learning function makes it possible to define the values of the three colour
components, in order to identify the reference colour by clicking the mouse on a point on
the monitor. The Learning button opens the dialogue page which shows the values of Red,
Green, Blue, Hue, Saturation, and pixel Intensity indicated to by the mouse. The
segmentation reference colour can be read by clicking the mouse on the image or with
manual setting. Permissible colour range definition is possible by modifying the ‘Intensity
Range’ and ‘Colour Range’ parameters.
When the Enable box is barred, the image will be segmented into three colours: orange,
black, gray. Orange pixels belong to colour and intensity ranges (segmented pixels) which
are permissible and thus extracted by the image transformation. Black pixels have the
correct intensity but not the correct colour. Gray pixels are out of intensity range.
model
searches for a model in the image. The Learning button makes it possible to understand
the required model (bitmap) using the mouse. The View button displays the image of the
learned model.
In order to have a positive result, the search result is a correlation value which must be
higher than the search contrast (Search Contrast). Harlequin can save several models,
each of which is identified by a model_bitmap.?????.bmp name, where ? indicates the
file consecutive number. The model to be used is chosen by setting the file number in the
File Number field. It is also possible to set the model Search Speed (from 0 to 5).
no search:
the product is not searched; it is assumed it is always present at the centre of the window;

Search Contrast
the contrast value for searches is the only value, which, in most cases, must be programmed; this
value is established experimentally by using the Search Test function; several different values are
tested in order to identify the range of values within which the tablet search is reliable and
repeatable; similarly, after removing the products from the cavities, you have to establish the
range of contrast values with which the program is certain not to find anything; at this point,
choose as a contrast, the central value of the range obtained by the intersection of the two
preceding ranges: for example, if the first range (enabling you to find the product) is 50 to 100,
and the second range 60 to 200, select 80 as the setting value;

Horizontal, Vertical Offset

amount (in pixels) of the horizontal and vertical displacements that are applied to the coloured dot
(result of the object search); this option is used when the search is made on an object different
from the measured one; the image shows an example: the goal is the measure of the ampoule
head, however the search window is on the ampoule body; the red dot is therefore horizontally
moved so that is falls in the middle of the ampoule head;

SEA Vision s.r.l.

Harlequin – Reference Manual Page 35

Special Parameters
opens the page for programming Special Parameters for Searching; the special parameters
should be changed only if it is impossible to obtain a reliable search by selecting an appropriate
contrast value;

Search Test
the search test makes it possible to verify immediately the validity of the programmed search
parameters; to this end, a keyboard appears on the right of the screen to enable you to select the
image source;
if you press one of the two keys, the search procedure is activated and the result of this is shown
graphically by the drawing of a coloured point on the tablet, or of a set of points for a two
dimensional search; if the search fails, no drawing is effected; the OK key terminates the search
test;

OK
to exit the window Article Data on Search; any modifications are saved in the archive only if you
exit the Article Programming Parameters window with the OK key.

3.2.8. Special Parameters for Searching

When a new article is created, values are attributed to the Special Parameters for Searching, which
make it possible to handle most of the cases encountered in practice. Nevertheless, it may be necessary to
modify some of them to deal with special cases: tablets or capsules with over-printed wording, unusual
shapes, or non-uniform powders.
We advise you to vary values one at a time and promptly execute a test search.
In particular the two dimensional search is influenced by several special parameters (in addition to the
contrast set on the search parameters window): the space filters on the cavity border and centre, the
anti-noise filter, the number of internal points, the lengthening and the dimensions of the object.
Internal points are those drawn on top of the tablet at the end of a search; their quantity can be
approximately evaluated from the drawing and depends on the sub-sampling step used. Lengthening
measures to what extent the shape of the region differs from a circle; the tablet lengthening value can be
obtained experimentally, for example, by increasing the minimum value until objects can no longer be
detected. Moreover the width and height represent a constraint on the horizontal and vertical dimensions.
Normally, none of these values should be changed but, if this is necessary, the principle of how two-
dimensional search operates should be kept in mind. The search is based on segmenting the image zone
inside the cavity into uniform blobs, one of which must be the object being searched. To help select the
blob corresponding to the tablet, the number of internal points (and also lengthening, width and height)
are calculated for each blob: all blobs not meeting the minimum and maximum value constraints of the
said parameters are rejected. Therefore, the values characterising the product must be within the range of
the minimum and maximum set values. Next, the surviving blobs are subjected to controls by the filters at
the border and centre (if enabled) and to the anti-noise filter at the final stage (if greater than 0).
The values set when the article is created are not in any way a constraint. If this configuration is
insufficient to obtain certain identification, the other constraints must be gradually introduced, preferably
in the following order:

SEA Vision s.r.l.

Page 36

• lengthening
• number of internal points
• width and height
• anti-noise filter at initial stage of search (morphologic filter)
• anti-noise filter at final stage of search (levels filter)
If, instead, the basic configuration does not enable any object to be detected, the two space filters must be
disabled (first the one on the border and then at the centre) and the other constraints must be introduced in
the order mentioned above.
Space filters, internal points, width and height only are used for Two Dimensional Capsule Search.
Moreover there exists a constraint on the boundary orientation. It is possible to specify a preferential
orientation of the edges: only those oriented as specified are detected, whereas all other edges are ignored.
All the other parameters are not considered and, therefore, variations of these have no effect on the result
of the search.
For the Level Search only the limits on the number of internal points are used.
Programmable values:

Sub-sampling Step
this value can be programmed from 1 to 6: it determines the pixel decimalization step for all single
and two dimensional search operations; for horizontal or vertical one dimensional searches, the
sub-sampling step determines also the way in which the second co-ordinate is established; if the
step is from 4 to 6, the second co-ordinate is set to the value at the centre of the search window,
whereas if the step is from 1 to 3, the second co-ordinate adapts to the object dimensions;

Noise Filtering Level

size of the morphological filter to apply before the search operation; we recommend values below
5; this function is used when the object surface is not uniform;

Minimum Level
pixel values under the minimum level are not taken into consideration.

Global Search
this option compels all found objects to have the same position inside the search window; this
position is computed as median value of the measured positions; the computation is done
independently horizontally and vertically; the global search is useful when the localisation of
some objects is difficult (not repeatable); it can be used if all objects have relative positions that
do not change from one image to the next;

Constraint (1D)
only for the one-dimensional search: it prevents points near the window edge from being used for
the computation of the object position;

Filter on Edge of Cavity, Filter on Centre of Cavity

these filters ensure that a product or combination of product and fragments (multiple detection)
are detected correctly, without imposing any constraints on the dimension and shape of products
or on their grey tone level; the article is created with the border and centre filters active and
without the minimum and maximum values of the number of internal points and of lengthening
being a constraint to search; filters can be disabled in exceptional cases only; if they are, area and
lengthening constraints as well as the anti-noise filter are used instead;

SEA Vision s.r.l.

Harlequin – Reference Manual Page 37

Noise Filtering Level (initial phase)

the filtering value to be executed at the initial stage of search; it activates mathematical
morphology operations on the regions extracted by the first phase of the two-dimensional search;

Noise Filtering Level (final phase 1 and 2)

the filtering value to be executed at the final stage of search, when the cavity has been split into
uniform areas, in order to reject areas that do not correspond to products; this function is used
when the effect of the filters (on the border and centre of the cavity) and constraints on area and
lengthening are not sufficient to ensure sure identification of the product, leading to multiple
detection inside the cavity; a negative effect of the anti-noise filter is reduced sensitivity in regard
to multiple objects in the cavity; the greater the filter value, the less likely the detection of double
objects (or of multiple fragments); the maximum value wholly prevents detection of multiple
objects, in any event, forcing identification of only a single object in the cavity;

Number of Internal Points (Minimum-Maximum)

threshold value of the quantity of internal points; areas with a number of points below the
minimum value or above the maximum value are rejected;

Lengthening (Minimum-Maximum)
threshold value of lengthening; areas with lengthening value below the minimum value or above
the maximum value are rejected;

Width (Minimum-Maximum)
threshold value of the horizontal dimension; areas with a width below the minimum value or
above the maximum value are rejected;

Height (Minimum-Maximum)
threshold value of the vertical dimension; areas with a height below the minimum value or above
the maximum value are rejected;

Number of Objects (Minimum-Maximum)

threshold value of the number of objects which may be found in the search window; areas with
extracted components number below the minimum value or above the maximum value are
rejected.

Multiple Search
the option is enabled for the capsule bi-dimensional search, and it allows the acceptance of
extracted components number above one.

Minimum Distance between Objects (pixel)

represents the threshold below which the distance among the objects is not accepted if more than
one object is located in the cavity, and if the Multiple Search option is enabled; the parameter is
expressed in pixels. The search fails if the distance constraint has not been executed.

Two-dimensional Capsule Search: Edge

when the search is of type Two-dimensional Capsule it is possible to execute the search by using
only the edges oriented in one direction; this makes the search easier when the objects are oriented
along a given direction;

SEA Vision s.r.l.

Page 38

Post-Processing Parameters
opens the pages of post-processing parameters for the two-dimensional Capsule search, technical
search based on the extraction of components formed by border points within the object border.
The parameters are:
Enable Post-Processing
Enables the post-processing technique;
Remove Border Points
Enables the removal of border points;
Include Border Points
Border points, extracted by the capsule bi-dimensional search, are added to internal points
extracted with the post-processing technique;
Filter Dimension Horizontal, Vertical
Dimension of the filter used to extract internal points;
Sensitivity
Internal points extraction threshold;
Size of Erosion
Dimension of the extracted internal points erosion filter, to be performer before the
extraction of the components;
Area Minimum, Maximum
Minimum and maximum area of extracted components;
Width Minimum, Maximum
Filter on the extracted components dimensions (width);
Height Minimum, Maximum
Filter on the extracted components dimensions (height);
Filter on Border Distance
Enables the filter on the components position; the component Maximum Distance is set
from the border points;
Minimum Distance from Window Edge, Horizontal, Vertical
Filter to eliminate the components which are close to the search window borders; it is the
minimum permissible horizontal and vertical distance between the extreme limit of the
component and the window border.

Mobile Window
Enables the possibility to shift the search window at a horizontally and vertically set distance,
compared to the search for a linked article where the number is specified.
The parameters are:
No
option disabled;
Absolute
the search window point is obtained by adding the horizontal and vertical offset to the
linked article search point;
Relative
the search point depends on the horizontal and vertical offset and on the difference
between the linked article search point and the centre of the linked article search window;
Linked Article
number of the linked article;
Offset Horiz., Vert.
horizontal and vertical offset to be reached at the linked article cavity search point.

SEA Vision s.r.l.

Harlequin – Reference Manual Page 39

Centre Position
the position of the window search point may be the centre point of the extracted points or one of
the cardinal points

Linked Article for Masking

it is the number of the linked article which is used to eliminate the areas which have already been
checked by the linked article, from the search window.

OK
to exit the window Special Parameters for Searching; any modifications are saved in the
archive, only if you exit the Article Programming Parameters window with the OK key.

3.2.9. Measure Parameters

The Article Data on Measure page is the tool for programming product measuring. It is the target of
Harlequin.
The measure consists in the localisation of the object contour. It is shown on the screen with a drawing. A
good measure is characterised by a drawing following the border of the measured object. All points inside
the drawing are considered to belong to the product.
The points laying externally of the drawing are ignored. The contour itself contains all information about
shape and size of the object: from it the geometrical parameters are computed (Area, Shape 1, Shape 2,
Shape 3, Shape 4, Angle). All points inside the border are used to compute the pictorial parameters
(Level, Dispersion, Hue, Saturation).

Code
contains the name of the article selected with the list;

Description
displays the description of the article;

Measure Contrast
the contrast value is the only value which, in most cases, must be programmed; this value is
obtained experimentally by using the measurement test function; test several different values in
order to find the range of values within which the measurement is reliable and repeatable, and then
choose the central value of the range as the contrast; high contrast values give a object contour
bigger than that obtained with lower values;

No Geometric Measure
when the box is barred the program calculates only the pictorial parameters (Level, Dispersion,
Hue, Saturation) inside the rectangle of the cavity window; in this case, the value of the area is
set equal to the number of points of the rectangle, whereas the shape and angle parameters are set
at 1;

Only Search Pixels

when the box is barred, Harlequin considers only the search points used to perform pictorial
measurements, even if such points are not included in the measurement window;

Only Empty Cavities are Good

when the box is barred Harlequin considers good only the cavities where the search fails; the
measure is not executed; this option is used when a blister shows cavities that can be erroneously
occupied by the product;

SEA Vision s.r.l.

Page 40

in this case two different articles must be created and linked together: the first checks the product,
the second, provided with this option, checks the cavities that should remain empty; of course the
search parameters of the second article have to be identical to those of the first one;

Also Empty Cavities are Good

when the box is barred Harlequin considers as good even the cavities in which the search has
given negative results; the measurement is not performed;

Special Parameters
opens the page for programming Special Parameters for Measure; the special parameters should
be changed only if it is impossible to obtain a reliable measure by selecting an appropriate contrast
value;

Measure Test
the measurement test enables you to check immediately the validity of the programmed
measurement parameters; to this end a keyboard is shown on the right of the screen enabling you
to select the image source; the results of search and measure are shown in graphic form;
measurement is executed correctly when the drawing on the border of the tablets is uniform,
without shifting away from the border itself; if the drawing tends to escape to the outside of the
tablet, the contrast value must be reduced; however, this value must be increased if the drawing
tends to remain inside the tablet;

measures executed with contrast 10, 15, 25, and 50:

Colours
to open the window for programming the number of Colours;

OK
to exit the Article Data on Measure window; any modifications are saved in the archive, only if
you exit the Article Programming Parameters window with the OK key.

3.2.10. Colours
An object usually has one colour only. Some gelatine capsule products are monochromatic too. However,
marketed capsules more often consist of two shell halves of different colours. In this case, we advise you
to measure the Hue, Saturation and Value parameters separately on each half of the capsule. To enable
double measurement of these parameters, specify 2 as the number of colours, and select the method for
distinguishing points belonging to each of the halves (segmentation).
Segmentation can be executed on the hue, saturation, or on the value of the image points. You should
select according to the differences between the points of the two halves for each of these 3 parameters:
the most suitable segmentation parameter is the one showing the greater difference.
The 3 parameters are usually evaluated by converting the colour image (RGB) into 3 components - Hue,
Saturation and Value (HSV) – by using the appropriate item of the Help menu (Convert RGB→HSV),
and viewing one parameter at a time to enable you to observe, directly on the converted images, the hue,
saturation and value differences of the two shell halves.
When the colour images have been converted, remember the following: the hue image (R→H) is placed
in the red band, the saturation image (G→S) is placed in the green band, and the value image (B→V) in
the blue band. The three bands must be viewed separately. If the bands are superimposed, this is of no
significance.
SEA Vision s.r.l.
Harlequin – Reference Manual Page 41

The images below show the following in this order:

• 25 two-colour capsules of 5 different types
• image of hue after conversion
• image of saturation
• image of value.
The converted images show that the following segmentation parameters can be used (from left to right):
• value for white and green capsules
• hue for the red and green capsules
• value for the white and red capsules
• saturation for the yellow and green capsules
• hue for the grey and red capsules.

SEA Vision s.r.l.

Page 42

3.2.11. Special Parameters for Measure

When a new article is created, values are attributed to the Special Parameters for Measure, which make
it possible to handle most of the cases encountered in practice. Nevertheless, it may be necessary to
modify some of them to deal with special cases. We advise you to vary values one at a time and promptly
execute a test measure.
The programmable values are as follows:

Number of Border Points

the number of points into which the object border is subdivided;
the search of the border starts from the centre (found by the search phase) and moves towards the
outside; it stops when a point is found, whose contrast is bigger than the measure one (set in the
measure programming page);
this procedure is repeated as many times as specified in this field along directions characterised by
different angles; if, as example, 100 points are used, the border is subdivided with a step of 3.6°;

Dimension of forbidden area at Centre of Product

the dimensions in image points (pixels) of the elliptic area around the object centre, which is
ignored during measurement; the ellipse is defined by the horizontal and vertical semi-axes and by
the rotation angle (in degrees); these parameters can be used if there is writing at the centre of the
tablet that could alter the measurement results;

SEA Vision s.r.l.

Harlequin – Reference Manual Page 43

Dimension of the Border Points Validation Area

this parameter can have two slightly different meanings depending on the Border Measure
Direction:
• direction from inside or outside: the dimension of the zone probed around each point of the
border to verify the validity of the border; this option is used when measuring contrast is low
due to insufficient contrast on the tablet border and, at the same time, the tablet surface is not
uniform, causing an irregular border to be detected;
• circular direction: the dimension of the zone probed round each point of the border to detect
other points of the border; recommended values are 3 and 4;

Sensitivity of Search for Fragments Adjacent to the Product

this parameter does not directly concern product measurement, but the search for product
fragments; if the cavity is larger than the product there may be fragments in the vicinity of the
product; to be sure that a fragment has been detected by the measurement test, the search control
points must be drawn correctly on the product but, at the same time, the product border must not
be drawn; when a fragment is detected, the window containing the numeric results of the
measurements shows the message “Fragment of product in cavity” on the line of the defective
cavity;

Noise Filtering Level

it is the size of the median filter to apply to the sub-image read for the measure;

Border Measure Direction

border measurement is usually executed from the centre to the outside of the tablet; if there are
large scale written areas on the inside of the tablet or if two-colour capsules of markedly different
colours are handled, it may be more convenient to measure in the opposite direction – from the
outside to the centre – or in circular direction;

Border Continuity Constraint

the border continuity constraint is necessary in rare cases when, due to unexpected lack of contrast
on the border of some tablets, a drawing occasionally escapes outwards in a few isolated points; if
the continuity constraint is implemented, the border is made uniform, by cutting border portions
that project abnormally from the tablet border;

measure without constraint , measure with constraint

SEA Vision s.r.l.

Page 44

Shape 2
the standard parameter Shape 2, which measures the elongation of the object, can be substituted
with other parameters, useful in particular cases; this option should be enabled when there exists
the risk of mix-up among circular and hexagonal (pentagonal) tablets, sharing the same size and
colour; the same tolerances of the shape 2 are used;

Shape 3
Shape 3 standard parameter, which measures object asymmetry, can be replaced by Min.
Rectangle or Min. Ellipse parameters, to determine the smallest rectangle (or ellipse) that
delimits the border of the measured object, regardless of its rotation angle; the value is determined
as the difference between the rectangle (or ellipse) area and the object area;

Border Convexity Constraint

the border convexity constraint is used in special cases whereby a convex border is required,
although it cannot be obtained directly; for example, if the capsules are over printed with writing
that may have a random lay-out when viewed by the camera, the border may be eroded in the
vicinity of the writing; the convexity constraint corrects the border thus enabling measuring
repeatability;

measure without constraint , measure with constraint

Non Uniform Contrast

objects are not always lighter or darker than their surrounding area; this option must be used if
both types of contrast are simultaneously present on different parts of the border of the same
object;

measures without and with the option Non Uniform Contrast

Measure of Length (Shape 1)

enables the measure of the object length; this value substitutes the Shape 1 parameter, whose
tolerances are used;

Differences RGB (Dispersions)

enables the calculation of dispersion related to the Red, Green, and Blue strips. This function
increases the colour recognition sensitivity;

OK
to exit the Special Parameters for Measure window; any modifications are saved in the archive,
only if you exit the Article Programming Parameters window with the OK key.

3.2.12. Measure Window

The measurement window is the image zone in which the border is detected. While the cavity window,
set by the user, is used as a search window, the measurement window, which is centred at the point
SEA Vision s.r.l.
Harlequin – Reference Manual Page 45

calculated by the search procedure, has variable dimensions; these dimensions are usually calculated
automatically by the program; in any case it is possible to fix the dimensions (and the shape) by selecting
one of the possible cases, independently in horizontal and vertical directions; when the measure test is
performed the measure window is drawn on the screen.

Diagonal measure window Rectangular measure window

Elliptic measure window together with the search window (in yellow)

3.2.13. Capsule Model

When you bar the box Enable Use of Capsule Model to enable the capsule model, a technique specially
designed for capsule control is activated; this technique assumes that the effective border of the capsule is
that of a pre-defined model, based on three parameters: dimension, position and angle. The model border
is used to evaluate the average level of grey tones and dispersion of capsule levels; shape parameters are
not calculated. Capsule dimensions, position and angle can be measured independently or be forced to
one of the possible values; dimension varies from 1 (minimum) to 10 (maximum), whereas the angle
ranges from 0 to 179 degrees.
The model based on half capsule requires that the measure be programmed only to detect half capsule
(possibly the half visible part of the body). From this measure Harlequin computes the whole model and
applies it to the image to obtain the pictorial parameters; the half capsule measure is advantageous when
one of the two colours of the capsule can be easily measured. If the Measure Window 1/3 box is enabled,
the half-capsule border is determined with a measurement window equal to one third.

Example of measure on half capsule: first the orange part is measured , then the model is

enabled .

3.2.14. Powder and Stains Check

Harlequin distinguishes two cases: check on the product and check on the blister. Each of them can be
programmed with its own Sensitivity of Search (if the sensitivity is 0 the check is not executed). The
check aims to detect stains and powder that create either darker or lighter areas in the image.
It is possible to select the search: Only light stains, Only dark stains, or Light and Dark stains. The
Minimum Number of Points represents the minimum dimension of the stain detected in the check. If the
value is 0, all stains, of whatever dimensions, are extracted from the image. Each stain is highlighted on
the screen by a red square drawn on the stain itself.
In case of product check, it is possible to define an area adjoining the border, which is not to be checked
(Dimension of the no-check area inside the border).
In case of blister check, it is possible to define an area adjoining the border, which is not to be checked
(Dimension of the no-check area around the product).
To avoid the wrong detection of the cavity edge as a stain, it is possible to define an area to ignore around
the product (Variation of the Check Area Size). The width of this area is expressed in pixel.

SEA Vision s.r.l.

Page 46

Harlequin checks the area corresponding to the blisters. This area can be modified by moving its four
edges with the four numbers available. The area is shown when a measure test is executed.

3.2.15. Colour Rings Check

The dialogue page enables the check of the colour rings on the product (vials, syringes,…). The algorithm
joins the search and the rings measurement; therefore, it is possible not to perform any search
The rings dimensions (thickness, diameter and distance) in pixels, may be measured on the acquired
image.
It is necessary to set the following parameters:

Number of Rings
indicates the number of rings to search;

Orientation Horizontal Rings, Vertical Rings

indicates the position of the rings inside the measurement window;

Filter Dimensions (Pixels) Horizontal, Vertical

Sets the filter on the rings dimensions;

Rings’ Dimensions (Pixel) Thickness, min. Diameter

geometric dimensions (thickness and minimum width) of the rings, calculated in pixels;

Distance between Rings (Pixel, 0: no)

minimum distance among the rings, calculated in pixels;

Minimum Contrast
minimum threshold contrast used in the rings search;

Search of Black, Grey and White Rings

if enabled, it permits the search of the black, gray, and white rings.

3.2.16. Program Linked Articles

Using this menu item, Harlequin modifies the parameters related to articles linked to the work article.
It is possible to select the required linked article, modifying its number. It is possible to modify the article
general parameters, search parameters, and tolerance measurement of the learned values.
When the ‘Work Measurement Search Test’ option is enabled, Harlequin performs a real-time test on the
image using the modified parameters: this way, it is possible to directly test the parameters which are
being modified in the work image.

SEA Vision s.r.l.

Harlequin – Reference Manual Page 47

3.2.17. Article Wizard

Harlequin offers to the user an article self-programming tool (Wizard). The Wizard starts when the icon

is pressed. The Wizard offers the following advantages.

• It can program almost all products.
• It prevents from forgetting some programming steps.
• It allows non-expert users to program new work articles by themselves.
• It speeds up the programming operations, saving time.
• It aids the user to select the correct sequence of operations.
• It aids the user to choose the correct tolerances.
The Wizard can be used if the blister machine is ready to run and can load the product in the cavities. If
the blister machine can run without product feeding, it is still possible to use the Wizard procedure by
manually loading some blisters. In this case the last step (learning with the machine running) is delayed to
when the blister machine will be able to load the product.
From the user point of view the Wizard is a sequence of dialogue windows, which the user can scan in
both directions (to modify or to check the setting). Each dialogue window always shows two boxes
containing messages sent to user by the Wizard and instructions that must be executed by the user.
Moreover there are always the following four buttons in the bottom end of the dialogue window:

go back to the previous dialogue window, abort the article creation procedure, open

the Help page (not available in the current version), go ahead to the next dialogue window.
For each window the user has to:
• read the messages;
• execute the instructions;
• go on to the next page; this is possible only after the execution of the instructions.
At any time it is possible to go back to the previous page.
When the user decides to abort the new article creation procedure the Wizard first asks for a confirmation,
then asks for deleting the article.
Here is the list of the Wizard steps and functions.

Article creation
An article is created either brand-new or as a copy of an existing one. In the latter case the procedure is
shorter, because the steps concerning the programming parameters computation are omitted. The copy of
an existing article is advantageous when a new format of the same product must be programmed, that is
when there already exists an article which shares with the new one both the strip and the product, but not
the cavity number and/or layout. The typical case happens when a full format (sale) is already
programmed and a new format containing fewer cavities must be created (sample).
The article being copied is selected in the list that appears with a click on the arrow.

Number of different products

Harlequin can check different products that are in the same blister at the same time (multi-product
blister). The number of different products must be specified.

Exposure time selection

The Wizard chooses the exposure time by measuring the light intensity of the product inside the cavity.
This can be done if at least one cavity contains the product: manually load a cavity in the field of view of
the camera (the first camera if two cameras are installed). Alternatively you can start the blister machine
to bring the product in the control area.

SEA Vision s.r.l.

Page 48

When the machine runs all blisters are rejected. This is true not only in this case but also in all cases when
the blister machine runs during the Wizard procedure.
After the button Autoexposure is pushed you must show to the Wizard the position of the cavity
containing the product. This is done through a click on the product.

Image acquisition
The Wizard needs some images to compute the programming parameters: at least three showing all
cavities full with product free of defects, and at least one with all cavities empty.
The images are acquired while the blister machine is running. When the machine stops the Wizard asks
for a classification of the acquired images: it shows on the screen one image per time and prompts for the
choice among three possibilities. In the images only the blisters to control must be taken into account.
Therefore, even if the images contain other blisters, they must be ignored for the classification purpose.
The classification must be carried out without errors. In fact the Wizard, during the computation of the
parameters, would be deceived by a wrong classification of the images.

Product type selection

The product type affects the choice of the measure parameters. The soft gelatine capsules are included in
the one-colour capsule category. If the blister contains more than one product the choice must be repeated
for each of them.

Forming strip type selection

The forming strip type affects the choice of the algorithms. The semitransparent coloured strips (red, blue,
amber) must be classified as transparent.

Background selection
The Wizard asks the background colour only if the base foil is transparent.

Number of channels
The number of channels of the format is not asked if the blister machine has only one channel.
Number of rows
The number of rows is asked only if the blister machine has alternating movement. On these machines
Harlequin acquires one image for each machine step (index). Inside the step the blister are arranged on
rows.

forming foil top view

machine side

first channel

second channel

third channel web moving direction

operator side
row of blisters

SEA Vision s.r.l.

Harlequin – Reference Manual Page 49

Blister length
The Wizard asks the blister length only if the internal PLC type 2 is active.

Blister format
The blister format description aims to define the cavity layout inside the blister. First the type of grid
(layout) must be selected. Only two types are allowed: rectangular and hexagonal (the message shows
examples of both). Then the numbers characterising the blister are set. It should be noted that the words
vertical and horizontal refer to the screen appearance of the blister, not to the operator's view while he
looks at the forming strip. For the rectangular grid the maximum numbers of cavities both in vertical and
horizontal directions are requested. If the blister contains more than one product the previous operations
must be repeated for each of them.

30 cavities, 5 cavities max. in vertical, 6 cavities max. in horizontal

18 cavities, 5 cavities max. in vertical, 6 cavities max. in horizontal

26 cavities, 5 cavities max. in vertical, 6 cavities max. in horizontal

24 cavities, 5 cavities max. in vertical, 6 cavities max. in horizontal

For the hexagonal grid the numbers of horizontal rows and the maximum length of them are requested.

28 cavities, 5 horizontal rows of max. length 6

30 cavities, 5 horizontal rows of max. length 6

30 cavities, 10 horizontal rows of max. length 3

10 cavities, 10 horizontal rows of max. length 1

9 cavities, 2 horizontal rows of max. length 5

SEA Vision s.r.l.

Page 50

Setting the position of the cavities

The Wizard has to know, other than the cavity layout, the position of the first blister on the screen.
Conventionally the first blister is located in the image of the first camera in the topmost and leftmost
position (looking at the screen), Then the Wizard asks, in case of rectangular grid, for two mouse clicks in
the centre of two cavities placed in two opposite corners. In case of hexagonal grid the clicks to do are
four: on one leftmost cavity, on one rightmost cavity, on one topmost cavity and on one bottommost
cavity.
If the product to check is a capsule, the Wizard asks for two extra clicks at the extremities of a capsule.

Where reference windows must be placed

The reference windows are used by Harlequin to measure the intensity of the light falling on the scene.
The Wizard creates a reference window for each camera and put it in a standard position. Then it asks the
operator for a correct setting of the window position. To do so the button Windows must be pushed to
enter in the graphic mode and move the windows (see the paragraph on mouse usage). At the end of the
graphic operations it is possible to proceed to the next step.

Computation of the programming parameters

The Wizard automatically computes the programming parameters. This operation can take as much as
some minutes. A set of dots shows the progress of the operations, while on the screen the acquired images
appear. The programming parameters divide in: general parameters, search parameters, measure
parameters. For each of these steps the Wizard reports the result: either OK or failed. Even in case of
failure the Wizard can step ahead, but the parameters are not computed in the best way and a manual
setting is needed.

Learning while the blister machine is running

The learning is in most cases the last operation to perform in the guided article creation procedure.
The proposed number of learning steps can be changed. It is 10 for the step machines and 20 for the
continuous moving machines. The Wizard stops the machine after having learned all steps.
At the end of the learning the Wizard sets the tolerances and the enablements for the product check. Their
values depend on the statistics observed for each measure parameter.

3.2.18. Cavities Management

The dialog page Programming of Windows on Cavities is the tool used to define and modify windows
of the cavities. Such windows are called search windows.

Group Number
the field for selecting the group number for modification operations; the value is changed with the
adjacent keys with arrows;

Cavity Number
the field for selecting the cavity number for modification operations; the value is changed with the
adjacent keys with arrows;

Total Number of Groups

indicates the total number of groups defined for the article; cannot be modified directly;

Total Number of Cavities

indicates the total number of cavities defined for the article; cannot be modified directly;
Harlequin – Reference Manual Page 51

Number of Cavities in Group

indicates the total number of cavities defined for the selected group; cannot be modified directly;

Viewed Colour
in addition to normal viewing of the colour image (colour), you can observe one of the three
colour components (Red, Green, and Blue) in grey tones; by additive synthesis, these three
components form the colour image on the screen;

Viewed TV
when several cameras are installed, you can choose which image to show on the screen; the
numbers 1, 2, 3 and 4 refer to images received from cameras 1, 2, 3 and 4 respectively;

Coordinates
opens the dialog page for manual modification (non-graphic) of cavity co-ordinates; it enables you
to set coordinates of all windows manually;

Group of Cavities
enables operations for cavity groups rather than single cavities; if the box is checked the key New,
Copy, Remove act at group level;

New
creates a new cavity group or a new cavity inside a selected group; the number of the new group
or new cavity will be equal to the number of existing elements plus one; the new cavity group is
created empty, without any cavities; you cannot create a new cavity unless at least one group has
already been created;

Copy
creates a new cavity group or a new cavity inside a group by copying the selected element; the
number of the new group or new cavity will be equal to the number of existing elements plus one;

Acquisition
acquires the images from the cameras according to the exposure time associated with the article;

Double
this operation is enabled for groups only; it doubles the number of cavities in a group;

Remove
eliminates the selected element (group or cavity);

Windows
Harlequin goes into the graphic mode to shift and resize the cavity windows by means of the
mouse (or trackball);

OK
to exit the cavities management window while saving any modifications in the archive;

Cancel
to exit the cavities management window without saving modifications in the archive; you are
prompted to confirm before exiting the window, but only if some parameter has been modified.

SEA Vision s.r.l.

Page 52

3.2.19. Modification of the cavity windows through the mouse

The graphic mode is entered through the button Windows in the dialogue pages for Cavities
Management, Strip Management and during the Wizard procedure.

When Harlequin is in graphic mode you can move and resize the windows by means of the mouse. The
graphic management keyboard that appears together with the window containing the instructions for the
mouse usage gives an aid to this task. In the lower part of this window the instructions can be read. Each
of them is associated to one of the eight buttons of the upper part. Here is the list of texts that appear
when the corresponding button is pushed:
Button to terminate the windows modification activity.

Button to align the selected windows (red). The first and the last window must already be in the
correct position.
Button to equalise the sizes of the selected windows (red): all windows are enlarged to the biggest
selected window size.
Button to cancel the last graphic operation. The windows are restored to the former sizes and
positions.
The window SELECTION (yellow->red) or DE-SELECTION (red->yellow) is achieved by
means of a double click of the mouse left button inside the window. If the mouse has 3 buttons,
the central button emulates the left button double click.
Harlequin – Reference Manual Page 53

The SELECTION of many windows is achieved by moving the mouse while the right button is
pressed. When the right button is released, all the windows inside the dashed rectangle are
selected.
The SHIFT of the selected windows (red) is achieved by bringing the cursor inside the selected
area and by moving the mouse while the left button is pressed.
The SIDE or CORNER SHIFT of the selected windows (red) is achieved by bringing the cursor
outside the selected area and by moving the mouse while the left button is pressed.

side shift
corner shift corner shift

windows shift
side shift side shift

corner shift corner shift

side shift

Rules on using the mouse:

• all operations affect selected windows only; these windows are drawn in red, whereas non selected
windows are shown in yellow;
• to select (or deselect) a window, double click the mouse left-hand button after moving the cursor
inside the window; the double click selects (or deselects) an entire cavity group providing, when you
press the Windows button of the dialog window, the Group of Cavities box is barred; in some mice
with three buttons, pressing the central button emulates a double click of the left-hand button;
• there is a quicker way to select windows (known as drag-and-drop): mark out an image zone with the
right-hand button of the mouse; while holding down the right-hand button, move the mouse to
enlarge the hatched rectangle which appears on the screen; when you release the right-hand button, all
windows inside the hatched rectangle will be selected; there is a special case too – when you release
the right-hand button immediately after pressing it, all the windows will be deselected as the hatched
rectangle has null dimensions;
• selected windows can be shifted by moving the cursor inside the selected zone and moving the mouse
while holding down the left-hand button;
• to shift one side of the selected windows, move the cursor outside the selected zone and onto the side
to be shifted, and move the mouse while holding down the left-hand button;
• to shift one corner of the selected windows, move the cursor outside the selected zone and onto the
corner to be shifted and move the mouse while holding down the left-hand button;
the figure shows how the nine zones of the plane are subdivided: the zone of the selected windows and
the eight zones adjacent to it; by positioning the mouse in each zone, the indicated effect is carried out.

3.2.20. Strip Management

Programming windows on the strip (inspection windows) is similar to programming cavity windows.
The control windows on the strip are usually positioned in cavity free zones in order to detect:
• foil splices effected with adhesive tape

SEA Vision s.r.l.

Page 54

• product outside cavities

• spots, dust, foil defects.
Harlequin measures some pictorial parameters inside the inspection windows: levels, dispersions, hue,
and saturation. The measured values are compared with the learned ones: the difference must be smaller
than that specified in the page Strip Tolerances. If one or more windows show off-tolerance values, all
blisters in the images are rejected.
The number of windows to be positioned depends on individual cases. However, remember that the
smaller the window area, the more defect sensitive it is.
Moreover the inspection windows are used:
• to measure the intensity of light cast on the image; this allows Harlequin to adapt the measured values
to the variation of light (reference windows for levels);
• to automatically balance the image colour (reference windows for white balance);
• to measure the web position on blister machine with alternating movement (step control windows).
The available fields are:

Window Number
the field for selecting the number of the inspection window for modification operations; the value
is changed with the adjacent keys with arrows;

Windows Total
indicates the total number of inspection windows defined for the article; cannot be modified
directly;

In Case of Defect, Stop Machine

if the box is barred, and a defect is detected on the strip, the blister machine is stopped and a
message indicating the position of the defect is shown on the screen; when the reset key of the
blister machine is pressed, the message disappears and the machine can be restated;

In Case of Defect, Restart with Password

if the box is barred and the blister machine stops, when the reset key is pressed, Harlequin
prompts you to enter the password to enable the blister machine to restart; the Password is not
requested if a user with the permission to reset the severe alarms is connected to Harlequin;

Reference Windows for Levels

if the box is barred, the inspection window is used to measure the value (intensity) of light cast on
the image; this value is compared to learned value, to obtain a levels correction factor, with
which all luminosity value measurements (grey and colour levels, and luminosity value) are
modified; in this way, all luminosity variations occurring for different reasons from the learning
time are compensated; this holds up to a variation of the light intensity of 25%; beyond this limit
Harlequin generates an alarm with stop of the blister machine;
the correction factor is calculated separately for each image of each camera;
you can use more than one inspection window as a reference window for the levels of an image; in
this case, the correction factor is calculated on the window showing the smallest difference
compared to learned value;
all windows located on metal surfaces can be used as reference windows (rails of the foil);
the reference windows cannot be used also to detect defects on the foil: no blister is rejected, even
in case of alarm on the light intensity;
Harlequin – Reference Manual Page 55

Reference Windows for White Balance

if the box is barred, the inspection window is used to balance the colour of the light cast on the
image; this implies an image transformation so that the values of red, green and blue measured
inside the window are the same after the transformation; this option allows the compensation of
changes in the light colour due either to lamp ageing or to variation in the environment light;
the white balance is executed independently on each camera;
all windows placed on metallic objects can be used as reference for white balance (rails of the
base foil);
usually the same window is used as reference for the levels and for the white balance;

Coordinates
opens the dialog page for manual modification (non-graphic) of the inspection window co-
ordinates;

Viewed Colour
in addition to normal viewing of the colour image (colour), you can observe one of the three
colour components (Red, Green, and Blue) in grey tones; by additive synthesis, these three
components form the colour image on the screen;

Viewed TV
when several cameras are installed, you can choose which image to show on the screen; the
numbers 1, 2, 3 and 4 refer to images received from cameras 1, 2, 3 and 4 respectively;

New
creates a new inspection window; its number is the number of existing windows plus one;

Copy
creates a new inspection window by copying the selected window; the number of the new window
is equal to the number of existing windows plus one;

Acquisition
acquires images from the cameras according to the exposure time associated with the article;

Remove
eliminates the selected window; you are prompted to confirm;

Windows
shows the graphic management keyboard for the windows;

OK
to exit the strip management dialog window while saving any modification in the archive;

Cancel
to exit the strip management dialog window without saving modifications in the archive; you are
prompted to confirm before exiting the window only if some parameter has been modified.

SEA Vision s.r.l.

Page 56

3.2.21. Critical Defects Management

Critical defects are those that, by their nature, can be worrying. Therefore, they cannot be defined
objectively. For example, a mix of different products is usually considered critical.
Harlequin offers the possibility of customising the definition of critical defects with the Critical Defects
Management dialog page.
A maximum of 10 critical defects can be defined for each article. For each defect, both characterisation
and type of action to take following detection during the production cycle, are supplied. Definition of a
critical defect is obtained by a combination of selectors having three positions, one for each measured
parameter.
For example, if the work product is a round, white tablet, and if there is a risk of it being confused with
another tablet of the same colour but with a different diameter, the critical defect will be defined by the
following combination:
Area Out Tolerance Range
Shape 1 In Tolerance Range
Shape 2 In Tolerance Range
Shape 3 In Tolerance Range
Shape 4 In Tolerance Range
Angle Don’t care
Red Level In Tolerance Range
Red Dispersion Don’t care
Green Level In Tolerance Range
Green Dispersion Don’t care
Blue Level In Tolerance Range
Blue Dispersion Don’t care
Hue 1 Don’t care
Saturation 1 Don’t care
Value 1 In Tolerance Range
Hue 2 Don’t care
Saturation 2 Don’t care
Value 2 Don’t care
Likewise, if we have two products of the same area but of different shape, we can define the following
critical defect:
Area In Tolerance Range
Shape 1 Out Tolerance Range
Shape 2 Out Tolerance Range
Shape 3 In Tolerance Range
Shape 4 In Tolerance Range
Angle Don’t care
Red Level Don’t care
Red Dispersion Don’t care
Green Level Don’t care
Green Dispersion Don’t care
Blue Level Don’t care
Blue Dispersion Don’t care
Hue 1 Don’t care
Saturation 1 Don’t care
Value 1 Don’t care
Hue 2 Don’t care
Saturation 2 Don’t care
Value 2 Don’t care
Harlequin – Reference Manual Page 57

If two products can be distinguished by their colour only, we have the following critical defect:

Area In Tolerance Range

Shape 1 In Tolerance Range
Shape 2 In Tolerance Range
Shape 3 In Tolerance Range
Shape 4 In Tolerance Range
Angle In Tolerance Range
Red Level Out Tolerance Range
Red Dispersion Don’t care
Green Level Out Tolerance Range
Green Dispersion Don’t care
Blue Level Don’t care
Blue Dispersion Don’t care
Hue 1 Out Tolerance Range
Saturation 1 Don’t care
Value 1 In Tolerance Range
Hue 2 Don’t care
Saturation 2 Don’t care
Value 2 Don’t care

From the operative point of view it is useful to build a mix-up table of the production line. It shows the
possible mix among products packaged in the same line. For example, if the product C (elliptic tablet,
third row of the following table) is packaged on PVC, its pocket can host the product A only, not the
products B and D, being too big. This can be not true if the base foil is made by aluminium, with big
pockets in comparison to the sizes of the products.
For each cell of the row containing a YES, a critical defect has to be defined. In our example, the article
of the product C, whose row contains a YES, will show a critical defect based on the differences between
C and A.

possible mix-up with

A B C D

A
NO NO NO
packaged product

B
YES YES NO

C
YES NO NO

D
YES NO YES

Meanings of the remaining fields of the page:

SEA Vision s.r.l.

Page 58

Number of Critical Defect

identifies the critical defect, from 1 to 10;

Enable Defect
if the box is barred, the critical defect is used for production;

Stop Machine
if the box is barred, and a critical defect is detected, the blister machine is stopped and a message
indicating the position of the defect is shown on the screen; when the reset key of the blister
machine is pressed, the message disappears and the machine can be restarted;

Restart with Password

if the box is barred and the blister machine stops, when the reset key is pressed, Harlequin
prompts you to enter the password to enable the blister machine to restart; the Password is not
requested if a user with the permission to reset the severe alarms is connected to Harlequin;

Other Defects
opens the dialogue box concerning other types of defects which can managed as critical defects,
that is with the stop of the blister machine and the alarm message generation; they are:
• Empty Cavities Control: it is the defect generated by Harlequin when a cavity, which is
considered as empty by the search algorithm, has actually a colour different from that of an
empty cavity; the threshold of accepting the difference on the colour level, depends on the
tolerance value which is programmable in this case; the colour levels of empty cavities, are
saved during the learning, when the machine runs without loading the product;
• Fragment of Tablet in Cavity;
• Foreign Body in Cavity;
• Powder (Stains) on Product;
• Powder (Stains) on Blister; the powder and stains check is programmed in the page
containing the special parameters for the measure;

Article Cross-Check
number which identifies the origin of the article used for the article cross-check and for the linked
article management;

OK
to exit the critical defect management dialog page while saving any modifications in the archive;

Cancel
to exit the critical defect management dialog window without saving modifications in the archive;
you are prompted to confirm before exiting the page.

3.2.22. Multi-Function Cameras Management, General Parameters

This part of the menu includes all the information relating to the multi-functional cameras management,
and used in the covering material code check.
The General Parameters title item represents the main page where the article programming data are
entered.
The page includes the following fields:

Code
shows the name of the article;
Harlequin – Reference Manual Page 59

Description
field used to save all kinds of information; press the corresponding push-button to modify the
description;

Image Acquisition, TV Number

to select the number of the multi-functional TV;

Image Acquisition, Exposure Time

exposure duration to be set for each camera; the exposure time is obtained by multiplying the
determined value by the camera value; the exposure time is specific for each camera;

Image Acquisition, Acquisition Delay (ms)

time range between the acquisition phase upstroke front and the beginning of exposure; this serves
to centre the image to be controlled inside the check window, without having to shift the image in
case of format change; values ranging between 0 (no delay) and 1000 ms are accepted; acquisition
delay is independent for each camera;

Acquisition
acquires the camera images, in accordance with the exposure times linked to the cameras
themselves; to determine the exposure time to be used, shift the General Parameters page
rightwards and partially move it out of the screen in order to make the images visible, and at the
same time, to be able to change the exposure time and displayed camera;

OK
exit the General Parameters page while saving any modifications in archive;

Cancel
exit the General Parameters page without saving the modifications; when the Cancel push-
button is pressed, you shall be asked to confirm before closing the page, only if modifications
have been made.

3.2.23. Multi-Function Cameras Management, Window

The windows delimits the check areas of the code inside the image.
The fields available for the windows management are the following:

Window Number
window number selection field; the value is changed with the arrow keys next to it; all
modifications are applied to the selected window;

Windows Total
indicates the total number of windows defined per article; cannot be directly modified;

Name
the name of the window which appears on the screen together with the window; can be modified
by pressing the push-button;

Acquisition
to acquire images from the camera, in conformity with the article-linked exposure times.

SEA Vision s.r.l.

Page 60

Viewed TV
when more than one camera are installed, it is possible to choose the image to display on the
screen; numbers from 1 to 16 indicate the images coming from cameras 1 to 16, respectively;

Coordinates
To open the dialogue page and manually modify (not graphic) the windows coordinates;

Check to Do
Selection of the check to perform in the window; the types of objects available are characters,
codes, ring nuts, 3D, cardboard boxes, packaging objects; programmable measures; printing
qualities; rings of colour. For each kind of objects, the number is to be used to select a specific
object; if said object has already been named, it shall appear in the relating field; the codes are to
be selected in checking the codes on covering material.

Rejection Queue
The two values in this page are to be programmed for each window; “Number of the Signal” is
the number of the outlet signal which communicates the check result; “Queue Length” is the
dimension of the rejection queue; when the rejection queue is 1 or more steps long, the results are
synchronised with the arrival of the signal in the image acquisition phase; for example, if the
length is 1, when the phase signal arrives, Harlequin expresses the result of the image acquired
during the previous phase; if the length is 2, the result refers to two previous phases, and so on; if
the specified length is 0, the result shall be expressed as soon as it is available, or else, at the end
of the image analysis; in this case the data outlet is said to be asynchronous, since the data
expression time is at any moment whatsoever (this depends on the calculation time) after
receiving the acquisition phase;

Debug Display
allows the display of the check algorithm steps during manual work;

Orientation
specifies one of the four possible orientations of the objects in the window;

Reflection
indicates if the window is to be read with the application of a reflection (vertical or horizontal);

Mobile Window
indicates the window horizontal and vertical offset, compared to a reference window (Number of
the Reference Window);

Anti-Reflection Filter
corrects the image before starting the check;

Copy to master article

if enabled, it copies the window check onto the reference master article;

Window displayed in Automatic Work

displays the window during automatic work;

End of Batch with variable data clearance

replaces the value code value checked by the window with the “00” string, at the end of the batch;
Harlequin – Reference Manual Page 61

New
creates a new window which takes the number of the existing windows plus one;

Copy
creates a new window by copying the selected one; the number of the new window shall be equal
to the existing windows plus one;

Extern Copy
copies the selected window onto one of the selected articles;

Remove
eliminates the selected window; you shall be prompted to confirm before cancellation;

OK
to exit the dialogue page while saving the modifications in archive;

Cancel
to exist the dialogue page without saving the modifications in archive; you shall be prompted to
confirm before existing the window, only if modifications have been made;

Windows
access to the graphic mode in the window management, using the mouse. This function is made
easy by the appearance of the windows graphic management keyboard together with the window
that contains the instructions regarding the use of the mouse.

3.2.24. Multi-Function Cameras Management, Codes

The section regarding the object code programming, makes it possible to create, eliminate, copy, and
manage all parameters relating to this type of check.
The code object, programmed here, has to be linked to a window in the windows management page. The
codes parameterisation page contains all possible parameters; only usable parameters are enabled, in
accordance with the type of the selected code.
The page is structured in this way:

Code Number
code selection field;

Codes Total
to indicate the total number of codes in the article file;

Name
code name. It can be assigned in a page which opens up upon pressing the push-button;

Type of Code
this field is used to select the code type amongst preset ones:
Binary, Pharmacode, Data Matrix ECC200, 39, 2/5, 128, 32, EAN8, EAN13, UPCA, UPCE, RSS-
14, RSS-14 Stacked, RSS Limited;

Bright Symbol on Dark Background

used to read negative symbols (bright on dark background) (for example: codes obtained with UV
illumination and sensitive ink);

SEA Vision s.r.l.

Page 62

Blank Areas not Necessary

Pharmacode does not have start/stop bars. For this reason, it requires a blank area at the beginning
and at the end of the symbol.
The dimension of this area is about 2 bars large plus one space. However, sometimes the code
may not be located at the same position, and the buffer areas are not to be considered when
accepting the codes which are close to the window;

The Code Contains the Check Digit

some codes (39, 2/5) have a check digit that makes it possible to localise wrong decoding. This
option is be used if the symbol contains the check digit.

Rotation Allowed
the barcode scanning occurs only along one direction. When this option is enabled, even rotation
codes may be read, since the scanning is performed along several directions with different angles.
This option is to be necessarily used when a horizontal/vertical line cuts through all the bar-codes.

Pharmacode Dimensions
bar and space widths, which typically are: 1.5, 0.5, 1.0 mm;

Measure Contrast
sensitivity of bar-code recognition. The higher the value is, the lesser the sensitivity. Therefore,
well-contrasted bars are needed. The recognised bars are highlighted with red segments during
measurement;

Datamatrix ECC200
to open the page dedicated to the datamatrix code parameters programming. The code reading is
divided into two phases: search and decoding. The two reading phases are characterised by
different programming parameters;

Min. Code Length (n. of Characters)

the decoded string is accepted only if its length is above the specified number;

Min. Reading Percentage

the decoded string is accepted only if the recurrence of reading it is at least as much as the number
specified in the window. To make things easier, this value is expressed in percentage. For
example: 50% means that the code is successfully decoded at least half-way through the window;

The Checked Code is a Sub-String of the Read Code

some products are identified by codes containing a constant string (which corresponds to the
product) plus the variable consecutive number. This option must be enabled if the constant string
only is to be checked. In such a case, the string position may be forced at the beginning or at the
end of the symbol;

Code Quality Check (ANSI Grading)

it enables the code quality check, emulating the ISO 15415 standard. The system defines the
minimum quality level, and therefore, the read code is accepted as good. The surface reflection
capacity has an influence on the contrast quality parameter. The quality assessment characteristics
are listed hereunder.
The international ISO standard has set up a method to measure codes quality parameters.
The symbol numeric classification and the related class of origin are indicated in the table below:
Harlequin – Reference Manual Page 63

Numerical Degree Class

3.5 ÷ 4.0 A
2.5 ÷ 3.5 B
1.5 ÷ 2.5 C
0.5 ÷1.5 D
< 0.5 F

In case of 2D codes, the quality assessment parameters are the following:

• Decoding: the symbol is to be correctly decoded as provided for by international standards.
• Contrast: measures the difference between the reflectance lower value and the higher one.
• Modulation: measures the reflectance uniformity in the symbol.
• Non uniformity of the axis: measures the code correct geometry.
• Non uniformity grid: measures the position of the code points compared to the ideal
position.
• Unused error correction: this depends on the number of errors in the symbol.
• Fixed Pattern Damage: measures the quality of the finder pattern quality and of the code
clock pattern.

The camera has to be periodically calibrated in order to obtain correct measurement of the contrast
through the Surface Reflectance parameter.
The contrast value, measured with the camera, has to be compared to the contrast value measured
with an ISO 15415 certified offline verifier.

Variable Code
Codes that vary from one image to another can be checked whenever there is a rule that
interrelates the subsequent codes. The permissible rules are the following:
• Increasing numeric value
• Decreasing numeric value
• Any digit
• Any character
Codes with fixed and variable parts are also permissible. In such a case, it is necessary to specify
the order number of the first character in the variable part;

New
creates a new code, the number of the new code is equivalent to the number of the already-
existing codes plus one;

Copy
creates a new code, copying the selected one; the number of the new code is equivalent to the
number of the already-existing codes plus one;

Extern Copy
Opens the dialogue page to copy the selected object towards other article; the paragraph relating to
the external copy is to be referred to;

Remove
eliminates the selected code; confirmation shall be requested;

SEA Vision s.r.l.

Page 64

OK
exit the code programming page while saving the modifications in archive;

Cancel
exit the code programming page without saving the modifications in archive; when pressing
Cancel, you shall be prompted to confirm before closing the page, only if parameter modifications
have been applied.

3.2.25. Multi-Function Cameras Management, Window, Codes, Datamatrix ECC200

Rectangular Symbol
enables the rectangular datamatrix check;

Bright Symbol on Dark Background

used to read negative symbols (bright on dark background) (for example: codes obtained with UV
illumination and sensitive ink)

Code Quality Check (ANSI Grading)

if the Enable differentiated threshold field has been activated, a minimum quality level may be
applied to each single parameter;

Dot Size (micron)

symbol dot size. The size can be calculated by dividing the symbol side by the number of dots
(whether white or black) which are counted at the side. Typical values range between 250 and 500
microns;

Symbol Size
number of the dots included in the symbol;

Symbol Search
the symbol search is the first step in code reading, and it could be model (the most common) and
based on pattern matching, or fast and based on the blob extraction in the window. This second
option decreases the calculation time and does not require knowledge of the symbol size;

Symbol decoding
symbol decoding is the second phase in code reading; there are three different types of decoding,
according to the deformation level of the symbol to be read;

GS1 encoding
used to define the GS1 encoding of the datamatrix code, and if performed, it has to be done either
by Harlequin or the printer.

No backgroung subtraction
prevents the software from applying the background subtraction. It is useful when a pre-
processing window executes the background subtraction in advance.

3.2.26. Rejection Queues

The Rejection Queues Programming dialog page is the tool for associating a rejection output signal
and an empty output signal (optional) with each cavity group.
Harlequin – Reference Manual Page 65

For every cavity group selected with the Group Number field, the following values in the page have to
be measured:

Rejection Number (or Channel Number)

the number of the rejection signal activated whenever one or more objects of the cavity group are
missing or off tolerance range; blister machines usually have one rejection output for each
channel, therefore, the rejection number corresponds to the number of the channel in which the
blister is located; see the Inputs and Outputs Control page;

Row Number
the row number indicates the position of the cavity group inside a single control step; row
numbers go from 1 upward, as row 1 is the nearest to the rejection station; obviously, for blister
machines with a continuously moving strip, only one row is controlled at each step; therefore, this
parameter should be left unaltered on value 1 (preset when the cavity groups was created); for
blister machines with alternating movement, the row numbers must be correctly specified for each
group as they determine the correct rejection sequence;

Distance from Rejection Station

the number of steps the cavity group has to travel from the control station to the rejection station;
for example, if the two stations are adjacent, the distance is 1, if they are separated by an
intermediate station, the distance is 2; for alternating movement blister machines too, the distance
is given as the number of steps of the blister machine and not as the number of blisters between
the observation and rejection stations; in the case of continuously moving blister machines, the
number of steps coincides with the number of blisters;

Number of Empty Blisters Flap

the number of the empty blisters rejection signal, which is activated when the number of
consecutive empty blisters is greater than or equal to the value set in the Work Parameters page;

Distance from Empty blisters Flap

the number of steps the cavity group has to travel from the control station to the empty blisters
flap station; the explanations given for the distance from the rejection station also apply here.

Number of the Good Signal

number of the good signal outlet to be linked to the group of cavities; the signal management is to
be performed together with that of the multi-functional TV;

Length of the Good Queue

Length of the good signal queue linked to the group of cavities;

Distance Variation for All Groups

The buttons +1 and –1 allow the operator to modify the distances (both for the rejection signal and
for the empty signal) at the same time for all groups of cavities. They increase/decrease the
distance of one blister. This is true for any kind of blister machine, no matter how it moves the
strip. The Wizard correctly programs the rejection queues for all groups. Therefore the
modification of the queue lengths should be done using the buttons +1 and –1 only. The box
Enable Numeric Values has to be barred only in particular cases, as it allows the modification of
each parameter independently.

SEA Vision s.r.l.

Page 66

Linked Article
to display the length of the queues of rejection articles linked to work articles; besides, when the
Linked Articles option is enabled, it shall be possible to modify even the rejection queues of
linked articles.

3.2.27. Adjusting the length of the rejection queues: a practical procedure

If the work article is well programmed and the rejection queues are correctly set (apart from their lengths)
the following procedure can be applied to determine the right lengths.
• Run the blister machine without feeding the product until the web is completely empty.
• Load manually only one blister before the control station.
• Run the blister machine and stop it immediately after the sealing of the blister.
• Verify that the blister has been considered good by Harlequin. If in doubt open the table of the
numerical results.
• Mark the blisters on the web as shown in figure.
• Start the blister machine and stop it after a blister is not rejected (sent to the cartonner).
• Take the blister not rejected and read the number on it.
• Open the page of the rejection queues and, if the number is positive (negative), press the button +1 (–
1) as many times as the number on the blister is.
• Repeat the test to assure that the new values are correct.

forming foil top view

machine side

-4 -3 -2 -1 +1 +2 +3 +4

web moving direction

operator side

3.2.28. Rejection Auxiliary Input Signals

Harlequin has 32 rejection auxiliary signals. They serve to inform Harlequin of any malfunctions so that
the program can force product rejection and/or stop the blister machine, irrespective of the outcome of
control by cameras. For example, a rejection auxiliary signal is that coming from the sensor detecting the
presence of a splice on the lid foil.
The parameters for the auxiliary signals are stored in the article file (.BLI). Therefore different settings
are possible for each article. The configuration file HARLE.INI contains a section where the default
values for the new articles are specified.
The following parameters can be programmed for each auxiliary signal:

Enable Signal
this signal is used if the box is barred;
Harlequin – Reference Manual Page 67

Stop Machine
providing the box is barred, if switching of the signal is detected, an alarm is generated and the
blister machine is stopped; the message shown on the screen can be edited with the Message
button;

Restart with Password

providing the box is barred, if the blister machine stops, it can be restarted only if the Password is
entered; the Password is not requested if a user with the permission to reset the severe alarms is
connected to Harlequin;

Immediate Rejection
this option can be activated only if the internal PLC is used; it causes the rejection of all the
blisters in the PLC queue; the immediate rejection is used, for example, to force the blister
rejection when an alarm of web position is detected;

Rejection
the auxiliary signal rejection can be defined as Standard, Critical Defect, or Empty Blister;
therefore, the rejection may be performed in the mode established for critical defects or for empty
blisters;

Distance from Rejection Station

the length of the rejection queue expressed as the number of machine steps; on continuous
movement blister machines, queue length is indicated as the number of blister rows; the machine
cycle starts when Harlequin receives the acquisition trigger and terminates at the next trigger;

Number of Steps to Reject

the number of steps to be rejected if switching of the signal is detected; blisters are rejected even if
the blister machine is not stopped; we advise you always to force the machine to stop – this will
enable you to note any faults on the rejection auxiliary signal which could cause blisters to be
rejected for no apparent reason; if the number of steps to reject is 0 the signal switching does not
cause any rejection; nevertheless it can stop the blister machine;

Rejection Channel (0=all)

the auxiliary input signal can be programmed for rejecting either one channel or all the channels;
the value 0 causes the rejection on all channels;

Message
opens the Modify Text for editing the alarm message to be shown on the screen; to this end, a
virtual keyboard appears on the screen, emulating the operation of a real one; the message is also
visible in the rejection queues window, during the automatic work.

Good of multi-function tv, rejection channel (0=no)

the good signal of multi-function tv windows can be programmed as auxiliary input signal for
rejecting either one channel or all the channels.

3.2.29. Asynchronous Shift Registers

The Shift Registers (SRs) are a powerful tool for managing the tracking of both external and internal
signals. An SR is a queue of binary data. The length of the queue (i.e. the number of data contained in it)
can range from a minimum to a maximum.
The input bit is calculated from one (or more) Input/Output signals connected to Harlequin.

SEA Vision s.r.l.

Page 68

A new bit is inserted in the SR (its length increases by 1) when the specified entry event occurs.
The oldest bit is extracted from the SR (its length diminishes by 1) when the specified exit event occurs.
When the bit is extracted from the queue the output signal of the SR is set to 1 or 0 according to the value
of the bit. Therefore, following to the extraction, the extracted value, apart from being physically written
as it exists, is also available as an entry for the successive SRs.
If the output signal of a SR is used only to transfer information from one SR to the next it doesn’t
necessarily have to be emitted as a physical 24V signal on the I/O card. Consequently a fictitious address
can be assigned to the configuration file, which doesn’t correspond to any physical exit available on the
card. Conventionally, the fictitious address is Port=0x2ff, Bit=0.
Many SRs can be created and linked together (the output signal of a SR is an input of the next SR) to
form a combined network.
When the same event triggers many insertion/extraction operations, such operations are executed in a
preset priority:
1. data extraction from the SRs
2. data insertion into the Discrete Time Logic Ports (DTLP)
3. data extraction from the DTLP
4. data insertion into the SRs.
A DTLP is a special case of SR: it is a SR with initial length 0 and with the same event for input and
output. Having the same event that triggers the input and output operations the length of a LP remains 0
forever. The LPs are drawn in red in the graphic window.
When the input/output event of a logic port is the system clock, the updating of the output from the port
is done with the internal PLC frequency of execution, or rather 2000 times a second. From a practical
point of view the logic port behaves like an analog device and it is called Continuous Time Logic Port
(CTLP). The CTLPs are drawn in yellow.
The system clock can be considered as a special kind of event which always occurs, triggering the
insertion/extraction operations of the CTLPs. When, in the same internal PLC cycle, one or more kinds of
events other than the system clock occur (switching of signals), the CTLP operations are done after the
operations relating to the events other than the system clock.
The SRs can be also used to build simple sequential networks. The figure shows a flip-flop of the set-reset
type built with two NOR CTLPs.

The following fields are available in the dialog page:

Number of the Shift Register

Field for the selection of the SR.

Total Number of Shift Registers

Indicates the total number of SRs contained in the article.

Name
Name of the SR. It can be assigned through the page that opens with the mouse click on the
button.
Harlequin – Reference Manual Page 69

Shift Register Input

To define the SR input it is necessary to decide when the data is inserted (Input Event) and which
data is inserted (input signals). The input event is either the (leading or trailing) edge of a signal or
the system clock (a special kind of event which occurs at every cycle, or rather 2000
times/second).
The input signals can be combined in AND, OR, NAND, NOR, EXOR, NEXOR. For each input
signal it is necessary to specify how the signal is converted into a logic binary value (0,1). There
are six possibilities; two of them are defined on levels, the others are defined on edges:
• 1 = signal high level: the value 1 (0) is read if the signal is high (low) when the event occurs
• 1 = signal low level: the value 0 (1) is read if the signal is high (low) when the event occurs
• 1 = signal leading edge: the value 1 is read if, after the event, the signal has a transition from
low to high; if this transition does not occur in the time interval specified by the Time-out
value, the value 0 is read; if, waiting for the transition, a second event occurs before the end of
the time interval, the value 0 is read;
• 1 = signal trailing edge: the same as before, but the transition of the input signal must be from
high to low;
• 0 = signal leading edge: the value 0 is read if, after the event, the signal has a transition from
low to high; if this transition does not occur in the time interval specified by the Time-out
value, the value 1 is read; if, waiting for the transition, a second event occurs before the end of
the time interval, the value 1 is read;
• 0 = signal trailing edge: the same as before, but the transition of the input signal must be
from high to low;

Shift Register Output

To define the SR output it is necessary to decide when the data must be extracted (output event)
and which signal must be set (output signal). The output event is either the (leading or trailing)
edge of a signal or the system clock.
The output signal is one of the Generic Output Signals signals defined in the configuration file
or, if the SR output should neither be used by other SRs, nor sent out, the assignment of an output
signal can be omitted (No Signal).
Note that the Generic Output Signals signals behaviour depends on the Pulsed Generic Output
Signals and Duration of Pulsed Generic Output Signals (ms) fields of the [Signals
Parameters] section of the configuration file.

Shift Register Length

The length of a SR is defined as the number of data contained in it. This number can range from
the minimum to the maximum here programmed. If an extraction operation is attempted when the
length of the SR is minimum, an alarm is generated. The same happens when an insertion
operation is attempted when the SR is full.
For each SR, the graphic window draws as many boxes as its maximum length. The data inside
the SR are drawn as coloured boxes (green = 1, red = 0).
When a datum is inserted, it appears on
the left most box of the SR and all other data shift one box to the right.
When a datum is extracted
the corresponding box is not black coloured, but it is marked with a cross.
The length of the SR can be checked when the machine stops. The length of the SR can be
checked when the machine stops. This option can be used when the SR is defined to track data on
a web, whose length must remain constant.

SEA Vision s.r.l.

Page 70

Shift Register Initial Values

At the beginning of the operations the SR is filled with N data: they can be either 0s (red) or 1s
(green). N is the SR initial length. The Reset key opens the page that allows the selection of
initialization conditions for the SR: when the expected conditions are met, the SR is refilled with
the initial values. Initialization conditions can also be defined for the partial counters.

Counters
If enabled, this function allows Harlequin to use the shift registers as input values for
customizable counters. In fact, it is possible to combine the shift registers arithmetically between
them, so as to create significant counters for the various types of applications; it is possible to
associate a counter to each shift register not defined on the system clock, this counter consists of 2
variables which are increased, respectively, when the shift extracts a 1 (typically good) and when
it extracts a 0 (typically a reject); there are 3 pairs of these variables: historic, batch, partial. The
first one can be zeroed from the programming page only, the second one can be zeroed at batch
start, whereas the third one can be zeroed upon request by the operator from the counters window.
Each counter is given a name which is then shown in the counters window. The SR does not need
to have an output signal: no signal is also OK. If one or more counters are defined from the SR in
an article, the counters window shows only these ones.
There is the possibility of editing 3 algebraic expression (one for reject computation and one for
good object computation) consisting of variables of A0 type (number of rejects of counter A), F1
type (number of good objects of counter F), as well as of operators (+ - * / %) and round brackets.
At run-time, each time a counter is incremented due to an exit event the shift registers list is
scanned and the counters are recalculated through their expressions.

Machine Stop for Consecutive Input Values

If enabled, this function allows Harlequin to generate an alarm in case of N consecutive inputs of
the same types (N 0s or N 1s). N is the number of consecutive inputs here programmed. When the
alarm is generated the message here programmed appears on the screen.

Enable Shift Register

The SR is ignored if it is not enabled.

Visible during Work

SR is displayed during automatic work (if the Show Async. Shift Register Window is also
enabled in the ConfigurationWork Control Images menu);

New
Creates a new SR; the number of the new SR will be the number of the existing SRs plus one.

Copy
Creates a new SR by copying the selected SR; the number of the new SR will be the number of
existing SRs plus one.

External Copy
Opens the dialog page for the copy of the selected object towards other articles.

Remove
Removes the selected SR; you are asked to confirm:
Harlequin – Reference Manual Page 71

Draw
Opens the window showing the SRs in graphic mode.

OK
Exit from the SRs’ programming page; all changes are stored in the archive.

Cancel
Exit from the SRs’ programming page without saving any change; when the Cancel button is
pressed, you are asked to confirm before closing the page, but only if any parameter has been
modified.

3.2.30. Learning
The learning is the measure operation (and memorisation in the article file .BLI) of the product reference
parameters. The learning can be performed either on still images or with the blister machine running. It is
not necessary that all pockets contain the product nor that all products measured during the learning are
correct. It is enough that the most part of them is good. At the end of the learning procedure Harlequin
computes the suggested tolerances by assessing the statistics of the measured parameters.
Meanings of keys in downward directions:
• end of learning
• automatic learning while blister machine is running
• learning from cameras; images are acquired from the cameras at every click and reference values are
calculated
• learning from cameras synchronised with the phase signal received from the blister machine; at every
click, the phase signal is awaited before acquisition begins
• learning from disk: images stored on the disk are displayed and reference values are calculated from
them
• viewing of learned values and tolerances recommended for each product.
The different learning modes are not mutually exclusive. That is to say, you can calculate the reference
values by combining the results of measurements executed in a different manner: statically by camera (or
disk), dynamically by camera.

SEA Vision s.r.l.

Page 72

When the button OK is pressed Harlequin prompts for confirmation before storing the learned values in
the article file.

3.2.31. Cavity Tolerances

Each of the parameters that describe the product has a lower and upper tolerance.
Tolerances are divided into three groups:
1. tolerances expressed as a percentage of learned value: area, shape parameters;
2. tolerances expressed as a percentage of the maximum value possible for the parameter: levels,
dispersions, saturations, and values;
3. tolerances expressed in degrees: angle, hues.
Moreover, each parameter may or may not be enabled independently of the others. This means that,
during production, the parameter may or may not be considered in order to establish whether a product
should be rejected.
Furthermore, for each parameter a recommended tolerance value is shown in the dialogue page. It is
calculated when the reference values are learned, by evaluating the statistics of data measured for each
parameter. If learning is executed automatically and consists of a statistically significant number of steps
(at least 30), the recommended tolerances can be used for work. In any event, the tolerances provide an
estimate of measurement repeatability.

Colour Rings
The following tolerances are set when the colour rings check is enabled:
• RGB difference of colour rings;
• TSI difference of colour rings;
• glass colour.

3.2.32. Strip Tolerances

Similarly, the parameters measured on the strip control windows (inspection windows) have
programmable tolerances too. Remember that if one or more parameters of an inspection window are off
the tolerance range, all blisters in the images will be rejected.
Harlequin – Reference Manual Page 73

3.3. Configuration Menu

3.3.1. Status Bar

This menu item is used to view or remove the status bar, which is normally shown on the bottom of the
screen.
The status bar contains brief explanations on the use of menus and keyboards for learning, search tests,
measurement tests, and manual work. The message inside the status bar changes when you select a menu
item or a key on the keyboard, providing you do not release the left-hand button of the mouse.

3.3.2. Windows Display

The overlay drawing of the cavity yellow windows can be enabled/disabled with this menu item

3.3.3. System Management

This menu item is accessible to the Harlequin administrator (user EXPERT). It opens the dialogue page
for the users management.

User Management
Enables the functions of the FDA 21 CFR Part 11. If the user management is not active there
exist three users only: Expert (Harlequin administrator), Operator and Extern. Both Operator
and Extern are not endowed with a password.
Operator is the default user: he is the user connected to Harlequin when no other user is
connected. Harlequin automatically selects it after the log-off of another user. Moreover Operator
is the user connected at the program start up.
Extern is the user who executes the commands sent either from the serial port or from the local
network. Extern must have the permissions Article choice and Batch management. If not,
Extern cannot execute the related commands. Also the control disabling by means of the extern
signal is an operation made by Extern. It requires the permission Start of machine for test.

SEA Vision s.r.l.

Page 74

If the user management is enabled every user has to log-on to the system with his own
identification code (ID) and password. The connected user can access only the functions whose he
has the permissions.
The list shows all the users defined.

Archive Management
Enables the management of the article files (.BLI). If the archive management is enabled the
article, before it is used for the automatic work, has to be committed by a user who has the proper
permission. The user commits the article inserting his password. This is done either when the
automatic work is started or when the user disconnects himself (log-off). Furthermore, the commit
operation copies the article file in the directory having the same name as the file. In this way
Harlequin maintains the history of the modifications made to all articles. The function Former
Article Versions (Work menu) allows the browsing of the files previously committed.

Batch Management
Enables the management of the batch files (.BTC). If the batch management is enabled the
function Batch End (Work menu) creates a file BTC in the directory of the current article. The
files of the produced batches are browsed with the function View Former Batch Data.

System Protection
It makes the file system on hard disk not accessible. The protection eliminates the shell of
Windows 2000 (Explorer). Therefore the program exit does not allow the access to the desktop.
Also the command Ctrl+Alt+Del from keyboard does not allow the execution of any task.

Automatic Log-off
A maximum time (Time-out) of connection to Harlequin can be set. The time begins at the log-
on. When the time-out is reached, Harlequin executes a silent log-off of the user, after that
Operator is again the connected user. If, at the end of the allowed time, the user is still operating,
Harlequin permits him to finish the operation. For example, if the user is editing the article
parameters in a dialogue box, he can continue until he comes back to the main menu. If the user
started the automatic work the blister machine continues to work after the connection time-out.
It is also possible to select the connection time-out at the beginning of each automatic work by enabling
the At Automatic Work Start option.

Expire of Password
A maximum time of password validity can be set. This does not hold for the Expert, whose
password never expires. The user with an expired password can still execute a log-on, but he can
access the function for password modification only.

New
Creates a new user. It opens the page for inserting the user’s data.
The user ID requires at least 3 characters. The user is created with the password empty and
expired at the same time. In this way at the first log-on the user can connect himself to Harlequin
simply with its own ID, but only to insert his private password.
The Harlequin administrator (Expert) can assign any subset of permissions to each user. The only
exception to this rule is the permission User management, which is always assigned to the Expert
only. A possible strategy to assign the permissions consists in dividing the users in groups,
assigning the same set of permissions to the users belonging to the same group. This is practical
when the groups are defined in hierarchical manner, that is when the user of the group of level n
owns all the permissions of the group of level n-1. The following table defines five standard users,
showing which permissions are assigned to each of them. The default user does not have any
Harlequin – Reference Manual Page 75

permission. This means that, when Harlequin starts, no operation is allowed until a user connects
himself to the system. The user of level 1 is the line operator: his target is the start of the blister
machine after the selection of the work article and eventually the start of the new batch. The user
of level 2 is the production supervisor. He is responsible for programming the work articles. The
user of level 3 is the electronic engineer: he can access to the Harlequin configuration. Moreover
he is responsible for saving the archive. The user of level 4 is the Harlequin administrator
(Expert). If Expert is responsible for the user management only and he does not work on the
system, he assigns to himself the permissions User management and Reset severe alarms only.
USER PERMISSIONS
level 0: none
DEFAULT USER
(OPERATOR)
level 1: Article choice, Work, Batch management, Start of machine for test
LINE OPERATOR
level 2: all permissions for level 1
PRODUCTION Reset severe alarms, Editing level 1, Editing level 2, Editing level
SUPERVISOR 3, Learning, Tolerances, Service call
level 3: all permissions for level 2, System management, Editing
ELECTRONIC ENGINEER configuration file
level 4: all permissions for level 3 (only if Expert works on the machine)
HARLEQUIN User management
ADMINISTRATOR
(EXPERT)
The following table shows which functions are enabled by each permission.
PERMISSIONS FUNCTIONS
No permission required Automatic Work, Manual Work, Vision System Disabled, Performance
Measure, Measure Results Presentation, Write on Log-File,
Status Bar, Windows Display, Log-on / Log-off, Acquisition,
Continuous Acquisition, Synchronised Acquisition, Clear Screen,
Display TV, Synoptic Display, Display Red, Display Green, Display
Blue, Display Colour, Rotate Images, Reflect Images, Article Cross-
Check, Triangle of Colours, Read Colours, Convert RGB->HSV,
Information on System
User management Exit Program, System Management
Article choice List of Articles
Work Automatic Work, Manual Work, Vision System Disabled
Reset severe alarms Reset of the alarms requiring a password
Batch management Batch Start, Batch End, View Batch
Editing level 1 Linked Article, Cavities Management, Strip Management, Windows,
Work Control Images, Save Images on Disk (Article), Save Images on
Disk (Archive), Save Images on External Device, Load Images from
Disk (Article), Load Images from Disk (Archive), Load Images from
External Device
Editing level 2 Article Wizard, Rejection Queues, Rejection Aux. Signals,
Asynchronous Shift Registers
Editing level 3 New Article, Copy Article, Remove Article, Program Article, Critical
Defects Management, Multi-Function Cameras Management, Work
Parameters, Internal PLC, Alarms
Learning Learning
Tolerances Cavity Tolerances, Strip Tolerances

SEA Vision s.r.l.

Page 76

System management View Article, Former Article Versions, View Log-File, Restart
Windows, Shut down, Save Article, Save Archive, Restore Article,
Restore Archive, Save System Files, Inputs/Outputs Control, Date and
Time
Start of machine for Possibility to start the machine using an article not committed
test
Service call Call Service, Terminate Service
Editing configuration Modify Configuration File
file

Modify
Opens the page for the modification of the data concerning the user selected inside the list.

OK
Closes the dialogue page with memorisation of the data in the file passwd.

Cancel
Closes the dialogue page without memorisation of the modifications.

3.3.4. Log-on / Log-off

The menu item Log-on / Log-off (corresponding icon ) shows the page where the user ID and
password have to be written.
If the user management is not enabled (and therefore only the users Operator, Expert and Extern exist)
the Log-on is possible only as Expert.
The log-off is achieved by selecting again this menu item. After the log-off the Operator is the user
connected.

3.3.5. Password Modification

The user connected to Harlequin can change the password at will. In any case the password must be
changed when it is expired. You are prompted to supply the following information in this order: old
password, new password, and the new password again for confirmation. Minimum length of password: 6
characters. Moreover the password has to contain at least one digit and at least one letter.

3.3.6. Save and Restore Archive

Saving the archive entails transferring data of the article archive from the hard disk to the external device.
The restore is the opposite operation (copy from the external device to hard disk). Harlequin in both cases
offers two functions. The Save Article function copies only one file (one article); the Save Archive
function copies all files (all articles).
Once the saving is done we recommend copying the external device content to an external computer (in
the office). Even in case of damage or loss of the external device the article files will be retrieved.
Further save the article or the complete archive whenever you modify the archive by adding to or
modifying articles, so that you can restore data rapidly either if the hard disk fails or if data are
accidentally altered due to an incorrect operation.

Save Article
Harlequin copies on the external device the file of the selected article and the configuration file
HARLE.INI.
Harlequin – Reference Manual Page 77

Save Archive
Harlequin copies on the external device all files (complete archive), the configuration file
HARLE.INI and the password file.

Restore Article
Harlequin presents the list of the articles stored on the external device. A click of the mouse left
button on the row corresponding to an article executes the copy of the file from the external device
to the hard disk. If the article already exists on the hard disk Harlequin asks the operator before
overwriting.

Restore Archive
Before restoring the whole archive Harlequin prompts for confirmation.

3.3.7. Save System Files

This procedure is performed to save Harlequin programme and some files linked to it. The system saving
is necessary owing to the possibility of upgrading the programme. In fact, only systems installed in
productions lines are usually upgraded, which leads to leaving the spare hard disk lacking in the new
version.
For this reason, after the replacement of the hard disk, the check system would work with an obsolete
version of the programme. If the system is saved after each software upgrading, the system may be used
to save the latest version of the programme on the hard disk.

3.3.8. Work Control Images

The quickest way to assess the efficiency of the control system, is to evaluate the accuracy of the
drawings appearing on the objects after measurement.
There are three types of drawing:
• above the object (result of object search stage);
• on the object contour (result of measurement stage);
• search window around the object, but only in work mode (the colour depends on the check
result).
The drawings on the object can be of two types:
• a point for one dimensional searches and for two dimensional capsule and two-colour capsule
searches
• a complex of equally spaced points for two-dimensional searches.
During the search and measure tests, the drawings are always enabled, whereas during learning or work
stages, the only drawings shown are those selected in this dialogue page.
When using the capsule model, which is set in the Special Parameters for Measure, double drawings
are executed on the contour during the measurement test; in fact, both the effectively detected contour and
the model contour are drawn. During leaning or work, only the model contour is drawn.
The colour of the drawings selected in the dialogue page refers only to the search and measure control
drawings. The colour of the windows depends on the outcome of measurement and adheres to the
following conditions: Yellow: empty cavity, green: object within tolerance range, red: defective tablet,
blue: object with critical defect.
The page consists of the following elements:

Construction of Images
Option useful to reduce the cycle time.
During the automatic work the screen shows the following information (in order of decreasing
computational load):

SEA Vision s.r.l.

Page 78

• Image + Drawings: the whole acquired image is visible together with the overlay of the
control drawings selected with the options Measure Control Drawings and Search Control
Drawing;
• Partial Image + Drawings: the same as before; the only difference regards the size of the
displayed area, which is limited to the region occupied by the cavities;
• Drawings only: the image is not visible; the control drawings are displayed on black
background;
• Nothing: neither image nor drawings.

Images Displayed during the Automatic Work

Option useful to observe the images containing the defects during the run of the blister machine.
• Last Image Checked: the image displayed on the screen changes at each step, no matter what
its content is;
• Image Containing the Last Detected Defect: the image displayed on the screen is that
containing the last defect detected; until no defect is found, the image changes at each step, like
in the previous case; once an image with a defect has been frozen on the screen, it is possible to
reset to the initial status by pressing the reset button when the blister machine is idle. You can
select the defects that must be frozen on the screen when this option is chosen; any subset of
defects can chosen by enabling the different possibilities (Empty Cavity, Foreign Body in
Cavity, Defective Product, Fragment in Cavity, Critical Defect, Strip Defect, Powder).
• Image Containing the Last Detected Good: the image on the screen contains the last detected
good; as long as no good has been detected, the image on the screen becomes black, just like in
the previous case; once the image containing a good freezes on the screen, it shall be possible
to restore the initial situation by pressing the reset push-button.

Images Memorised during the Automatic Work

Enables the memorisation of the images that are acquired and checked during the work operations.
Not all images are stored, but only those containing the objects specified using the key Choose
Images. When the memory dedicated to the images is full, it is overwritten starting by the oldest
images: this allows the display of the last detected defects. The images are viewed when the page
of the numerical results is open: a click over a row, if the image has been memorised, opens a
window containing the image.

Counters Window
Displays the batch counter window (lot and/or partial) during the automatic work.

Measure Control Drawings

Selects the measure control drawings to display during the work.

Search & Measure Drawing Colour

Selects the colour of the drawings on the object for the search and the measure (object contour).

Search Control Drawing

Enables the search control drawing: either a dot in the centre of the tablet or a set of equally
spaced points covering most of the tablet (two-dimensional search).

Crossed Window in Case of Defect

Option useful for people who do not distinguish the colours on the screen; it enables extra
drawings to discriminate among four cases: empty cavity (yellow window), object within
tolerance (green window), defective object (red window), object with critical defect (blue
Harlequin – Reference Manual Page 79

window); the green window is unchanged, the yellow window adds one diagonal, the red window
adds two diagonals, the blue window adds two diagonals and one cross.

Drawing of Characters Quality

Selects the character quality drawings to be displayed during automatic work.

Drawing of Reference Codes

Enables, for each window, the programmed reference code at the beginning of the batch.

Show Rejection Queues

Enables the display, during the automatic work, of the window showing the rejection queues.

Show Alarms Window

Enables the display, during the automatic work, of the window showing the messages.

Show Async. Shift Register Window

Enables the display of the asynchronous shift registers during automatic work.

SEA Vision s.r.l.

Page 80

3.3.9. Work Parameters

The parameters in the dialog window are used during automatic work with the exception of parameters
useful for images: exposure time and duration of continuous acquisition, which refer to the Image
menu functions.
Parameters identified by a yellow trackball refer exclusively to selected work articles; the others are
system parameters and are used by all articles.

Queues Initial Status

When Harlequin enters automatic work mode, it initialises the rejection queues differently
according to the setting of the Initial Status of Queues parameter. This is what happens.
• Normal: when the system is powered up, the rejection queues are initialised as rejections; if
the automatic work mode is exited, the rejection queues are saved and restored on return to
automatic mode; if, between two work sessions, the operator performs certain special
operations (e.g. disables control), for reasons of safety, stored queues are not restored and the
rejection queues are initialised as rejections.
• OK: after the parameter is selected as OK, the first time the automatic work mode is accessed,
the queues are initialised with values indicating good blisters; furthermore, for reasons of
safety, the parameter is changed back to normal status.
• KO: this functions in the same way as the preceding case, with the exception that the queues
initialising value corresponds to rejected blisters.

Outputs Status
If always KO is chosen, all blisters are rejected during automatic work mode, irrespective of the
result of inspection, which is, in any event, executed. On the other hand, by selecting always OK,
all blisters are forced to pass through. If normal is selected, blisters are rejected if they have at
least one object off tolerance range in regard to at least one of the active control parameters.
For reasons of safety, the always OK and always KO options are valid only for the first session
of automatic work. For subsequent sessions, unless otherwise specified, the machine assumes the
normal outputs option.

Status of Unused Outputs

Harlequin has 32 rejection outputs. But only some of them are used (one per channel). The
remaining rejection outputs not associated with any blister can be forced into the required status.

Output Word
Used to set an output word for the current article at the automatic work input..

Light Box Signals

Harlequin can manage and enable illumination signals in format. Besides, press the % push-button
to programme the switch-on time of each work bit in the illuminator. This duration is indicated as
the exposure time percentage programmed by the article.

Count of Consecutive Rejections Separated for each Channel

If the box is barred, consecutive rejections are counted separately for each channel, i.e. every
channel has its own particular rejection sequence. This means that to stop the blister machine, a
sequence of rejections with a length of at least the N. of Consecutive Rejected Blisters must
occur on one channel only. If the box is not barred, the same rejection sequence applies to all
channels.
Harlequin – Reference Manual Page 81

Count of Consecutive Rejections Including Totally Empty Blisters

If the box is barred also the totally empty blisters are taken into account for the stop caused by too
many consecutive rejections. In the opposite case they are not summed in the total of the
consecutive rejected blisters. Therefore, in the latter case, if the blister machine runs without
loading the product, Harlequin does not stop it.

Start Program in Automatic Work Mode

If the box is barred, when the machine is powered up, Harlequin starts to operate directly in
automatic work mode, but only if the default user (Operator) has the permission Work.

Virtual Acquisition Trigger Period

Harlequin can send an acquisition virtual trigger to each TV; the Period is set between one trigger
and the following one for each TV.

Strobo
In the management of the illuminator signals, it is possible to assign a TV to each illuminator
strobe signal.

Exposure Time
The exposure time value to be used for acquisitions from cameras executed with the key
Acquisition. This value is used also by functions in Images menu when no article is selected. The
item New Article in Archive menu assigns this value to each new article.

Number of Consecutive Rejections

If, during automatic work mode, the number of consecutive rejections is greater than or equal to
the set value (for each camera), the control system resets the run permitted signal thus causing the
blister machine to stop, and waits for the operator to send the reset after error signal (reset key on
the blister machine) in order to restore the signal and restart work.
If value 0 is set, the blister machine is never stopped.
If, for example, value 1 is set, the blister machine is stopped at the first rejection.
This stop for too many rejections can be disabled if the control system receives the following
signal from the blister machine: stop inhibition for too many rejections.

Duration of Continuous Acquisition

The number of seconds that Harlequin devotes to continuous acquisition from the cameras (item
Continuous Acquisition in Images menu).

Stop Inhibit Delay (steps)

The signal of stop inhibit can be delayed in the space. This means that at a given time the level of
the signal received n steps in advance is taken into account, n being the value set in this field. The
number of steps (n) represents the number of acquired images, which is the number of acquisition
triggers received.
A value greater than 0 is useful when, for example, the stop inhibit signal represents the state of
the product feeder (0 = feeder open, 1 = feeder closed). Because the feeder is up-line of the control
vision system, if the blister machine must not be stopped when the feeder is closed, it is sufficient
to set a value n that equals the number of steps between the feeder and the control system.

SEA Vision s.r.l.

Page 82

Consecutive Rejections Period

It is the period phase of consecutive rejections. If 1 is programmed, the rejection is not periodic;
contrary to this, the rejection period is to be programmed. In this way the machine stop for
consecutive rejections does not depend on continuous rejections, but on the programmed period.

Acquisition, Number of Images per Step, Images, Delay (ms)

On the alternate moving machines Harlequin can acquire the images during the movement of the
base strip. In this case the number of Images to acquire in each machine step must be specified.
For each acquired image a Delay can be set.
It is the time waited by Harlequin, after the reception of the acquisition trigger, before acquiring
the image.

Acquisition
Acquires the images from the cameras according to the exposure time of this dialogue page.

3.3.10. Internal PLC

Harlequin can execute, beyond the normal control functions, also the functions of a PLC to manage, for
example, the activation of the rejection systems on the machine that do not have these capabilities. The
internal PLC is implemented with a subroutine, which, while the machine is running, is executed with a
frequency high enough to guarantee real time reactions to the events that happen in the production line
(usually 0.5 ms).
The field Internal PLC Enable of the configuration file selects the internal PLC type. Nowadays
there are the following types of internal PLC available.
• type 1: for Partena blister machines with parallel rejections
• type 2: for Partena blister machines with serial rejections

If enabled, the internal PLC operates when:

• the control is disabled with the proper function of the Configuration menu (or with the external
signal); in this case the blisters are either rejected or passed depending on the field Output Status of
the dialogue page Work Parameters;
• Harlequin is in the automatic work mode.

3.3.11. Partena blister machines with parallel rejections

The internal PLC executes the following functions:
• activates the blister rejection solenoid-valves according to phases supplied by the sensors;
• checks possible jamming of the output conveyor;
• diverts blisters from the output conveyor if the cartonner downline of the blister machine stops;
• executes counter-check based on transit time to detect any rejection blisters that were not rejected and
also partial jamming status of the cutter;
• executes optical fibre counter-check.
Some parameters of the Internal PLC can be programmed from the dialogue page.

Maximum Interval between Two Consecutive PLC Executions (ms)

This is the maximum time (in milliseconds) that can elapse between two consecutive executions
of the Internal PLC’s routine; if this limit is exceeded, the program generates an alarm and stops
the blister machine; the alarm message indicates the point of the code that delayed the call of the
Internal PLC as well as the measured delay.
Harlequin – Reference Manual Page 83

Number of Blisters for each Cutter Trigger

This is the number of data that are extracted from the rejection queue (for each channel) for each
cutter trigger.
The result is a rejection provided that at least one extracted value is a rejection.

Enable Optical Fibre Counter-Check

To enable the optical fibre counter-check, bar the Enable box.

Non Rejected Blisters Ejected from Outfeed Conveyor

In case of no-rejection alarm, it is possible to deviate the unrejected blisters through the vent on
the outfeed conveyor.
If the box is not barred, the unrejected blisters shall be oriented towards the packaging machine
magazine, where they can be easily recovered when the machine stops.

Stop Outfeed Conveyor in Case of Alarm

In case of alarm, it is possible to immediately stop the outfeed conveyor.

Reject in Case of Conveyor Belt Stop

When the outfeed conveyor is not running, the blisters on the conveyor are rejected.

Counter-Check based on Transit Time

The purpose of the counter-check at transit time is to detect two conditions - failed rejection and
partial jamming of the cutter; the counter-check is based on the time employed by the blisters to
arrive under the photocell on the output conveyor, after being cut; as the output conveyor moves at
constant speed, blister transit time is identical for all blisters on each channel of the blister
machine.

As the transit time associated with each channel is known, the internal PLC compares the time
measured for blisters outfeed by blister machine with the reference time value; if a blister passes
under the photocell too early with respect to correct time, this blister should not have been on the
conveyor at that time, therefore, it is a rejection blister that was not rejected; vice-versa, if a
blister reaches the photocell too late, this means that at least one blister was not outfeed from the
cutter area: this is therefore a case of partial jamming; in both cases, the Internal PLC generates
an alarm and stops the blister machine.

Enable Counter-Check
Barring the Enable box enables counter-check at transit time.

Learning of Transit Times

To enable learning of transit time, bar the appropriate box; to ensure that learning is completed,
the blister machine must not reject any blisters for the entire duration of learning (10 rows of
blisters); this can be achieved by forcing outputs to Always OK in the Work Parameters
dialogue page.

Transit Time Tolerance (ms)

The maximum permissible tolerance for transit times compared to learned values: transit times
differing from learned times, as their value is higher than set value, cause a failed rejection or
partial jamming alarm to be generated.

SEA Vision s.r.l.

Page 84

Learned Transit Times (Channel 1-Channel 4, ms)

Learned transit times cannot be edited directly; transit times must be scaled; for example, if
channel 1 is the nearest to the output conveyor photocell, the following relations apply tch1 < tch2
< tch3. The last value (separated by a dash) shows the output conveyor photocell inhibition time
(in milliseconds). The inhibition starts when the photocell detects a blister edge. This means that
the signal coming from the photocell is ignored until the inhibition time is expired.

Conveyor Speed (mm/sec)

Conveyor speed to detect the blisters which that exit in a superimposed position.

Blister Length (mm)

Blister size in the conveyor movement direction.

Transit Time Tolerance (ms) Overlapped Blisters

Transition time tolerance of superimposed blisters.

Auxiliary Rejection Signals

For each channel in the machine it is possible to combine one of the list signals to the rejection
queue signal.

3.3.12. Partena blister machines with serial rejections

The internal PLC executes the following functions:
• activates the blister rejection solenoid-valves according to phases supplied by the sensors;
• checks the blister transit on the output conveyor;
• diverts blisters from the output conveyor if the cartonner downline of the blister machine stops;
• executes counter-check based on transit time to detect any rejection blisters that were not rejected and
also partial jamming status of the cutter;
• stops the second output conveyor in case of alarm.
The dialogue page shows the parameters valid for all articles (for example the distances between the
sensors) and the parameters depending on the article (for example the blister length). The first one are
stored in the configuration file, the second ones are stored in the article file (.BLI). Anyway they have
default values in the configuration file. Such a values are assigned when a new article is created.

Maximum Interval between Two Consecutive PLC Executions (ms)

This is the maximum time (in milliseconds) that can elapse between two consecutive executions
of the Internal PLC’s routine; if this limit is exceeded, the program generates an alarm and stops
the blister machine; the alarm message indicates the point of the code that delayed the call of the
Internal PLC as well as the measured delay.

Blister Length (mm)

Length of the blister in the direction of movement on the conveyor.

Number of Blisters for each Cutter Trigger

This is the number of data that are extracted from the rejection queue (for each channel) for each
cutter trigger. The result is a rejection provided that at least one extracted value is a rejection.

Rejection Auxiliary Signals

For each channel in the machine it is possible to combine one of the list signals to the rejection
queue signal.
Harlequin – Reference Manual Page 85

Rejection
There are two devices that reject the blister: mechanical flap (first) and air flow (second). You
can choose to use either one of them or both. Two values should be set for each of them (in
milliseconds): the Delay and the Duration. The delay is the time elapsing since the blister
detection (by the rejection sensor) to the start of the rejection. The duration is the time elapsing
since the start to the end of the rejection.

Blister Output Direction on Conveyor

It depends on the layout of the packaging line. If the exit is on the rear side, the first blister out
from the cutter belongs to the first channel. If the exit is on the front side the first blister out from
the cutter belongs to the last channel.

Conveyor Speed (mm / sec)

The first two sensors measure the conveyor speed. Harlequin, knowing the distance between the
sensors, measures the transit time of the blister from the first to the second sensor and computes
the speed. This is done for all blisters, so that the conveyor speed can be changed without
changing the programming. If the sensors are not able to measure with accuracy the edge of the
blister in transit the conveyor speed should be set with the numerical value.

Sensor Distances (mm)

The sensors on the conveyor belt, starting from the cutter, are:
sensor 1: first sensor for measuring the blister speed
sensor 2: second sensor for measuring the blister speed
sensor 3: sensor for rejecting the completely empty blisters
sensor 4: sensor for rejecting the defective blisters
sensor 5: sensor for checking the rejections
If the rejection of the completely empty blisters is not installed the numbers range from 1 to 4 and
the last field (4→5) is disabled.
The distances between the sensors have to be measured and programmed in the dialogue page.
The sensors work on the blister edge: Harlequin ignores the commutations of the signals
happening after the blister edge for the whole length of the blister. This makes the rejection
system not sensitive to the printing on the aluminium foil.

Check on Conveyor
The checks on the conveyor may be performed with the transition interval (Time) or with the
conveyor feeding clock (Distance)
Sensor 1: the sensor 1 must see, in the time interval between two cutter triggers, the blisters just
cut. To facilitate this function the cutter trigger can be delayed with the field Delay (ms). The
delay moves ahead the time interval in which the blisters must be seen by the sensor 1.
Sensor 2: the sensor 2 measures the transit time of the blister and compares it with the expected
one (computed with the information on blister speed and length); if two blisters are overlapped the
transit time is too long (above the specified time tolerance).
Sensors 3, 4, 5: the transit time of the blister is checked: it starts at the previous sensor. This time
must be the expected one (computed with the information on blister speed and distance between
the sensors) apart from the tolerance on the transit time.

Tolerances, Transit Time (ms)

We suggest values from 50 to 100 ms.

Tolerances, Distance (mm)

Tolerance in mm when the selected check of the conveyor is of Distance type.
SEA Vision s.r.l.
Page 86

Conveyor Clock Frequency (Pulses/Meter)

Feeding conveyor clock frequency when the selected check on the conveyor is of the Distance
type.

Blister Ejection from Conveyor in case of Alarm

In case of alarm generated by non-rejected blisters, they can be flown out from the conveyor. If
the box in not barred the non-rejected blisters go normally to the cartonner, where they can be
easily picked up after the blister machine stop.

Stop Outfeed Conveyor in Case of Alarm

If a second conveyor is installed between the main conveyor and the cartonner, it can be stopped
when Harlequin generates an alarm on the blister output. This allows the non-rejected blisters to
be easily picked up after the blister machine stop.

3.3.13. Alarms
Some blister machines mount two reset push buttons. The first is on the operator panel. The second is
near the blister rejection device. If the alarms generated by Harlequin concerning the blister rejection (for
example the missing rejection) can be reset with the second button only, the operator has to move to the
area of the blister machine where the alarm arose.
Harlequin, through this dialogue page, allows you to assign one or both reset buttons to each alarm class.
Furthermore each alarm class can be considered severe and subjected to the password insertion. In this
case the alarm can be reset only by users having the permission: reset severe alarms.

3.3.14. Inputs/Outputs Control

This menu item shows a page with an overview of all signals communicating with the outside. The input
signals are at the top and the output signals at the bottom. Each signal includes its meaning, the relevant
I/O port, the number of the port bit, and the type of logic used – positive or negative.
As logic values are referred to, a tick appears in the square when the signal is active. For positive logic,
the signal is active at high voltage value, whereas for negative logic, the signal is active at low voltage
value. The type of logic and connection (port and bit) of each signal is set in the configuration file.
If you click over one of the output signals, its status will be switched. When you exit the control page, the
preceding situation of the output signals will be restored.
Harlequin – Reference Manual Page 87

Harlequin has an oscilloscope function for the input / output signals. The oscilloscope shows the signals
memorised during the blister machine run. To activate the signal memorisation set the field Log of the
input signals. During the automatic work, when the required event happens (an alarm or simply the stop
of the machine), Harlequin creates a file containing the commutations of the signals in the time interval
starting few seconds before the machine starts and ending few seconds after it stops. The button List of
Files opens the page showing the stored files (in chronological order).
If the file creation was triggered by an alarm, this is shown in the same row of the file. The files can be
exported on floppy disk (button Export File) and displayed on the screen (button Show Signals).
The oscilloscope shows a signal per row: above the inputs, below the outputs. The drawing is panned with
the arrow keys. The resolution of the single box ranges (with the zoom keys) from 1 second (minimum
resolution) to 1 millisecond (maximum resolution). Meaning of the colours:
black: the signal takes the logic low value for the box duration
red: the signal takes the logic high value for the box duration
yellow: the signal takes the both levels inside the box.
The column with the reversed colours shows the time of the alarm generation by Harlequin.

3.3.15. Date and Time

The System Date and Time Setting dialogue page enables you to change the system setting, which will
remain stored even when the machine is powered down.

3.3.16. Modify Configuration File

The configuration file HARLE.INI is edited in this page.
Small editing operations do not require the keyboard: you can exploit the right mouse button, which
opens a pop-up menu containing, among others, the commands
Cut: deletes the selected text and makes it available to Paste
Copy: makes the selected text available to Paste

SEA Vision s.r.l.

Page 88

Paste: inserts the text in the cursor position

Delete: deletes the selected text
Undo: removes the effect of the last command.

3.4. Images Menu

3.4.1. Acquisition
If this item is selected, images are immediately acquired from the cameras. The exposure time is that
associated to the selected article. If no article is selected the time set in dialogue page Work Parameters
is used.

3.4.2. Continuous Acquisition

If this menu item is selected, images will be acquired from the cameras for a period depending on the
value of the Duration of Continuous Acquisition parameter set in Work Parameters dialogue page.
Exposure time is identical to the time used for immediate acquisition.

3.4.3. Synchronised Acquisition

If this menu item is selected, it causes acquisition of images from the cameras synchronised with
reception of the blister machine acquisition trigger. If the acquisition trigger is not received within 10
seconds, control is handed back to the operator without acquisition of images. Exposure time is that used
for other types of acquisition. For alternating movement machines this function is disabled.

3.4.4. Save Images on Disk (Article)

If this menu item is selected, images shown on the screen are copied on the hard disk for later use (e.g. for
search and measure tests). Therefore this operation links the images displayed on the screen to the
selected article. It is possible to save three images for each article: Work, Good, Empty. When such an
article is selected through the list the images are shown. The operation in reverse direction, from disk to
video, is executed with function Load Images from Disk (Article).
Harlequin – Reference Manual Page 89

3.4.5. Save Images on Disk (Archive)

When this menu item is selected, the images on the screen shall be copied on a hard disk in a common
folder for all articles (Images).
The inverted operation from the disk to the video is performed with the Load Images from Disk
(Archive) Function.

3.4.6. Save Images on External Device

If this menu item is selected images shown on the screen are copied on the external device. The operation
in reverse direction, from the external device to video, is executed with the function Load Images from
External Device.

3.4.7. Load Images from Disk (Article)

If this menu item is selected, images saved on disk with the Save Images on Disk (Article) command are
copied in the image memory and then shown on the screen.

3.4.8. Load Images from Disk (Archive)

Upon selecting this menu item, the list of all the saved images appears on the disk by using the Save
Images on Disk (Archive) control.
Upon selecting the line which corresponds to the required image, the image shall be copied in the image
memory and displayed on the screen. The OK push-button cancels the window to return to the main
menu. The Remove Bitmap push-button eliminates the image selected by the saving external device. The
Clear Screen push-button resets the memory which contains the images and consequently, the screen
turns completely black.

3.4.9. Load Images from External Device

Upon selecting this menu item, the images saved in the external disk, by means of the Save Images on
External Device control, shall be displayed in the list of images.
Upon selecting the line which corresponds to the required image, the image shall be copied in the image
memory and displayed on the screen. The OK push-button cancels the window to return to the main
menu. The Remove Bitmap push-button eliminates the image selected by the saving external device. The
Clear Screen push-button resets the memory which contains the images and consequently, the screen
turns completely black.

3.4.10. Clear Screen

With this menu item, the memory containing the images is reset and, as a result, the screen turns
completely black.

3.4.11. Display TV
When more than one camera are installed, it shall be possible to choose the image to display on the
screen. The screen can display the images one by one or all together. The numbers from 1 to 16 refer to
images received from cameras 1 to 16 respectively.

3.4.12. Synoptic Display

With this menu item, images coming from all the installed cameras are displayed on the screen.
High Resolution Display
Images on the screen are displayed in high resolution.

3.4.13. Display Red

If the image is coloured, only the Red component of the image shall be displayed.

SEA Vision s.r.l.

Page 90

3.4.14. Display Green

If the image is coloured, only the Green component of the image shall be displayed.

3.4.15. Display Blue

If the image is coloured, only the Blue component of the image shall be displayed.

3.4.16. Display Colour

Coloured images are displayed on the screen.

3.4.17. Rotate Images

Rotated images appear on the screen. There are four options: +90° (clockwise), 180° (overturned), -90°
(anti-clockwise) and Any Angle. In the last case the angle value is specified in degrees.

3.4.18. Reflect Images

Reflected images are displayed on the screen (Vertical and Horizontal).

3.5. Help Menu

3.5.1. Article Cross Check

It is the instrument that assesses the risk of mixing different products. This risk is measured and showed
in a table which regards all the article pairs that belong to the same group (the group is the number
indicated at the Article Cross Check title in the Critical Defects Management page of the Archive
menu). A hypothesis is prepared for each pair, so that, while working on the first article, an object
described by the second article can arrive to the check station. Since each object is characterised by
learned values which determine its geometry and colours, it is possible to check whether a value
belonging to the second article may fall or not within the first article tolerance range.
This table shows, for each pair of articles, the number of the out-of-tolerance parameters which are found
when the object described by the article in the column replaces the work article displayed on the line. The
box colour depends on the number of the displayed out-of-tolerance parameters: red means no out-of-
tolerance parameter, and consequently, the display system cannot guarantee the detection of the mix-up
between two products because said products seem to be equal.
Harlequin – Reference Manual Page 91

3.5.2. Triangle of Colours

The triangle of colours shown on the screen illustrates the relationship between colour space RGB, (in
which a colour is obtained by the sum of red, green and blue) and HSV space in which the colour is
represented by three components: hue, saturation and value. The triangle of colours contains all colours
viewable on the screen but does not include their value. In other words, every point of the triangle
corresponds to a precise colour that may be more or less luminous, even if the point on the triangle is
drawn with the maximum possible luminosity. In particular, the triangle vertexes represent the three
fundamental wholly saturated colours, whereas the centre of the triangle is the achromatic point, i.e. a
grey that, according to its value ranges from black to white. When any of the numeric values are altered,
as a result, the three values of the other colour space are also modified; moreover, the cross-cursor moves
on the screen indicating which colour corresponds to the set numeric values.
Some properties of the triangle:
• the hue of a colour is obtained from the angle of the segment that unites the cursor to the centre of the
triangle;
• the saturation of a colour is obtained through the distance of the cursor from the centre of the triangle;
consequently, wholly saturated colours (i.e. obtained as the sum of two fundamental colours only) are
those on the edge of the triangle;
• points having the same hue are all those located on the same segment connecting the centre of the
triangle to a point at the edge: the cursor moves along this segment when saturation between 0
(triangle centre) and 255 (a point on the edge) is varied;
• points having the same saturation are located on the perimeter of an equilateral triangle that is
concentric with respect to the main triangle: the cursor moves along this perimeter when the hue is
varied;
• if a colour component (e.g. red) is increased, the cursor moves in the direction of the red vertex;

SEA Vision s.r.l.

Page 92

• if the value is varied, the cursor does not move, but the numeric values of red, green and blue vary.

3.5.3. Read Colours

Dialogue page Colours Reading shows the colour parameters (Red, Green, Blue, Hue, Saturation, Value)
of the image point on which the cursor is located. If the cursor is moved, the values are updated
automatically.
This page is also used for the image binarisation. The segmentation reference colour can be read by
clicking the mouse on a point in the image, or by manually setting it. When the Enable box is barred, the
image is segmented into three colours: orange, black, and gray. The orange pixels represent the colour
and density ranges (segmented pixels). The black pixels have the correct density but not the right colour.
The gray pixels are out of intensity tolerance.

3.5.4. Conversion RGB→HSV

The function for converting from space (red, green and blue) to space (hue, saturation and value)
executes the following substitutions:
• the red image becomes the hue image
• the green image becomes the saturation image
• the blue image becomes the value image.
This conversion is useful for two-colour capsules, when selecting the segmentation parameter enabling
the two colours to be distinguished (see paragraph on selection of colour segmentation).
The converted image must be observed band by band; superimposition of the three bands is of no
significance.

3.5.5. Call Service

Sea Vision offers a Remote Service facility to its clients. To make use of it, you must have a telephone
line connected to the internal modem of the Harlequin system.
The dialogue box allows you to select some dial-up parameters;
1. INTERNET: enables the connection through Internet;
Harlequin – Reference Manual Page 93

2. telephone number: if necessary it is possible to insert pauses during the number dialling by
putting one or more dots (.) in the middle of the number;
3. host IP address: either 192.168.1.1 for the direct call or 217.57.108.203 for the connection
through Internet;
4. connection speed: depends on the quality of the telephone line; not all modems allow this
selection;
5. tones or pulses: the choice depends either on the company switchboard or on the local telephone
exchange.

When OK is pressed Harlequin will dial the Service number.

Reference is to be made to paragraph 6, in order to obtain a detailed description of the assistance service.

3.5.6. Terminate Service

This title disconnects the remote assistance.

3.5.7. Language choice

The language choice is allowed only to users with the system management permission.

3.5.8. Information on the System

The dialogue box shows some information concerning the system and the installed optional packs. The
language is always English.

SEA Vision s.r.l.

Page 94

4. Alarm messages
Harlequin is able to stop the blister machine. This can occur following normal malfunctions such as
detection of too many consecutive rejects, but may also be due to more serious problems. To stop the
blister machine, Harlequin disables the run permitted signal and wait for the blister machine to stop.
After the machine stops, the screen shows a message explaining the reason for stoppage.
This message disappears when the reset push-button (on the control panel of the blister machine) is
pressed, thus sending to Harlequin the reset after error signal. On receiving this signal, Harlequin re-
enables the run permitted signal to allow work to continue. If several alarms are generated
simultaneously, they are displayed in sequence: each pressing of the reset key cancels the last message
and displays the new one. The blister machine can therefore be restarted immediately. The only
exceptions to this are faults that are considered serious, for which the blister machine is locked until the
Password is entered, i.e. until a user with the permission to reset the severe alarms intervenes. In these
cases, pressing the reset key makes the message disappear from the screen, but it is replaced by the
dialogue page for entering the Password. The run permitted signal is not restored until the correct
Password is entered.
In any event, all alarm messages generated by Harlequin are saved in the Log-File, and all include the
data and time at which the malfunction occurred.
Some blister machine stops can be avoided if Harlequin receives the disable blister machine stop signal
from the blister machine. This signal is effective only for some types of stop (e.g. it cannot disable a stop
caused by a fault), providing the stop disable system is enabled for the different classes of stop reasons.
The following are the classes for which stop inhibition can be enabled, i.e. for which the disable blister
machine stop signal can be made active:
• stop due to too many consecutive rejections
• stop due to a critical defect
• stop caused by a defect on the strip
• stop caused by a rejection auxiliary signal
The following is a list of messages which are shown when the blister machine stops, with a description of
the reason of stoppage.

(M001) Too many consecutive rejections

In this case, during automatic work mode, the number of consecutively rejected blisters counted is
greater than or equal to the value set in the Work Parameters dialogue page. If value 0 is set in
Work Parameters, the blister machine is never stopped; if instead, value 1 is set, the blister
machine is stopped at the first rejection, and so on. Consecutive rejections are calculated
separately for each channel or as a whole on all channels, according to the setting of the relevant
parameter in the Work Parameters dialogue page.

(M002) Too much light variation, either change the lamp or execute a new learning
This is the message appearing when the light intensity measured in the reference windows
changes for more than 50% in comparison to the learned value. It may depend on the lamp ageing,
on the wrong position of the lighting system, on the shift of the reference windows, on a strong
variation of the environment light. Also a camera failure can give this alarm.

(M003) Shift register X: Message

This message appears following a stop caused by the input signal of a generic shift register.
Message is any text entered in the appropriate dialogue page.
Harlequin – Reference Manual Page 95

(M004) Message, number of steps from the control station: X

This message appears following a stop caused by a rejection auxiliary signal. Message is any text
entered in the appropriate dialogue page.

(M005 - M007) Defect detected on the strip inside window n. X which is N steps from the control
station
This message appears following a stop caused by a defect on the strip.

(M008 - M010) Foreign body detected in cavity n. X of group n. Y, which is N steps from the control
station
This message is shown following a stop caused by a foreign body in cavity.

(M011 - M013) Fragment of tablet detected in cavity n. X of group n. Y, which is N steps from the
control station
This message is shown following a stop caused by a fragment of tablet in cavity.

(M014 - M016) Powder (stains) detected in cavity n. X of group n. Y, which is N steps from the control
station
This message is shown following a stop caused by detection of powder on product.

(M017 - M019) Powder (stains) detected in group n. X which is N steps from the control station
This message is shown following a stop caused by detection of powder on blister.

(M020 - M022) Critical defect (non empty cavity) detected: n. X of group n. Y, which is N steps from
the control station
This message is shown following a stop caused by a non-empty cavity. It is a cavity considered
empty by the search algorithms, but showing colours different from those learned.

(M023 - M025) Critical defect type X detected in cavity n. Y of group n. Z which is N steps from the
control station
This message appears following a stop caused by a critical defect.

(M026) Detected N critical defects on the product

This message appears following a stop caused by many critical defects.

(M027) Machine too fast; reprogram the article to obtain better performance (X ms)
This message appears in case of overrun, i.e. when the blister machine cycle item is shorter than
Harlequin’s cycle time. X shows the elapsed time between two consecutive acquisition triggers. If
this value is too small in comparison with the blister machine speed, the alarm is generated by a
wrong commutation of the acquisition trigger.

(M028) Blister machine too fast for image acquisition

This message appears in case of image acquisition overrun on alternate moving machines. It is
generated when the blister machine cycle time is shorter than the acquisition time of Harlequin.

(M029) Blister machine strip out of step (X.YY mm)

This message appears when the base foil goes out of step (apart from the set tolerance) with
respect to the acquisition trigger signal. Step control can be enabled in the Work Parameters
dialogue page.

SEA Vision s.r.l.

Page 96

(M030) Wrong number of images per step

An alarm message. It can appear on alternate moving machines. It is generated when the number
of images per step (programmed in the Work Parameters dialogue page) does not match the
number of acquisition triggers received by Harlequin in a machine cycle.

(M031) Phase signal for image acquisition not received

An alarm message. If the phase signal is not received 10 seconds after the blister machine was
started, Harlequin assumes that a fault has occurred.

(M032) Run permitted signal not received by blister machine

An alarm message. If the blister machine does not stop 10 seconds after the run permitted signal is
disabled (for any reason), Harlequin assumes a fault has occurred.

(M035) Alarm: the values of the rejection signals do not match the set values
An alarm message. It appears when one of the rejection signal, read back by Harlequin does not
correspond to the set value.

(M036) Reset of the rejection queues from external reset signal

It appears when the signal resetting the rejection queues is received.

(M037) Alarm! Motherboard Temperature X° (max Y°)

(M037) Alarm! CPU Temperature X° (max Y°)

These are alarm messages. They are shown when Harlequin perceives temperatures beyond the
allowed thresholds. In these cases it is important to verify that the air filters are clean and the fans
bringing fresh airs inside the machine case are working. It is also important to check that the CPU
cooling fan is not blocked.

(M038) Machine running signal not received

An alarm message. It appears when Harlequin perceives that the acquisition trigger is switched
although the machine running signal indicates that the blister machine is not running yet.

(M039) Collision in rejection FIFOs: the rejection phase signal is probably not being received

(M040) Collision in rejection FIFOs (X)

Alarm messages generated by the Internal PLC 1 and 2. They appear when the number of
collections from the rejection queues is different than the number of insertions.
As collection is executed, for all channels, when Harlequin receives the corresponding rejection
phase signal, the difference between the number of collections and insertions is attributed to non-
reception of the rejection phase signal. Otherwise, this alarm could be caused by electromagnetic
noise on the image acquisition trigger In this case, the following alarm will probably be shown
also: Blister machine too fast; reprogram the article to obtain better performance.
In the second case X is the difference between insertions and collections from the rejection
queues.

(M044) Light box not in position

An alarm message which appears when the illuminator is out of position and prevents the machine
from running.

(M049) Length of the rejection queue

An alarm message which appears in case of an error in the rejection queue data number.
Harlequin – Reference Manual Page 97

(M050) Timeout results ready

An alarm message which appears when the multi-functional TV good signals are used as rejection
auxiliaries; Harlequin waits for the results of the multi-functional TV windows for one second
then it activates the alarm.

(M051) Error on acquisition trigger

An alarm message. It appears upon enabling the time period check which passes between two
fronts of the acquisition signal.

(M100) Image acquisition not executed

An alarm message which appears when the TV acquisition is not performed.

(M101) Image acquisition not completed

An alarm message which appears when the TV acquisition is not completed.

(M102) Blister output direction not correct

An alarm message activated by the Internal PLC 2. It appears upon enabling the programming
check on the blisters output direction.

(M103) Wrong length of the shift register

Message generated by the shift length check when the machine is not running.

(M104) Insertion failed on shift register

Shift register full: the shift extraction number is not sufficient and the insertion number is
excessive.

(M105) Extraction failed on shift register

Shift register empty: the extraction number is excessive or the insertion number is not sufficient.

(M106) The shift register %d (%s) is still open for insertion

Message generated by the shift register check.

(M501) Jammed cutter: release the output conveyor

An alarm message generated by the Internal PLC 1. It appears when the output conveyor belt
photocell is engaged for more than 0.7 seconds.

(M502) One or more blisters were not rejected: check blisters loaded on the cartonner or fallen in the
container under the output conveyor

(M503) Failed rejection of one or more blisters: check blisters loaded on the cartonner
Alarm messages generated by the Internal PLC 1 and 2. They appear when the counter-check of
the internal PLC detects a failed rejection: some rejected blisters were transported on the output
conveyor belt.

(M504) Partial jamming of cutter: some blisters were not loaded on the conveyor belt
Alarm message generated by the Internal PLC 1 and 2. It appears when the counter-check of the
internal PLC detects partial jamming: some cut blisters were not transported on the output
conveyor belt.

SEA Vision s.r.l.

Page 98

(M505) Some blisters have reached the output conveyor photocell in advance: clean the conveyor and
check the photocell setting

(M506) Some blisters have reached the output conveyor photocell too late: clean the conveyor and
check the photocell setting
Alarm messages generated by the Internal PLC 1. They appear when the counter-check (based
on transit time) of the internal PLC measures off-range transit times without detecting failed
rejection or partial jamming states.

(M507) Sensor 2: either the distance between blisters is too short or the blisters are overlapped

(M508) Sensor 2: blister too short

Alarm messages generated by the Internal PLC 2. They appear when the counter-check of the
internal PLC measures blisters whose length is different from the value set in the internal PLC
dialogue page. In the first case it is possible that two blisters left overlapped the cutter area.

(M509) Sensor 3: blister too fast

(M510) Sensor 3: blister too late

Alarm messages generated by the Internal PLC 2. They appear when the counter-check of the
internal PLC measures wrong transit times at the sensor 3.

(M511) #Cut timing signal > #Acquisition timing signal

An alarm message generated by the Internal PLC 2. It appears when the number of cut triggers
received is greater than the number of acquisition triggers multiplied by the number of rows in the
stroke.

(M512) #Cut timing signal > #Sensor 1

An alarm message generated by the Internal PLC 2. It appears when the number of blisters seen
by the sensor 1 is less than the expected value.

(M513) #Sensor 1 > #Cut timing signal

An alarm message generated by the Internal PLC 2. It appears when the number of blisters seen
by the sensor 1 is greater than the expected value.

(M514 – M521) #Sensor X > #Sensor Y

Alarm messages generated by the Internal PLC 2. They appear when the number of blisters seen
by a sensor does not match the number of blisters seen by the next sensor (apart from the rejected
blisters).

(M522) The article is not correctly programmed: few channels defined

An alarm message generated by the Internal PLC 2. It appears when the number of cut blisters is
greater than the number channels of the work article.
Harlequin – Reference Manual Page 99

(M523 – M527) Sensor X does not read

(M528 – M532) Sensor X reads less than normal

(M533 – M537) Sensor X reads more than normal

Alarm messages generated by the Internal PLC 2. They appear when the number of blisters seen
by a sensor does not match the number of blisters seen by all other sensors (apart from the rejected
blisters).

(M538) Some blisters did not transit on the outfeed conveyor

An alarm message generated by the Internal PLC 2. It appears when the counter-check sensor
sees a blister too late on the expected time.

(M539) A blister was not rejected from X channel: check blisters loaded on the cartonner or fallen in
the container under the output conveyor

(M540) A blister was not rejected from X channel: check blisters loaded on the cartonner
Alarm messages generated by the Internal PLC 1. They appear when the counter-check (based
on optical fibre) of the internal PLC detects failed rejection of a blister.

(M541) The fibre of the counter-check of X channel is incorrectly set: it reads transit of non existent
blisters
An alarm message generated by the Internal PLC 1. It appears when counter-check (based on
optical fibre) of the internal PLC detects rejection of a blister that was not in fact rejected.

(M542) PLC call too late: X ms; caller's id: Y (Z)

An alarm message generated by the Internal PLC (any type). It appears when the time between
two successive calls of the routine implementing the internal PLC is longer than the time set on
the dialogue page of the internal PLC.

(M543) The rejection phase of channel X was read an insufficient number of times (Y less)

(M544) The rejection phase of channel X was read too many times (Y more)
Alarm messages generated by the Internal PLC 1. They appear when there are malfunctions on
the rejection phase signal of channel X.

(M545) Phase error channel X

An alarm message generated by the Internal PLC (any type). It appears when, during the
machine run, the difference between the number of extractions and the number of insertions in the
rejection queues exceeds the number of rows of the machine stroke.

(M550) The signal coming from the light curtain is always high
An alarm message generated by the Internal PLC 2. It appears when there are malfunctions on
the signal coming from the countercheck light curtain placed at the entrance of the rejection
tunnel.

(M551) The signal coming from the light curtain (empty blisters) is always high
An alarm message generated by the Internal PLC 2. It appears in case of malfunction in the
signal coming from the empty blisters countercheck barrier on the empty blisters tunnel.

SEA Vision s.r.l.

Page 100

(M552) Conveyor Belt Clock signal not received

An alarm message generated by the Internal PLC 2. It appears in case of malfunction in the strip
feed clock signal.

(M553) The number of acquisition triggers is not compatible with the number of cutter triggers (the
article may not be correctly programmed)
An alarm message generated by the Internal PLC 2. It appears in case of displacement between
the rejection phases and acquisition phases.

(M554) Machine phase check

An alarm message generated by the Internal PLC 1 and 2. It appears when Harlequin activates
an alarm which resets the rejection queue. The machine is forced to stop to rephrase the queues.

(M555) Error on rejection phase channel %ld

An alarm message generated by the Internal PLC 1. It appears upon enabling the time period
check which passes between the two rejection phase signal fronts.

(M556) Error on cutter trigger

An alarm message generated by the Internal PLC 2.. It appears upon enabling the time period
check which passes between the two cutting phase signal fronts.
Harlequin – Reference Manual Page 101

5. Back-up and restore procedures

The Saving, Archive, System Saving, and Archive recovery functions perform the system back-up and
the recovery of system files in case of data loss.

5.1. Back-up procedure

The back-up procedure consists in the following steps:

1. insert a USB pen-drive and wait for the operating system to recognize the device;

2. press the Auto Mode Exit button at the right bottom of the display, if available;

3. execute the Log-On function (Configuration menu);

if the program asks for confirmation, press the YES button and execute the function again;
check that the username is Expert, insert no password and press the OK button;

4. execute the Save System Files function (Configuration menu);

5. when the program asks “Do you want to remove memory device d:?” press the NO button;

6. execute the Save Archive function (Configuration menu);

7. when the program asks “Do you want to remove memory device d:?” press the YES button;

8. confirm the warning message "The memory device d: has been removed" with the OK button;

9. remove the USB pen-drive.

5.2. Restore procedure with hard-disk replacement

The restore procedure with hard disk replacement consists in the following steps:

1. execute the shut down of the operating system (Work menu);

2. power down the system (press the auxiliary power-on button at the back of the PC);

3. remove the rear bottom panel, if present, to access the hard drive;

4. remove the hard disk;

5. insert the spare hard disk supplied by SEA Vision srl;

6. power up the system (press the auxiliary power-on button at the back of the PC);
wait the end of the start operations of the operating system and the application;

7. press the Auto Mode Exit button at the right bottom of the display, if available;

8. execute the Log-On function (Configuration menu) with an Expert user;

9. remove the System Protection option using System Management function (Configuration menu)
and press the OK button;
execute the Exit Program function (Work menu);
if the system was protected, the first Exit Program causes a reboot of the system;
wait for the system to restart;

SEA Vision s.r.l.

Page 102

now log-on as Expert user and exit from the program again;

10. insert the USB pen-drive which contains the system and wait for the operating system to recognize
the device;

11. double click on My Computer icon on desktop;

12. double-click the Removable Disk (D:) device;

open the directory with the system name;
open the SYSTEM directory;

13. double click the copyharle.bat file, wait the end of operations and close the window;

14. double-click the HARLE.EXE icon on desktop to enter the Harlequin program again;

15. confirm the warning message "No Article selected, select one and try again" with the OK button;

16. execute the Log-On function (Configuration menu) with an Expert user;

17. execute the Restore Archive function (Configuration menu);

confirm the warning message "Warning! Archive on disk will be overwritten with this operation, are
you sure you want to go on?" with the YES button;

18. when the program asks “Do you want to remove memory device d:?” press the YES button;

19. execute the List of Articles function (Archive menu);

verify that the article list contains all the articles of the primary hard disk;
select the article you want to use and press OK;
20. verify that the software version (at the top of the display) is updated;

21. restore the System Protection option using the System Management function (Configuration
menu).
Harlequin – Reference Manual Page 103

6. Service
The remote Assistance service supplied by SEA Vision facilitates the diagnosis of hardware and software
malfunctioning, as well as the programming of the work articles.
When the support via Internet or modem is not available, images and the system’s archive can be
manually saved, then call SEA Vision after-sale department.

6.1. Assistance through modem or Internet

Two options are available to connect to the Assistance: by a direct call or via the Internet.
In the first case use the telephone number of Sea Vision modem (and IP-address 192.168.1.1). In the
second case, use the local provider’s telephone number (and IP-address 82.90.12.33). Specify also
the ID and the password to connect to the provider.
The procedure for activating the connection to the Assistance is the following:
• connect the telephone line’s cable to the modem slot;
• select an article which allows the Automatic work execution, but do NOT enter the Automatic work
mode; if you are in the Automatic work mode, press the button with the Auto Mode Exit wording to
exit the Work mode; in this case, the selected font enables the Automatic work execution;
• select the Call Service option from the Help menu: the dialog box allows the selection of some
parameters relating to the phone call;
1. INTERNET: enables the connection via the Internet;
2. telephone number: a pause can be introduced while a phone number is being dialled, inserting one
or more dots (.) into the number to be dialled;
3. server address: 192.168.1.1 for direct connection or 82.90.12.33 for Internet connection (please
ask Sea Vision for any change of the Internet address);
4. connection speed: depends on the telephone line’s quality and cannot be set on all modems;
5. tones or pulses: this choice depends on the exchange or the local switching centre;
• press the OK button: Harlequin will dial the telephone number;
• wait until the connection is established: during the connection phase, a window appears on the screen
showing the operation progress and any anomaly; the window disappears after the connection has
been established;
• after this step, Sea Vision’s Assistance operator can work on the Harlequin system as if he were in
that place, because he can use, on the other end of the line, the same Harlequin program to conduct
the tests and to program the work article;
• during connection, some messages can be received from the Assistance: they appear in a window on
the right of the screen; three answers to these messages are available: YES, NO, DON’T KNOW;
• at the end of the work, Sea Vision operator closes the connection, by terminating the phone call; the
connection can be terminated also at local level, using the Terminate Service option in the Help
menu.

6.2. Telephone assistance

When the assistance service via modem or Internet is not available, it is necessary to contact SEA Vision
Assistance department and manually send the required information.
The required information is:
• work images of good objects and rejects
• the work article
• the oscilloscope file
• the Log file
These files can be easily saved on a USB pen-drive.

SEA Vision s.r.l.

Page 104

6.2.1. Saving Work Images

1. Under ConfigurationWork Check Images, select the type of image to be displayed during
Automatic Work. The display of the latest good or defective piece or the latest unit can be
selected for each TV.
2. Insert a USB pen-drive and wait for the operating system to recognize the device.
3. access the Automatic Work mode, start the line and the product transit;
4. when the image of the good object or the reject is displayed o the screen, stop the line and exit the
Automatic Work (Auto Mode Exit button at the bottom right of the screen);
5. execute the Save Images on External Device function (Images menu);
6. repeat steps 3 through 5 in order to save more images;
7. when the program asks “Do you want to remove memory device d:?” press Yes to safely
disconnect the USB pen-drive.

6.2.2. Saving the work archive

1. Insert a USB pen-drive and wait for the operating system to recognize the device;
2. execute the Save Archive function (Configuration menu); Log files are also saved together with
format files;
3. when the program asks “Do you want to remove memory device d:?” press Yes to safely
disconnect the USB pen-drive.

6.2.3. Saving the oscilloscope file

1. Insert a USB pen-drive and wait for the operating system to recognize the device;
2. access the Automatic Work mode, start the line and the product transit;
3. stop the line and exit the Automatic Work (Auto Mode Exit button at the bottom right of the
screen);
4. open the ConfigurationInput and Output Check, select File List, select the la test file
by date and press the Export button;
5. when the program asks “Do you want to remove memory device d:?” press Yes to safely
disconnect the USB pen-drive.

6.2.4. Exporting a specific audit trail

1. Insert a USB pen-drive and wait for the operating system to recognize the device;
2. execute the View Log-File function (Work menu);
3. select a time interval and also a user, if necessary;
4. press View Messages;
5. press the Export button;
6. when the program asks “Do you want to remove memory device d:?” press Yes to safely
disconnect the USB pen-drive.