
Commodio software
constantly analyzes the content displayed on a screen of a
device and extracts from it all visible objects that appear,
such as text, graphics, images and GUI controls.
The extraction of
objects is accomplished by combining image-processing
techniques with knowledge of operating system internals. The
information about objects, which includes their properties and location
on the screen, is kept in a database of screen objects. The database is
maintained and updated in real time, and mirrors at any given moment the
current content of the screen.
This database may be
thought of as a new medium - a "Content Layer" built on top of
the existing pixel layer of the screen. Screen content layer
is the collection of all meaningful objects, such as words,
graphics and images that are currently visible on a screen.
Technology Edge
|