Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
CONFIGURABLE DISPLAY ARRAY
Document Type and Number:
WIPO Patent Application WO/2024/100655
Kind Code:
A1
Abstract:
A system is presented comprising a desktop formed with a receiving space formed in a portion thereof; an array of displays being accommodated within the receiving space and being configured to display media from multiple sources, wherein: at least one of the displays have position mechanisms and are controllably shiftable by said position mechanisms between position states comprising (1) a flush state, in which the display is flush with a desktop surface, such that each two neighboring displays, when are in the flush state, form a continuous surface, and (2) a range of angled states, in which the display is tilted with respect to the desktop surface; and each display is controllably operable to provide a layout of the media being displayed, such that a combination of the position states and the layouts characterizing each display in the array of displays defines an operational mode of the system.

Inventors:
HAREL SHAI (IL)
GELERENTER GABRIEL (IL)
Application Number:
PCT/IL2023/051144
Publication Date:
May 16, 2024
Filing Date:
November 07, 2023
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
MEDDESK ADVANCED TECH SYSTEMS LTD (IL)
International Classes:
A47B13/10; A47B21/007; F16M11/04; F16M11/06; G06F3/04842; G06F3/0488; H04N13/388; A47B37/02; A63F13/98; F16M13/02; G06F1/16; G06F9/451; H04N5/64
Foreign References:
US20200096802A12020-03-26
US20200312279A12020-10-01
US20090102335A12009-04-23
Attorney, Agent or Firm:
COHN, Lior (IL)
Download PDF:
Claims:
CLAIMS:

1. A system, comprising: a desktop formed with a receiving space formed in a portion thereof; an array of displays accommodated within the receiving space configured to display media from multiple sources, wherein: at least some of the displays have position mechanisms and are controllably shiftable by said position mechanisms between position states comprising (1) a flush state, in which the display is flush with a desktop surface, such that each two neighboring displays, when are in the flush state, form a continuous surface, and (2) a range of angled states, in which the display is tilted with respect to the desktop surface; each display is controllably operable to provide a layout of the media being displayed, such that a combination of the position states and the layouts characterizing each display in the array of displays defines an operational mode of the system.

2. The system of claim 1, wherein the receiving space is a depression formed in the desktop.

3. The system of claim 1, wherein the operational mode of the system defines functional groups of displays, wherein each group is formed by one or more displays controllably operable to display media in the layout different from that of the other groups to be viewed by one or more viewers with a viewing angle or direction different from the other groups.

4. The system of claim 1, wherein the array of displays is operable by a controller providing position state data and layout data for each of the displays in the array of displays.

5. The system of claim 1, wherein said controller is an integral controller.

6. The system of claim 1, configured for communication with the controller, being an external controller, providing the position state data and the layout data for each of the displays in the array of displays.

7. The system of claim 5, wherein said integral controller is configured for communication and operation with an external controller to provide the position state data and the layout data for each of the displays in the array of displays. 8. The system of claim 4, wherein the controller is further configured to control the media to be displayed on each of the displays.

9. The system of claim 3, wherein the controller is configured and operable to define the operational mode of the array of displays in accordance with one or more predetermined workflows for one or more of the displays.

10. The system of claim 3, wherein the controller is configured and operable to define the operational mode of the array of displays in accordance with predicted workflow for each display.

11. The system of claim 10, wherein the controller comprises an Al-based utility configured and operable to generate data indicative of the predicted workflow for each display.

12. The system of claim 11, wherein the Al-based utility is configured and operable to generate the data indicative of the predicted workflow according to predetermined user- related data, said user-related data being indicative of user preferences or group of users' preferences.

13. The system of claim 10, wherein the Al-based utility is configured and operable to run a Graph Neural Network (GNN).

14. The system of claim 10, wherein said Al-based utility is configured and operable to analyze input data comprising physical properties data, virtual properties data, and user data, to generate said data indicative of the predicted workflow comprising one or more of the following: media content movement, a change of the position state data per display; new user log in data to the display; media content presentation in response to log in of a specific user.

15. The system of claim 14, wherein the physical properties data comprises one or more of the following: tilted angle of the display, axis angular speed of a change of the position state of the display, display properties, active area of media presentation on the display, resolution, touch panel type of the display, screen and touch response rate of the display.

16. The system of claim 14, wherein the virtual properties data comprises one or more of the following: media content to be displayed, media content type, partial object, file volume, display virtual position, orientation, media content speed movement. 17. The system of claim 14, where the user data comprises one or more of the following: user ID, type of user, age, work professional, scientific degree, computer software skills, company position, favorites and preferences, field of view, social network markup, languages.

18. The system of claim 3, wherein the displays of the same group are in the same position state.

19. The system of claim 3, wherein the displays of the same group display media from the same source.

20. The system of claim 18, wherein the displays of the same group form a consecutive display of the media.

21. The system of claim 3, wherein the displays of different groups display media from different sources.

22. The system of claim 4, wherein the controller is configured to control the position state of each display and the layout of the media being displayed by each display to set the array in a selected operational mode out of a plurality of predefined operation modes.

23. The system of claim 22, wherein the controller is configured to receive selected operational mode input defining the selected operation mode.

24. The system of claim 4, wherein the controller is configured to carry out the following: (i) receive a specific display request indicative of one or more of: a desired position state of a specific display, a layout of the displayed media of said specific display, and a selected source of media to be displayed on said specific display, and (ii) control one or more of the position state of the specific display, the layout of the displayed media of the specific display, and the source of media to be displayed on said specific display to satisfy the specific display request.

25. The system of claim 1, wherein at least part of the position mechanism is accommodated within the receiving space.

26. The system of claim 1, wherein when the display is in the flush state, the position mechanism is accommodated entirely within the receiving space.

27. The system of claim 1, wherein the position mechanism comprises one or more joints. 28. The system of claim 1, wherein at least some of the displays in the array are touch screens.

29. The system of claim 1, wherein at least some of the displays of the array are removable.

30. The system of claim 1, wherein at least one display of the display array comprises a CPU.

31. The system of claim 1, wherein at least some of the displays are configured to be rotated about an axis parallel to one boundary of the receiving space to result in said transition between the position states.

32. The system of claim 31, wherein at least two displays of the array are configured to be rotated about two different axes parallel to different boundaries of the receiving space to result in said transition between the position states.

33. The system of claim 4, wherein the controller is further configured to set one or more of the displays with a default setting of one or more media file and/or application associated with the selected operational mode of the system.

34. The system of claim 33, wherein said default setting comprises positioning most frequent used media file and/or application in a central position of the display.

35. The system of claim 33, wherein the controller is configured to update said default setting in response to the user behavior following an initial setting of the array.

36. The system of claim 1, wherein at least one of displays is configured to receive two or more media sources and to allocate in the display respective two or more areas, each area displaying a respective media source, and wherein the display is configured to display said two or more media sources simultaneously.

37. The system of claim 36, wherein each area on the display responds only to gestures or actions applied within its boundaries.

38. A controller for controlling the array of displays in the system of claim 1, the controller being configured and operable to provide position state data and layout data for each of the displays in the array of displays.

39. The controller of claim 38, further configured to control the media to be displayed on each of the displays. 40. The controller of claim 38, configured and operable to define the operational mode of the array of displays in accordance with one or more predetermined workflows for one or more of the displays.

41. The controller of claim 38, configured and operable to define the operational mode of the array of displays in accordance with predicted workflow for each display.

42. The controller of claim 41, comprising an Al-based utility configured and operable to generate data indicative of the predicted workflow for each display.

43. The controller of claim 42, wherein the Al-based utility is configured and operable to generate the data indicative of the predicted workflow according to predetermined user- related data, said user-related data being indicative of user preferences or group of users' preferences.

44. The controller of claim 42, wherein the Al-based utility is configured and operable to run a Graph Neural Network (GNN).

45. The controller of claim 42, wherein said Al-based utility is configured and operable to analyze input data comprising physical properties data, virtual properties data, and user data, to generate said data indicative of the predicted workflow comprising one or more of the following: media content movement, a change of the position state data per display; new user log in data to the display; media content presentation in response to log in of a specific user.

46. The controller of claim 45, wherein the physical properties data comprises one or more of the following: tilted angle of the display, axis angular speed of a change of the position state of the display, display properties, active area of media presentation on the display, resolution, touch panel type of the display, screen and touch response rate of the display.

47. The controller of claim 45, wherein the virtual properties data comprises one or more of the following: media content to be displayed, media content type, partial object, file volume, display virtual position, orientation, media content speed movement.

48. The controller of claim 45, wherein the user data comprises one or more of the following: user ID, type of user, age, work professional, scientific degree, computer software skills, company position, favorites and preferences, field of view, social network markup, languages. 49. A display array for use in the system of claim 1, said display array comprising said displays and being configured for accommodating the displays within said receiving space formed by the desktop.

50. A display array configured for accommodating within a receiving space of a desktop, and configured to display media from multiple sources, wherein: at least some of displays of the display array have position mechanisms and are controllably shiftable by said position mechanisms between position states comprising (1) a flush state, in which the display is flush with a desktop surface, such that each two neighboring displays of said at least some of the displays, when are in the flush state, form a continuous surface, and (2) a range of angled states, in which the display is tilted with respect to the desktop surface; and each display is controllably operable to provide a layout of the media being displayed, such that a combination of the position states and the layouts characterizing each display in the array of displays defines an operational mode of the system.

51. The display array of claim 50, further comprising a controller configured and operable to provide position state data and layout data for each of the displays in the display array.

52. The controller of claim 51, characterized by at least one of the following: further configured to control the media to be displayed on each of the displays; configured and operable to define the operational mode of the array of displays in accordance with one or more predetermined workflows for one or more of the displays. configured and operable to define the operational mode of the array of displays in accordance with predicted workflow for each display.

53. The controller of claim 51, configured and operable to define the operational mode of the array of displays in accordance with predicted workflow for each display, the controller comprising an Al-based utility configured and operable to generate data indicative of the predicted workflow for each display.

54. The controller of claim 53, wherein the Al-based utility is configured and operable to carry out at least one of the following: generate the data indicative of the predicted workflow according to predetermined user-related data, said user-related data being indicative of user preferences or group of users' preferences; run a Graph Neural Network (GNN); analyze input data comprising physical properties data, virtual properties data, and user data, to generate said data indicative of the predicted workflow comprising one or more of the following: media content movement, a change of the position state data per display; new user log in data to the display; media content presentation in response to log in of a specific user.

55. The controller of claim 53, wherein said Al-based utility is configured and operable to analyze input data comprising physical properties data, virtual properties data, and user data, to generate said data indicative of the predicted workflow comprising one or more of the following: media content movement, a change of the position state data per display; new user log in data to the display; media content presentation in response to log in of a specific user.

56. The controller of claim 55, wherein the physical properties data comprises one or more of the following: tilted angle of the display, axis angular speed of a change of the position state of the display, display properties, active area of media presentation on the display, resolution, touch panel type of the display, screen and touch response rate of the display.

57. The controller of claim 55, wherein the virtual properties data comprises one or more of the following: media content to be displayed, media content type, partial object, file volume, display virtual position, orientation, media content speed movement.

58. The controller of claim 55, wherein the user data comprises one or more of the following: user ID, type of user, age, work professional, scientific degree, computer software skills, company position, favorites and preferences, field of view, social network markup, languages.

Description:
CONFIGURABLE DISPLAY ARRAY

TECHNOLOGICAL FIELD

The present disclosure is in the field of a working station, in particular the working station that includes multiple displays.

BACKGROUND ART

References considered to be relevant as background to the presently disclosed subject matter are listed below:

- WO 2019/198082

Acknowledgement of the above references herein is not to be inferred as meaning that these are in any way relevant to the patentability of the presently disclosed subject matter.

GENERAL DESCRIPTION

The present disclosure provides a technique for controlling operation of a desktop station that includes multiple displays (an array of displays) capable of displaying media from one or more media sources and capable of being used by a single user or concurrently used by multiple users.

The desktop, or a working surface, e.g., a surface of a desk or a table, defines a receiving space formed in a portion thereof. The default state of the display array is to be flush with the desktop such that the desktop and the display array form together a flat surface. Each of the displays can be individually controlled, by a controller (processing circuitry) to (i) be positioned at a desired state, i.e. a state in which the plane defined by the display is angled / tilted with respect to the desktop surface and (ii) display a media in a desired orientation, i.e. an orientation that allows a viewer in a desired location around the desktop to view in a standard manner the media being displayed in the display.

By controlling the state of the display position and the orientation of media being displayed, many operational modes of the display array can be set to suit many scenarios of usages of the desktop and the array of displays. The controller can be pre-set with a plurality of operational modes and by a selection, by a user, of one of this modes via the controller, the later executes the setting of the display array to achieve the desired operational mode. The user also may control each of the displays independently and make fine adjustments to obtain the most fitted operational mode for its specific personal uses. Alternatively or additionally, the controller can be configured for automatic or semiautomatic execution of user-specific various operational modes, e.g., may be employed with a machine learning algorithm that constantly learns the behavior of the user(s) and update the pre-set operational modes, to personalize the utility of the user. For example, the controller can utilize an Al-based utility configured and operable to generate predicted workflow(s) for the display array operation.

Each operational mode can include grouping or clustering of several displays to function together as a functional group that can emulate one big screen that displays a media from a single source or different sources. It is to be noted that in each operation mode, there can be several functional groups. The displays of the same group are in a similar position state and display media in a similar orientation. The displays of different groups may be oriented orthogonally to each other. The data contents / media items displayed on the displays of the different groups may be displayed with different properties (shapes, sizes, resolution, etc.). Media items, such as figures, images, documents, can be transferred between groups (through a designated application for example). This can be performed by a simple user action, such as a drag and drop gesture or any other predetermined user action. A group member also can be assigned as a remote display.

Therefore, an aspect of the present invention provides a system for controlling a desktop working station. The system comprises a desktop (or a working surface, e.g. a surface of a desk or a table), formed with a receiving space formed in a portion thereof; and an array of displays (flat displays) accommodated within the receiving space and configured to display media from multiple sources. At least some of the displays have position mechanisms and are controllably shiftable by said position mechanisms between position states comprising (1) a flush state, in which the display is flush with the desktop surface, such that each two neighboring displays, when are in the flush state, form a continuous surface, and (2) an angle state, from a range of angled states, in which the display is tilted with respect to the desktop. The angle between the plane defined by the surface of the display and the plane defined by the desktop surface or the receiving space surface defines the angled/tilted state. Each display is controllably operable to provide a layout of the media being displayed, such that a combination of the specific states and the layouts characterizing each display defines an operational mode of the system. A combination of the specific state and the layout characterizing each display in the array of displays defines an operational mode of the system.

The operation mode defines groups of displays, where the group may include one or more displays. Considering that the group includes two or more displays, they all display media in the same layout. Each group is intended to be viewed by respective one or more viewers viewing the display(s) of the same group from the same viewing angle or direction. Some data (e.g., data content intended for one group) can be presented/displayed as a preview to several groups to complete the shared surface visual data. In other words, each group of displays display media in a different layout orientation. For example, a first group can display media in a layout orientation towards a first edge of the desktop, a second group can display media in a layout orientation towards a second edge of the desktop and so on.

It should be understood that when referring to the display as being accommodated within the receiving space it means that at least portion of each display or an extension thereof is found in the receiving space. Each display of the array may be configured to display digital media from a predefined source. The term "predefined source" should be understood as any source that was selected to be coupled to the display by the user or by the manufacturer, including a CPU embedded within the display itself and/or HOSTCLIENT CPU configuration.

The invention of the present invention provides a solution for many working stations, for example, for a medical working station. The medical working station can be used by a single user, such as a doctor, in which a first operation mode is relevant, and when the doctor sees patients, a second operational mode can be selected to allow the doctor to share some information/medical data to the patient and/or get his/her signature on some documents through a different display than his/her own. For example, the technique of the present disclosure can advantageously be used in a Medical Team meeting where two or more groups use the displays of the same desktop with orthogonally positioned screens to each other, and a remote group uses a screen which can be joined to one of the groups of said desktop.

The operation of the array of displays is managed by a controller. To this end, the display array may be configured for communication with an external controller (using any known suitable communication technique and communication protocols), or may be connected to or include an integral controller, or the functions of the controller may be distributed between the external controller and the integral controller.

The controller is configured to control: (i) the position state of each display; and (ii) the layout/orientation of the displayed media of each display, namely the direction of presentation of the media with respect to the boundaries of the display, the size of the presentation media on the display, etc. The controller may also be configured to carry out the following: control displays' grouping settings for the display array of the desktop; control displays' grouping settings for the at least some displays of the display array of the desktop and one or more external displays, as the case may be; control data contents presentation on the displays of the groups; control data contents transfer from the display(s) of one group to display(s) of a different group.

In some embodiments, the controller is configured and operable to define the operational mode of the array of displays in accordance with predicted workflow for each display. The controller may comprise an Al-based utility configured and operable to generate data indicative of the predicted workflow for each display. The data indicative of the predicted workflow may comprise one or more of the following: movement of data content of the media to be displayed; position state change data; user log in data (to take into account the specific user's operational preferences, workflow, behavior, etc.); data content of the media to be displayed in response to user log in.

Although, the controller, being a computerized system including inter alia input / output utilities, memory and data processor and analyzer (processing circuitry), the controller is at times referred to herein below as “processing circuitry”.

It is to be noted that any combination of the described embodiments with respect to any aspect of this present disclosure is applicable. In other words, any aspect of the present disclosure can be defined by any combination of the described embodiments. In some embodiments of the system, the receiving space is a depression formed in the desktop. The dimension of the receiving space is adapted to accommodate the display array such that in the flush state of all the displays, the desktop and the displays form a continuous flat surface, namely all the array is flush with the desktop surface.

In some embodiments of the system, each two neighboring displays, when are in the flush state, forming a continuous surface. It is to be noted that in the default state of the system, typically all displays are flat and flush with one another to form a continuous working surface of a desktop.

In some embodiments of the system, the processing circuitry is further configured to control (iii) the media to be displayed on each of the displays. Namely, in each operation mode, the processing circuitry is configured to select the media source to be displayed in each display or group of displays according to the requirements of the operational mode.

In some embodiments of the system, the operation mode defines groups of one or more displays. All the grouped displays, namely all the displays in a single group, display media in the same display layout, wherein each group has a different layout orientation than the other groups. Namely, each group is intended to be viewed by a respective viewer viewing the array from a different viewing angle or direction / point of view (POV).

In some embodiments of the system, all grouped displays are in the same position state.

In some embodiments of the system, all grouped displays are controlled to display media from the same source.

In some embodiments of the system, all grouped displays form a consecutive display of the media, namely all grouped displays effectively form together one big display.

In some embodiments of the system, different displays of grouped displays are controlled to display media from a different source. By a unique configuration of the system, also displays that display media from different sources can be operated together, namely with a single mouse controller or by touch of the user in case the displays are touchscreens. For example, media files can be transferred from one display to another, therefore, one viewer can transfer a media file to another viewer, viewing a different functional group.

In some embodiments of the system, the processing circuitry is configured to control the position state of each display and the layout of the displayed media of each display to set the array in a selected operational mode out of a plurality of predefined operation modes.

In some embodiments of the system, the processing circuitry is configured to receive selected operational mode input from a user defining the selected operation mode.

In some embodiments of the system, the processing circuitry is configured to (i) receive a specific display request indicative of one or more of: a desired position state of a specific display, a layout of the displayed media of said specific display, and/or a selected source of media to be displayed on said specific display, and (ii) control the position state of the specific display, the layout of the displayed media of the specific display and/or the source of media to be displayed on said specific display to satisfy the specific display request. In other words, each display can be also controlled independently through the controller to be positioned in a desired angle position and display a desired media source in a desired layout of the user.

In some embodiments of the system, the processing circuitry is configured to update the predefined operational modes in response to user behavior, namely in response to adjustments the user is doing after the initial set of the operational mode. This process of machine learning making the system to adapt itself to the personalize requirements of a specific user.

As described above, each display of the display array, or at times only part of the displays of the array, is supported by position mechanism configured to allow positioning of the display in the flush state and in any of the angled states.

In some embodiments of the system, at least part of the position mechanism is accommodated within the receiving space.

In some embodiments of the system, when the display is in the flush state, the position mechanism is accommodated entirely within the receiving space.

In some embodiments of the system, the position mechanism comprises one or more joints. In some embodiments of the system, at least some of the displays in the array are touchscreens.

In some embodiments of the system, all the displays are touch screens.

In some embodiments of the system, at least one of the displays of the array are removable. This can be important for maintenance reasons for example. After removal of the display, it can be place back in the array or can be replaced with a different display.

In some embodiments of the system, at least one display of the display array comprises a CPU.

In some embodiments of the system, at least some of the displays are configured to be rotated about an axis parallel to one boundary of the receiving space to result in said transition between position states.

In some embodiments of the system, at least two displays of the array are configured to be rotated about two different axes parallel to different boundaries of the receiving space to result in said transition between position states, the two axes can be normal or parallel to one another.

It is to be noted that in some embodiments of the system, the position mechanism can be in various shapes and integration arrangements, such electro-mechanic mechanisms capable of providing a movement in six degrees of freedom movement. For example, the position mechanism can be a robotic arm that moves the screens or any other placements or enclosure that holds the screen and is driven by mechanism using motors, gears, drive chains/belts, actuators, sliders track of any kind, pneumatic mechanisms, magnetic drive mechanisms, together with all types of sensor means.

In some embodiments of the system, the processing circuitry is further configured to set one or more of the displays with a default setting of one or more media file and/or application associated with the selected operational mode of the system.

The terms "media file" and "application" should be interpreted as any computerized program or file enabled to be displayed by a computer, such as a hospital program, a medical program displaying medical files and data of patients, images, documents, etc. In some embodiments of the system, the default setting comprises positioning most frequent used media file and/or application in a central position of the display. In other words, the functions in the media source that are the most common are selected to be opened and presented to the user in the initial setting of the display array. Therefore, when the user sets the display array, in addition to the position and the layout orientation of the displays, the processing circuitry sets a default state of the displayed media source that is intended to reduce actions from the user.

In some embodiments of the system, the processing circuitry is configured to update said default setting in response to the user behavior following an initial setting of the array. In other words, the system has a default setting for each operational mode, in which a media file or application is opened as part of the whole setting of the display array. This can be updated over time in case the processing circuitry identifies that the specific user frequently uses a different application or a different media file as he/she approaches the system after the initial setting. When the processing circuitry identifies that the initial requirement of the user is different than the default setting, the processing circuitry changes the default setting to be suited to the personal needs of the user in an Al process of machine learning.

In some embodiments of the system, at least one of the displays is configured to receive two or more media sources and to allocate in the display respective two or more areas, each area displays a respective media source, and wherein the display is configured to display said two or more media sources simultaneously. This is typically enabled due to two or more graphics cards in the display that allow it to split the display to several areas, each area displays a different media source and also responds only to gestures, either through touch screen interface or through a mouse and keyboard interface, that are applied in its boundaries.

In some embodiments of the system, each area on the display responds only to gestures or actions applied within its boundaries.

The solutions provided by the present invention improves the ergonomic settings of the working environment and facilitate to relieve the ergonomic stress on users or viewers of the system. According to another broad aspect of the present disclosure, it provides a controller for operating the array of displays in the above-described system, by providing position states data and layout data to each of the displays.

According to yet another broad aspect of the present disclosure, it provides a display array configured for accommodating within a receiving space of a desktop, and configured to display media from multiple sources, wherein: at least some of displays of the display array have position mechanisms and are controllably shiftable by said position mechanism between position states comprising (1) a flush state, in which the display is flush with a desktop surface, such that each two neighboring displays of said at least some of the displays, when are in the flush state, form a continuous surface, and (2) a range of angled states, in which the display is tilted with respect to the desktop surface; and each display is controllably operable to provide a layout of the media being displayed, such that a combination of the position states and the layouts characterizing each display in the array of displays defines an operational mode of the system.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to better understand the subject matter that is disclosed herein and to exemplify how it may be carried out in practice, embodiments will now be described, by way of non-limiting examples only, with reference to the accompanying drawings, in which:

Figs. 1A-1B are schematic illustrations of an embodiment of a non-limiting example of different states of the array of displays positioned in the receiving space of a desktop;

Figs. 2A-2B are schematic illustrations of an embodiment of a non-limiting example of different states of the array of displays positioned in the receiving space of a desktop according to an aspect of the present disclosure;

Fig. 3 is a schematic illustration of an embodiment of a non-limiting example showing a state of the display array positioned in the receiving space of a desktop after setting by the controller (from the default flat state) according to an aspect of the present disclosure; Fig. 4 is a schematic illustration of an example of transferring a media item from one display to another or from one functional group to another;

Fig. 5 is a schematic illustration of a non-limiting example of the display array of the present invention in which one or more displays are removed from the array;

Fig. 6 is a schematic illustration exemplifying a default setting of a display of the array with media contents to be displayed by it;

Fig. 7 is a schematic illustration of a specific display configuration in a display of the array;

Fig. 8 is a schematic illustration of an exemplary flow operation of Al-based utility of the controller and prediction workflow;

Fig. 9 exemplifies the Graph Neural Network (GNN) based multi-display workflow;

Figs. 10A-10B illustrate, by way of block diagrams an exemplary configuration (Fig. 10A) and operation (Fig. 10B) of the controller associated with and controlling operation of a display array; and

Fig. 10C illustrates a specific not-limiting example of a state machine lookup table suitable for being implemented by the controller to operate the display array.

DETAILED DESCRIPTION

The following figures are provided to exemplify embodiments and realization of the technique of the present disclosure for configuring operation of a desktop station that includes an array of displays capable of displaying media from one or more media sources.

Reference is first being made to Figs. 1A-1B, which are schematic illustrations of an embodiment of a non-limiting example of different states of the array of displays 102 positioned in the receiving space 104 of a desktop (i.e., receiving space formed in a portion of the desktop).

In this embodiment, as well as in all the embodiments described and exemplified further below, each display of the array is configured to display, during a display session, media from a predefined source. Each display is associated / equipped with a position mechanism 103 to be transitionable / shiftable between position states including: a flush state, in which the display is flush with the desktop, and a range of angled / tilted states, in which the display forms a non-zero angle with the desktop.

As will be described further below, the display array is configured for communication with (is connectable to or installed with) a controller 105 which may be configured to operate the position mechanisms (e.g., robotic axis mechanisms) of the displays to control the position state of each display, and is also configured to provide/define a layout (orientation) of the displayed media of each display. A combination of the specific state and the layout characterizing each display defines an operational mode of the system (display array).

The operational mode may define groups of one or more displays, where all grouped displays display media in the same display layout, and each group is intended to be viewed by a respective viewer viewing the array from a different viewing angle or direction.

In the example of Figs. 1A-1B, the array includes two displays 102, and Fig. 1A shows a first state of these displays 102 in which they are both flat and flush with the desktop. In the first state, each display displays media that is generally facing a different direction, namely each display is intended to be viewed by a first viewer VI positioned in an opposite position to the second viewer V2. Each of the displays 102 is tiltable and can change its position state, namely the plane defined by the display and the desktop or the plane defined by the surface of the receiving space 104.

It is to be noted that the desktop may extend to the area surrounding the peripheral edges of the displays when they are in the first, flat state. However, in some embodiments of the invention, the desktop boundaries can be defined by the edges of the displays.

Fig. IB shows a second state of the displays 102 after the system received a command to switch to that second state. The controller 105 (processing circuitry) operates change of the position states to form a certain non-zero angle with the desktop, while the layout orientation of the displayed media is maintained the same. As described above, the controller 105 operates the position mechanisms 103 of the displays.

The position mechanism can be a robotic arm that moves the screens or any other placements or enclosure that holds the screen and is driven by a suitable mechanism using motors, gears, drive chains/belts, actuators, sliders track of any kind, pneumatic mechanisms, magnetic drive mechanisms, together with all types of sensors (sensing means).

It should be noted that each two adjacent/neighboring displays, when are in the flush state, form a continuous surface. In the default state of the system, typically all displays are flat and flush with one another to form a continuous working surface of a desktop.

In some embodiments, the operational mode defines functional groups, each formed by one or more displays. The displays of the same functional group display media in the same display layout. The display(s) of the same group is/are intended to be viewed by respective viewer(s) with the same viewing angle or direction, which may be different from that/those of a different group. The displays may be configured such that, when they are divided into functional groups, they operate to prevent transfer of the data content from the display(s) of one group to display(s) of another group and such transfer is allowed in response to user's input; or vice versa, i.e. the "normal/default" operation allows data transfer between the functional groups until it is prevented in response to user input.

Reference is now made to Figs. 2A-2B, which are schematic illustrations of an embodiment of a non-limiting example of different states of the array of displays positioned in the receiving space 204 (seen in Fig. 2B) of a desktop. In the example of Figs. 2A-2B, the array includes two rows of displays 206A and 206B, where each row comprises a plurality / array of displays 202. Fig. 2A shows the default state of the displays, in which all of them are in a flat position creating the surface of the desktop and/or all of the displays are flush with other portions of the desktop or at least its boundaries. In Fig. 2B, the controller operates the array of displays after receiving a command (from user or automatic operator) to change to a new desired state and positioned the first row in a first angle with respect to the desktop and the second row in a second angle with respect to the desktop (where the second angle can be equal to or different from the first angle). Each row 206A, 206B displays media in a layout orientation facing an opposite direction to the other.

The displays are divided into three functional groups 208A, 208B and 208C, each group either (i) displays media from a different media source, e.g. a different computer, or (ii) displays a defined part of the media source with a predetermined boundary from a different part of the same media source. Each group may be formed by one or more displays, where each display of the group is adjacent to the display of the same row or of the other row. As exemplified in Fig. 2B, the functional group 208A includes 2 adjacent / neighboring displays of row 206A and 2 adjacent/neighboring displays of row 206B which are adjacent to said 2 displays of row 206A; the functional group 208B includes 2 adjacent/neighboring displays of the row 206A; and the functional group 208C includes 2 adjacent/neighboring displays of the row 206B.

One or more functional groups can be duplicated to be presented in two or more duplications in the array. Media items, e.g. a document or an image, can be transferred between displays in the same functional group and in some scenarios also between two different functional groups. However, in some embodiments of the system, the transfer of media items is blocked between two different functional groups. The system of the present invention provides a broad flexibility for the user to set a variety of states of the displays in the array to be suited to a wide variety of working requirements.

Reference is now made to Fig. 3, which is a schematic illustrations of an embodiment of a non-limiting example showing a state of the display array positioned in the receiving space 304 of a desktop after setting by the controller (from the default flat state). In this example, the displays 302 are divided into three functional groups. The first group 308A is pivoted about an axis XI parallel to a first boundary 310A of the receiving space 304 and the layout of the displayed media of this group is facing away from said first boundary 310A. The second group 308B is pivoted about an axis X2 parallel to a second boundary 310B of the receiving space 304 and the layout of the displayed media of this group is facing away from said second boundary 310B. The third group 308C comprises two opposite displays, each is pivotable about a different axis ¥1 and ¥2 parallel to the third and fourth boundaries 310C and 310D, respectively, being normal to the first and second boundaries 310A and 310B. In this example, the third group 308C comprises flat displays being flush with the desktop, however it is to be noted that they can also be pivoted to a certain angle. Each of the displays of the third group 308C displays an identical media source, however the layout orientation of each display is opposite to the other, namely the displayed media in each display is intended to be viewed by a viewer positioned in an opposite side of the desktop. This example provides a scenario of the array of displays that can serve viewers from four different sides of the desktop simultaneously.

Fig. 4 is a schematic illustration of an example of transferring a media item 412, e.g. a document or an image, from one display to another. In this example, an image is transferred from a first display 402A in a first row 406A to a second display 402B in a second row 406B and then to a third display 402C in the same row 406B (the process is seen from left to right). A document 414 presented before in the last received display is transferred to a different display, either in the same row or in the other row of displays. The displays can be touch-screens and the process of transferring the media item can be made by a dragging gesture over the display or by operation of a mouse and a keyboard.

Fig. 5 exemplifies, in a self-explanatory manner, that the array of the displays is a modular assembly enabling removing one or more displays from the array, for maintenance for example. The controller 105 is configured to set the desired state of the array taking into account the absence of one or more displays in the array.

Fig. 6 is a schematic illustration exemplifying a default setting of an individual display 602 of the display array with media contents to be displayed by this individual display. In this example, the display 602 is divided into a central area/region CA and two peripheral areas/regions PAi and PA2. The central area CA is an area that is found in the central field of vision of the user. Therefore, the controller 105 may be configured to set a default setting that includes opening of selected application or media files within the central area CA. The applications that are opened in the central area are the most viewed and used applications. The controller 605 may also open secondary importance of applications that are less viewed and used by the user and position them initially in at least one of the peripheral areas.

Fig. 7 is a schematic illustration of a specific display configuration in an individual display of the display array. In this example, the display is configured to receive data segments from two or more media sources and to allocate the respective data segments in two or more areas of the display, identified as Source 1 and Source 2 in the figure. Each area displays data received from a different media source, and in order to interface with the media source displayed in a selected area, the user is required to perform gestures in the selected area. The gestures can be touch gestures if the display is a touch screen or mouse clicks within the boundaries of the area. The specific display may include a self-processor (local controller) that controls the allocation of the areas between the sources on the screen and the transfer of commands triggered by gestures or actions being made on one of the two areas to a respective CPU of the media source related to the area.

The controller is configured to manage the display array operation in response to user(s)' input and/or may be configured to manage the workflow of the display array accordingly to modeled or predicted workflow data. The configuration and operation of the controller described further below with respect to an example of Figs. 10A-10B. The controller is typically a computerized system including data unput and output utilities, memory and a processing circuitry. The processing circuitry may include an Al-based utility, e.g. neural network, preferably Graph Neural Network (GNN) to generate data indicative of a predicted workflow for the display array, e.g., each display in the display array.

The general principles underlying the configuration and operation of neural networks, as well as those of GNN are known per se and do not form part of the present disclosure, and therefore need not be specifically described. The present disclosure utilizes the fundamental properties of GNN to generate prediction of the workflow of the configurable display array.

As described above, the display of the display array is equipped with a robotic- axial mechanism enabling translation of the display position state between the flush state and tilted state with respect to the desktop surface. The displays of the display array are used for related flow of usages for a single person workflow or mutual or multiply users. The workflow data for the display array includes dynamics (time patterns) of changes of the position data for each display and dynamics (time patterns) of presentation of data contents by the displays including movement of the data contents between the displays. This workflow data further includes or is dependent on log in of various users to specific displays of the display array.

Reference is made to Fig. 8 exemplifying operation of the Al-based utility of the processing circuitry, e.g., GNN utility, to generate and use predicted workflow of the display array. GNN is typically configured to define data structures that presents data points (nodes) which are linked by lines (edges) with mathematically expressed elements. This allows machine learning algorithms to create useful predictions at the level of nodes, edges, or entire graphs. Thus, the GNN-based utility performs a machine learning procedure by monitoring operation of each display in a given display array, while utilizing predetermined input data, and generates output data indicative of a predicted workflow for each display.

The input data to the GNN-based utility includes, for each display, physical properties data, virtual properties data, user data. The physical properties data may include one or more of the following: tilted angle, axis angular speed, display properties (L,W,H), active area (XX”), resolution, ratio (xx;yy), touch panel type, screen and touch response rate, etc. The virtual properties data may include one or more of the following: content to be displayed (content ID data), content type, partial object, file volume, display virtual position, orientation, content speed movement, position, etc. The user data (or user-related data) may include one or more of the following: user ID, type of user, age, work professional, scientific degree, computer software skills, company position, favorites and preferences, field of view, social network markup, languages, etc.

It should be noted that the workflow for each display can be predicted according to predetermined user-related data, which may be indicative of user preferences or group of users' preferences.

During the monitoring procedure (machine learning), a GNN is constructed according to vectors of nodes and edges to define encoder functions (ENC) for converting feature vectors, merging physical axis and virtual axis positions as a complete united geometric forms of nodes position/movements on screen. The GNN is thus configured according to relations of the generated nodes, with different time and geometric dimen ions. Conning a graph of neural network for foe whole work space area, capable of providing output data indicative of a predicted workflow. Each node, created or predicted, can also hold different data as a file or other form of digital content of display content with edges connection for other interest nodes. Each edge can be directed or non-directed to form classification of connection between nodes. Prediction can follow up workflow scenario relating to particular user’s behavior or users' behaviors.

The output data indicative of the predicted workflow may include one or more of the following: data content movement; position state change data per display; new user log in data to specific display; data content presentation in response to log in, etc. For example, the data content movement may be informative of that certain data content (“id-DAT456XAT” data content) is to be moved to specific display (display 003) and presented on said display according to specific coordinates, area and time. For example, the position state change data may be indicative of a certain tilt angle (e.g., 35dig) for the specific display (display 003) with a specific type/mode of tilting rate (e.g., “urgent” mode). New user log in data may for example indicate that new user log in is to be opened on a specific display (display 004), e.g., a specific individual/user (e.g., Doctor Jhon Blake) is expected to join a specific session (e.g., session-S066 UID0025195). The data content in response to log in on specific display indicates that upon log in of a specific user (UID0025195), the display is to present specific content or a sequence of contents (e.g., id-DAT456XAT/content Idat565mat/content id-DAT777LVT).

Fig. 9 exemplifies, in a self-explanatory manner, the multi-display operation in accordance with the GNN -based prediction workflow.

Reference is now made to Figs. 10A-10B illustrating an exemplary configuration (Fig. 10A) and operation (Fig. 10B) of the controller 105 associated with and controlling operation of a display array. In this specific not limiting example, the controller is exemplified for implementing the GNN -based data processing to generate predicted workflow for the display array operation.

The controller is a computerized system including inter alia data input and output utilities and a memory (which are not specifically shown) and a data/signal processing circuitry 110 typically including the main host CPU and embedded microchips. As illustrated in this non-limiting example, in some embodiments, the controller 105 may be configured for communication with an external control system 112 using network devices / communication utilities 114 of any known suitable type. The processing circuitry 110.

Some of the functional utilities (hardware/software) of the processing circuitry 110 are shown in the figure in a self-explanatory manner. It should be understood that some of these functional utilities are optional and may not be needed for implanting the general principles of the technique of the present disclosure.

As described above, the display array system is equipped with position mechanisms associated with axial motion drive (automatically operated by axis drivers of the processing circuitry) and/or user tilt switch (manual operation by users). The display array system may include motion sensor(s) of any known suitable type (e.g., optical sensor, inclinometer, accelerometer, etc.) capable of providing motion sensing data indicative of the display position change and the velocity of change (between different position states). The motion sensors are in communication with respective sensor utility of the processing circuitry.

The controller 105 is thus configured to manage the display array operation in response to user(s)' input and/or may be configured to manage the workflow of the display array accordingly to modeled / predicted data.

Fig. 10B exemplifies, in a self-explanatory manner, various possible data processing procedures carried out by the controller in response to various types of inputs.

As noted above, the use of Al-based data processing (e.g., GNN-based generation of predicted workflow) is generally optional, always in some embodiments might be preferable. Generally, the controller (its data processing circuitry) may utilize the lookup table based principles to control the display array operation. A specific not-limiting example of such state machine lookup table is illustrated in Fig. 10C. As shown, the controller operates to identify the existing scenario of the display array (e.g., the position states of the displays do not change for a certain time period reaching a predetermined thresholding time) and operates according to predefined operational mode / machine state code (e.g., changes (resets) the position states of the displays) assigned to scenario of users' requirement for the specific operational mode of the display array (e.g., users are normally gaining a need for mutual flat united surface work).

Thus, the technique of the present disclosure provides for controlling operation of a multi-display desktop enabling to display media / data contents from one or more media sources and capable of being used by a single user or concurrently used by multiple users. The controlled operation of the display array may be managed by users and/or may be configured for Al-assisted control.