The HDGI ontology aims to model the pose and/or movement of human upper limbs that are used to interact with devices (particularly with device affordances). It is mapped around gestures performed by human's upper limb region to interact with these affordances. While allowing these mapping the ontology is also developed to be used as a dictionary for manufacturers, designers and developer community to browse and locate commonly used gestures to command certain affordances, or/and to understand the connections and dynamics around it. This ontology is made accessible, flexible and extendable enabling device manufacturers, designers and users to incorporate new gestures and map the relations to corresponding affordances accordingly. The ontology is geared at mapping the ubiquitousness in gesture vocabularies by linking them appropriately and does not enforce designers and manufacturers to follow a standard. 2020-05-22 Copyright © 2020 Madhawa Perera, Armin Haller Human Device Gesture Interaction Ontology hdgi https://w3id.org/hdgi# Human Device Gesture Interaction Ontology 0.1 Relation from an Affordance to a Device describing an affordance of a device. affordedBy Relation from a Human to a User Context or from a Device to a Device Context. hasContext Relation between a Movement and a Duration describing the time duration of a movement. hasDuration hasEndPose hasLocalCoordinateSystem hasMovement hasPart hasPose hasPosition hasQuaternion hasRotation hasStartPose hasTimeStamp hasUnitOfMeasure includesGesture involves isPartOf manufacturedBy observes performs supportsGesture used uses A quaternion “q” can be defined as (q) = w + xi + yj + zk, where w, x, y, and z are all real numbers. The jComponent is the component of j which equals to y. In the equation 'j' is defined as √-1. With quaternions, i = j = k = √-1. iComponent In an equation where quaternion (q) = w + xi + yj + zk, where w, x, y, and z are all real numbers j-component = y In the equation 'i' is defined as sqrt(-1). With quaternions, i = j = k = sqrt(-1). jComponent In an equation where quaternion (q) = w + xi + yj + zk, where w, x, y, and z are all real numbers k-component = z In the equation 'i' is defined as sqrt(-1). With quaternions, i = j = k = sqrt(-1). kComponent Frame of reference or the initial center. Location of the (0,0,0) postion related to the given coordinates. originPoint timestamp Represents the amount of rotation which will occur about this axis defined by (i-component, j-component, k-component). Known as scalar component. wComponent leftward rightward xAxisDirection In a three-dimensional Cartesian coordinate system where coordinates of any point in space are determined by three real numbers: x, y, z, the xPosition is the value of the real number x. Known as abscissa or x-coordinate in mathematics. xPosition Angle around the x-axis xRotation downward upward yAxisDirection yPosition Angle around the y-axis yRotation inward outward zAxisDirection zPosition Angle around the z-axis zRotation An actuatable Affordance of a Device. This is rdfs:subClassOf ssn:ActuatableProperty. ActuatableAffordance TV is a Device that can change the state to “on” or “off”. This is a property of a TV which a human could act upon. Thus, ability to “turn on” is an ActuatableAffordance of a TV. Affordance is a quality or characteristic of Devices that indicates the possible action a Human can take with it. This is rdfs:subClassOf ssn:Property. Affordance BodyPart is any part of HumanBody such as an Face, Leg etc. BodyPart "Head", "Palm", "Finger" etc. Context describes details of a situation. Context Device denotes a piece of hardware or software which consists of sensors or actuators or both. Device DeviceContext describes the data that is specifically related to a Device in a certain Context that is Device specific data in a Context. DeviceContext DeviceManufacturer is the company/vendor manufactures a Device. DeviceManufacturer Duration of a temporal extent expressed as a decimal number scaled by a temporal unit. This is an owl:equivalentClass time:Duration. Duration Face is a BodyPart which represents the front side of a Head. Face 1 FacialGesture is a Gesture executed with a Movement or a Pose using the BodayPart Face. FacialGesture Finger is a BodyPart of the HumanBody. Also know as Digits of hand. This is an owl:equivalentClass fma:fma9666. Finger Thumb, MiddleFinger, RingFinger etc. FingerAnticlcokwiseRotation FingerBackward FingerClockwiseRotation FingerDownward FingerForward FingerLeftward 1 5 FingerMovement FingerPose FingerRightward FingerUpward Foot Foot is a BodyPart. It is the terminal segmant of lower limb. This is an owl:equivalentClass fma:fma9664. 1 2 FootGesture is a Gesture executed with a Movement or a Pose using the BodayPart Foot. FootGesture FootPose Forearm is a BodyPart. It is the region of the upper limb between the elbow and the wrist. This is an owl:equivalentClass fma:fma9663. Forearm ForearmAnticlockwiseRotation ForearmBackward ForearmClockwiseRotation ForearmDownward ForearmForward 1 2 ForearmGesture is a Gesture executed with a Movement or a Pose using the BodyPart Forearm. ForearmGesture ForearmLeftward ForearmLeftwardAndDown ForearmLeftwardAndUp 1 2 ForearmMovement 1 2 ForearmPose ForearmRightward ForearmRightwardAndDown ForearmRightwardAndUp ForearmUpward 1 1 1 Gesture is a Movement or a Pose of a BodyPart. Gesture Hand is a BodyPart. It is the terminal segmant of upper limb which starts at end of the Forearm and consists of Fingers. This is an owl:equivalentClass fma:fma9712. Hand 1 1 2 10 HandGesture is a Gesture executed with a Movement or a Pose using the BodayParts Hand, Palm and/or Fingers. HandGesture Head is a BodyPart. It is the upper part of the HumanBody which starts from the upper end of the neck. This is an owl:equivalentClass fma:fma7154. Head 1 HeadGesture is a Gesture executed with a Movement or a Pose using the BodayPart Head. HeadGesture User who perform a gesture Human HumanBody holds a collection of BodyParts of a Human. HumanBody IndexFinger is the second Finger on Hand. Also known as second Digit of hand. This is an owl:equivalentClass fma:fma24946. IndexFinger IndexFingerCurled IndexFingerFolded 1 1 IndexFingerPose IndexFingerStraightandBackward IndexFingerStraightandDownward IndexFingerStraightandForward IndexFingerStraightandLeftward IndexFingerStraightandRightward IndexFingerStraightandUpward LeftForearm is the region of the left upper limb between the left elbow and the left wrist. This is an owl:equivalentClass fma:fma11346. LeftForearm LeftHand is the terminal segmant of left upper limb which starts at end of the LeftForearm and consists of Fingers. This is an owl:equivalentClass fma:fma9714. LeftHand LeftIndexFinger is the IndexFinger on the LeftHand. This is an owl:equivalentClass fma:fma60334. LeftIndexFinger LeftLittleFinger is the LittleFinger on LeftHand. This is an owl:equivalentClass fma:fma60328. LeftLittleFinger LeftMiddleFinger is the MiddleFinger on LeftHand. This is an owl:equivalentClass fma:fma60332. LeftMiddleFinger LeftPalm is the area located at the end of the LeftForearm (starting from left wrist) up until the start of a LeftHand Fingers which is the central region of the anterior part of the LeftHand. This is an owl:equivalentClass fma:fma61071. LeftPalm LeftRingFinger is the RingFinger on LeftHand. This is an owl:equivalentClass fma:fma60330. LeftRingFinger LeftThumb is the Thumb on LeftHand. This is an owl:equivalentClass fma:fma60326. LeftThumb LeftUpperArm is the region of the left upper limb between the left shoulder and left elbow joint. This is an owl:equivalentClass fma:fma24896. LeftUpperArm Leg is a BodyPart and it is the intermediate segment of lower limb. This is an owl:equivalentClass fma:fma24979. Leg 1 2 LegGesture is a Gesture executed with a Movement or a Pose using the BodayPart Leg. LegGesture LegPose LittleFinger is the fifth Finger on Hand. Also known as fifth Digit of hand. This is an owl:equivalentClass fma:fma24949. LittleFinger LittleFingerCurled LittleFingerFolded 1 1 LittleFingerPose LittleFingerStraightandBackward LittleFingerStraightandDownward LittleFingerStraightandForward LittleFingerStraightandLeftward LittleFingerStraightandRightward LittleFingerStraightandUpward leftward rightward downward upward inward outward The local coordinate system is the coordinate system that is convenient for a given entity (Finger, palm etc.), local space, or object space. LocalCoordinateSystem MiddleFinger is the third Finger on Hand. Also known as third Digit of hand. This is an owl:equivalentClass fma:fma24947. MiddleFinger MiddleFingerCurled MiddleFingerFolded 1 1 MiddleFingerPose MiddleFingerStraightandBackward MiddleFingerStraightandDownward MiddleFingerStraightandForward MiddleFingerStraightandLeftward MiddleFingerStraightandRightward MiddleFingerStraightandUpward 1 The act of moving a certain body part towards a certain direction. Movement An observable Affordance of a Device. This is rdfs:subClassOf ssn:ObservableProperty. ObservableAffordance Thermostat is a Device that can sense/measure a temperature of a certain location at a given point of time and display it. Thus, “display measured temperature” is an ObservableAffordance of a thermostat. Observer Palm is a BodyPart. It is the area located at the end of the Forearm (starting from wrist) up until the start of a Finger which is the central region of the anterior part of the Hand. This is an owl:equivalentClass fma:fma24920. Palm PalmAnticlockwiseRotation PalmBackward PalmClockwiseRotation PalmDownward PalmDownwardPose PalmForward PalmInwardPose PalmLeftward PalmLeftwardPose 1 2 Movement of palm. Either right or left. PalmMovement PalmOutwardPose 1 2 PalmPose PalmRightward PalmRightwardPose PalmUpward PalmUpwardPose 1 1 1 Pose 1 1 1 1 1 Position of a pose in a particular time Position 1 1 1 1 A quaternion is defined as q = w + xi + yj + zk where w, x, y, and z are real numbers and i is defined as square root of -1. With quaternions, i = j = k = square root of -1. The magnitude of a quaternion is calculated by magnitude = square root of (w2 + x2 + y2 + z2). For the unit quaternions, the magnitude is one. Quaternion RightForearm is the region of the right upper limb between the right elbow and the right wrist. This is an owl:equivalentClass fma:fma11345. RightForearm RightHand is the terminal segmant of right upper limb which starts at end of the RightForearm and consists of Fingers. This is an owl:equivalentClass fma:fma9713. RightHand RightIndexFinger is the IndexFinger on the RightHand. This is an owl:equivalentClass fma:fma60333. RightIndexFinger RightLittleFinger is the LittleFinger on RightHand. This is an owl:equivalentClass fma:fma60327. RightLittleFinger RightMiddleFinger is the MiddleFinger on RightHand. This is an owl:equivalentClass fma:fma60331. RightMiddleFinger RightPalm is the area located at the end of the RightForearm (starting from right wrist) up until the start of a RightHand Fingers which is the central region of the anterior part of the RightHand. This is an owl:equivalentClass fma:fma61070. RightPalm RightRingFinger is the RingFinger on RightHand. This is an owl:equivalentClass fma:fma60329. RightRingFinger RightThumb is the Thumb on RightHand. This is an owl:equivalentClass fma:fma60325. RightThumb RightUpperArm is the region of the right upper limb between the right shoulder and right elbow joint. This is an owl:equivalentClass fma:fma24895. RightUpperArm RingFinger is the fourth Finger on Hand. Also known as fourth Digit of hand. This is an owl:equivalentClass fma:fma24948. RingFinger RingFingerCurled RingFingerFolded 1 1 RingFingerPose RingFingerStraightandBackward RingFingerStraightandDownward RingFingerStraightandForward RingFingerStraightandLeftward RingFingerStraightandRightward RingFingerStraightandUpward 1 1 1 1 1 1 Rotation of a pose. Rotation Thumb is the first Finger on Hand. Also known as first Digit of hand. This is an owl:equivalentClass fma:fma24938. Thumb ThumbCurled ThumbFolded 1 1 ThumbPose ThumbStraightandBackward ThumbStraightandDownward ThumbStraightandForward ThumbStraightandLeftward ThumbStraightandRightward ThumbStraightandUpward Defines units of measurement. This is an equivalent class to qudt:Unit UnitOfMeasure UpperArm is a BodyPart. It is the region of the upper limb between the shoulder and elbow joint. This is an owl:equivalentClass fma:fma24890. UpperArm UpperArmAnticlcockwiseRotation UpperArmBackward UpperArmClockwiseRotation UpperArmForward 1 2 UpperArmGesture is a Gesture executed with a Movement or a Pose using the BodayPart UpperArm. UpperArmGesture UpperArmLeftward UpperArmLeftwardAndBack UpperArmLeftwardAndFront 1 2 UpperArmMovement 1 2 UpperArmPose UpperArmRightward UpperArmRightwardAndBack UpperArmRightwardAndFront UserContext describes the data that is specifically related to a Human in a certain Context that is Human specific data in a Context. UserContext