{"id":23002,"date":"2019-02-28T11:00:47","date_gmt":"2019-02-28T16:00:47","guid":{"rendered":"http:\/\/www.sinclairclarion.com\/home\/?p=23002"},"modified":"2019-02-25T11:44:57","modified_gmt":"2019-02-25T16:44:57","slug":"deepasl-more-than-meets-the-ear","status":"publish","type":"post","link":"https:\/\/www.sinclairclarion.com\/home\/tartan-news\/2019\/02\/28\/deepasl-more-than-meets-the-ear\/","title":{"rendered":"DeepASL: More Than Meets The Ear"},"content":{"rendered":"

\u00a0 \u00a0Researchers at Michigan State University have recently created a device that can assist those who are deaf and hard-of-hearing. This new technology, known as DeepASL, is able to help hearing-impaired individuals communicate with others who can hear well and\/or don\u2019t comprehend sign language.<\/span><\/p>\n

\u00a0 \u00a0According to the World Health Institute, devastating hearing loss impacts around 466 million people, or 5 percent of the Earth\u2019s population. This statistic includes eight percent of Americans, who use American Sign Language ( ASL) to communicate with those around them. <\/span><\/p>\n

\u00a0 \u00a0However, many Americans, including myself, do not understand ASL and must rely on an interpreter to figure out what sign language users are attempting to convey.<\/span><\/p>\n

\u00a0 \u00a0\u201cHundreds of thousands of hard-of-hearing people rely upon American Sign Language, or ASL, to communicate,\u201d mentioned Mi Zhang, assistant professor of electrical and computer engineering at Michigan State. \u201cWithout an interpreter present, they don\u2019t have the same employment opportunities and are oftentimes left at a disadvantage in delicate or sensitive situations\u201d<\/span><\/p>\n

\u00a0 \u00a0Many of the translating products that are on the market can be bulky and humiliating for the user. Some are only able to slowly pick up hand gestures from the user, which makes naturally flowing conversation difficult. <\/span><\/p>\n

\u00a0 \u00a0DeepASL, on the other hand, is around the size of a tube of chapstick and uses multiple cameras to capture the signer\u2019s gestures. It also offers the user personalized feedback in real time.<\/span><\/p>\n

\u00a0 \u00a0\u201cHard-of-hearing individuals who need to communicate with someone who doesn\u2019t understand sign language can have a personalized, virtual interpreter at anytime, anywhere,\u201d Zhang said.<\/span><\/p>\n

\"\"<\/p>\n

How does this technology work? \u00a0<\/b><\/p>\n

\u00a0 \u00a0DeepASL utilizes light sensing technology known as Leap Motion, which takes information from the joints in the hand and turns it into sign language. <\/span><\/p>\n

\u00a0 \u00a0Biyi Fang, one of Zhang\u2019s colleagues who helped develop DeepASL expands on what Leap Motion entails: \u00a0<\/span><\/p>\n

\u00a0 \u00a0\u201cLeap Motion converts the motions of one\u2019s hands and fingers into skeleton-like joints,\u201d Fang said. \u201cOur deep learning algorithm picks up data from the skeleton-like joints and matches it to signs of ASL.\u201d <\/span><\/p>\n

\u00a0 \u00a0The product also uses an algorithm based on deep learning, which involves a machine learning through data that is similar in structure to the human brain. <\/span><\/p>\n

\u00a0 \u00a0When a user signs different words with hand gestures, DeepASL automatically converts the signs into English and broadcasts the translated speech through a speaker worn on the user\u2019s neck.<\/span><\/p>\n

\u00a0 \u00a0As the receiver responds to the sender, DeepASL recognizes the speech and translates it to text. The newly transformed words are then displayed to the user by utilizing a pair of augmented reality glasses.<\/span><\/p>\n

\"\"<\/p>\n

How well does it work? <\/b><\/p>\n

\u00a0 \u00a0According to a paper published by Zhang, Fang and undergraduate student Jillian Co, DeepASL is 94.5 percent accurate when it comes to word translation. Meanwhile, translated words in sentences performed by unseen senders come with an average error rate of 16.1 percent. <\/span><\/p>\n

\u00a0 \u00a0However, the program is able to translate signs from users in various postures or in different lighting conditions with remarkable accuracy. \u00a0DeepASL translates words from ASL to English with a success rate of more than 91.8 percent. <\/span><\/p>\n

\u00a0 \u00a0\u201cGiven its promising performance, we believe DeepASL represents a significant step towards breaking the communication barrier between deaf people and hearing majority, and thus has the significant potential to fundamentally change deaf people\u2019s lives,\u201d the paper reads.<\/span><\/p>\n

\u00a0 \u00a0Zhang and his fellow researchers are currently ready to market DeepASL to the public, and the product will retail for around $78. They are also interested in teaching the program new sign languages and giving it iPhone compatibility.<\/span><\/p>\n

Maxwell Patton<\/strong>
\n<\/span>Reporter<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

\u00a0 \u00a0Researchers at Michigan State University have recently created a device that can assist those who are deaf and hard-of-hearing. This new technology, known as DeepASL, is able to help hearing-impaired individuals communicate with others who can hear well and\/or don\u2019t comprehend sign language. \u00a0 \u00a0According to the World Health Institute, devastating hearing loss impacts […]<\/p>\n","protected":false},"author":10416,"featured_media":23003,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[2105,3,2106,2150],"tags":[3026,3024,3025,1400,3028,2933,3027],"class_list":["post-23002","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science","category-tartan-news","category-technology","category-world","tag-asl","tag-deaf","tag-deepasl","tag-health","tag-hearing-loss","tag-maxwell-patton","tag-michigan-state-university"],"jetpack_publicize_connections":[],"cc_featured_image_caption":{"caption_text":false,"source_text":false,"source_url":false},"jetpack_featured_media_url":"https:\/\/www.sinclairclarion.com\/home\/wp-content\/uploads\/2019\/02\/adult-care-caress-1242349.jpg","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p5s3vR-5Z0","_links":{"self":[{"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/posts\/23002","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/users\/10416"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/comments?post=23002"}],"version-history":[{"count":4,"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/posts\/23002\/revisions"}],"predecessor-version":[{"id":23010,"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/posts\/23002\/revisions\/23010"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/media\/23003"}],"wp:attachment":[{"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/media?parent=23002"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/categories?post=23002"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sinclairclarion.com\/home\/wp-json\/wp\/v2\/tags?post=23002"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}