{"id":67149,"date":"2024-01-16T16:20:28","date_gmt":"2024-01-16T08:20:28","guid":{"rendered":"https:\/\/inventec2.mjitec.tw\/?page_id=67149"},"modified":"2024-01-17T14:29:33","modified_gmt":"2024-01-17T06:29:33","slug":"an-efficient-ckks-fhew-tfhe-hybrid-encrypted-inference-framework","status":"publish","type":"page","link":"https:\/\/inventec2.mjitec.tw\/zh-hans\/ai\/an-efficient-ckks-fhew-tfhe-hybrid-encrypted-inference-framework\/","title":{"rendered":"CKKS-FHEW\/TFHE Hybrid Encrypted Inference Framework\u200b"},"content":{"rendered":"

[vc_row full_width=”stretch_row”][vc_column]

\r\n
<\/div>\t\t\t\r\n\t\t\t<\/div>[vc_row_inner el_class=”md-full-col”][vc_column_inner el_class=”m_p” width=”1\/2″]\n
\n \t
\n \t\t\n\t \n\t

An Efficient CKKS-FHEW\/TFHE Hybrid Encrypted Inference Framework <\/h2>\n\t <\/div><\/div>[vc_column_text css=”.vc_custom_1705392986352{margin-bottom: 20px !important;}”]International Workshop on Privacy Security and Trustworthy AI (PriST-AI 2023), a workshop of ESORICS 2023[\/vc_column_text][vc_column_text css=”.vc_custom_1660542835761{margin-bottom: 5px !important;}”]<\/p>\n
\n
\u4f5c\u8005<\/h6>\n<\/div>\n

[\/vc_column_text][vc_column_text css=”.vc_custom_1705393020934{margin-bottom: 20px !important;}”]Tzu-Li Liu, Yu-Te Ku, Ming-Chien Ho (Beth), Feng-Hao Liu, \u200b Ming-Ching Chang, Chih-Fan Hsu, Wei-Chao Chen, and Shih-Hao Hung\u200b[\/vc_column_text][vc_column_text css=”.vc_custom_1660542850538{margin-bottom: 5px !important;}”]<\/p>\n

\n
\u767c\u8868\u65e5\u671f<\/h6>\n<\/div>\n

[\/vc_column_text][vc_column_text]2023\/9\/29[\/vc_column_text][\/vc_column_inner][vc_column_inner el_class=”m_p” width=”1\/2″][vc_single_image image=”67151″ img_size=”full”][\/vc_column_inner][\/vc_row_inner][\/vc_column][\/vc_row][vc_row][vc_column]

\r\n
<\/div>\t\t\t\r\n\t\t\t<\/div>[\/vc_column][\/vc_row][vc_row full_width=”stretch_row”][vc_column][vc_row_inner content_placement=”top” css=”.vc_custom_1657794580528{margin-bottom: 20px !important;}”][vc_column_inner el_class=”m_p paragraph_title” width=”1\/3″]\n
\n \t
\n \t\t\n\t \n\t

\u6982\u8981 <\/h2>\n\t <\/div><\/div>[\/vc_column_inner][vc_column_inner el_class=”m_p” width=”2\/3″][vc_column_text]Machine Learning as a Service (MLaaS) is a robust platform that offers various emerging applications. Despite great convenience, user privacy has become a paramount concern, as user data may be shared or stored in outsourced environments. To address this, fully homomorphic encryption (FHE) presents a viable solution, yet the practical realization of this theoretical approach has remained a significant challenge, requiring specific optimization techniques tailored to different applications.<\/p>\n

We aim to investigate the opportunity to apply the CKKS-FHEW\/TFHE hybrid approach to NNs, which inherit the advantages of both approaches. This idea has been implemented in several conventional ML approaches (PEGASUS system presented in IEEE S&P 2021), such as decision tree evaluation and K-means clustering, and demonstrated notable efficiency in specific applications. However, its effectiveness for NNs remains unknown.<\/p>\n

In this paper, we show that directly applying the PEGASUS system on encrypted NN inference would result in a significant accuracy drop, approximately 10% compared to plaintext inference. After a careful analysis, we propose a novel LUT-aware fine-tuning method to slightly adjust the NN weights and the functional bootstrapping for the ReLU function to mitigate the error accumulation throughout the NN computation. We show that by appropriately fine-tuning the model, we can largely reduce the accuracy drop, from 7.5% to 15% compared to the baseline implementation without fine-tuning, while maintaining comparable efficiency with extensive experiments.[\/vc_column_text][\/vc_column_inner][\/vc_row_inner][\/vc_column][\/vc_row][vc_row][vc_column]

\r\n
<\/div>\t\t\t\r\n\t\t\t<\/div>[\/vc_column][\/vc_row][vc_row][vc_column width=”1\/3″ el_class=”m_p keyword_title”][vc_column_text]<\/p>\n

\u95dc\u9375\u5b57<\/h2>\n

[\/vc_column_text][\/vc_column][vc_column width=”2\/3″ el_class=”m_p keyword”][vc_row_inner content_placement=”middle”][vc_column_inner width=”1\/3″][vc_raw_html]JTNDdWwlMjBjbGFzcyUzRCUyMnN0eWxlbGlzdGluZyUyMiUzRSUwQSUyMCUwOSUzQ2xpJTIwc3R5bGUlM0QlMjJsaW5lLWhlaWdodCUzQTM0cHglM0IlMjIlM0VIb21vbW9ycGhpYyUyMGVuY3J5cHRpb24lM0MlMkZsaSUzRSUwQSUyMCUwOSUzQ2xpJTIwc3R5bGUlM0QlMjJsaW5lLWhlaWdodCUzQTM0cHglM0IlMjIlM0VQcml2YWN5LXByZXNlcnZpbmclMjBtYWNoaW5lJTIwbGVhcm5pbmclM0MlMkZsaSUzRSUwQSUzQyUyRnVsJTNF[\/vc_raw_html][\/vc_column_inner][vc_column_inner width=”1\/3″][vc_raw_html]JTNDdWwlMjBjbGFzcyUzRCUyMnN0eWxlbGlzdGluZyUyMiUzRSUwQSUyMCUwOSUzQ2xpJTIwc3R5bGUlM0QlMjJsaW5lLWhlaWdodCUzQTM0cHglM0IlMjIlM0VOZXVyYWwlMjBuZXR3b3JrJTNDJTJGbGklM0UlMEElM0MlMkZ1bCUzRQ==[\/vc_raw_html][\/vc_column_inner][vc_column_inner width=”1\/3″][vc_raw_html]JTNDdWwlMjBjbGFzcyUzRCUyMnN0eWxlbGlzdGluZyUyMiUzRSUwQSUyMCUwOSUzQ2xpJTIwc3R5bGUlM0QlMjJsaW5lLWhlaWdodCUzQTM0cHglM0IlMjIlM0VGdW5jdGlvbmFsJTIwYm9vdHN0cmFwcGluZyUzQyUyRmxpJTNFJTBBJTNDJTJGdWwlM0U=[\/vc_raw_html][\/vc_column_inner][\/vc_row_inner][\/vc_column][\/vc_row][vc_row][vc_column]

\r\n
<\/div>\t\t\t\r\n\t\t\t<\/div>[\/vc_column][\/vc_row][vc_row full_width=”stretch_row” el_class=”bg” css=”.vc_custom_1657248474326{padding-top: 50px !important;padding-bottom: 50px !important;}”][vc_column][vc_column_text css=”.vc_custom_1657009336143{margin-bottom: 20px !important;}”]<\/p>\n

\u4e0b\u8f09\u8207\u5206\u4eab<\/h3>\n

[\/vc_column_text][vc_row_inner content_placement=”middle”][vc_column_inner el_class=”download_btn_wrap”][vc_btn title=”PDF” style=”flat” color=”white” align=”center” link=”url:https%3A%2F%2Finventeccorp-my.sharepoint.com%2F%3Ab%3A%2Fg%2Fpersonal%2Fho_beth_inventec_com%2FEVTRY4i5pr1Nnb6iz8x6WKkBQImtFL_YOIHeJCVIf0y9dg%3Fe%3DVEuAeL|target:_blank” el_class=”download_btn”][\/vc_column_inner][\/vc_row_inner][\/vc_column][\/vc_row]<\/p>\n<\/div>","protected":false},"excerpt":{"rendered":"

[vc_row full_width=”stretch_row”][vc_column…<\/p>\n","protected":false},"author":4,"featured_media":0,"parent":4976,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-67149","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/inventec2.mjitec.tw\/zh-hans\/wp-json\/wp\/v2\/pages\/67149","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/inventec2.mjitec.tw\/zh-hans\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/inventec2.mjitec.tw\/zh-hans\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/inventec2.mjitec.tw\/zh-hans\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/inventec2.mjitec.tw\/zh-hans\/wp-json\/wp\/v2\/comments?post=67149"}],"version-history":[{"count":0,"href":"https:\/\/inventec2.mjitec.tw\/zh-hans\/wp-json\/wp\/v2\/pages\/67149\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/inventec2.mjitec.tw\/zh-hans\/wp-json\/wp\/v2\/pages\/4976"}],"wp:attachment":[{"href":"https:\/\/inventec2.mjitec.tw\/zh-hans\/wp-json\/wp\/v2\/media?parent=67149"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}