WEKO3
アイテム
{"_buckets": {"deposit": "9e2d9b3e-e223-48a2-99f4-9c3b4ce3f877"}, "_deposit": {"created_by": 6, "id": "28059", "owners": [6], "pid": {"revision_id": 0, "type": "depid", "value": "28059"}, "status": "published"}, "_oai": {"id": "oai:nagasaki-u.repo.nii.ac.jp:00028059", "sets": ["2011"]}, "author_link": ["125195", "125196"], "item_2_biblio_info_6": {"attribute_name": "書誌情報", "attribute_value_mlt": [{"bibliographicIssueDates": {"bibliographicIssueDate": "2023-03-01", "bibliographicIssueDateType": "Issued"}, "bibliographicIssueNumber": "3", "bibliographicPageEnd": "513", "bibliographicPageStart": "504", "bibliographicVolumeNumber": "E106.A", "bibliographic_titles": [{"bibliographic_title": "IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences"}]}]}, "item_2_description_4": {"attribute_name": "抄録", "attribute_value_mlt": [{"subitem_description": "In this paper, we propose a real-time vibration extraction system, which extracts vibration component within a given frequency range from videos in real time, for realizing tremor suppression used in microsurgery assistance systems. To overcome the problems in our previous system based on the mean Lucas-Kanade (LK) optical flow of the whole frame, we have introduced a new architecture combining dense optical flow calculated with simple feature matching and block-based band-pass filtering using band-limited multiple Fourier linear combiner (BMFLC). As a feature of optical flow calculation, we use the simplified rotation-invariant histogram of oriented gradients (RIHOG) based on a gradient angle quantized to 1, 2, or 3 bits, which greatly reduces the usage of memory resources for a frame buffer. An obtained optical flow map is then divided into multiple blocks, and BMFLC is applied to the mean optical flow of each block independently. By using the L1-norm of adaptive weight vectors in BMFLC as a criterion, blocks belonging to vibrating objects can be isolated from background at low cost, leading to better extraction accuracy compared to the previous system. The whole system for 480p and 720p resolutions can be implemented on a single Xilinx Zynq-7000 XC7Z020 FPGA without any external memory, and can process a video stream supplied directly from a camera at 60fps.", "subitem_description_type": "Abstract"}]}, "item_2_description_63": {"attribute_name": "引用", "attribute_value_mlt": [{"subitem_description": "IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, E106A(3), pp.504-513; 2023 ", "subitem_description_type": "Other"}]}, "item_2_publisher_33": {"attribute_name": "出版者", "attribute_value_mlt": [{"subitem_publisher": "Institute of Electronics Information Communication Engineers"}]}, "item_2_relation_12": {"attribute_name": "DOI", "attribute_value_mlt": [{"subitem_relation_type": "isIdenticalTo", "subitem_relation_type_id": {"subitem_relation_type_id_text": "10.1587/transfun.2022VLP0009", "subitem_relation_type_select": "DOI"}}]}, "item_2_rights_13": {"attribute_name": "権利", "attribute_value_mlt": [{"subitem_rights": "© 2023 The Institute of Electronics, Information and Communication Engineers."}]}, "item_2_source_id_7": {"attribute_name": "ISSN", "attribute_value_mlt": [{"subitem_source_identifier": "0916-8508", "subitem_source_identifier_type": "ISSN"}]}, "item_2_text_62": {"attribute_name": "出版者別言語", "attribute_value_mlt": [{"subitem_text_value": "電子情報通信学会"}]}, "item_2_version_type_16": {"attribute_name": "著者版フラグ", "attribute_value_mlt": [{"subitem_version_resource": "http://purl.org/coar/version/c_970fb48d4fbd8a85", "subitem_version_type": "VoR"}]}, "item_creator": {"attribute_name": "著者", "attribute_type": "creator", "attribute_value_mlt": [{"creatorNames": [{"creatorName": "MANABE, Taito"}], "nameIdentifiers": [{"nameIdentifier": "125195", "nameIdentifierScheme": "WEKO"}]}, {"creatorNames": [{"creatorName": "SHIBATA, Yuichiro"}], "nameIdentifiers": [{"nameIdentifier": "125196", "nameIdentifierScheme": "WEKO"}]}]}, "item_files": {"attribute_name": "ファイル情報", "attribute_type": "file", "attribute_value_mlt": [{"accessrole": "open_date", "date": [{"dateType": "Available", "dateValue": "2023-04-04"}], "displaytype": "detail", "download_preview_message": "", "file_order": 0, "filename": "IEICETFECCSE106.A_504.pdf", "filesize": [{"value": "2.1 MB"}], "format": "application/pdf", "future_date_message": "", "is_thumbnail": false, "licensetype": "license_free", "mimetype": "application/pdf", "size": 2100000.0, "url": {"label": "IEICETFECCSE106.A_504.pdf", "url": "https://nagasaki-u.repo.nii.ac.jp/record/28059/files/IEICETFECCSE106.A_504.pdf"}, "version_id": "be50fe5e-f854-491d-ae5d-e5c6b2fa9249"}]}, "item_keyword": {"attribute_name": "キーワード", "attribute_value_mlt": [{"subitem_subject": "optical flow", "subitem_subject_scheme": "Other"}, {"subitem_subject": "feature matching", "subitem_subject_scheme": "Other"}, {"subitem_subject": "BMFLC", "subitem_subject_scheme": "Other"}, {"subitem_subject": "FPGA", "subitem_subject_scheme": "Other"}, {"subitem_subject": "real-time", "subitem_subject_scheme": "Other"}]}, "item_language": {"attribute_name": "言語", "attribute_value_mlt": [{"subitem_language": "eng"}]}, "item_resource_type": {"attribute_name": "資源タイプ", "attribute_value_mlt": [{"resourcetype": "journal article", "resourceuri": "http://purl.org/coar/resource_type/c_6501"}]}, "item_title": "Real-Time Image-Based Vibration Extraction with Memory-Efficient Optical Flow and Block-Based Adaptive Filter", "item_titles": {"attribute_name": "タイトル", "attribute_value_mlt": [{"subitem_title": "Real-Time Image-Based Vibration Extraction with Memory-Efficient Optical Flow and Block-Based Adaptive Filter"}]}, "item_type_id": "2", "owner": "6", "path": ["2011"], "permalink_uri": "http://hdl.handle.net/10069/00042189", "pubdate": {"attribute_name": "公開日", "attribute_value": "2023-04-04"}, "publish_date": "2023-04-04", "publish_status": "0", "recid": "28059", "relation": {}, "relation_version_is_last": true, "title": ["Real-Time Image-Based Vibration Extraction with Memory-Efficient Optical Flow and Block-Based Adaptive Filter"], "weko_shared_id": -1}
Real-Time Image-Based Vibration Extraction with Memory-Efficient Optical Flow and Block-Based Adaptive Filter
http://hdl.handle.net/10069/00042189
http://hdl.handle.net/10069/00042189bb98fa17-3850-4c42-8797-7f5712207fa2
名前 / ファイル | ライセンス | アクション |
---|---|---|
IEICETFECCSE106.A_504.pdf (2.1 MB)
|
|
Item type | 学術雑誌論文 / Journal Article(1) | |||||
---|---|---|---|---|---|---|
公開日 | 2023-04-04 | |||||
タイトル | ||||||
タイトル | Real-Time Image-Based Vibration Extraction with Memory-Efficient Optical Flow and Block-Based Adaptive Filter | |||||
言語 | ||||||
言語 | eng | |||||
キーワード | ||||||
主題Scheme | Other | |||||
主題 | optical flow | |||||
キーワード | ||||||
主題Scheme | Other | |||||
主題 | feature matching | |||||
キーワード | ||||||
主題Scheme | Other | |||||
主題 | BMFLC | |||||
キーワード | ||||||
主題Scheme | Other | |||||
主題 | FPGA | |||||
キーワード | ||||||
主題Scheme | Other | |||||
主題 | real-time | |||||
資源タイプ | ||||||
資源タイプ識別子 | http://purl.org/coar/resource_type/c_6501 | |||||
資源タイプ | journal article | |||||
著者 |
MANABE, Taito
× MANABE, Taito× SHIBATA, Yuichiro |
|||||
抄録 | ||||||
内容記述タイプ | Abstract | |||||
内容記述 | In this paper, we propose a real-time vibration extraction system, which extracts vibration component within a given frequency range from videos in real time, for realizing tremor suppression used in microsurgery assistance systems. To overcome the problems in our previous system based on the mean Lucas-Kanade (LK) optical flow of the whole frame, we have introduced a new architecture combining dense optical flow calculated with simple feature matching and block-based band-pass filtering using band-limited multiple Fourier linear combiner (BMFLC). As a feature of optical flow calculation, we use the simplified rotation-invariant histogram of oriented gradients (RIHOG) based on a gradient angle quantized to 1, 2, or 3 bits, which greatly reduces the usage of memory resources for a frame buffer. An obtained optical flow map is then divided into multiple blocks, and BMFLC is applied to the mean optical flow of each block independently. By using the L1-norm of adaptive weight vectors in BMFLC as a criterion, blocks belonging to vibrating objects can be isolated from background at low cost, leading to better extraction accuracy compared to the previous system. The whole system for 480p and 720p resolutions can be implemented on a single Xilinx Zynq-7000 XC7Z020 FPGA without any external memory, and can process a video stream supplied directly from a camera at 60fps. | |||||
書誌情報 |
IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences 巻 E106.A, 号 3, p. 504-513, 発行日 2023-03-01 |
|||||
出版者 | ||||||
出版者 | Institute of Electronics Information Communication Engineers | |||||
出版者別言語 | ||||||
電子情報通信学会 | ||||||
ISSN | ||||||
収録物識別子タイプ | ISSN | |||||
収録物識別子 | 0916-8508 | |||||
DOI | ||||||
関連タイプ | isIdenticalTo | |||||
識別子タイプ | DOI | |||||
関連識別子 | 10.1587/transfun.2022VLP0009 | |||||
権利 | ||||||
権利情報 | © 2023 The Institute of Electronics, Information and Communication Engineers. | |||||
著者版フラグ | ||||||
出版タイプ | VoR | |||||
出版タイプResource | http://purl.org/coar/version/c_970fb48d4fbd8a85 | |||||
引用 | ||||||
内容記述タイプ | Other | |||||
内容記述 | IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, E106A(3), pp.504-513; 2023 |