è¿å¹ŽãAIæè¡ã®é²æ©ã«ããã人ã®å§¿å¢ããªã¢ã«ã¿ã€ã ã«æšå®ã§ããããã«ãªããŸããããã®äžã§ãããªãŒãã³ãœãŒã¹ã®ã©ã€ãã©ãªã§ããOpenPoseã泚ç®ãéããŠããŸããOpenPoseã¯ãè€æ°äººã®å§¿å¢ãé«ç²ŸåºŠãã€é«éã«æšå®ã§ããç¹ãç¹åŸŽã§ããã§ã¯ãå ·äœçã«OpenPoseã¯ã©ã®ãããªå Žé¢ã§æŽ»çšãããŠããã®ã§ããããïŒæ¬èšäºã§ã¯ãã¹ããŒããå»çããšã³ã¿ãŒãã€ã¡ã³ããªã©æ§ã ãªåéã«ãããOpenPoseã®æŽ»çšäºäŸã培åºçã«è§£èª¬ããŸãããŸããOpenPoseã䜿ã£ãåäœåæã·ã¹ãã ãç°åžžåäœæ€ç¥ã·ã¹ãã ãã€ã³ã¿ã©ã¯ãã£ãã¢ããªã±ãŒã·ã§ã³ã®å®è£ äŸã玹ä»ããŸããOpenPoseã®å¯èœæ§ãšããããåãæãæªæ¥ã«ã€ããŠããã²ãäžèªãã ããã
OpenPoseãšã¯äœã
OpenPoseã®æŠèŠãšç¹åŸŽ
OpenPoseã¯ã人éã®å§¿å¢ãæšå®ãããªãŒãã³ãœãŒã¹ã®ã©ã€ãã©ãªã§ãããªã¢ã«ã¿ã€ã ã§äººäœã®äž»èŠãªé¢ç¯ç¹ãæ€åºãã姿å¢ãæšå®ããããšãã§ããŸããOpenPoseã¯ãCMUã®ç 究ã°ã«ãŒãã«ãã£ãŠéçºããã2017幎ã«å ¬éãããŸããã
OpenPoseã®äž»ãªç¹åŸŽã¯ä»¥äžã®éãã§ãã
- ãªã¢ã«ã¿ã€ã ã§ã®å§¿å¢æšå®ãå¯èœ
- è€æ°äººã®å§¿å¢ãåæã«æšå®å¯èœ
- é«ç²ŸåºŠãªå§¿å¢æšå®ãå¯èœ
- GPUã䜿çšããããšã§é«éåŠçãå¯èœ
- C++ãPythonãMATLABãªã©æ§ã ãªèšèªã«å¯Ÿå¿
OpenPoseã¯ã人äœã®äž»èŠãªé¢ç¯ç¹ãæ€åºããããããç·ã§çµã¶ããšã§å§¿å¢ãæšå®ããŸããæ€åºå¯èœãªé¢ç¯ç¹ã¯ãé ãéŠãè©ãèãæéŠãè °ãèã足éŠãªã©åèš25ç¹ãããŸãããŸããé¡ã®ã©ã³ãããŒã¯ãæã®é¢ç¯ç¹ãæ€åºå¯èœã§ãã
OpenPoseã®ä»çµã¿ãšåã
OpenPoseã¯ã深局åŠç¿ãçšãã姿å¢æšå®ææ³ã®äžã€ã§ããå ·äœçã«ã¯ãConvolutional Pose Machines (CPMs)ãšããã¢ãŒããã¯ãã£ã䜿çšããŠããŸããCPMsã¯ãç³ã¿èŸŒã¿ãã¥ãŒã©ã«ãããã¯ãŒã¯ïŒCNNïŒãè€æ°æ®µéããããšã§ãé¢ç¯ç¹ã®äœçœ®ãæšå®ããŸãã
OpenPoseã®åŠçã®æµãã¯ä»¥äžã®éãã§ãã
- å ¥åç»åãCNNã«éããç¹åŸŽããããæœåº
- ç¹åŸŽããããããåé¢ç¯ç¹ã®ç¢ºä¿¡åºŠããããšéšäœéã®é¢ä¿æ§ãè¡šã2次å ãã¯ãã«å Žãæšå®
- 確信床ããããš2次å ãã¯ãã«å Žãããåé¢ç¯ç¹ã®äœçœ®ãæšå®
- æšå®ãããé¢ç¯ç¹ãç·ã§çµã¶ããšã§ã姿å¢ãæšå®
OpenPoseã¯ãè€æ°ã®å§¿å¢ãåæã«æšå®ããããšãã§ããŸããããã¯ãå ¥åç»åå ã®å šãŠã®äººç©ã«å¯ŸããŠãåæã«å§¿å¢æšå®ãè¡ãããšãã§ããããã§ãããŸããOpenPoseã¯ãGPUã䜿çšããããšã§é«éã«åŠçãè¡ãããšãã§ããŸãã
OpenPoseãä»ã®å§¿å¢æšå®ææ³ãšç°ãªãç¹
OpenPoseã¯ãä»ã®å§¿å¢æšå®ææ³ãšæ¯èŒããŠãããã€ãã®ç¹åŸŽããããŸãã
ãŸããOpenPoseã¯ãè€æ°äººã®å§¿å¢ãåæã«æšå®å¯èœãªç¹ã倧ããªç¹åŸŽã§ããä»ã®ææ³ã®å€ãã¯ãåäžã®äººç©ã®å§¿å¢æšå®ã«ç¹åããŠãããããè€æ°äººãåã£ãŠããç»åã«å¯ŸããŠã¯é©çšãé£ããã§ãããOpenPoseã¯ãããå¯èœã§ãã
ãŸããOpenPoseã¯ãé¢ç¯ç¹ã®äœçœ®ã ãã§ãªããé¢ç¯ç¹éã®é¢ä¿æ§ãèæ ®ããŠããç¹ãç¹åŸŽçã§ããããã«ãããããæ£ç¢ºãªå§¿å¢æšå®ãå¯èœãšãªã£ãŠããŸãã
ããã«ãOpenPoseã¯ãGPUã䜿çšããããšã§é«éåŠçãå¯èœãªç¹ã倧ããªç¹åŸŽã§ãããªã¢ã«ã¿ã€ã ã§ã®å§¿å¢æšå®ãè¡ãããã«ã¯ãé«éãªåŠçãäžå¯æ¬ ã§ãããOpenPoseã¯GPUã掻çšããããšã§ãããå®çŸããŠããŸãã
å ããŠãOpenPoseã¯ããªãŒãã³ãœãŒã¹ã§å ¬éãããŠããããã誰ã§ãèªç±ã«äœ¿çšã»æ¹å€ãå¯èœãªç¹ãç¹åŸŽã®äžã€ã§ããããã«ãããæ§ã ãªåéã§ã®æŽ»çšãæåŸ ãããŠããŸãã
OpenPoseã®å¿çšåé
OpenPoseã¯ããã®é«ã粟床ãšæè»æ§ãããæ§ã ãªåéã§æŽ»çšãããŠããŸããããã§ã¯ãã¹ããŒããå»çããšã³ã¿ãŒãã€ã¡ã³ãã®3ã€ã®åéã«ãããOpenPoseã®æŽ»çšäºäŸã玹ä»ããŸãã
ã¹ããŒãåéã«ãããOpenPoseã®æŽ»çš
ã¹ããŒãåéã§ã¯ãéžæã®ããã©ãŒãã³ã¹åæãæªæã®äºé²ãªã©ã«ãOpenPoseã掻çšãããŠããŸãã
äŸãã°ãéžäžç«¶æã§ã¯ãOpenPoseã䜿ã£ãŠéžæã®èµ°è¡ãã©ãŒã ãåæããããšã§ãããå¹æçãªãã¬ãŒãã³ã°æ¹æ³ãèæ¡ããããšãã§ããŸãããŸããçæã¹ããŒãã§ã¯ãéžæã®åãã远跡ã»åæããããšã§ãæŠè¡ã®æ¹åã«åœ¹ç«ãŠãããšãã§ããŸãã
ããã«ãOpenPoseã䜿ã£ãŠéžæã®åäœãåæããããšã§ãæªæã®ãªã¹ã¯ãæ©æã«çºèŠããäºé²ããããšãå¯èœã§ããäŸãã°ãæçåäœãªã©ã®ç¹°ãè¿ãåäœãåæãããã©ãŒã ã®ä¹±ããæ€åºããããšã§ãèãè©ã®æªæãäºé²ã§ããå¯èœæ§ããããŸãã
å®éã«ãããéçããµãã«ãŒãªã©ã®çŸå Žã§ããOpenPoseã掻çšããéžæã®åäœåæãè¡ããå§ããŠããŸããä»åŸãã¹ããŒãåéã§ã®OpenPoseã®æŽ»çšã¯ãããã«åºãã£ãŠãããšäºæ³ãããŸãã
å»çåéã«ãããOpenPoseã®æŽ»çš
å»çåéã§ã¯ããªãããªããŒã·ã§ã³ãæè¡æ¯æŽãªã©ãæ§ã ãªå Žé¢ã§OpenPoseã掻çšãããŠããŸãã
ãªãããªããŒã·ã§ã³ã§ã¯ãOpenPoseã䜿ã£ãŠæ£è ã®åäœãåæããããšã§ãé©åãªãªãããªããã°ã©ã ãäœæããããšãã§ããŸããäŸãã°ãè³åäžã®æ£è ã®ãªãããªã§ã¯ãOpenPoseã§æ£è ã®æ©è¡åäœãåæãããã©ã³ã¹ãæ©å¹ ãªã©ã®åé¡ç¹ãç¹å®ããããšã§ãããå¹æçãªãªãããªãå¯èœã«ãªããŸãã
ãŸããæè¡æ¯æŽã®åéã§ããOpenPoseã掻çšããå§ããŠããŸããæè¡äžã«ãOpenPoseã䜿ã£ãŠå»åž«ã®æã®åãã远跡ããããšã§ãããæ£ç¢ºã§å®å šãªæè¡ãå¯èœã«ãªããŸããããã«ãæè¡ã®ã·ãã¥ã¬ãŒã·ã§ã³ã«ãOpenPoseã掻çšãããŠããŸãã
ä»ã«ããé«éœ¢è ã®èŠå®ãã·ã¹ãã ãããªã¢ãŒã蚺çã§ã®æ£è ã®ç¶æ ææ¡ãªã©ãå»çåéã§ã®OpenPoseã®æŽ»çšå¯èœæ§ã¯åºãã£ãŠããŸããOpenPoseã掻çšããããšã§ããã質ã®é«ãå»çãµãŒãã¹ã®æäŸãæåŸ ã§ããŸãã
ãšã³ã¿ãŒãã€ã¡ã³ãåéã«ãããOpenPoseã®æŽ»çš
ãšã³ã¿ãŒãã€ã¡ã³ãåéã§ã¯ãã²ãŒã ãã¢ãã¡ãŒã·ã§ã³ãVRãªã©ãæ§ã ãªå Žé¢ã§OpenPoseã掻çšãããŠããŸãã
ã²ãŒã å¶äœã§ã¯ãOpenPoseã䜿ã£ãŠã¢ãŒã·ã§ã³ãã£ããã£ãŒãè¡ãããšã§ãããèªç¶ã§ãªã¢ã«ãªãã£ã©ã¯ã¿ãŒã®åããè¡šçŸããããšãã§ããŸãããŸãããã¬ã€ã€ãŒã®åããOpenPoseã§èªèããããšã§ãã€ã³ã¿ã©ã¯ãã£ããªã²ãŒã äœéšãæäŸããããšãå¯èœã§ãã
ã¢ãã¡ãŒã·ã§ã³å¶äœã§ã¯ãOpenPoseã䜿ã£ãŠäººã®åããåæã»ãã¬ãŒã¹ããããšã§ãããçååãããå¶äœããã»ã¹ãå®çŸã§ããŸããããã«ãOpenPoseã§åŸãããããŒã¿ãåºã«ãCGãã£ã©ã¯ã¿ãŒãèªç¶ã«åããããšãå¯èœã§ãã
VRã®åéã§ããOpenPoseã掻çšãããŠããŸããOpenPoseã䜿ã£ãŠãŠãŒã¶ãŒã®åããèªèããããšã§ãããã€ã³ã¿ã©ã¯ãã£ããªVRäœéšãæäŸããããšãã§ããŸããäŸãã°ããŠãŒã¶ãŒã®æã®åããèªèããVR空éå ã§ã®ãã³ããã©ããã³ã°ãå®çŸããããšã§ãèªç¶ãªæäœæãå®çŸã§ããŸãã
ãŸããã©ã€ãããã©ãŒãã³ã¹ã§ããOpenPoseã掻çšããå§ããŠããŸããããã©ãŒããŒã®åãããªã¢ã«ã¿ã€ã ã§èªèããããã«åãããŠç §æãæ åãé³é¿ãªã©ãã³ã³ãããŒã«ããããšã§ãããã€ã³ã¿ã©ã¯ãã£ããªã©ã€ãããã©ãŒãã³ã¹ãå¯èœã«ãªããŸãã
ãšã³ã¿ãŒãã€ã¡ã³ãåéã§ã¯ãOpenPoseã掻çšããããšã§ãããæ²¡å ¥æã®é«ãäœéšãæäŸããããšãã§ããŸããä»åŸãOpenPoseã®æŽ»çšã«ãã£ãŠãããã«é©æ°çãªãšã³ã¿ãŒãã€ã¡ã³ããçã¿åºãããŠããããšã§ãããã
OpenPoseã䜿ã£ãå ·äœçãªå®è£ äŸ
OpenPoseã䜿ã£ãåäœåæã·ã¹ãã ã®æ§ç¯
OpenPoseã掻çšããå ·äœçãªå®è£ äŸã®äžã€ããåäœåæã·ã¹ãã ã®æ§ç¯ã§ããOpenPoseãçšããããšã§ã人ã®åäœããªã¢ã«ã¿ã€ã ã§åæãããã®çµæãå¯èŠåããããšãã§ããŸããããã¯ãã¹ããŒãéžæã®ããã©ãŒãã³ã¹åäžãããªãããªããŒã·ã§ã³ã®å¹æ枬å®ãªã©ãæ§ã ãªåéã§æŽ»çšã§ããŸãã
äŸãã°ããŽã«ãã®ã¹ã€ã³ã°åäœã®åæã«ãOpenPoseã掻çšããããšãã§ããŸããOpenPoseã§ãŽã«ãã¡ãŒã®ã¹ã€ã³ã°åäœãåæããããšã§ãã¹ã€ã³ã°ã®åå±é¢ã§ã®äœã®åãã詳现ã«ææ¡ã§ããŸããããã«ãããã³ãŒããéžæã¯ãã¹ã€ã³ã°ã®åé¡ç¹ãç¹å®ããæ¹åã®ããã®ã¢ããã€ã¹ãè¡ãããšãã§ããŸãã
ãŸãããªãããªããŒã·ã§ã³ã®åéã§ããOpenPoseã掻çšããåäœåæã·ã¹ãã ãæçšã§ããæ£è ã®åäœãOpenPoseã§åæããããšã§ããªãããªã®å¹æãå®éçã«è©äŸ¡ã§ããŸããããã«ãããé©åãªãªãããªããã°ã©ã ã®äœæãããªãããªã®é²æç¶æ³ã®ææ¡ãå¯èœã«ãªããŸãã
OpenPoseã䜿ã£ãåäœåæã·ã¹ãã ã¯ã以äžã®ãããªæµãã§æ§ç¯ã§ããŸãã
- åäœãæ®åœ±ããããã®ã«ã¡ã©ã·ã¹ãã ãèšçœ®
- OpenPoseãçšããŠãæ®åœ±ããåç»ãã人ã®å§¿å¢ãæšå®
- æšå®ããã姿å¢ããŒã¿ãåæããå¿ èŠãªæ å ±ãæœåº
- åæçµæãå¯èŠåãããŠãŒã¶ãŒã«æ瀺
ãã®ãããªã·ã¹ãã ãæ§ç¯ããããšã§ã人ã®åäœããã詳现ã«åæããæ§ã ãªåéã§ã®æŽ»çšãæåŸ ã§ããŸãã
OpenPoseã䜿ã£ãç°åžžåäœæ€ç¥ã·ã¹ãã ã®æ§ç¯
OpenPoseã掻çšããããäžã€ã®å®è£ äŸããç°åžžåäœæ€ç¥ã·ã¹ãã ã®æ§ç¯ã§ããå·¥å Žã®è£œé ã©ã€ã³ããå ¬å ±ã®å Žãªã©ãæ§ã ãªå Žé¢ã§ã人ã®ç°åžžãªåããæ€ç¥ããããšãæ±ããããŠããŸããOpenPoseãçšããããšã§ããã®ãããªç°åžžåäœæ€ç¥ã·ã¹ãã ãæ§ç¯ããããšãã§ããŸãã
äŸãã°ãå·¥å Žã®è£œé ã©ã€ã³ã§ã¯ãäœæ¥è ã®åäœãåžžæã¢ãã¿ãªã³ã°ããç°åžžãªåããæ€ç¥ããããšãéèŠã§ããOpenPoseãçšããŠäœæ¥è ã®åäœãåæããããšã§ãéåžžãšã¯ç°ãªãåããèªåçã«æ€åºã§ããŸããããã«ãããäœæ¥è ã®å®å šæ§ã確ä¿ããäºæ ãæªç¶ã«é²ãããšãã§ããŸãã
ãŸããå ¬å ±ã®å Žã§ã®äžå¯©è ã®æ€ç¥ã«ããOpenPoseã掻çšã§ããŸãã人ã®åããOpenPoseã§ãªã¢ã«ã¿ã€ã ã«åæããããšã§ãä»ã®äººãšã¯ç°ãªãäžèªç¶ãªåããæ€ç¥ã§ããŸããããã«ãããæœåšçãªè åšãæ©æã«çºèŠããé©åãªå¯Ÿå¿ãåãããšãå¯èœã«ãªããŸãã
OpenPoseã䜿ã£ãç°åžžåäœæ€ç¥ã·ã¹ãã ã¯ã以äžã®ãããªæµãã§æ§ç¯ã§ããŸãã
- ç£èŠã«ã¡ã©ãèšçœ®ãã人ã®åããåžžææ®åœ±
- OpenPoseãçšããŠãæ®åœ±ããåç»ãã人ã®å§¿å¢ãæšå®
- æšå®ããã姿å¢ããŒã¿ãåæããç°åžžãªåããæ€ç¥
- ç°åžžãæ€ç¥ãããå ŽåãèŠåãã¢ã©ãŒããçºä¿¡
ãã®ãããªã·ã¹ãã ãæ§ç¯ããããšã§ãæ§ã ãªå Žé¢ã§äººã®å®å šæ§ã確ä¿ããäºæ ãç¯çœªãæªç¶ã«é²ãããšãæåŸ ã§ããŸãã
OpenPoseã䜿ã£ãã€ã³ã¿ã©ã¯ãã£ãã¢ããªã±ãŒã·ã§ã³ã®éçº
OpenPoseã掻çšããå®è£ äŸã®äžã€ç®ããã€ã³ã¿ã©ã¯ãã£ãã¢ããªã±ãŒã·ã§ã³ã®éçºã§ããOpenPoseãçšããããšã§ã人ã®åããèªèããããã«å¿ããŠã¢ããªã±ãŒã·ã§ã³ãå¶åŸ¡ããããšãã§ããŸããããã«ãããããçŽæçã§æ²¡å ¥æã®é«ããŠãŒã¶ãŒäœéšãæäŸã§ããŸãã
äŸãã°ãã²ãŒã ã¢ããªã±ãŒã·ã§ã³ã§ã¯ãOpenPoseã䜿ã£ãŠãã¬ã€ã€ãŒã®åããèªèããã²ãŒã å ã®ãã£ã©ã¯ã¿ãŒãæäœããããšãã§ããŸãããã¬ã€ã€ãŒã®åããOpenPoseã§ãªã¢ã«ã¿ã€ã ã«åæãããã®åãã«åãããŠãã£ã©ã¯ã¿ãŒãåããããšã§ãããçŽæçãªã²ãŒã æäœãå¯èœã«ãªããŸãã
ãŸããã€ã³ã¿ã©ã¯ãã£ãã¢ãŒãã®åéã§ããOpenPoseã掻çšãããŠããŸããéè³è ã®åããOpenPoseã§èªèããããã«å¿ããŠã¢ãŒãäœåãå€åãããããšã§ãéè³è ãšã¢ãŒãäœåã®æ°ããé¢ä¿æ§ãç¯ãããšãã§ããŸããããã«ãããããèœåçã§æ²¡å ¥æã®é«ãã¢ãŒãäœéšãæäŸã§ããŸãã
OpenPoseã䜿ã£ãã€ã³ã¿ã©ã¯ãã£ãã¢ããªã±ãŒã·ã§ã³ã¯ã以äžã®ãããªæµãã§éçºã§ããŸãã
- ãŠãŒã¶ãŒã®åããæ®åœ±ããããã®ã«ã¡ã©ã·ã¹ãã ãèšçœ®
- OpenPoseãçšããŠãæ®åœ±ããåç»ãããŠãŒã¶ãŒã®å§¿å¢ãæšå®
- æšå®ããã姿å¢ããŒã¿ãåæããã¢ããªã±ãŒã·ã§ã³ã®å¶åŸ¡ä¿¡å·ãçæ
- å¶åŸ¡ä¿¡å·ã«åºã¥ããŠãã¢ããªã±ãŒã·ã§ã³ãåçã«å€åããã
ãã®ãããªã¢ããªã±ãŒã·ã§ã³ãéçºããããšã§ããŠãŒã¶ãŒã®åããçŽæ¥çã«ã¢ããªã±ãŒã·ã§ã³ã«åæ ãããããšãã§ããããçŽæçã§æ²¡å ¥æã®é«ããŠãŒã¶ãŒäœéšãæäŸã§ããŸãã
以äžã®ããã«ãOpenPoseã掻çšããããšã§ãåäœåæãç°åžžåäœæ€ç¥ãã€ã³ã¿ã©ã¯ãã£ãã¢ããªã±ãŒã·ã§ã³ãªã©ãæ§ã ãªåéã§ã®å®è£ ãå¯èœã§ããOpenPoseã®æè»æ§ãšé«ã粟床ã掻ããããšã§ããããŸã§ã«ãªãé©æ°çãªã·ã¹ãã ãã¢ããªã±ãŒã·ã§ã³ãéçºã§ããã§ããããä»åŸãOpenPoseã掻çšããæ°ããªäºäŸãç»å ŽããããšãæåŸ ãããŸãã
ãŸãšã
OpenPoseã¯ããªã¢ã«ã¿ã€ã ã§è€æ°äººã®å§¿å¢ãé«ç²ŸåºŠã«æšå®ã§ãããªãŒãã³ãœãŒã¹ã©ã€ãã©ãªã§ããã¹ããŒãéžæã®ããã©ãŒãã³ã¹åæãå»ççŸå Žã§ã®ãªãããªæ¯æŽãã²ãŒã ãã¢ãã¡ãŒã·ã§ã³å¶äœãªã©ãå¹ åºãåéã§æŽ»çšãããŠããŸããOpenPoseã䜿ã£ãåäœåæã·ã¹ãã ãç°åžžåäœæ€ç¥ã·ã¹ãã ãã€ã³ã¿ã©ã¯ãã£ãã¢ããªã±ãŒã·ã§ã³ã®éçºäºäŸãå¢ããŠããŠããããã®å¯èœæ§ã¯ç¡é倧ã§ããä»åŸãOpenPoseã®æŽ»çšãé²ã¿ãæ§ã ãªåéã«é©æ°ãããããããšãæåŸ ãããŸãã