åºç« ïŒããŒã¿ãšã³ãžãã¢ãªã³ã°ãšã¯ïŒ
ããŒã¿ãšã³ãžãã¢ãªã³ã°ãšã¯ã倧éã®ããŒã¿ãå¹ççã«åŠçããä¿åã管çãåæããããã®ã·ã¹ãã ãããã»ã¹ãèšèšã»éçºããåéã§ããããã°ããŒã¿ãããžãã¹æŠç¥ã®äžå¿çãªåœ¹å²ãæããçŸä»£ã«ãããŠããã®æè¡ã¯éåžžã«éèŠãšãããŠããŸãã
ããŒã¿ãšã³ãžãã¢ã¯ãããŒã¿ãµã€ãšã³ãã£ã¹ããããžãã¹ã¢ããªã¹ããå©çšããããŒã¿ã®è³ªãšã¢ã¯ã»ã¹æ§ãé«ããããšãç®æšã«ããŸãã圌ãã¯ããŒã¿ã®åéãå€æããããŠé ä¿¡ãæ ããåçš®ããŒã¿ããŒã¹ãããŒã¿ãŠã§ã¢ããŠã¹ã®æ§ç¯ãè¡ããŸãã
ãã®åéã¯çµ¶ããå€åããæ°ããããŒã«ãæè¡ãæ¥ã éçºãããŠããŸãããã®ãããããŒã¿ãšã³ãžãã¢ã¯ç¶ç¶çãªåŠç¿ãšæè¡ã®æŽæ°ãæ±ãããããããã§ãã·ã§ã³ãªã®ã§ãã
ããŒã¿ãšã³ãžãã¢ã®åœ¹å²ãšæ¥åå 容
ããŒã¿ãšã³ãžãã¢ã®äž»ãªåœ¹å²ã¯ãäŒæ¥ãããŒã¿ãè³ç£ãšããŠæå¹ã«æŽ»çšã§ããããã«ããããšã§ãã圌ãã¯ããŒã¿ã®åéãæœåºã転éãããŒãïŒETLããã»ã¹ïŒã«é¢ãããããŒã¿ãã¯ãªãŒã³ã¢ããããŠåæå¯èœãªåœ¢ã«æŽããŸãã
圌ãã®æ¥åå 容ã¯ãããŒã¿ããŒã¹ã®èšèšãšç®¡çãããŒã¿ãã€ãã©ã€ã³ã®æ§ç¯ãããŒã¿ã¬ã€ã¯ã®å®è£ ãããã«ã¯ããã°ããŒã¿åŠçãã©ãããã©ãŒã ãžã®ããŒã¿ã®çµ±åãšãã£ãæè¡çãªäœæ¥ãå«ãŸããŸããããŒã¿ã»ãã¥ãªãã£ãšãã©ã€ãã·ãŒã®ç¢ºä¿ãéèŠãªè²¬åã®äžã€ã§ãã
ãŸããããŒã¿ã€ã³ãã©ã®ããã©ãŒãã³ã¹ç£èŠããã©ãã«ã·ã¥ãŒãã£ã³ã°ãããŒã¿ãšã³ãžãã¢ã®è²¬ä»»ç¯å²ã«å ¥ããŸãããã®ããã«ããŒã¿ãšã³ãžãã¢ã¯ãããŒã¿ãæ±ãããã®åºç€ãç¯ããç¶æããããã«äžå¯æ¬ ãªååšã§ãã
æ¥çã§æ±ããããããŒã¿ãšã³ãžãã¢ã¹ãã«ã»ãã
ããŒã¿ãšã³ãžãã¢ã«æ±ããããã¹ãã«ã»ããã¯ãé«åºŠãªããã°ã©ãã³ã°èœåãããŒã¿ã¢ããªã³ã°ãããŒã¿ãŠã§ã¢ããŠãžã³ã°ãETLéçºãªã©ãäž»ã§ãã
å ·äœçã«ã¯ãPythonãJavaãScalaãªã©ã®ããã°ã©ãã³ã°èšèªã«å ããŠãSQLã«ããããŒã¿ããŒã¹æäœãHadoopãSparkãªã©ã®ããã°ããŒã¿åŠçãã¬ãŒã ã¯ãŒã¯ã®ç¥èãå¿ èŠãšãããŸãããã®ã¹ãã«ãæã€ããšã§ãè€éãªããŒã¿ãã€ãã©ã€ã³ãæ§ç¯ãã倧èŠæš¡ããŒã¿ã»ããã®åŠçãå¯èœã«ãªããŸãã
å ããŠãããŒã¿ãšã³ãžãã¢ã¯ã¯ã©ãŠããµãŒãã¹ïŒããšãã°AWSãAzureãGoogle Cloud PlatformïŒã®äœ¿çšçµéšãå¿ èŠãšãããŠããŸããããã«ã¯ãã¢ãžã£ã€ã«éçºæ¹æ³è«ãDevOpsã®ååã«æ £ããŠããããšãã圌ãã«æ±ããããã¹ãã«ãšããŠéèŠã§ãã
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã®ãã£ãªã¢ãã¹
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã¯éåžžã«å€æ§ãªãã£ãªã¢ãã¹ãæäŸããŠããŸããå€ãã®ããŒã¿ãšã³ãžãã¢ã¯ãä»ã®ãã¯ãããžãŒé¢é£ã®è·çš®ããã®è»¢è·è ã§ããããšãå€ããããããç°ãªãããã¯ã°ã©ãŠã³ããæã¡å¯ããŸãã
åçŽããŒã¿ãšã³ãžãã¢ããã¹ã¿ãŒãããŠãçµéšãç©ãããšã§ã·ãã¢ããªãŒãããŒã¿ãšã³ãžãã¢ãžãšã¹ãããã¢ããããããšãã§ããŸãã管çè·ãããŒã¿ã¢ãŒããã¯ãããããŠããŒã¿ãµã€ãšã³ã¹ãããŒã¿ã¢ããªãã£ã¯ã¹ã®æ¹é¢ãžã®é²åºãå¯èœã§ãã
ãŸããããŒã¿ãšã³ãžãã¢ãªã³ã°ã®ãã£ãªã¢ã¯éåžžã«éèŠãé«ããããŸããŸãªæ¥çã§ã®å°±è·æ©äŒããããŸããé«åºŠãªå°éç¥èãæã¡ãããžãã¹ã€ã³ãã¯ããããããããšãã§ããããããã®å ±é ¬ãéåžžã«é åçã§ãã
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã®å°æ¥æ§ãšåžå Žåå
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã®åžå Žã¯æ¥æé·ãéãããã®å°æ¥æ§ã¯éåžžã«é«ããšè©äŸ¡ãããŠããŸããäŒæ¥ã¯ããŒã¿ã«åºã¥ãã決å®ãäžãããšã§ç«¶äºåãç¶æããããšããŠããããã®ããã«ã¯ããŒã¿ãšã³ãžãã¢ã®å°éç¥èãäžå¯æ¬ ã§ãã
ããžã¿ã«å€é©ã®é²è¡ã«äŒŽããIoTããã€ã¹ããœãŒã·ã£ã«ã¡ãã£ã¢ãªã©å€æ§ãªããŒã¿ãœãŒã¹ããã®ããŒã¿ãæ¥å¢ããŠããããã®åŠçãšåæã®ããã®å°éæè¡ãããäžå±€éèŠãšãªã£ãŠããŠããŸããããŒã¿ãšã³ãžãã¢ãªã³ã°ã¯ããžãã¹ã€ã³ããªãžã§ã³ã¹ã顧客äœéšåäžã補åéçºãšãã£ãåéã«ãããŠãäžå¿çãªåœ¹å²ãæãããŠããŸãã
æçµçã«ãããŒã¿ãšã³ãžãã¢ãªã³ã°ã®åžå Žååã¯ãAIãæ©æ¢°åŠç¿ã®æè¡ã®é²æ©ã«ãã£ãŠãããã«ä¿é²ãããŠããŸãããã®ãããªæè¡ãããžãã¹ããã»ã¹ã«çµã¿èŸŒãŸããéãããŒã¿ãšã³ãžãã¢ã¯ãããã®æ°ããªã¢ããªã±ãŒã·ã§ã³ãæ¯ããããã®ããŒã¿ã¢ãŒããã¯ãã£ãç¯ãããšãæåŸ ãããŠããŸãã
第1ç« ïŒãããŒã¿ãšã³ãžã㢠ãããšãããšèšãããèæ¯
åžå Žã®é£œåãšç«¶äºæ¿å
è¿å¹Žãå€ãã®äŒæ¥ãããŒã¿é§ååã®ææ決å®ãéèŠããããã«ãªããããŒã¿ãšã³ãžãã¢ã®éèŠã¯äžæçã«é«ãŸã£ãããããããã®çµæãšããŠãåžå Žã«ã¯ããŒã¿ãšã³ãžãã¢ãããµããåžå Žã®é£œåãèŠãããããã«ãªã£ããçµæãšããŠãæ°ããè·ãæ±ããéã«ã¯ã以åããããã£ãšæ¿ãã競äºã«æã¡åããã°ãªããªãç¶æ³ãçãŸããŠããã
ããã«ãçŸåœ¹ã®ããŒã¿ãšã³ãžãã¢ã¯ãã®ç«¶äºãçãæ®ãããã«ãã¹ãã«ã»ããã®æ¡å ãšåžžã«ææ°ã®æè¡ååã«ã€ããŠåŠã³ç¶ããå¿ èŠãããããããéåžžã«å€§ããªè² æ ãšãªã£ãŠãããã¹ãã«ã®é³è åã¯ç®ã«èŠããéãã§é²è¡ããæç¶çãªèªå·±åçºãæ±ããããè·æ¥ã§ããããšããããããšãããšèšãããäžå ãšãªã£ãŠããã
ããã«ãæ°ããæè¡ãããŒã«ã次ã ãšåºçŸããäžã§ãã©ã®æè¡ã«æè³ãã¹ããã®å€æãé£ãããªã£ãŠãããå¿ èŠãªã¹ãã«ã»ãããé »ç¹ã«å€ããç°å¢ã§ã¯ãæ¥å以å€ã®æéã倧ããå²ããªããã°ãªããããã£ãªã¢ãç¶ããäžã§å€§ããªéå£ãšãªã£ãŠããã
æè¡ç°å¢ã®å€åãžã®å¯Ÿå¿å°é£
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã¯åžžã«é²åããåéã§ããããã䜿ãããŠããæè¡ãé »ç¹ã«å€ããããã®éãæè¡å€åã«é©å¿ããã®ã¯å®¹æã§ã¯ãªããå€ãã®ããŒã¿ãšã³ãžãã¢ããã®ããŒã¹ã«è¿œãã€ãããšã«ã¹ãã¬ã¹ãæããŠãããç¹ã«ã倧èŠæš¡ãªããŒã¿ã€ã³ãã©ã¹ãã©ã¯ãã£ãŒãæ§ç¯ã»ç¶æããæè¡ã®é²æ©ã¯éããã²ãšãã³åŠãã æè¡ãããã«æ代é ãã«ãªãããšãçãããªãã
äŸãã°ãããã°ããŒã¿åŠçã®ããã®ãã¬ãŒã ã¯ãŒã¯ãããŒã¿ããŒã¹ãã¯ãããžãŒã¯çµ¶ããã¢ããããŒããããŠãããæ°ããããŒãžã§ã³æ¯ã«æ°ããæ©èœãè¿œå ããããããã«å¯Ÿå¿ããããã«ã¯ãæ¥é ããæ¥çã®ååãè¿œããããåŠç¿ãšç¿çã«å°å¿µããããšãæ±ããããã
ãŸããã¯ã©ãŠãããŒã¹ã®ãœãªã¥ãŒã·ã§ã³ã®äœ¿çšãå¢å ããŠãããåŸæ¥ã®ãªã³ãã¬ãã¹ã®ã€ã³ãã©ã¹ãã©ã¯ãã£ãŒããã¯ã©ãŠããžã®ç§»è¡ã匷ããããããšãããããã®ãããªæ¥æ¿ãªç°å¢ã®å€åã¯ã粟ç¥çãªã ãã§ãªããæè¡çãªææŠã倧ãããããããšãããšèšãããèŠå ã«ãªã£ãŠããã
é·æéåŽåãšã¯ãŒã¯ã©ã€ããã©ã³ã¹ã®æ¬ åŠ
ããŒã¿ãšã³ãžãã¢ã¯ãã°ãã°ããããžã§ã¯ãã®æéãå€å€§ãªããŒã¿éã®åãæ±ããé«åºŠãªåé¡è§£æ±ºãæ±ãããããããé·æéåŽåã«é¥ãããšãå°ãªããªããéšééã§ã®é£æºãå¿ èŠãªã·ãã¥ãšãŒã·ã§ã³ãå€ããããã«ããã¹ã±ãžã¥ãŒã«ã®èª¿æŽãã¯ãŒã¯ã©ã€ããã©ã³ã¹ã®åŽ©å£ãåŒãèµ·ããåå ãšãªã£ãŠããã
ç¹ã«ããŒã¿ãã©ãã©ãå¢ãç¶ããçŸä»£ã«ãããŠã¯ãããŒã¿ã®åŠçãåæäœæ¥ã«ãããæéã¯å¢å ããäžæ¹ã§ãããããããã©ã€ããŒãã®æéã䟵é£ããçµæã«ç¹ãã£ãŠããããŸããç·æ¥æã®å¯Ÿå¿ãå¿ èŠãªå Žåãå€ããäºæãã¬ãã©ãã«ã«ããæ·±å€ã®äœæ¥ãçãããªãã
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã®æ¥åã¯é è³åŽåãå€ãã粟ç¥çãªç²åŽã倧ãããèªåã®æéã確ä¿ãããªãã¬ãã·ã¥ããæ©äŒãå°ãªãããã«ãè·æ¥ãšããŠã®é åãäœäžããŠããŸãããšãããããã®ç¹ãããããšãããšèŠåãããçç±ã®ã²ãšã€ãšãªã£ãŠããã
å°éæ§ã®é«ãã«ãããã£ãªã¢ã®å¶é
ããŒã¿ãšã³ãžãã¢ã¯å°éçãªç¥èãšæèœãæ±ããããè·çš®ã§ããããããé·æçãªãã£ãªã¢æ§ç¯ã«ãããŠå¶éãšãªãåŸããæ·±ãæè¡çå°éæ§ãæãŸãããããããŒã¿ãšã³ãžãã¢ããä»ã®è·çš®ãžã®è»¢è·ãå°é£ã§ããå Žåãå€ãã®ã ã
äŸãã°ãããŒã¿ãŠã§ã¢ããŠãžã³ã°ãETLããã»ã¹ãããŒã¿ãã€ãã³ã°ãªã©ã®å°éã¹ãã«ã¯éåžžã«äŸ¡å€ãããããä»æ¥çš®ã§ã¯çŽæ¥çãªå¿çšãé£ããããšããã°ãã°ã§ãããå€ãã®æéãç¹å®ã®æè¡ã«è²»ãããçµæããã®æè¡ãå»ãããèªèº«ããã®åéã«èå³ã倱ã£ããããå Žåããã£ãªã¢ã®åèšå®ã¯å®¹æã§ã¯ãªãã
ããã«ãããžãã¹ã®äžçã§ã¯æè¡ãããããžãã¹ã¹ãã«ãéèŠããåŸåããããå°éæè¡è ãšããŠã®çµéšã¯è±å¯ã§ãã£ãŠãããããžã¡ã³ãããªãŒããŒã·ãããšãã£ãã¹ãã«ãæ±ããããããžã·ã§ã³ãžã®ã·ããã¯å°é£ã§ããããšãåŸã ã«ããŠããããã®ãããªãã£ãªã¢ã®å¶éæ§ããããŒã¿ãšã³ãžãã¢ãšããè·æ¥ãåèãããçç±ãšãªã£ãŠããã
第2ç« ïŒããŒã¿ãšã³ãžãã¢ãç®æãããšã®ãã¡ãªãã
ç¶ç¶çãªåŠç¿ãšèªå·±æè³ã®å¿ èŠæ§
ããŒã¿ãšã³ãžãã¢ãšããè·çš®ã¯ãæè¡ãæ¥é²ææ©ã§é²åããŠããåéã§ãããã®ãããå°éç¥èãåžžã«ææ°ã®ç¶æ ã«ä¿ã€å¿ èŠããããŸããããã¯ãå®æçãªç ä¿®ãžã®åå ãæ°ããæè¡ã«é¢ããæžç±ããªã³ã©ã€ã³ã³ãŒã¹ã®è³Œå ¥ãªã©ãç¶ç¶çãªèªå·±æè³ãå¿ èŠã§ããããšãæå³ããŠããŸãã
ãŸããèªãã®ã¹ãã«ã»ãããã¢ããã°ã¬ãŒããç¶ãããšããç¹ã§ãæéçãªã³ãããã¡ã³ããæ±ããããŸããä»äºçµãããé±æ«ã«ãç¬åŠãè¡ããªã©ããã©ã€ããŒãã®æéãå²ãèŠæãå¿ èŠã«ãªããŸãã
ãã®ãããªç¶ç¶çãªåŠç¿ãšèªå·±æè³ãã¹ãã¬ã¹ãšæããããå ŽåãããŒã¿ãšã³ãžãã¢ã®è·ã«å°±ãããšãæ«æã«ã€ãªããå¯èœæ§ããããŸããããããã³ãããã¡ã³ãã«æ¶æ¥µçãªæ¹ã¯ãä»ã®ãã£ãªã¢ãã¹ãæ€èšããã®ãäžã€ã®éžæè¢ãããããŸããã
ãããžã§ã¯ãäŸåã§äžå®å®ãªè·æ¥å±æ
å€ãã®ããŒã¿ãšã³ãžãã¢ã¯ãããžã§ã¯ãããŒã¹ã§åããŠããŸããããã«ã¯ããªãŒã©ã³ã¹ãå¥çŽããŒã¹ã®ä»äºãå«ãŸãããããžã§ã¯ããçµããã°æ¬¡ã®ä»äºãæ¢ããªããã°ãªããªãäžå®å®ããåãã§ããŸãã
åå ¥é¢ã§ãããããžã§ã¯ãã«ãã£ãŠå ±é ¬ã倧ããç°ãªããããå®å®ããåå ¥ãæ±ãã人ã«ãšã£ãŠã¯äžé©åãªå ŽåããããŸããé·æã«ãããå¥çŽãå®æçãªã¯ã©ã€ã¢ã³ããç²åŸã§ããªãå Žåãçµæžçãªãã¬ãã·ã£ãŒãæããããšã§ãããã
äŒæ¥ã«æ£ç€Ÿå¡ãšããŠæå±ããŠããå Žåã§ããåžå ŽãäŒæ¥ã®ç¶æ³ã«ãã£ãŠã¯ãããžã§ã¯ããçªç¶ãã£ã³ã»ã«ãããå¯èœæ§ãããããããè·ã倱ããªã¹ã¯ã«çŽçµããããšããããŸãã
æè¡ã®ç§»ãå€ãããšã¹ãã«ã®é³è å
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã®äžçã§ã¯ã䜿ãããæè¡ãããŒã«ãéåžžã«æ©ãããŒã¹ã§æŽæ°ãããé©æ°ããç¶ããŠããŸããäŸãã°æ°å¹Žåã®äž»åæè¡ããä»ã§ã¯ãã§ã«å€ããã®ãšããŠæ±ãããããšãçãããããŸããã
ããã¯ãçŸåšäœ¿ãããªããæè¡ãèšèªãçæéã§é³è åããåžå ŽäŸ¡å€ã倱ããããããšãæå³ããŠããŸããã¹ãã«ã»ãããã³ã³ã¹ã¿ã³ãã«æŽæ°ããå€åã«è¿œãã€ããŠãããªããã°ãªããªããã¬ãã·ã£ãŒããããŸãã
ç¹ã«äžå 以äžã«ãªããšãæ°ããã¹ãã«ãç¿åŸããæéãåãã«ããããšããæ°åè ã«æŒãåºãããäžå®ãªã©ããã£ãªã¢ã®æç¶æ§ã«é¢ããå¿é äºãå¢ããŠããŸãã
é«ãã¹ãã¬ã¹ãšãã¬ãã·ã£ãŒ
ããŒã¿ãšã³ãžãã¢ã®è·ã¯é«åºŠãªå°éæ§ãèŠæ±ãããããšã«å ãã倧éã®ããŒã¿ãåŠçããåæãããšãã責任ãæ ããããéåžžã«ã¹ãã¬ã¹ãå€ãè·æ¥ã§ããããŒã¿ã®æ£ç¢ºæ§ãšã»ãã¥ãªãã£ã¯äŒæ¥ã«ãšã£ãŠæ¥µããŠéèŠã§ããããã¹ãèš±ãããªããã¬ãã·ã£ãŒãåžžã«ãããŸãã
ãŸããã¿ã€ããªçŽæããäºæãã¬ãã©ãã«ã«ãããªã³ã³ãŒã«å¯Ÿå¿ãªã©ãæéå€åŽåãå€ãããšãå ±åãããŠããŸããä»äºãšãã©ã€ããŒãã®ãã©ã³ã¹ã倧åã«ããæ¹ã«ã¯ããã®ãã©ã³ã¹ãåãããšãé£ããå ŽåããããŸãã
ããã«ãããŒã¿ã«åºã¥ããããžãã¹ã®ææ決å®ãå¢ããŠãããããçµæãåºãããã®ãã¬ãã·ã£ãŒãæ¥ã«æ¥ã«é«ãŸã£ãŠããŸãããã®ãããªç¶æ³ã§ã®ã¹ãã¬ã¹èæ§ã足ããªãå ŽåãããŒã¿ãšã³ãžãã¢ãšããŠã®åãæ¹ã«çåãæããå¯èœæ§ããããŸãã
第3ç« ïŒããŒã¿ãšã³ãžãã¢ã«ããããã£ãªã¢ã®å£
å°éã¹ãã«ãè¶ ããçµ±åçç¥èã®å¿ èŠæ§
ããŒã¿ãšã³ãžãã¢ããã£ãªã¢ãç¯ãã«ããããå°éçãªã¹ãã«ã ãã§ã¯äžååã§ãããšããçŸå®ããããŸããããã°ããŒã¿ã®äžçã¯åžžã«é²åããŠãããæè¡çãªããŠããŠã ãã§ã¯è¿œãã€ãããšãã§ããŸãããããžãã¹ã€ã³ããªãžã§ã³ã¹ãããŒã¿åæã®ç解ãšãã£ãçµ±åçç¥èãæ±ããããå°é家ã§ãããªãããå¹ åºãèŠéãæã€å¿ èŠããããŸãã
ããŒã¿ããŒã¹ç®¡çãETLåŠçãããŒã¿ã¢ããªã³ã°ã«é¢ããæ·±ãç解ã«å ããããŒã¿ã¬ããã³ã¹ãã»ãã¥ãªãã£å¯Ÿçã®ç¥èãäžå¯æ¬ ã§ãããããã®ããŒã¿ã«é¢ããæ³çèŠä»¶ãèŠå¶ã®å€åã«è¿ éã«é©å¿ããããšã¯ãããŒã¿ãšã³ãžãã¢ã«ãšã£ãŠå€§ããªææŠãšãªã£ãŠããŸãã
ããŒã¿ãµã€ãšã³ã¹ãšæ©æ¢°åŠç¿ãããããžãã¹ã«çµã¿èŸŒãŸããŠããäžã§ããããã®åéã®åºç€ãç解ããŠããªããã°ãããŒã¿ãšã³ãžãã¢ãšããŠã®äŸ¡å€ãèœãšããªãããã«ããçµå¶å±€ãšå¹æçã«ã³ãã¥ãã±ãŒã·ã§ã³ããšãèœåãå¿ èŠã«ãªããŸãã
ãããžã¡ã³ãããªãŒããŒã·ãããžã®éç
ããŒã¿ãšã³ãžãã¢ã§ãã£ãŠãããã£ãªã¢ãé²ããããã§ãªãŒããŒã·ããããããžã¡ã³ãèœåã¯é¿ããŠéããŸãããæè¡é¢ã ãã§ãªãããããžã§ã¯ãããªãŒãããããŒã ã管çããã¹ãã«ãæ±ããããããšããããããŸããããã«ã¯ãã³ãã¥ãã±ãŒã·ã§ã³èœåã察人é¢ä¿ã¹ãã«ãªã©ãæè¡çãªç¥èãè¶ ããèœåãéèŠã«ãªããŸãã
ããŒã¿ãããžã§ã¯ãã¯è€éã§ãããå€ãã®ã¹ããŒã¯ãã«ããŒãé¢ãã£ãŠãããããããŒã¿ãšã³ãžãã¢ã¯ããŒã å å€ã®èª¿æŽåœ¹ãšããŠã®åœ¹å²ãæããããšãæåŸ ãããã§ããããäžã«ã¯ããããžã¡ã³ãã®åœ¹å²ã«ã·ããããããšã§ãã£ãªã¢ã®è¿œæ±ãç¶ããããŒã¿ãšã³ãžãã¢ãããŸãããããã¯æè¡çãªæ¥åããé¢ããããšãæå³ãããããå šãŠã®äººã«ããŸãé©å¿ã§ããããã§ã¯ãããŸããã
ãªãŒããŒã·ãããã¬ãŒãã³ã°ãã³ãã¥ãã±ãŒã·ã§ã³ã¯ãŒã¯ã·ã§ãããªã©ãéããŠããããã®èœåã磚ãããšã§ãããŒã¿ãšã³ãžãã¢ã®ãã£ãªã¢ãã¹ã¯ããã«åºãããèŠããå¯èœæ§ããããŸãã
ãã£ãªã¢ãã§ã³ãžã®é£ãã
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã¯ç¹å®ã®ããŒã«ãæè¡ã«æ·±ãäŸåãããããã®ã¹ãã«ã¯éåžžã«å°éåãããŠããŸãããã®ãããä»ã®ITåéãžã®ãã£ãªã¢ãã§ã³ãžã転è·ã¯ãæ³å以äžã«å°é£ãªããšãå€ãã§ããä»ã®åéã®æ¥åã«ç§»è¡ããããã«ã¯ãæ°ããã¹ãã«ã»ãããåŠã³çŽãå¿ èŠããããããæéãšåŽåã倧ããªé害ãšãªããŸãã
äžæ¹ã§ãããŒã¿ãšã³ãžãã¢ãªã³ã°ã®çµéšã¯éåžžã«äŸ¡å€ããããšãããŠãããããŒã¿éèŠã®äŒæ¥ãå¢ããŠããçŸä»£ã§ã¯ãã¹ãã«ãå€ããªããªãããç¶ç¶çãªåŠç¿ãããŠããã°ãããŒã¿ãšã³ãžãã¢ãšããŠé·æçãªãã£ãªã¢ãç¯ãããšãå¯èœã§ãã
ãšã¯ãããæè¡ã®é²æ©ã®ã¹ããŒãã«ã€ããŠããããšã¯å€§å€ã§ãããåžžã«æ°ããæè¡ãèšèªãåŠã³ç¶ããå¿ èŠãããããããã¹ãã¬ã¹ãç²åŒã«ã€ãªããããšãå°ãªããããŸããããã£ãªã¢ãã§ã³ãžãèæ ®ããéã«ã¯ããããã®çŸå®ããã£ãããšç解ããŠããå¿ èŠããããŸãã
ããŒã¿ãšã³ãžãã¢ãšããŠã®åãæ¹ãšãã£ãªã¢ã®å€æ§æ§
ããŒã¿ãšã³ãžãã¢ã®åãæ¹ã¯ãçµç¹ã«ãã£ãŠå€§ããç°ãªããŸããããå Žæã§ã¯ãããžã§ã¯ãããŒã¹ã§å€æ§ãªããŒã¿ãœãŒã¹ã«è§Šããæ©äŒãããäžæ¹ãå¥ã®å Žæã§ã¯äžã€ã®ããŒã¿ãŠã§ã¢ããŠã¹ã®éçšã«å°å¿µããããšã«ãªããããããŸããããã®ãããè·å Žãéžã¶éã«ã¯ãèªåã®ãã£ãªã¢ç®æšãåãæ¹ã®çæ³ãšç §ããåãããããšãéèŠã§ãã
ããªãŒã©ã³ã¹ãã³ã³ãµã«ã¿ã³ããšããŠç¬ç«ããããšãäžã€ã®éžæè¢ã§ãããèªåã®ã¹ãã«ãåžå ŽäŸ¡å€ã«å€ãã€ã€ããã¬ãã·ãã«ãªãã£ãªã¢ãã¹ãè¿œæ±ããããšãã§ããŸãããã ããããã«ã¯èªå·±ç®¡çèœåãããžãã¹ã¹ãã«ãäžå¯æ¬ ãšãªããŸãã
ããã«ãåœéçãªçµéšãéããããæ°ããæ¥çã«ææŠãããããããšã«ãã£ãŠãããŒã¿ãšã³ãžãã¢ãšããŠã®ãã£ãªã¢ã¯å€åœ©ãªãã®ã«ãªãåŸãŸããæ¥çãæè¡ã絶ããå€åãç¶ããäžã§ãåŠç¿æ欲ãšæè»æ§ãæã¡ç¶ããããšããããŒã¿ãšã³ãžãã¢ã®æåãžã®éµãšèšããã§ãããã
第4ç« ïŒããŒã¿ãšã³ãžãã¢ãšããŠåã¡æãããã«
å¿ èŠãªã¹ãã«ã»ããã®ç¿åŸ
ããŒã¿ãšã³ãžãã¢ãšããŠæåããããã«ã¯ãåºç¯å²ã®æè¡çã¹ãã«ã身ã«ã€ããŠããããšãäžå¯æ¬ ã§ããããã°ã©ãã³ã°èšèªïŒPythonãScalaãªã©ïŒãããŒã¿ããŒã¹ç®¡çãããŒã¿ãã€ãã©ã€ã³ã®æ§ç¯ãETLïŒæœåºã»å€æã»èªã¿èŸŒã¿ïŒããã»ã¹ãã¯ã©ãŠããµãŒãã¹ã®å©çšãåºæ¬ãšãªããŸãããŸããããã°ããŒã¿æè¡ã«é¢ããç¥èãç¹ã«HadoopãSparkãªã©ã®ãã¬ãŒã ã¯ãŒã¯ã«ç²ŸéããŠããããšãéèŠã§ãã
ãããã®ã¹ãã«ãç¿åŸããããã«ã¯ããªã³ã©ã€ã³ã³ãŒã¹ãã¯ãŒã¯ã·ã§ãããå®éã®ãããžã§ã¯ããžã®åå ãªã©ãéããŠç¥èãæ·±ããå¿ èŠããããŸããå°éçãªèªèšŒããã°ã©ã ãååŸããããšããã¹ãã«ã蚌æããä¿¡é Œæ§ãé«ããã®ã«åœ¹ç«ã¡ãŸããå ããŠããªãŒãã³ãœãŒã¹ãããžã§ã¯ããžã®è²¢ç®ãGitHubã§ã®äœåã®å ¬éããå°éæè¡ã®å±ç€ºãšããŠæå¹ã§ãã
ããã«ãããŒã¿ãšã³ãžãã¢ã«æ±ããããã¹ãã«ã»ããã¯æ代ãšãšãã«é²åããŠããŸãããããã£ãŠãåºæ¬çãªã¹ãã«ã ãã§ãªããæ©æ¢°åŠç¿ã人工ç¥èœãããŒã¿ã»ãã¥ãªãã£ã«é¢ããç¥èãç¶ç¶ããŠç¿åŸããæŽæ°ããŠããããšã競äºåãç¶æããããã«å¿ èŠã§ãã
æ¥çãã¬ã³ãã®è¿œè·¡ãšèªå·±æŽæ°
æ¥çã®ãã¬ã³ãã¯çµ¶ããå€åããŠãããããŒã¿ãšã³ãžãã¢ãšããŠæŽ»èºãç¶ããããã«ã¯ããããã®å€åã«æè»ã«å¯Ÿå¿ããŠããããšãäžå¯æ¬ ã§ããæ°ããããŒã¿ã¹ãã¬ãŒãžæè¡ãã¯ã©ãŠããã©ãããã©ãŒã ã®é²åãããŒã¿åŠçã®ã¢ã«ãŽãªãºã ã®æ¹åãªã©ãå¹ åºããããã¯ãè¿œãç¶ããå¿ èŠããããŸãã
ãããå®çŸããããã«ã¯ãå®æçã«é¢é£ããå°éèªãèªãã ããé¢é£ããã³ã³ãã¡ã¬ã³ã¹ãã»ãããŒã«åå ãããããŠç¥èãæŽæ°ããããšãæ±ããããŸãããŸãããªã³ã©ã€ã³ãã©ãŒã©ã ããããã§ãã·ã§ãã«ãªãããã¯ãŒã¯ã掻çšããåæ¥è ãšã®äº€æµãéããŠææ°æ å ±ãå ±æããããšã倧åã§ãã
èªå·±æè²ã¯ããŒã¿ãšã³ãžãã¢ãªã³ã°åéã§ã®çåæŠç¥ã®äžéšã§ããæè¡ã®è¿ éãªåžåãšå¿çšãå¯èœã§ãããªãã°ãåžå Žã®éèŠãæºããããšãã§ãããã®çµæããã£ãªã¢ãã¹ã«ãããŠéèŠãªã¢ããã³ããŒãžãæã€ããšã«ãªããŸãã
ã¡ã³ã¿ã«ãã«ã¹ãšã¹ãã¬ã¹ç®¡ç
ããŒã¿ãšã³ãžãã¢ã®ä»äºã¯é«åºŠãªå°éç¥èãèŠããã ãã§ãªããæã«ã¯å³ããç· ãåããè€éãªåé¡ã«å¯ŸåŠããã¹ãã¬ã¹ã䌎ããŸãããã®ãããã¡ã³ã¿ã«ãã«ã¹ãšé©åãªã¹ãã¬ã¹ç®¡çã¯æ¥µããŠéèŠã§ããé·æéåŽåããããžã§ã¯ãã®ãã¬ãã·ã£ãŒããä»äºã®ããã©ãŒãã³ã¹ãæ¥åžžç掻ã«æªåœ±é¿ãäžããªãããã«çæããå¿ èŠããããŸãã
å¹æçãªã¹ãã¬ã¹ç®¡çãšããŠã¯ãé©åãªäŒæ¯ã®åãæ¹ãä»äºä»¥å€ã®æŽ»åãžã®åå ã身äœçãªéåã®å®è·µãªã©ããããŸãããŸããæé管çã®ã¹ãã«ãé«ããŠãä»äºãšãã©ã€ããŒãã®ãã©ã³ã¹ããšãããšããé·æçã«ããã©ãŒãã³ã¹ãç¶æããããã«ã¯äžå¯æ¬ ã§ãã
ããã«ãã¡ã³ã¿ã«ãã«ã¹ã®ãµããŒããšããŠã¯ãååãäžåžãå°é家ãšã®ã³ãã¥ãã±ãŒã·ã§ã³ã圹ç«ã¡ãŸããåé¡ãæ©ã¿ãå ±æãã察話ãéããŠè§£æ±ºçãèŠã€ããããšããã¹ãã¬ã¹ãã«ãªæéãä¹ãåãã®ã«å©ããšãªãã§ãããã
ãããã¯ãŒã¯æ§ç¯ãšãã£ãªã¢ã¢ããæŠç¥
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã¯å調æ§ãèŠæ±ãããåéã§ãããã®ãããåæ¥è ãé¢é£åéã®å°é家ãšã®ãããã¯ãŒã¯ãæ§ç¯ããããšã¯ãæ°ããªèŠç¹ãåŸããããã£ãªã¢ã¢ããã®æ©äŒãèŠã€ãããããããã§å€§ãã«åœ¹ç«ã¡ãŸããããæèãæã¡ãªãããå©ãåããæ å ±å ±æããããšã§ãé·æçãªãã£ãªã¢ãã¹ãç¯ãããšãã§ããã§ãããã
è·æ¥çãªãããã¯ãŒãã³ã°ã¯ãæ¥çã€ãã³ããäŒè°ãªã©ã§ãåºããããšãã§ããŸãããLinkedInããã®ä»ã®ãœãŒã·ã£ã«ã¡ãã£ã¢ãã©ãããã©ãŒã ãéããŠç©æ¥µçã«é¢ä¿ãç¯ãããšãæçã§ãããããã®ãã©ãããã©ãŒã ã¯ããã£ãªã¢ã®å¯èœæ§ãæ¢ãããã ãã§ãªããç¥èãåºããããã®æ å ±æºãšããŠã掻çšã§ããŸãã
æçµçã«ã¯ããã£ãªã¢ã¢ããã®æŠç¥ãæ確ã«ããããšã倧åã§ããèªåã®åŒ·ã¿ãã¿ãŒã²ãããšããæ¥çãé·æçãªãã£ãªã¢ãŽãŒã«ãææ¡ããããã«åãããã¹ãã«ã®ç¿åŸãè³æ Œã®ååŸãããžã·ã§ã³ãžã®å¿åãªã©ãè¡ãããšã§ãããŒã¿ãšã³ãžãã¢ãšããŠã®æé·ãä¿ãããšãã§ããŸãã
çµè«ïŒããŒã¿ãšã³ãžãã¢ãç®æãã¹ããïŒ
ãã£ãªã¢ãšããŠã®ããŒã¿ãšã³ãžãã¢ãªã³ã°ã®å¯èœæ§ãã©ãæãããã¯ãæ±è·è ã®äŸ¡å€èŠ³ãšæåŸ ã«æ·±ãé¢ãã£ãŠããŸããããã§ã¯ãã®éãç®æãããšã®ããžãã£ããªåŽé¢ãšãäžéšã®äººã ãæå±ããæ éãªã¢ãããŒãã«ã€ããŠåæããå°æ¥çãªãã£ãªã¢éžæã®åèã«ããŸãã
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã¯è€éãªããŒã¿ã·ã¹ãã ã®æ§ç¯ã管çãæé©åãæ ãéèŠãªåœ¹å²ã§ãããé«ãæè¡åãåžžã«é²åãããã¯ãããžãŒã«è¿œãã€ãå¿ èŠæ§ããããŸãããã®åéã«ã¯ãã£ã¬ã³ãžã³ã°ãªåŽé¢ãå€ã ååšããŸãã
ããããå€å€§ãªåªåãšåŠç¿ã®æè³ãè¡ãããšã§ãããŒã¿ãšã³ãžãã¢ã¯è±ããªãã£ãªã¢å±éãèŠèŸŒãããšãå¯èœã§ãããã®èšäºãæåŸãŸã§ãèªã¿ããã ãããšã§ãããŒã¿ãšã³ãžãã¢ã®è·ã«å°±ãããšãããªãã«ãšã£ãŠæ£ããéžæãã©ãããèããäžå©ãšãªãã§ãããã
è·æ¥éžæãšåã ã®äŸ¡å€èŠ³
è·æ¥éžæã¯ãåã«åå ¥ãå®å®æ§ã ãã§ãªããåã ã®äŸ¡å€èŠ³ãç掻ç®æšãšãå¯æ¥ã«çµã³ã€ããŠããŸããããŒã¿ãšã³ãžãã¢ã¯æè¡çãªã¹ãã«ã解æçãªæèãé§äœ¿ããè·æ¥ã§ãããç¶ç¶çãªèªå·±åäžãæ±ããããããšãå€ãã§ãã
ãã人ã«ãšã£ãŠã¯ãããŒã¿ãæäœããã·ã¹ãã ãèšèšããåµé æ§ããããããšæããããã§ããããããããå¥ã®äººã«ã¯åãäœæ¥ãã«ãŒãã£ã³çã§éå±ã«æãããããããããŸãããåŸã£ãŠãèªåã楜ãããä»äºãã©ãããèŠæ¥µããããšã倧åã§ãã
ãŸããå¹ççãªåé¡è§£æ±ºãå³ãããã«ã¯ãããŒã å ã³ãã¥ãã±ãŒã·ã§ã³ãæ¬ ãããªãããã察人ã¹ãã«ã®éèŠæ§ãèŠéããŸããããã®ããã«ãèªåèªèº«ã®ç¹æ§ãšè·æ¥ã®èŠæ±ããã¹ãã«ãããããããã©ããããè·æ¥éžæã«ãããŠèæ ®ãã¹ãéèŠãªãã€ã³ãã«ãªããŸãã
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã®é åãšã¯ïŒ
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã¯ãããŒã¿é§ååã®ææ決å®ããµããŒãããããžãã¹ã€ã³ããªãžã§ã³ã¹ãé«ããæ ¹å¹¹æè¡ãšããŠã®é åããããŸããããŒã¿ãåæããæçãªæŽå¯ãçã¿åºãèœåã¯å€ãã®æ¥çã§äŸ¡å€ãæã£ãŠããŸãã
ããã°ããŒã¿ã®æ代ã«ãããŠãäŒæ¥ã¯èšå€§ãªæ å ±ãæ±ãããã«ããŒã¿ãšã³ãžãã¢ã®å°éç¥èãå¿ èŠãšããŠããŸããæè¡é²åã«äŒŽããæ°ããããŒã«ããœãããŠã§ã¢ãç»å ŽããããŒã¿ãšã³ãžãã¢ã®éèŠã¯çã é«ãŸã£ãŠããŸãã
ããã«ãããŒã¿ãšã³ãžãã¢ãªã³ã°ã¯å€æ§ãªæ¥çã§ã®æŽ»èºãæåŸ ã§ãããããé£èºçãªãã£ãªã¢ã¢ãããçããåéã§ããããŸããå匷ãšçµéšãç©ãããšã§ã責任ã®å€§ãã圹å²ãžãšã¹ãããã¢ããããéãéãããŠããã®ã§ãã
ããããšãããšãã声ãè¶ ããŠ
äžã«ã¯ãããŒã¿ãšã³ãžã㢠ãããšãããšãã声ãèŠåããããŸããããã¯ãç¶ç¶çãªåŠç¿ã®æ·±ãããæ°æè¡ã®åãå ¥ããå¿ èŠãšãããéé ·ãªæ¥çã®ååã«å¯ŸããŠã®èŠéã§ãã
ãããããããã®ææŠãä¹ãè¶ããããšã§ãåªããå°éç¥èãæã€ããŒã¿ãšã³ãžãã¢ã«ã¯ãåžå ŽäŸ¡å€ãå¢ããéžæè¢ãåºãããšããäºå®ããããŸããæè¡ã®æ¥éãªé²æ©ã«è¿œãã€ãããšã¯å°é£ãããããŸããããããã«å¯Ÿãã察å¿åãããã°ã倧ããªéææãåŸãããã§ãããã
äžæ¹ã§ããã¬ãã·ã£ãŒãã¹ãã¬ã¹ã«å¯Ÿããå人ã®ç®¡çèœåãéèŠèŠãããŸãã競äºãæ¿ãããåžžã«æå 端ãè¿œæ±ããå¿ èŠããããããã¡ã³ã¿ã«ã®åŒ·ããé©å¿åãå¿ é ãšãªããŸãã
ããŒã¿ãšã³ãžãã¢ãšããŠæåããããã®ç§èš£
ããŒã¿ãšã³ãžãã¢ãªã³ã°åéã§æåããããã«ã¯ãæè¡çã¹ãã«ã®åäžã ãã§ãªããããžãã¹ãžã®ç解ãå¿ èŠã§ããããŒã¿ããæå³ããæ å ±ãæœåºãããããããžãã¹æŠç¥ã«æŽ»ããããšãã§ããã°ãäŒæ¥ã«ãšã£ãŠäŸ¡å€ã®ãã人æãšãªããŸãã
ãŸããããŒã¿ãšã³ãžãã¢ãšããŠã®å°éæ§ãæ·±ãã€ã€ãæ°ããæè¡ãããŒã«ãžã®ç¿çãæ ããªãããã«ããããšãäžå¯æ¬ ã§ãããã®åéã¯åžžã«é²åããŠãããããåŠç¿æ欲ãæç¶ãããªããã°ãªããŸããã
ããã«ã¯ãã³ãã¥ãã±ãŒã·ã§ã³èœåãåæ§ã«éèŠãšãããŸããããŒã¿ãåãããããäŒããããŒã ãé¢é£éšéãšã®ååäœå¶ãç¯ãããšã§ããããžã§ã¯ãã®æåã«å€§ããè²¢ç®ããããšãã§ããã®ã§ãã
ãŸãšã
ããŒã¿ãšã³ãžãã¢ãªã³ã°ã®äžçã¯é åã«æºã¡ãŠããŸããããã®éã¯é£œååžå Žãæè¡ã®æ¿ããå€åããããŠç¶ãåŠç¿å¿ èŠæ§ãšãã£ãææŠãå«ãã§ããŸããæ¥çå ã§ã®é«ã競äºãé·æéåŽåããšã¯ãŒã¯ã©ã€ããã©ã³ã¹ã®æ¬ åŠã¯ããããŒã¿ãšã³ãžã㢠ãããšãããšããæèŠãåºãèæ¯ã§ããããã«ãæè¡ã®ç§»ãå€ããã¯ã¹ãã«ã®é³è åãæããé«ãã¹ãã¬ã¹ãšãã¬ãã·ã£ãŒã䌎ããŸãããã£ãªã¢ã®å£ãšããŠããããžã¡ã³ãã¹ãã«ã®ç¿åŸããã£ãªã¢ãã§ã³ãžã®é£ãããæããããŸããããããäžå¯æ¬ ãªã¹ãã«ç¿åŸãæ¥çãã¬ã³ãã®è¿œè·¡ãã¡ã³ã¿ã«ãã«ã¹ã®ç®¡çããããŠåŒ·åºãªãããã¯ãŒã¯æ§ç¯ã«ãããããŒã¿ãšã³ãžãã¢ãšããŠæåããéã¯éããŸããçµå±ãããã¯åã ã®äŸ¡å€èŠ³ãšè·æ¥éžæã«ãããŸãããé©åãªæºåãšé©å¿ãæåãžã®éµã§ãã