Introduction to MCMC * Petros Dellaportas and Gareth O. Roberts ...

)R¹ + û)Ý¢«Ê¡y¢«f¥ž¨V±©§º®žÝ‚0­f¢_§Ê¢-²Â°y±V¢:} À:} £ s{z ó›ü uy¨Ÿª³«Ê¡a¢I«f¥q¨Ÿ±©§7-_«Ê¡a¢_ª±V¨Ÿ¬ž¡¢«í«M¥q¨Ÿ±V¢!ØÙ¢«f­Ê®¯+®±V¨©§$ā­f®ž¯/®§f¥q±©§$±V¢!¥ž«Ê®Z¥ž±V¬®ž­f¨¸«f¡a²§ÄÄ¤ß ±AœÎ ŽŒ;‘7P“rÛb‘ ,²AJŒ;±Aç ÚV²A” æ o ‘7“ƒ,±§Íœ±A”–Ž3ÎÓ±/ Ûb‘w²AÜ9•¦“Ô²/Ž ”©‘wŒ¦“Ô²/ µ‘6“ Œ¥‘6œÎwŽ “ƒŽ‘6ΘΠ´œ’wÛ ²?Θ“rÛb‘gºòaôöõ¦óRæÙ÷²/´œ’§Û8•PŒ/Ž3Îw“ƒ ŽÝ7´8“ Ž±/bÕ Ú£Ûb‘7,‘ˆÚV‘DZMßw“Ô‘7 Ûœ²AÜA‘&“rÛb‘ÁÍš§±§Íœ‘6 “ƒ•D“rÛb²/“ѱŸ¨Ÿ² ÀŸž UW ‚a).À  l + ¬?‚a)©À + oü‚;Õß6±/ˆ²/” ”ßÄ')( ƒ ( ƒ5‡+*Ĉt„, Š ´)R¥ + k ®ž­Â«f¥ž­Ê¬¢«ca¢-ªy§Ê¨¸«f¨V¢!§ÂÐ]¨V«Ê¡ «f¥ž¨V±©§Â¼yªa¨¸Ý€®­Ê²0±Ÿ¦;°+®¼aªy·¢!Ó°{¦ ¢-Ç·¯+®ªa¢-ª¢«Ê¨©¥q±©§¤¨Vª ¥ž±V±†·¨Ÿ­Ê¢!¹X«f¨V®ªy§7-­M¥qª+·®ž²ÐÑ¥ž±VÒîªa¢¹®žª+·¨¸«f¨V®ªØÙ¢«f­Ê®¯+®±V¨©§Â¨©§c¬ž¢_®ž²0¢«f­Ê¨©¹-¥ž±V±Ÿ¦;¢-­f¬ž®··¨©¹¥ž§c±Ÿ®žªa¬;¥ž§¤«f¡a¢-¨Ÿ­c«f¥q¨Ÿ±©§c¥ž­Ê¢ì§T¼bɹ-¨V¢_ª¢«Ê±Ÿ¦ö­Ê¢_¬ž¼a±©¥q­!«Ê® ¡y¥@Ꞣé¹-¼a­Êê.¥q«Ê¼a­f¢éÐ]¡a¨©¹M¡Ð]¡a¨Ÿ¹M¡ï¨©§ì§T¼8É=¹-¨V¢_ª«Ý€®ž­=«f¡a¨©§­f¢@2¢¼a¨Ÿ­Ê¢!§«f¡a¢F¹-®žª¢«Ê®¼a­f§=®qݳ«Ê¡a¢6«f¥ž­Ê¬¢«C·¢_ªy§Ê¨¸«k¦¹®žª{ê¢-­f¬ž¢_§?«Ê®5¤0¥ž§Ñ«f¡a¢-¦C²0®.Ꞣ݀¼a­T«f¡a¢-­¥@ÐÑ¥@¦cÝ€­f®ž²«f¡a¢³«f¥ž­Ê¬¢«]·¢-ª+§T¨V«k¦²0®··¢ž+ û)ÝJ‚¡y¥ž§3«M¥q¨Ÿ±Ÿ§IÐ]¡a¨Ÿ¹M¡¥ž­Ê¢Z§T«Ê­f¨Ÿ¹«Ê±Ÿ¦Â¡a¢!¥@ê{¨V¢_­3«Ê¡y¥žªc¢-Ç·¯+®ªa¢-ª¢«Ê¨©¥q±ƒ-q«f¡a¢-ªªy®­f¥žªy·®ž² ÐÑ¥ž±VÒcØÙ¢«f­Ê®¯+®±V¨©§¥q±Ÿ¬ž®­Ê¨V«Ê¡a²)j°¹-¥qªì°/¢¬ž¢-®²0¢«Ê­f¨©¹-¥q±Ÿ±Ÿ¦¢-­f¬ž®··¨©¹qŠ OÛÄ®.Ð,¢_Ꞣ-­9-¡y¢_¥@ê{¦]«f¥ž¨V±Ÿ¢_³ê¢-­M§T¨Ÿ®žª+§$®qÝ{«Ê¡a¢,¥q±Ÿ¬ž®ž­f¨V«Ê¡a²§í¹-¥žª³¨Vªy¹-­Ê¢!¥ž§Ê¢Ð]¡a¨Ÿ¹M¡¹-®žª{Ꞣ_­Ê¬¢3¥q«º¯+®±V¦{ªa®²0¨Ÿ¥ž±q­f¥q«Ê¢_hq¬+«Ê¡a¢¯/®ž±Ÿ¦{ªa®ž²0¨©¥q±$­f¥q«Ê¢¥q­f°a¨V«Ê­M¥q­f¨V±Ÿ¦$)j§Ê¢-¢¤ÆIÇ·¢-­M¹¨©§T¢c‚_¿¢§T¡+¥q±Ÿ±Iªa®.Ð °y­Ê¨Ÿ¢60y¦ ¹®ªy§T¨©·¢_­«Ê¡a¢²¤¼a±V«Ê¨©¨)·¨Ÿ²0¢-ªy§Ê¨Ÿ®žªy¥ž±?ØÙ¢«f­Ê®¯+®±V¨©§²0¢«f¡a®·íCϹ-¹-®ž­M·¨Vªy¬«Ê®é †¡a¢_®ž­f¢-² ) Š Ÿ‚ + -B†¡a¢-­f¢¤¥q­f¢«kÐÑ®¬ž¢_®ž²0¢«f­Ê¨©¹³¢-­f¬ž®··¨©¹¨V«k¦¨©§­Ê¢_±Ÿ¥q«Ê¢_ì«f®=¢Ç·¯/®žªa¢_ª¢«Ê¨©¥q±¨²0®²c¢_ª¢«f§Z®žÝ­Ê¢-«Ê¼a­fª«Ê¨Ÿ²0¢_§Ä«Ê®¥=§Ê²¥q±Ÿ±O§Ê¢«‚€cÄ®ž°{ê{¨Ÿ®ž¼y§ÄÐÑ¥@¦·§¨VªéÐ]¡y¨Ÿ¹M¡6«Ê¡a¢c¢Ç·¨©§k«f¢-ªy¹-¢¤®žÝI¢Ç·¯+®ªa¢-ª¢«f¨Ÿ¥ž±O²0®ž²0¢_ª«M§«Ê®¢-Ça¹¼a­M§T¨Ÿ®žª6±V¢_ªa¬q«f¡y§¹_¥qªÙÝj¥ž¨V±¦«f®C¡a®±ŸÙÝ€®ž­³¥Ð†¥q±ŸÒ Ø颫ʭf®ž¯/®ž±Ÿ¨©§¤¥q±Ÿ¬ž®­Ê¨V«Ê¡a²£Ñ®q«Ê¡Ó®žÝ†«Ê¡a¢!§T¢CÐÑ¥@¦·§³¨ŸªöÐ]¡a¨©¹M¡Ó¬ž¢-®²0¢«Ê­f¨©¹0¢-­f¬ž®··¨©¹¨V«k¦F¹-¥žª;Ýj¥q¨Ÿ±,¹_¥qªÓ°/¢­M¥qªy·®²·¢!§Ê¹-­Ê¨Ÿ°+¢!°{¦«Ê¡a¢ªa®ž«Ê¨Ÿ®žªì®qÝ3¢Ça¹¼y­f§Ê¨V®ªy§†¥@ÐÑ¥@¦cÝ€­f®ž² §Ê²¥q±Ÿ±¨§Ê¢«f§†°/¢-¨Ÿªa¬¡a¢!¥@ê{¦0«f¥q¨Ÿ±Ÿ¢_-y¥§†¨VªÙ †¡a¢_®ž­f¢-² ) Š Ÿ‚ ++ k ¨V­M§k«f±V¦¥-/«Ê¡a¢0¥q±Ÿ¬ž®­Ê¨V«Ê¡a²ä²0¨V¬¡¢«¡y¥@ê¢ §T«Ê¨©¹MÒ{¦J¦yȳ¥q«f¹M¡a¢!§ÄÐ]¡a¢_­Ê¢Â«Ê¡a¢c¹M¡y¥q¨Ÿª6§Ê¯+¢_ªya§t¥=±Ÿ®žªa¬=«Ê¨Ÿ²c¢c¨Ÿªéȳ¥q­Ê«Ê¨©¹¼y±Ÿ¥ž­)j¨¢ž§T¢-«f§_÷¼aā¯/®§Ê¢Ð,¢¹-¥žªC¡+¥@Ꞣ¥q­f°a¨V«Ê­M¥q­f¨V±Ÿ¦0°y¥ž§T«Ê¨©¹MÒ¢¦ȳ¥.«M¹M¡a¢_§@-·¨RT )©Àv‹2HÀ4A+ ^ ‚¥q±Ÿ®žªa¬ ¥ §T¼a¨V«f¥ž°a±Ÿ¢F§Ê¢@2¢¼a¢-ª+¹¢6®žÝ¤¯+®¨Vª¢«M§+2AÀ4 †¡a¢-ª5¨¸«ì¨Ÿ§C¢_¥§T¦ «Ê® §Ê¡a®.Ðä«Ê¡y¥q«C­f¢«Ê¼y­Êªï«f¨V²0¢!§=«f® §Ê²0¥ž±V±†¡a¢ì­Ê¢_¬ž¼a±©¥q­f¨¸«k¦Ó¹-®žªy·¨V«Ê¨Ÿ®žª+§¤ÐÑ¢ì­Ê¢92¼y¨V­f¢=«f®F¢_ªy§T¼y­Ê¢ì¬ž¢_®ž²0¢«f­Ê¨©¹§T¢-«f§0¹-¥žªaªa®q«0¡y¥@ꢬž¢_®ž²0¢«f­Ê¨©¹=²0®²c¢_ª¢«f§_¢-­f¬ž®··¨©¹¨V«k¦Ð]¨¸«f¡ì¢-Ç·¯+®ªa¢-ª¢«Ê¨©¥q±$«M¥q¨Ÿ±Ÿ§†¨©§†«f¡a¢-­f¢;-·¢!§Ê§Ê¢-ª¢«Ê¨©¥q±Ÿ±Ÿ¦;-{«Ê®ȳ­Ê¢!¹±Ÿ¼y·¢t«Ê¡a¨©§]Ò{¨Ÿªyì®qÝO°/¢-¡+¥@ꢨŸ®ž¼y­_ “…Ž3΀Ü?‘7 •&’w±/ç€ç5±AœÕ‘7Ü?‘75ß6±A€Îw“ȲAJŒ;²/,Œ Îw“ȲA“ƒŽ3Î “ Ž’w²/”‘§ùZ²AçgÍš”©‘6ÎwÕJß6±/ÁÎ “ƒŽ’§æ/• ,‘Ôµ;Ž±AœÎÁ“Ô±&‘§ù¥Ž3Îw“ Ùgºòaôöõ¦óRæìœÎm²/$Î Ž çgÍš”©‘®‘,ùZ²/ç:ÍJ”©‘€’w±/bÎ ŽŒ;‘7 “rÛb‘¤J±A ç5²A”–Þµ²Aç®ç5² Œ;‘7bÎ Ž “ƒ•1Íš,‘7ÜA²A”©‘7œ“…Ž ˆû²A•;‘6ÎwŽ²/å²Aš²/”–•?Î Ž3ÎÁ±dßm”–Ž J‘§²/nç÷±9Œ;‘7” Î7á¤&›+dx9+ ¬ Šl4 y ¢‚a)rÏ(v,é +Vê é ¸ © x ¢Ç·¯r2é§)45  à )rÏ´8Ž “Ô²¥Ý6”{‘’w±AœÎ “Ô²/œ“ Î Ã v35v ¢ Ù1 “£“ ´8 œÎ*±/´8“X“rÛb²/“X“rÛZŽ3ÎgŒAŽ3Î “ƒ ŽÝ6´8“ƒŽ±A"Ûb²AÎ…Î “ƒŽ’§æ/•…Íœ²A“È’§Ûœ‘ ÎXß6±/Îwç5²A” ”GÜ?²/”–´œ‘6Î:±Mßß6±Aε‘Ü?²/”–´œ‘6Î*±Mß…} ÏV} Ù Ë Ž J’§‘*“ Ûœ‘:²A” µ±A Ž “rÛZç Î “ ´;µ9µ;”©‘ Î^“Ô±1”©‘w²/Ü?‘:“ Ûœ‘ Î7‘,‘Ôµ;Ž±AœÎ§Õ§“ȱVÍš§‘ Î7‘7 Ü?‘*Îw“ȲA“ƒŽ±AJ²A Ž “ƒ•é&²/šŒm”©²/µ‘6“(Œ;‘7bÎ Ž “ƒ•?Õ£Ž “箏Îw“²A” Î7±¤Ûb²/Ü?‘mŒ/Ž œØ’7´8”–“ƒ•ÁŽ §‘§²¥’§Û8Ž µ5±/´8“£Ž G“Ô±Á“ Ûœ‘:“ȲAŽ ”–Î:Ž “rÛb‘FŠawÎ “bÍš”©²¥’§‘ Ù5ú ÛZŽ3αdß*“rÛb‘“ȲAß6‘6Îw“ Î Ž “ Î6‘7”ßÁŽ =²“È‘6JŒ;‘7š’7•"“Ô± 箎3Χ΀“ Ûœ‘Á“ȲAŽ ”–ή±dßgÏ ±APç÷±AÎ “ o ß o ß ,‘ÈÍš”–Ž’w²/“ Ž±/bÎ÷±Mß “rÛb‘ o ‘6“ƒ,±wÍb±/”–Ž3Îç÷²/œŽÙv $“rÛb‘Á,²A,‘®’w²?Î7‘6ÎmÚ£Ûœ‘6§‘ “rÛb‘ “Ô²/Ž ”XŽ3Îm,‘w²;’wÛb‘wŒ?Õ…“ Ûœ‘Á’wÛb²AŽ PÚ(Ž ” ”§ÎƒÍœ‘6JŒ"ŒAŽ3΃ÍJ,±§Íœ±A “ƒŽ±AJ²A“È‘6”–•ˆ”©±/µ Ž Î6²/ç:ÍJ”©‘7Ûœ‘®“Ô²/Ž ” ÎwÕ:²/šŒÇ±/Ü?‘7,‘6Îw“ƒŽ ç5²A“ƒŽ µ&“ȲAŽ ”GÍš§±;Ýw²;Ý7Ž ”–Ž “ƒŽ‘ Î5ç5²?ÎwÎ Ž Ü?‘7”–• Ù=ú Û8ŹÎ€“rÛb‘5±/Ü?‘7,²A” ”V‘4g‘w’7“:Ž3ή±AJ‘"±dß÷²"ÛZŽÊµ?ÛZ”Ê•““ƒ ŽÝ6´8“ƒŽ±A ±A˜‘7çgÍšŽ Ž’w²A”¡“Ô²/Ž ”8ÍJ,±;Ýw²;Ý7Ž ”–Ž “ƒŽ‘ Î ÙÎM楑7ÚV‘§ŒŒAŽ3Î+ †¡a¢Ù§T¢!¹®ªyöІ¥@¦Ó¨VªÿÐ]¡a¨©¹M¡ ­M¥qª+·®ž²½Ð†¥q±ŸÒö¥q±Ÿ¬ž®ž­f¨V«Ê¡a²§0¹-¥žªöÝj¥q¨Ÿ±†«Ê®;°/¢¬ž¢-®²0¢«Ê­f¨©¹-¥q±Ÿ±Ÿ¦ ¢_­Ê¬®··¨Ÿ¹C¨©§0Ð]¡a¢-­f¢)j¨V¨°+¢!¹®ž²0¢!§0ªa¢-¬±V¨Ÿ¬ž¨Ÿ°a±Ÿ¢¨Ÿª «f¡a¢ì«f¥q¨Ÿ±©§7-ѧT®F«Ê¡y¥q«¤«f¡a¢Ù¥q±Ÿ¬ž®­Ê¨V«Ê¡a²«Ê¡a¢ì¢6.$¢_¹«0®žÝÄ«f¡a¢Ù¥ž¹-¹-¢-¯·«$þ@­f¢k»k¢!¹X«¤²0¢!¹M¡y¥qªa¨©§Ê²†¡{¼y§]Ý€­f®ž²«Ê¡a¢Â«f¥ž­Ê¬¢«·¢_ªy§Ê¨¸«k¦C«f¥ž¨V±©§7-y«Ê¡a¢c·­f¨¸Ýw««Ê¡y¥q«Ä«Ê¡y¢¥qāā­f®@Ç·¨V²¥q«Ê¢_§]¥=ª¢¼y±V±©¨'­f¢_¹-¼a­f­Ê¢_ª«Z­M¥qª+·®ž²ÐÑ¥ž±VÒ$]¨Ÿªy·¼y¹-¢_§«Ê®.І¥q­Ma§]«f¡a¢0¡a¨Ÿ¬ž¡Fa¢-ªy§Ê¨¸«k¦Ù­f¢-¬¨V®ªy§Z¨©§³¨Ÿªy§T¼bɹ-¨V¢_ª¢«Ý€®­³¥C¹®ªy·¨V«Ê¨Ÿ®žª6±Ÿ¨ŸÒž¢&)R¾Ô + «f®C¢_Ꞣ_­¥q±Ÿ¬ž®ž­f¨V«Ê¡a²¡a®ž±©˜)€Ý€®ž­Z¥žª¢¦¢-±Ÿ¨V¬¨V°a±Ÿ¢³Ý€¼aªy¹«Ê¨Ÿ®žªur + I †¡a¨©§†¡y¥qā¯/¢-ª+§]Ð]¡a¢-ªì«f¡a¢³«f¥ž­Ê¬¢«Z·¢-ª+§T¨V«k¦=¨©§†êž¢-­f¦50+¥q«]¨Vªì«Ê¡y¢³«f¥q¨Ÿ±©§-Î7±&“rÛb²/“Ý7•Žx³" 3z?Õ:“ Ûœ‘1ÍJ,±;Ýw²;Ý7Ž ”–Ž “ƒ•D±dß5²AG•&ç÷±/Ü?‘ݧ‘7Ž µ$,‘³7‘§’7“È‘§ŒÇ,‘w’§‘wŒ¥‘ ή“Ô±y¡9‘7,±$±A´8“gŽ “ Ûœ‘÷“Ô²/Ž ” Îl„iẑ“rÛb‘ ŒAŽ3Î “ ŽÝ7´8“ƒŽ±A Ù =“ Û8Ž3ή’w²?Î7‘÷,‘³7‘w’6“ƒŽ±AœÎ÷Ýw‘w’w±Aç5‘®Ž š’7,‘w²?Î Ž µ;”–•ˆ,²A,‘®Ž “rÛb‘®“ȲAŽ ”–Î÷±d߀“rÛb‘5ŒAŽ3Î “ƒ ŽÝ6´8“ƒŽ±A Ù±dߎ’‘6ƒµ¥±9ŒAŽ’7Ž “ • ß6²/Ž ” Î"Ž “rÛZŽ3Î"’§²AÎ7‘ Õ1²/šŒ&“rÛb‘",²A“È‘"±MßÍb±/”–•Aš±/瀎²/”…‘7 µ¥±9ŒAŽ’7Ž “ƒ•DŒ;‘ÈÍb‘7šŒAÎ5’7 ´œ’6Ž²/” ”–•˜±/¦*‘w±/ç÷‘7“Ûœ‘¤“ȲAŽ ”¡Ýw‘wÛb²/Ü@Ž±/´8€±dߤ“rÛb‘Á,²/šŒ;±/ç~ÚV²/” æ Ž š’7,‘7ç÷‘7œ“ŒAŽ3Î “ ŽÝ7´8“ƒŽ±A Ù“