{"id":48015,"date":"2020-10-23T19:12:25","date_gmt":"2020-10-23T17:12:25","guid":{"rendered":"https:\/\/blog.wedos.cz\/?p=48015"},"modified":"2020-10-26T06:40:48","modified_gmt":"2020-10-26T05:40:48","slug":"pocet-blokovanych-prenosu-presahl-60-aneb-jak-jsme-pokrocili-s-ochranou-vasich-webu","status":"publish","type":"post","link":"https:\/\/blog.wedos.com\/cs\/pocet-blokovanych-prenosu-presahl-60-aneb-jak-jsme-pokrocili-s-ochranou-vasich-webu","title":{"rendered":"Po\u010det blokovan\u00fdch p\u0159enos\u016f p\u0159es\u00e1hl 60 % aneb jak jsme pokro\u010dili s ochranou va\u0161ich web\u016f"},"content":{"rendered":"<p>Je to zhruba \u010dty\u0159i a p\u016fl roku, co jsme hromadn\u011b spustili filtraci provozu pro webhostingy na\u0161\u00ed IPS\/IDS ochranou. Syst\u00e9m pokro\u010dil\u00e9 detekce a eliminace hrozeb. P\u016fvodn\u00ed pravidla pro filtrov\u00e1n\u00ed se s t\u011bmi dne\u0161n\u00edmi u\u017e nedaj\u00ed srovn\u00e1vat. Jsou daleko benevolentn\u011bj\u0161\u00ed, ale p\u0159esto efektivn\u011bj\u0161\u00ed ne\u017e kdykoliv p\u0159edt\u00edm.<\/p>\n<p><!--more--><\/p>\n<h3>T\u0159i stupn\u011b ochrany<\/h3>\n<p>Ne\u017e se n\u011bkdo dostane na v\u00e1\u0161 web, mus\u00ed proj\u00edt p\u0159es t\u0159i stupn\u011b ochrany.<\/p>\n<ol>\n<li><strong>DDoS ochrana<\/strong> &#8211; Nejd\u0159\u00edve jsou to senzory na\u0161\u00ed masivn\u00ed DDoS ochrany. Ty hledaj\u00ed hlavn\u011b nestandardn\u00ed (nadlimitn\u00ed) podez\u0159el\u00fd provoz. Pokud jej najdou, tak provoz odklon\u00ed p\u0159es v\u00fdhybku na v\u00fdkonn\u00e9 servery, kde se za\u010dne s filtrov\u00e1n\u00edm. V b\u0159eznu 2020 jsme <a href=\"https:\/\/blog.wedos.cz\/jak-jsme-zaspali-nejsilnejsi-ddos-utok-ktery-na-nas-kdy-sel-a-nikdo-si-toho-nevsiml\" target=\"_blank\" rel=\"noopener\">zastavili DDoS \u00fatok o s\u00edle 44,5 Gbps<\/a>. Nikdo si ni\u010deho nev\u0161iml.<\/li>\n<li><strong>P\u0159edsazen\u00e1 ochrana<\/strong> &#8211; <a href=\"https:\/\/blog.wedos.cz\/lepsi-a-prisnejsi-filtrace-utoku-a-zbytecnych-robotu-u-webhostingu\" target=\"_blank\" rel=\"noopener\">P\u0159edsazenou ochranu jsme v\u00e1m p\u0159edstavili v dubnu 2019<\/a>. Jedn\u00e1 se o velice rychlou filtraci postavenou na anal\u00fdze p\u0159\u00edstup\u016f ze v\u0161ech na\u0161ich webserver\u016f, kter\u00e9 stahujeme na jedno centr\u00e1ln\u00ed m\u00edsto a v re\u00e1ln\u00e9m \u010dase vyhodnocujeme.<\/li>\n<li><strong>IPS\/IDS ochrana<\/strong> &#8211; A te\u010f p\u0159ich\u00e1z\u00ed na \u0159adu IPS\/IDS ochrana, kter\u00e1 detailn\u011b zkoum\u00e1 p\u0159\u00edchoz\u00ed i odchoz\u00ed provoz. Na z\u00e1klad\u011b v\u00edce jak dvaceti tis\u00edc pravidel, kter\u00e9 se pr\u016fb\u011b\u017en\u011b p\u0159id\u00e1vaj\u00ed a upravuj\u00ed (manu\u00e1ln\u011b i automaticky), dok\u00e1\u017ee zachytit jak zn\u00e1m\u00e9 hrozby, tak i ty potenci\u00e1ln\u00ed. Nev\u00fdhodou je, \u017ee prozat\u00edm neum\u00edme filtrovat provoz p\u0159es HTTPS. Ji\u017e brzo budeme um\u011bt i to.<\/li>\n<\/ol>\n<p>Do toho nepo\u010d\u00edt\u00e1me trval\u00e1 pravidla na samotn\u00fdch serverech a routerech. Ka\u017ed\u00fd paket sm\u011b\u0159uj\u00edc\u00ed k n\u00e1m na servery je tedy 3x posouzen a teprve potom se dostane k server\u016fm. Cel\u00e9 to zabere n\u011bkolik mikrosekund. To mal\u00e9 zdr\u017een\u00ed za to stoj\u00ed.\u00a0<\/p>\n<p>Syst\u00e9m ochran vyv\u00edj\u00edme n\u011bkolik let a neust\u00e1le ho vylep\u0161ujeme.<\/p>\n<h3>Po\u010det zablokovan\u00fdch p\u0159\u00edstup\u016f roste<\/h3>\n<p>Tento t\u00fdden jsem si v\u0161imli, \u017ee po\u010det zablokovan\u00fdch p\u0159\u00edstup\u016f na p\u0159edsazen\u00e9 a IPS\/IDS ochran\u011b se p\u0159ehoupl p\u0159es 60 % provozu. P\u0159ev\u00e1\u017en\u00e1 v\u011bt\u0161ina p\u0159\u00edstup\u016f se blokuje pr\u00e1v\u011b na p\u0159edsazen\u00e9 ochran\u011b. Trochu n\u00e1s znejist\u011blo, jestli toho u\u017e neblokujeme t\u0159eba moc, ale oproti p\u0159edchoz\u00edm rok\u016fm jsme benevolentn\u011bj\u0161\u00ed t\u0159eba k robot\u016fm a to d\u00edky chyt\u0159ej\u0161\u00edm pravidl\u016fm. T\u00edm jsme tak\u00e9 sn\u00ed\u017eili pod\u00edl fale\u0161n\u011b pozitivn\u00edch blokac\u00ed a blokujeme na krat\u0161\u00ed dobu.<\/p>\n<p>Vysv\u011btlen\u00ed je asi jednoduch\u00e9. Hardware, konektivita a dal\u0161\u00ed v\u011bci spojen\u00e9 s Internetem jsou levn\u011bj\u0161\u00ed. \u00dato\u010dn\u00edci prost\u011b maj\u00ed v\u00edce zdroj\u016f. Je to jako s e-mailov\u00fdm SPAMem. Je ho v\u00edce a v\u00edce (ale i ten um\u00edme blokovat velmi dob\u0159e).<\/p>\n<p>Hodn\u011b blokovan\u00fdch p\u0159\u00edstup\u016f nemus\u00ed p\u0159\u00edmo cht\u00edt n\u011bjakou zranitelnost zneu\u017e\u00edt, ale jen hledaj\u00ed, zda-li se na c\u00edlov\u00e9m webu n\u00e1hodou nenach\u00e1z\u00ed. Tohle samoz\u0159ejm\u011b blokujeme. V\u011bt\u0161inou automaticky, ale um\u00edme zakro\u010dit i manu\u00e1ln\u011b, jako tomu bylo v p\u0159\u00edpad\u011b <a href=\"https:\/\/help.wedos.cz\/otazka\/php-framework-nette-obsahujici-kritickou-zranitelnost-cve-2020-15227\/35244\/\" target=\"_blank\" rel=\"noopener\">zranitelnosti PHP framework Nette <\/a>a nebo jako v p\u0159\u00edpad\u011b, kde jsme zase <a href=\"https:\/\/blog.wedos.cz\/jak-jsme-chranili-weby-nasich-zakazniku-pred-kritickou-chybou-ve-wordpress-pluginu-themegrill-demo-importer\" target=\"_blank\" rel=\"noopener\">blokovali zneu\u017eit\u00ed &#8222;d\u011brav\u00e9ho&#8220; pluginu pro WordPress<\/a>. A takov\u00fdch p\u0159\u00edklad\u016f je mnohem v\u00edce&#8230;<\/p>\n<h3>R\u016fzn\u00e1 pravidla pro r\u016fzn\u00e9 servery anebo nejd\u016fle\u017eit\u011bj\u0161\u00ed je \u010dlov\u011bk a\u017e potom robot<\/h3>\n<p>V\u0161e je velmi komplikovan\u00e9 a funguje zde ur\u010dit\u00fd syst\u00e9m reputac\u00ed. Jde o velk\u00e9 mno\u017estv\u00ed dat a jejich anal\u00fdzu a nastaven\u00ed pr\u00e1zdn\u00fdch pravidel. Sb\u00edr\u00e1me logy ze v\u0161ech server\u016f, vyu\u017e\u00edv\u00e1me des\u00edtky r\u016fzn\u00fdch blacklist\u016f (i placen\u00fdch) a stahujeme r\u016fzn\u00e9 datab\u00e1ze hrozeb (i placen\u00fdch) a z\u00e1rove\u0148 se na\u0161e filtry chovaj\u00ed inteligentn\u011b. To v\u0161e m\u011bn\u00ed na\u0161e filtrace dynamicky a v re\u00e1ln\u00e9m \u010dase a i n\u011bkolikr\u00e1t za sekundu.\u00a0<\/p>\n<p>A\u010dkoli sb\u00edr\u00e1me data ze v\u0161ech hosting\u016f NoLimit a WMS, tak jednotliv\u00e9 servery mohou m\u00edt individu\u00e1ln\u00ed pravidla a nastaven\u00ed, kter\u00e1 se dynamicky m\u011bn\u00ed v \u010dase.<\/p>\n<p>Nap\u0159\u00edklad pokud m\u00e1me server, kde se v d\u016fsledku t\u0159eba \u00fasp\u011b\u0161n\u00e9 reklamn\u00ed kampan\u011b zvedne n\u011bkolika web\u016fm nar\u00e1z n\u00e1v\u0161t\u011bvnost nad r\u00e1mec v\u0161ech rezerv, tak m\u016f\u017ee doj\u00edt k omezov\u00e1n\u00ed p\u0159\u00edstup\u016f t\u0159eba robot\u016f. Tyto situace jsou pom\u011brn\u011b extr\u00e9mn\u00ed, ale ob\u010das se mohou p\u0159ihodit. C\u00edlem je zachovat chod slu\u017eeb i za cenu, \u017ee si roboti budou muset t\u0159eba hodinku po\u010dkat.<\/p>\n<p>Samoz\u0159ejm\u011b to neznamen\u00e1, \u017ee v\u00e1m hned za\u010dnou chodit varov\u00e1n\u00ed o nedostupnosti z monitoringu. Restrikce se t\u00fdkaj\u00ed opakovan\u00fdch p\u0159\u00edstup\u016f, kter\u00e9 z\u00e1sadn\u011b zat\u011b\u017euj\u00ed server nadm\u011brnou aktivitou.<\/p>\n<p>Jen abyste m\u011bli p\u0159edstavu, tak &#8222;b\u011b\u017en\u00fd&#8220; agresivn\u00ed robot dok\u00e1\u017ee ud\u011blat t\u0159eba tis\u00edc po\u017eadavk\u016f za vte\u0159inu a tam nem\u016f\u017eete \u010dekat, proto\u017ee by to okam\u017eit\u011b z\u00e1kazn\u00edci poznali. Takto p\u0159et\u00ed\u017een\u00fd webserver m\u00e1 probl\u00e9m to rozd\u00fdchat a v n\u011bkter\u00fdch p\u0159\u00edpadech by to muselo skon\u010dit i restartem webov\u00e9ho serveru. To jsou dlouh\u00e9 minuty pomal\u00e9ho na\u010d\u00edt\u00e1n\u00ed va\u0161eho webu s n\u00e1sledn\u00fdm v\u00fdpadkem. Proti tomu se prost\u011b mus\u00edme br\u00e1nit a tak\u00e9 br\u00e1n\u00edme. Na prvn\u00edm m\u00edst\u011b jsou u n\u00e1s z\u00e1kazn\u00edci.\u00a0<\/p>\n<h3>U robot\u016f rozhoduje co d\u011blaj\u00ed, ne co jsou za\u010d<\/h3>\n<p>V dne\u0161n\u00ed dob\u011b se nem\u016f\u017eete spol\u00e9hat na to, \u017ee n\u011bjak\u00fd robot o sob\u011b tvrd\u00ed, \u017ee je t\u0159eba GoogleBot. Pokud bychom v\u0161em &#8222;googlebot\u016fm&#8220; dovolili neomezen\u00fd pohyb po serverech v r\u00e1mci n\u011bjak\u00e9ho whitelistu, tak to nedopadne dob\u0159e.<\/p>\n<p>Mimochodem m\u00e1me specializovan\u00e9 filtry, kter\u00e9 hledaj\u00ed fale\u0161n\u00e9 roboty. Pokud se n\u011bkdo vyd\u00e1v\u00e1 za robota, kter\u00fd p\u0159istupuje jen z ur\u010dit\u00fdch IP adres a najednou tu m\u00e1me p\u0159\u00edstup z jin\u00e9 IP adresy, tak tento p\u0159\u00edstup m\u016f\u017eeme zablokovat, v\u00fdrazn\u011b omezit po\u010det p\u0159\u00edstup\u016f (zku\u0161ebn\u00ed provoz) anebo jej limitujeme v tom, co m\u016f\u017ee d\u011blat &#8211; nesm\u00ed t\u0159eba odes\u00edlat formul\u00e1\u0159e anebo p\u0159istupovat do administrace WordPress.<\/p>\n<p>Pr\u00e1v\u011b o tom v\u0161em je chytr\u00e1 ochrana. Spousta mo\u017enost\u00ed, kde se d\u00e1 naj\u00edt kompromis t\u00e9m\u011b\u0159 pro ka\u017ed\u00e9ho.<\/p>\n<p>Proto sledujeme hlavn\u011b aktivitu IP adres. Pokud n\u011bjak\u00e1 IP adresa za\u010dne spou\u0161t\u011bt jeden anebo i v\u00edce filtr\u016f nar\u00e1z, tak j\u00ed zablokujeme na omezenou dobu. Kdy\u017e si ned\u00e1 pokoj, tak na del\u0161\u00ed a pak del\u0161\u00ed&#8230;<\/p>\n<h3>Roboti vyhled\u00e1va\u010d\u016f maj\u00ed v\u00fdjimky, ale mus\u00ed se chovat slu\u0161n\u011b<\/h3>\n<p>Vyhled\u00e1va\u010de m\u00e1me v\u0161ichni r\u00e1di a chceme, aby v\u0161echen n\u00e1\u0161 obsah co nejd\u0159\u00edve m\u011bli k dispozici v aktu\u00e1ln\u00ed podob\u011b. Proto ke v\u0161em zn\u00e1m\u00fdm vyhled\u00e1va\u010d\u016fm p\u0159istupujeme jinak, ne\u017e t\u0159eba k robot\u016fm, co sb\u00edraj\u00ed marketingov\u00e1 data.<\/p>\n<p>Tv\u016frci robot\u016f vyhled\u00e1va\u010d\u016f po\u010d\u00edtaj\u00ed s t\u00edm, \u017ee mohou web anebo server p\u0159et\u00ed\u017eit, proto tak\u00e9 reaguj\u00ed na r\u016fzn\u00e9 varovn\u00e9 znamen\u00ed, jako je nap\u0159\u00edklad omezen\u00fd po\u010det p\u0159\u00edstup\u016f za ur\u010dit\u00fd \u010das anebo vzr\u016fstaj\u00edc\u00ed d\u00e9lku odezvy.<\/p>\n<p>Nap\u0159\u00edklad Google dok\u00e1zal natolik p\u0159esn\u011b spo\u010d\u00edtat limity na\u0161ich server\u016f, \u017ee prakticky nenar\u00e1\u017e\u00ed na omezen\u00ed. Je to kr\u00e1sn\u011b vid\u011bt na n\u00e1sleduj\u00edc\u00edm grafu. Horn\u00ed graf ukazuje po\u010det p\u0159\u00edstup\u016f GoogleBota a doln\u00ed kolik p\u0159\u00edstup\u016f bylo zablokov\u00e1no. Jedn\u00e1 se o 7 denn\u00ed graf po hodin\u00e1ch.<\/p>\n<p><a href=\"https:\/\/blog.wedos.cz\/wp-content\/uploads\/2020\/10\/googlebot-7d.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-48056 lazyload\" data-src=\"https:\/\/blog.wedos.cz\/wp-content\/uploads\/2020\/10\/googlebot-7d-1024x354.png\" alt=\"\" width=\"525\" height=\"181\" data-srcset=\"https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-1024x354.png 1024w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-300x104.png 300w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-768x265.png 768w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-1536x530.png 1536w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d.png 1541w\" data-sizes=\"(max-width: 525px) 100vw, 525px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 525px; --smush-placeholder-aspect-ratio: 525\/181;\" \/><\/a><\/p>\n<p>Jen zlomek p\u0159\u00edstup\u016f je zablokov\u00e1n. Pro GoogleBota evidujeme konkr\u00e9tn\u00ed IPv4 adresy.<\/p>\n<p><a href=\"https:\/\/blog.wedos.cz\/wp-content\/uploads\/2020\/10\/googlebot-7d-blokovane.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-48059 lazyload\" data-src=\"https:\/\/blog.wedos.cz\/wp-content\/uploads\/2020\/10\/googlebot-7d-blokovane-1024x259.png\" alt=\"\" width=\"525\" height=\"133\" data-srcset=\"https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-blokovane-1024x259.png 1024w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-blokovane-300x76.png 300w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-blokovane-768x194.png 768w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-blokovane-1536x389.png 1536w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/googlebot-7d-blokovane.png 1541w\" data-sizes=\"(max-width: 525px) 100vw, 525px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 525px; --smush-placeholder-aspect-ratio: 525\/133;\" \/><\/a><\/p>\n<p>Je a\u017e neuv\u011b\u0159iteln\u00e9, jak hezky dok\u00e1\u017ee rozlo\u017eit Google z\u00e1t\u011b\u017e v \u010dase. Naproti tomu SeznamBot jednou za \u010das zavel\u00ed &#8222;Zte\u010d!&#8220; a v\u011btr\u00e1ky v serverech za\u0159ad\u00ed vy\u0161\u0161\u00ed obr\u00e1tky, proto\u017ee se mus\u00ed p\u0159etaktovat procesory na vy\u0161\u0161\u00ed v\u00fdkon \ud83d\ude42<\/p>\n<p><a href=\"https:\/\/blog.wedos.cz\/wp-content\/uploads\/2020\/10\/seznambot-7d.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-48061 lazyload\" data-src=\"https:\/\/blog.wedos.cz\/wp-content\/uploads\/2020\/10\/seznambot-7d-1024x343.png\" alt=\"\" width=\"525\" height=\"176\" data-srcset=\"https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/seznambot-7d-1024x343.png 1024w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/seznambot-7d-300x101.png 300w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/seznambot-7d-768x257.png 768w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/seznambot-7d.png 1534w\" data-sizes=\"(max-width: 525px) 100vw, 525px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 525px; --smush-placeholder-aspect-ratio: 525\/176;\" \/><\/a><\/p>\n<p>Proto tak\u00e9 m\u00e1 v\u011bt\u0161\u00ed mno\u017estv\u00ed zablokovan\u00fdch po\u017eadavk\u016f. I tak se v\u0161ak jedn\u00e1 jen o zanedbateln\u00fd zlomek.<\/p>\n<p><a href=\"https:\/\/blog.wedos.cz\/wp-content\/uploads\/2020\/10\/seznambot-7d-blokovane.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-48063 lazyload\" data-src=\"https:\/\/blog.wedos.cz\/wp-content\/uploads\/2020\/10\/seznambot-7d-blokovane-1024x262.png\" alt=\"\" width=\"525\" height=\"134\" data-srcset=\"https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/seznambot-7d-blokovane-1024x262.png 1024w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/seznambot-7d-blokovane-300x77.png 300w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/seznambot-7d-blokovane-768x196.png 768w, https:\/\/blog.wedos.com\/wp-content\/uploads\/2020\/10\/seznambot-7d-blokovane.png 1533w\" data-sizes=\"(max-width: 525px) 100vw, 525px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 525px; --smush-placeholder-aspect-ratio: 525\/134;\" \/><\/a><\/p>\n<p>Dal\u0161\u00ed zaj\u00edmavosti:<\/p>\n<ul>\n<li>Oba se nejv\u00edce zaj\u00edmaj\u00ed o soubor robots.txt\n<ul>\n<li>Google m\u011bl 7.785.218 po\u017eadavk\u016f za posledn\u00edch 7 dn\u00ed<\/li>\n<li>Seznam m\u011bl 6.129.646 po\u017eadavk\u016f za posledn\u00edch 7 dn\u00ed<\/li>\n<\/ul>\n<\/li>\n<li>Google tak\u00e9 pom\u011brn\u011b aktivn\u011b hled\u00e1 soubor ads.txt &#8211; 667.876 po\u017eadavk\u016f<\/li>\n<\/ul>\n<h3>Roboti podle po\u010dtu p\u0159\u00edstup\u016f<\/h3>\n<p>V n\u00e1sleduj\u00edc\u00ed tabulce najdete p\u0159\u00edstup top 45 nejaktivn\u011bj\u0161\u00edch robot\u016f (podle toho jak se sami identifikovali) za posledn\u00edch 7 dn\u00ed. Tito roboti tedy pro\u0161li p\u0159es DDoS ochranu, p\u0159edsazenou ochranu i IPS\/IDS ochranu. Z tabulky jsou odstran\u011bny skripty a univerz\u00e1ln\u00ed roboti jako crawler, robot, Python request, Apache-HttpClient atd.<\/p>\n<table border=\"0\" frame=\"VOID\" rules=\"NONE\" cellspacing=\"0\"><colgroup> <col width=\"217\" \/> <col width=\"98\" \/> <col width=\"85\" \/><\/colgroup>\n<tbody>\n<tr>\n<td align=\"LEFT\" width=\"217\" height=\"17\">Robot<\/td>\n<td align=\"LEFT\" width=\"98\">Komu pat\u0159\u00ed<\/td>\n<td align=\"LEFT\" width=\"85\">Po\u010det po\u017eadavk\u016f<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Googlebot<\/td>\n<td align=\"LEFT\">Google<\/td>\n<td align=\"RIGHT\">58\u00a0230\u00a0724<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">bingbot<\/td>\n<td align=\"LEFT\">Bing<\/td>\n<td align=\"RIGHT\">56\u00a0851\u00a0376<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">SeznamBot<\/td>\n<td align=\"LEFT\">Seznam<\/td>\n<td align=\"RIGHT\">48\u00a0036\u00a0897<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">YandexBot<\/td>\n<td align=\"LEFT\">Yandex<\/td>\n<td align=\"RIGHT\">13\u00a0631\u00a0396<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"17\">MJ12bot<\/td>\n<td align=\"LEFT\">Majestic<\/td>\n<td align=\"RIGHT\">11\u00a0453\u00a0595<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">FacebookBot<\/td>\n<td align=\"LEFT\">Facebook<\/td>\n<td align=\"RIGHT\">10\u00a0818\u00a0181<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Googlebot-Image<\/td>\n<td align=\"LEFT\">Google<\/td>\n<td align=\"RIGHT\">9\u00a0615\u00a0900<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">AdsBot-Google<\/td>\n<td align=\"LEFT\">Google<\/td>\n<td align=\"RIGHT\">5\u00a0865\u00a0139<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">UptimeRobot<\/td>\n<td align=\"LEFT\">UptimeRobot<\/td>\n<td align=\"RIGHT\">5\u00a0487\u00a0728<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Adsbot<\/td>\n<td align=\"LEFT\">Google<\/td>\n<td align=\"RIGHT\">3\u00a0696\u00a0208<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">SemrushBot<\/td>\n<td align=\"LEFT\">SEMrush<\/td>\n<td align=\"RIGHT\">3\u00a0163\u00a0259<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Mediapartners-Google<\/td>\n<td align=\"LEFT\">Google<\/td>\n<td align=\"RIGHT\">2\u00a0955\u00a0552<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">ZoominfoBot<\/td>\n<td align=\"LEFT\">ZoomInfo<\/td>\n<td align=\"RIGHT\">2\u00a0837\u00a0140<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">serpstatbot<\/td>\n<td align=\"LEFT\">Serpsat<\/td>\n<td align=\"RIGHT\">2\u00a0477\u00a0853<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Seekport Crawler<\/td>\n<td align=\"LEFT\">\u00a0<\/td>\n<td align=\"RIGHT\">2\u00a0406\u00a0872<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Applebot<\/td>\n<td align=\"LEFT\">Apple<\/td>\n<td align=\"RIGHT\">2\u00a0134\u00a0281<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">heritrix<\/td>\n<td align=\"LEFT\">Internet Archive<\/td>\n<td align=\"RIGHT\">1\u00a0779\u00a0452<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">PetalBot<\/td>\n<td align=\"LEFT\">Aspiegel<\/td>\n<td align=\"RIGHT\">1\u00a0758\u00a0849<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">BingPreview<\/td>\n<td align=\"LEFT\">Bing<\/td>\n<td align=\"RIGHT\">1\u00a0662\u00a0438<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">WP Fastest Cache Preload Bot<\/td>\n<td align=\"LEFT\">\u00a0<\/td>\n<td align=\"RIGHT\">1\u00a0501\u00a0166<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">DotBot<\/td>\n<td align=\"LEFT\">Moz<\/td>\n<td align=\"RIGHT\">1\u00a0402\u00a0027<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">YandexImages<\/td>\n<td align=\"LEFT\">Yandex<\/td>\n<td align=\"RIGHT\">1\u00a0367\u00a0933<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">dns-crawler<\/td>\n<td align=\"LEFT\">CZ.NIC<\/td>\n<td align=\"RIGHT\">1\u00a0239\u00a0963<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">aranhabot<\/td>\n<td align=\"LEFT\">Amazon<\/td>\n<td align=\"RIGHT\">1\u00a0230\u00a0600<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Pinterestbot<\/td>\n<td align=\"LEFT\">Pinterest<\/td>\n<td align=\"RIGHT\">1\u00a0039\u00a0024<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">AhrefsBot<\/td>\n<td align=\"LEFT\">Ahrefs<\/td>\n<td align=\"RIGHT\">987\u00a0148<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Datanyze<\/td>\n<td align=\"LEFT\">Datanyze<\/td>\n<td align=\"RIGHT\">870\u00a0914<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Heurekabot<\/td>\n<td align=\"LEFT\">Heureka.cz<\/td>\n<td align=\"RIGHT\">822\u00a0107<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">ptolemaiaBot<\/td>\n<td align=\"LEFT\">\u00a0<\/td>\n<td align=\"RIGHT\">767\u00a0102<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Mail.RU_Bot<\/td>\n<td align=\"LEFT\">Mail.ru<\/td>\n<td align=\"RIGHT\">722\u00a0754<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"17\">de\/bot<\/td>\n<td align=\"LEFT\">\u00a0<\/td>\n<td align=\"RIGHT\">593\u00a0131<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Mediatoolkitbot<\/td>\n<td align=\"LEFT\">Mediatoolkit<\/td>\n<td align=\"RIGHT\">558\u00a0655<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">DuckDuckBot<\/td>\n<td align=\"LEFT\">DuckDuckGo<\/td>\n<td align=\"RIGHT\">532\u00a0675<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">magpie-crawler<\/td>\n<td align=\"LEFT\">Brandwatch<\/td>\n<td align=\"RIGHT\">425\u00a0309<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">AimySitemapCrawler<\/td>\n<td align=\"LEFT\">Aimy<\/td>\n<td align=\"RIGHT\">403\u00a0751<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">PingdomBot<\/td>\n<td align=\"LEFT\">Pingdom<\/td>\n<td align=\"RIGHT\">387\u00a0363<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Sogou web spider<\/td>\n<td align=\"LEFT\">Sogou<\/td>\n<td align=\"RIGHT\">372\u00a0302<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">BLEXBot<\/td>\n<td align=\"LEFT\">WebMeUp<\/td>\n<td align=\"RIGHT\">333\u00a0534<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">CFNetwork<\/td>\n<td align=\"LEFT\">Apple<\/td>\n<td align=\"RIGHT\">332\u00a0778<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">SimplePie<\/td>\n<td align=\"LEFT\">SimplePie<\/td>\n<td align=\"RIGHT\">283\u00a0075<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Electron<\/td>\n<td align=\"LEFT\">\u00a0<\/td>\n<td align=\"RIGHT\">264\u00a0931<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">DuckDuckGo-Favicons-Bot<\/td>\n<td align=\"LEFT\">DuckDuckGo<\/td>\n<td align=\"RIGHT\">251\u00a0105<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Seznam-Zbozi-robot<\/td>\n<td align=\"LEFT\">Seznam<\/td>\n<td align=\"RIGHT\">247\u00a0458<\/td>\n<\/tr>\n<tr>\n<td align=\"LEFT\" height=\"18\">Amazonbot<\/td>\n<td align=\"LEFT\">Amazon<\/td>\n<td align=\"RIGHT\">239\u00a0876<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>Je\u0161t\u011b p\u0159ed p\u00e1r lety bychom n\u011bkter\u00e9 z t\u011bchto robot\u016f blokovali. Dnes u\u017e m\u00e1me chytr\u00e9 filtry, kter\u00e9 je jen omez\u00ed, kdy\u017e je to v z\u00e1jmu na\u0161ich z\u00e1kazn\u00edk\u016f. Jinak jim v proch\u00e1zen\u00ed web\u016f nebr\u00e1n\u00edme.<\/p>\n<h3>Co moment\u00e1ln\u011b zlob\u00ed<\/h3>\n<p>V sou\u010dasn\u00e9 dob\u011b m\u00e1me nejv\u011bt\u0161\u00ed probl\u00e9my s CDN jako je t\u0159eba CloudFlare, p\u0159es kter\u00e9 jde velk\u00e9 mno\u017estv\u00ed \u00fatok\u016f. Jejich u\u017eivatel\u00e9 si \u010dasto neuv\u011bdomuj\u00ed, \u017ee za jejich pokro\u010dilej\u0161\u00ed ochranu je nutn\u00e9 si p\u0159iplatit. Na IPS\/IDS je filtrovat nem\u016f\u017eeme, proto\u017ee se vyu\u017e\u00edv\u00e1 HTTPS. IP adresy tak\u00e9 nelze omezovat, proto\u017ee jde v\u0161echno p\u0159es spole\u010dn\u00e9 IP adresy CloudFlare. Cloudflare je prost\u011b jedna velk\u00e1 komplikace. Dom\u00e9ny, kter\u00e9 maj\u00ed CloudFlare, nepou\u017e\u00edvaj\u00ed ani na\u0161e DNS a tak je nem\u016f\u017eeme rychle migrovat nebo br\u00e1nit jin\u00fdm zp\u016fsobem. Ale o tom asi nap\u00ed\u0161eme a\u017e p\u0159\u00ed\u0161t\u011b.<\/p>\n<p>V budoucnu tohle vy\u0159e\u0161\u00edme vylep\u0161en\u00edm IPS\/IDS ochrany, kdy budeme kontrolovat i provoz p\u0159es HTTPS.<\/p>\n<p>Jinak jsme se za celou dobu setkali s ni\u017e\u0161\u00edmi des\u00edtkami probl\u00e9m\u016f, kdy jsme blokovali n\u011bco v\u00edc, ne\u017e jsme asi m\u011bli. To je fantastick\u00fd \u00fasp\u011bch.<\/p>\n<h3>Z\u00e1v\u011br<\/h3>\n<p>Jinak jsme s IPS\/IDS ochranou nesm\u00edrn\u011b spokojeni. Blokuje velk\u00e9 mno\u017estv\u00ed \u0161kodliv\u00e9ho provozu, kter\u00fd nikomu nechyb\u00ed. Na fale\u0161n\u011b pozitivn\u00ed zablokov\u00e1n\u00ed naraz\u00edme jen v\u00fdjime\u010dn\u011b. V\u011bt\u0161inou kdy\u017e hled\u00e1me probl\u00e9m, tak najdeme \u00fatoky z napaden\u00fdch po\u010d\u00edta\u010d\u016f anebo n\u011bkdo zkou\u0161\u00ed dosti ne\u0161ikovn\u011b r\u016fzn\u00e9 penetra\u010dn\u00ed testy. Pak m\u016f\u017ee zjistit, \u017ee se mu neda\u0159\u00ed p\u00e1r hodin p\u0159ihl\u00e1sit do administrace redak\u010dn\u00edho syst\u00e9mu, proto\u017ee IPS\/IDS blokuje POST requesty.<\/p>\n<p>Samoz\u0159ejm\u011b mezi v\u00edce jak dvaceti tis\u00edci r\u016fzn\u00fdmi filtry se m\u016f\u017ee ob\u010das n\u011bco podez\u0159el\u00e9ho dostat omylem. Pokud byste n\u011bco takov\u00e9ho na\u0161li, prost\u011b n\u00e1m napi\u0161te p\u0159es kontaktn\u00ed formul\u00e1\u0159 a my to prov\u011b\u0159\u00edme.<\/p>\n\n\n<p><strong>Na\u0161e ochrany pova\u017eujeme za na\u0161i nejv\u011bt\u0161\u00ed konkuren\u010dn\u00ed v\u00fdhodu. Takhle komplexn\u00ed \u0159e\u0161en\u00ed jen tak nenajdete&#8230; A to jsme to popsali jen povrchn\u011b, proto\u017ee to by bylo na stovky podobn\u00fdch \u010dl\u00e1nk\u016f. <\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Je to zhruba \u010dty\u0159i a p\u016fl roku, co jsme hromadn\u011b spustili filtraci provozu pro webhostingy na\u0161\u00ed IPS\/IDS ochranou. Syst\u00e9m pokro\u010dil\u00e9 detekce a eliminace hrozeb. P\u016fvodn\u00ed pravidla pro filtrov\u00e1n\u00ed se s t\u011bmi dne\u0161n\u00edmi u\u017e nedaj\u00ed srovn\u00e1vat. Jsou daleko benevolentn\u011bj\u0161\u00ed, ale p\u0159esto efektivn\u011bj\u0161\u00ed ne\u017e kdykoliv p\u0159edt\u00edm.<\/p>\n","protected":false},"author":9,"featured_media":48088,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[112],"tags":[23,43,44,141,37],"class_list":["post-48015","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-bezpecnost","tag-bezpecnost","tag-ddos-ochrana","tag-ips-idsc-ochrana","tag-spam","tag-wordpress"],"_links":{"self":[{"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/posts\/48015","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/comments?post=48015"}],"version-history":[{"count":23,"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/posts\/48015\/revisions"}],"predecessor-version":[{"id":48446,"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/posts\/48015\/revisions\/48446"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/media\/48088"}],"wp:attachment":[{"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/media?parent=48015"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/categories?post=48015"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.wedos.com\/cs\/wp-json\/wp\/v2\/tags?post=48015"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}