Noman.Blogger

Types of Webs on Internet..

THERE ARE 3 BASIC TYPES OF WEBS ON INTERNET THAT WE CAN ACCESS FOR DIFFERENT PURPOSES...

                                                                                           1.SURFACE WEB

The Surface Web (also called the Visible Web, Indexed Web, Indexable Web or Lightnet)[1] is the portion of the World Wide Web that is readily available to the general public and searchable with standard web search engines. It is the opposite of the deep web, the part of the web not indexed by a web search engine.[2] The Surface Web only consists of 10 percent of the information that is on the internet.[3] The Surface Web is made with a collection of public Web pages on a server accessible by any search engine.[4]

According to one source, as of June 14, 2015, Google's index of the surface web contains about 14.5 billion pages.[5] 

References..

1. ^ "Redefining light and dark". Gondwanaland.com. November 28, 2005.
2. ^ Barratt, Monica (January 15, 2015). "A Discussion About Dark Net Terminology". Drugs, Internet, Society. Retrieved June 14, 2015.
3. ^ "What is the difference between the Surface Web, The Deep Web and the Dark Web?". Pink Hat Technology Management. Retrieved 2018-09-29.
4. ^ "The Surface Web". Dark Side of the Web. 2012-05-11. Retrieved 2018-09-29.

   • References...

     1. ^ Hamilton, Nigel (2003). "The Mechanics of a Deep Net Metasearch Engine". In Isaías, Pedro; Palma dos Reis, António (eds.). Proceedings of the IADIS International Conference on e-Society. pp. 1034–6. CiteSeerX 10.1.1.90.5847. ISBN 972-98947-0-1.
     2. ^ Devine, Jane; Egger-Sider, Francine (July 2004). "Beyond google: the invisible web in the academic library". The Journal of Academic Librarianship. 30 (4): 265–269. doi:10.1016/j.acalib.2004.04.010.
     3. ^ Raghavan, Sriram; Garcia-Molina, Hector (September 11–14, 2001). "Crawling the Hidden Web". 27th International Conference on Very Large Data Bases.
     4. ^ "Surface Web". Computer Hope. Retrieved June 20, 2018.
     5. ^ Wright, Alex (February 22, 2009). "Exploring a 'Deep Web' That Google Can't Grasp". The New York Times. Retrieved September 2, 2019. [...] Mike Bergman, a computer scientist and consultant who is credited with coining the term Deep Web.
     6. ^ Madhavan, J., Ko, D., Kot, Ł., Ganapathy, V., Rasmussen, A., & Halevy, A. (2008). Google's deep web crawl. Proceedings of the VLDB Endowment, 1(2), 1241–52.
     7. ^ Shedden, Sam (June 8, 2014). "How Do You Want Me to Do It? Does It Have to Look like an Accident? – an Assassin Selling a Hit on the Net; Revealed Inside the Deep Web". Sunday Mail. Retrieved May 5, 2017 – via Questia.
     8. ^ Beckett, Andy (November 26, 2009). "The dark side of the internet". Retrieved August 9, 2015.
     9. ^ "Clearing Up Confusion – Deep Web vs. Dark Web". BrightPlanet. March 27, 2014.
     10. ^ Solomon, Jane (May 6, 2015). "The Deep Web vs. The Dark Web". Retrieved May 26, 2015.
     11. ^ NPR Staff (May 25, 2014). "Going Dark: The Internet Behind The Internet". Retrieved May 29, 2015.
     12. ^ Greenberg, Andy (November 19, 2014). "Hacker Lexicon: What Is the Dark Web?". Retrieved June 6, 2015.
     13. ^ "The Impact of the Dark Web on Internet Governance and Cyber Security"(PDF). Retrieved January 15, 2017.
     14. ^ Lam, Kwok-Yan; Chi, Chi-Hung; Qing, Sihan (November 23, 2016). Information and Communications Security: 18th International Conference, ICICS 2016, Singapore, Singapore, November 29 – December 2, 2016, Proceedings. Springer. ISBN 9783319500119. Retrieved January 15, 2017.
     15. ^ "The Deep Web vs. The Dark Web | Dictionary.com Blog". Dictionary Blog. May 6, 2015. Retrieved January 15, 2017.
     16. ^ Akhgar, Babak; Bayerl, P. Saskia; Sampson, Fraser (January 1, 2017). Open Source Intelligence Investigation: From Strategy to Implementation. Springer. ISBN 9783319476711. Retrieved January 15, 2017.
     17. ^ "What is the dark web and who uses it?". The Globe and Mail. Retrieved January 15, 2017.
     18. ^ Jump up to:a b Bergman, Michael K (August 2001). "The Deep Web: Surfacing Hidden Value". The Journal of Electronic Publishing. 7 (1). doi:10.3998/3336451.0007.104.
     19. ^ Garcia, Frank (January 1996). "Business and Marketing on the Internet". Masthead. 15 (1). Archived from the original on December 5, 1996. Retrieved February 24, 2009.
     20. ^ @1 started with 5.7 terabytes of content, estimated to be 30 times the size of the nascent World Wide Web; PLS was acquired by AOL in 1998 and @1 was abandoned. "PLS introduces AT1, the first 'second generation' Internet search service" (Press release). Personal Library Software. December 1996. Archived from the original on October 21, 1997. Retrieved February 24, 2009.
     21. ^ "Hypertext Transfer Protocol (HTTP/1.1): Caching". Internet Engineering Task Force. 2014. Retrieved July 30, 2014.
     22. ^ Wiener-Bronner, Danielle (June 10, 2015). "NASA is indexing the 'Deep Web' to show mankind what Google won't". Fusion. Retrieved June 27, 2015. There are other simpler versions of Memex already available. "If you've ever used the Internet Archive's Wayback Machine", which gives you past versions of a website not accessible through Google, then you've technically searched the Deep Web, said Chris Mattmann.
     23. ^ Wright, Alex (February 22, 2009). "Exploring a 'Deep Web' That Google Can't Grasp". The New York Times. Retrieved February 23, 2009.
     24. ^ "Intute FAQ, dead link". Retrieved October 13, 2012.
     25. ^ "Elsevier to Retire Popular Science Search Engine". library.bldrdoc.gov. December 2013. Archived from the original on June 23, 2015. Retrieved June 22,2015. by end of January 2014, Elsevier will be discontinuing Scirus, its free science search engine. Scirus has been a wide-ranging research tool, with over 575 million items indexed for searching, including webpages, pre-print articles, patents, and repositories.
     26. ^ Sriram Raghavan; Garcia-Molina, Hector (2000). "Crawling the Hidden Web"(PDF). Stanford Digital Libraries Technical Report. Retrieved December 27, 2008.
     27. ^ Raghavan, Sriram; Garcia-Molina, Hector (2001). "Crawling the Hidden Web"(PDF). Proceedings of the 27th International Conference on Very Large Data Bases (VLDB). pp. 129–38.
     28. ^ Alexandros, Ntoulas; Zerfos, Petros; Cho, Junghoo (2005). "Downloading Hidden Web Content" (PDF). UCLA Computer Science. Retrieved February 24, 2009.
     29. ^ Shestakov, Denis; Bhowmick, Sourav S.; Lim, Ee-Peng (2005). "DEQUE: Querying the Deep Web" (PDF). Data & Knowledge Engineering. 52 (3): 273–311.
     30. ^ Barbosa, Luciano; Freire, Juliana (2007). "An Adaptive Crawler for Locating Hidden-Web Entry Points" (PDF). WWW Conference 2007. Retrieved March 20,2009.
     31. ^ Barbosa, Luciano; Freire, Juliana (2005). "Searching for Hidden-Web Databases" (PDF). WebDB 2005. Retrieved March 20, 2009.
     32. ^ Madhavan, Jayant; Ko, David; Kot, Łucja; Ganapathy, Vignesh; Rasmussen, Alex; Halevy, Alon (2008). "Google's Deep-Web Crawl" (PDF). VLDB Endowment, ACM. Retrieved April 17, 2009.
     33. ^ Aaron, Swartz. "In Defense of Anonymity". Retrieved February 4, 2014.

     Further reading...

     • Barker, Joe (January 2004). "Invisible Web: What it is, Why it exists, How to find it, and its inherent ambiguity". University of California, Berkeley, Teaching Library Internet Workshops. Archived from the original on July 29, 2005. Retrieved July 26, 2011..
     • Basu, Saikat (March 14, 2010). "10 Search Engines to Explore the Invisible Web". MakeUseOf.com..
     • Ozkan, Akin (November 2014). "Deep Web /Derin İnternet"..
     • Gruchawka, Steve (June 2006). "How-To Guide to the Deep Web"..
     • Hamilton, Nigel (2003). "The Mechanics of a Deep Net Metasearch Engine". 12th World Wide Web Conference..
     • He, Bin; Chang, Kevin Chen-Chuan (2003). "Statistical Schema Matching across Web Query Interfaces" (PDF). Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data. Archived from the original (PDF) on July 20, 2011.
     • Howell O'Neill, Patrick (October 2013). "How to search the Deep Web". The Daily Dot..
     • Ipeirotis, Panagiotis G.; Gravano, Luis; Sahami, Mehran (2001). "Probe, Count, and Classify: Categorizing Hidden-Web Databases" (PDF). Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data. pp. 67–78. Archived from the original (PDF) on September 12, 2006. Retrieved September 26, 2006.
     • King, John D.; Li, Yuefeng; Tao, Daniel; Nayak, Richi (November 2007). "Mining World Knowledge for Analysis of Search Engine Content" (PDF). Web Intelligence and Agent Systems: An International Journal. 5 (3): 233–53. Archived from the original(PDF) on December 3, 2008. Retrieved July 26, 2011.
     • McCown, Frank; Liu, Xiaoming; Nelson, Michael L.; Zubair, Mohammad (March–April 2006). "Search Engine Coverage of the OAI-PMH Corpus" (PDF). IEEE Internet Computing. 10 (2): 66–73. doi:10.1109/MIC.2006.41.
     • Price, Gary; Sherman, Chris (July 2001). The Invisible Web: Uncovering Information Sources Search Engines Can't See. CyberAge Books. ISBN 978-0-910965-51-4.
     • Shestakov, Denis (June 2008). Search Interfaces on the Web: Querying and Characterizing. TUCS Doctoral Dissertations 104, University of Turku
     • Whoriskey, Peter (December 11, 2008). "Firms Push for a More Searchable Federal Web". The Washington Post. p. D01..
     • Wright, Alex (March 2004). "In Search of the Deep Web". Salon. Archived from the original on March 9, 2007..
     • Scientists, Naked (December 2014). 
     • "The Internet: the good, the bad and the ugly – In-depth exploration of the Internet and the Dark Web by Cambridge University's Naked Scientists                  
     ^ de Kunder, Maurice (June 14, 2015). "The Size of the World Wide Web". WorldWideWebSize.com. Retrieved June 14, 2015

                                                                                            2.DEEP WEB

     This article is about the part of the World Wide Web not indexed by traditional search engines. For other uses, see Deep web (disambiguation).

     Not to be confused with Dark web.

     The deep web,[1] invisible web,[2] or hidden web[3] are parts of the World Wide Web whose contents are not indexed by standard web search-engines. The opposite term to the deep web is the "surface web", which is accessible to anyone/everyone using the Internet.[4] Computer-scientist Michael K. Bergman is credited with coining the term deep web in 2001 as a search-indexing term.[5]

     The content of the deep web is hidden behind HTTP forms[6][7] and includes many very common uses such as web mail, online banking, private or otherwise restricted access social-media pages and profiles, some web forums that require registration for viewing content, and services that users must pay for, and which are protected by paywalls, such as video on demand and some online magazines and newspapers.

     The content of the deep web can be located and accessed by a direct URL or IP address, but may require a password or other security access to get past public-website pages.

     Contents

     • 1Terminology
     • 2Non-indexed content
     • 3Indexing methods
     • 4Content types
     • 5See also
     • 6References
     • 7Further reading
     • 8External links

     Terminology

     The first conflation of the terms "deep web" with "dark web" came about in 2009 when deep web search terminology was discussed together with illegal activities taking place on the Freenet and darknet.[8]

     Since then, after their use in the media's reporting on the Silk Road, media outlets have taken to using 'deep web' synonymously with the dark web or darknet, a comparison some reject as inaccurate[9] and consequently has become an ongoing source of confusion.[10] Wired reporters Kim Zetter[11] and Andy Greenberg[12] recommend the terms be used in distinct fashions. While the deep web is a reference to any site that cannot be accessed through a traditional search engine, the dark web is a portion of the deep web that has been intentionally hidden and is inaccessible through standard browsers and methods.[13][14][15][16][17]

     Non-indexed content

     Bergman, in a paper on the deep web published in The Journal of Electronic Publishing, mentioned that Jill Ellsworth used the term Invisible Web in 1994 to refer to websites that were not registered with any search engine.[18] Bergman cited a January 1996 article by Frank Garcia:[19]

     It would be a site that's possibly reasonably designed, but they didn't bother to register it with any of the search engines. So, no one can find them! You're hidden. I call that the invisible Web.

     Another early use of the term Invisible Web was by Bruce Mount and Matthew B. Koll of Personal Library Software, in a description of the #1 Deep Web tool found in a December 1996 press release.[20]

     The first use of the specific term deep web, now generally accepted, occurred in the aforementioned 2001 Bergman study.

     Indexing method..

     Methods that prevent web pages from being indexed by traditional search engines may be categorized as one or more of the following:

     1. Contextual web: pages with content varying for different access contexts (e.g., ranges of client IP addresses or previous navigation sequence).
     2. Dynamic content: dynamic pages, which are returned in response to a submitted query or accessed only through a form, especially if open-domain input elements (such as text fields) are used; such fields are hard to navigate without domain knowledge.
     3. Limited access content: sites that limit access to their pages in a technical way (e.g., using the Robots Exclusion Standard or CAPTCHAs, or no-store directive, which prohibit search engines from browsing them and creating cached copies).[21]
     4. Non-HTML/text content: textual content encoded in multimedia (image or video) files or specific file formats not handled by search engines.
     5. Private web: sites that require registration and login (password-protected resources).
     6. Scripted content: pages that are only accessible through links produced by JavaScript as well as content dynamically downloaded from Web servers via Flash or Ajax solutions.
     7. Software: certain content is intentionally hidden from the regular Internet, accessible only with special software, such as Tor, I2P, or other darknet software. For example, Tor allows users to access websites using the .onion server address anonymously, hiding their IP address.
     8. Unlinked content: pages which are not linked to by other pages, which may prevent web crawling programs from accessing the content. This content is referred to as pages without backlinks (also known as inlinks). Also, search engines do not always detect all backlinks from searched web pages.
        • Barker, Joe (January 2004). "Invisible Web: What it is, Why it exists, How to find it, and its inherent ambiguity". University of California, Berkeley, Teaching Library Internet Workshops. Archived from the original on July 29, 2005. Retrieved July 26, 2011..
        • Basu, Saikat (March 14, 2010). "10 Search Engines to Explore the Invisible Web". MakeUseOf.com..
        • Ozkan, Akin (November 2014). "Deep Web /Derin İnternet"..
        • Gruchawka, Steve (June 2006). "How-To Guide to the Deep Web"..
        • Hamilton, Nigel (2003). "The Mechanics of a Deep Net Metasearch Engine". 12th World Wide Web Conference..
        • He, Bin; Chang, Kevin Chen-Chuan (2003). "Statistical Schema Matching across Web Query Interfaces" (PDF). Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data. Archived from the original (PDF) on July 20, 2011.
        • Howell O'Neill, Patrick (October 2013). "How to search the Deep Web". The Daily Dot..
        • Ipeirotis, Panagiotis G.; Gravano, Luis; Sahami, Mehran (2001). "Probe, Count, and Classify: Categorizing Hidden-Web Databases" (PDF). Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data. pp. 67–78. Archived from the original (PDF) on September 12, 2006. Retrieved September 26, 2006.
        • King, John D.; Li, Yuefeng; Tao, Daniel; Nayak, Richi (November 2007). "Mining World Knowledge for Analysis of Search Engine Content" (PDF). Web Intelligence and Agent Systems: An International Journal. 5 (3): 233–53. Archived from the original(PDF) on December 3, 2008. Retrieved July 26, 2011.
        • McCown, Frank; Liu, Xiaoming; Nelson, Michael L.; Zubair, Mohammad (March–April 2006). "Search Engine Coverage of the OAI-PMH Corpus" (PDF). IEEE Internet Computing. 10 (2): 66–73. doi:10.1109/MIC.2006.41.
        • Price, Gary; Sherman, Chris (July 2001). The Invisible Web: Uncovering Information Sources Search Engines Can't See. CyberAge Books. ISBN 978-0-910965-51-4.
        • Shestakov, Denis (June 2008). Search Interfaces on the Web: Querying and Characterizing. TUCS Doctoral Dissertations 104, University of Turku
        • Whoriskey, Peter (December 11, 2008). "Firms Push for a More Searchable Federal Web". The Washington Post. p. D01..

        • Wright, Alex (March 2004). "In Search of the Deep Web". Salon. Archived from the original on March 9, 2007..                                                                                                                                                                                                                                                                                3.DARKWEB 

          1. ^ Hamilton, Nigel (2003). "The Mechanics of a Deep Net Metasearch Engine". In Isaías, Pedro; Palma dos Reis, António (eds.). Proceedings of the IADIS International Conference on e-Society. pp. 1034–6. CiteSeerX 10.1.1.90.5847. ISBN 972-98947-0-1.
          2. ^ Devine, Jane; Egger-Sider, Francine (July 2004). "Beyond google: the invisible web in the academic library". The Journal of Academic Librarianship. 30 (4): 265–269. doi:10.1016/j.acalib.2004.04.010.
          3. ^ Raghavan, Sriram; Garcia-Molina, Hector (September 11–14, 2001). "Crawling the Hidden Web". 27th International Conference on Very Large Data Bases.
          4. ^ "Surface Web". Computer Hope. Retrieved June 20, 2018.
          5. ^ Wright, Alex (February 22, 2009). "Exploring a 'Deep Web' That Google Can't Grasp". The New York Times. Retrieved September 2, 2019. [...] Mike Bergman, a computer scientist and consultant who is credited with coining the term Deep Web.
          6. ^ Madhavan, J., Ko, D., Kot, Ł., Ganapathy, V., Rasmussen, A., & Halevy, A. (2008). Google's deep web crawl. Proceedings of the VLDB Endowment, 1(2), 1241–52.
          7. ^ Shedden, Sam (June 8, 2014). "How Do You Want Me to Do It? Does It Have to Look like an Accident? – an Assassin Selling a Hit on the Net; Revealed Inside the Deep Web". Sunday Mail. Retrieved May 5, 2017 – via Questia.
          8. ^ Beckett, Andy (November 26, 2009). "The dark side of the internet". Retrieved August 9, 2015.
          9. ^ "Clearing Up Confusion – Deep Web vs. Dark Web". BrightPlanet. March 27, 2014.
          10. ^ Solomon, Jane (May 6, 2015). "The Deep Web vs. The Dark Web". Retrieved May 26, 2015.
          11. ^ NPR Staff (May 25, 2014). "Going Dark: The Internet Behind The Internet". Retrieved May 29, 2015.
          12. ^ Greenberg, Andy (November 19, 2014). "Hacker Lexicon: What Is the Dark Web?". Retrieved June 6, 2015.
          13. ^ "The Impact of the Dark Web on Internet Governance and Cyber Security"(PDF). Retrieved January 15, 2017.
          14. ^ Lam, Kwok-Yan; Chi, Chi-Hung; Qing, Sihan (November 23, 2016). Information and Communications Security: 18th International Conference, ICICS 2016, Singapore, Singapore, November 29 – December 2, 2016, Proceedings. Springer. ISBN 9783319500119. Retrieved January 15, 2017.
          15. ^ "The Deep Web vs. The Dark Web | Dictionary.com Blog". Dictionary Blog. May 6, 2015. Retrieved January 15, 2017.
          16. ^ Akhgar, Babak; Bayerl, P. Saskia; Sampson, Fraser (January 1, 2017). Open Source Intelligence Investigation: From Strategy to Implementation. Springer. ISBN 9783319476711. Retrieved January 15, 2017.
          17. ^ "What is the dark web and who uses it?". The Globe and Mail. Retrieved January 15, 2017.
          18. ^ Jump up to:a b Bergman, Michael K (August 2001). "The Deep Web: Surfacing Hidden Value". The Journal of Electronic Publishing. 7 (1). doi:10.3998/3336451.0007.104.
          19. ^ Garcia, Frank (January 1996). "Business and Marketing on the Internet". Masthead. 15 (1). Archived from the original on December 5, 1996. Retrieved February 24, 2009.
          20. ^ @1 started with 5.7 terabytes of content, estimated to be 30 times the size of the nascent World Wide Web; PLS was acquired by AOL in 1998 and @1 was abandoned. "PLS introduces AT1, the first 'second generation' Internet search service" (Press release). Personal Library Software. December 1996. Archived from the original on October 21, 1997. Retrieved February 24, 2009.
          21. ^ "Hypertext Transfer Protocol (HTTP/1.1): Caching". Internet Engineering Task Force. 2014. Retrieved July 30, 2014.
          22. ^ Wiener-Bronner, Danielle (June 10, 2015). "NASA is indexing the 'Deep Web' to show mankind what Google won't". Fusion. Retrieved June 27, 2015. There are other simpler versions of Memex already available. "If you've ever used the Internet Archive's Wayback Machine", which gives you past versions of a website not accessible through Google, then you've technically searched the Deep Web, said Chris Mattmann.
          23. ^ Wright, Alex (February 22, 2009). "Exploring a 'Deep Web' That Google Can't Grasp". The New York Times. Retrieved February 23, 2009.
          24. ^ "Intute FAQ, dead link". Retrieved October 13, 2012.
          25. ^ "Elsevier to Retire Popular Science Search Engine". library.bldrdoc.gov. December 2013. Archived from the original on June 23, 2015. Retrieved June 22,2015. by end of January 2014, Elsevier will be discontinuing Scirus, its free science search engine. Scirus has been a wide-ranging research tool, with over 575 million items indexed for searching, including webpages, pre-print articles, patents, and repositories.
          26. ^ Sriram Raghavan; Garcia-Molina, Hector (2000). "Crawling the Hidden Web"(PDF). Stanford Digital Libraries Technical Report. Retrieved December 27, 2008.
          27. ^ Raghavan, Sriram; Garcia-Molina, Hector (2001). "Crawling the Hidden Web"(PDF). Proceedings of the 27th International Conference on Very Large Data Bases (VLDB). pp. 129–38.
          28. ^ Alexandros, Ntoulas; Zerfos, Petros; Cho, Junghoo (2005). "Downloading Hidden Web Content" (PDF). UCLA Computer Science. Retrieved February 24, 2009.
          29. ^ Shestakov, Denis; Bhowmick, Sourav S.; Lim, Ee-Peng (2005). "DEQUE: Querying the Deep Web" (PDF). Data & Knowledge Engineering. 52 (3): 273–311.
          30. ^ Barbosa, Luciano; Freire, Juliana (2007). "An Adaptive Crawler for Locating Hidden-Web Entry Points" (PDF). WWW Conference 2007. Retrieved March 20,2009.
          31. ^ Barbosa, Luciano; Freire, Juliana (2005). "Searching for Hidden-Web Databases" (PDF). WebDB 2005. Retrieved March 20, 2009.
          32. ^ Madhavan, Jayant; Ko, David; Kot, Łucja; Ganapathy, Vignesh; Rasmussen, Alex; Halevy, Alon (2008). "Google's Deep-Web Crawl" (PDF). VLDB Endowment, ACM. Retrieved April 17, 2009.
          33.  Hamilton, Nigel (2003). "The Mechanics of a Deep Net Metasearch Engine". In Isaías, Pedro; Palma dos Reis, António (eds.). Proceedings of the IADIS International Conference on e-Society. pp. 1034–6. CiteSeerX 10.1.1.90.5847. ISBN 972-98947-0-1.
          34. ^ Devine, Jane; Egger-Sider, Francine (July 2004). "Beyond google: the invisible web in the academic library". The Journal of Academic Librarianship. 30 (4): 265–269. doi:10.1016/j.acalib.2004.04.010.
          35. ^ Raghavan, Sriram; Garcia-Molina, Hector (September 11–14, 2001). "Crawling the Hidden Web". 27th International Conference on Very Large Data Bases.
          36. ^ "Surface Web". Computer Hope. Retrieved June 20, 2018.
          37. ^ Wright, Alex (February 22, 2009). "Exploring a 'Deep Web' That Google Can't Grasp". The New York Times. Retrieved September 2, 2019. [...] Mike Bergman, a computer scientist and consultant who is credited with coining the term Deep Web.
          38. ^ Madhavan, J., Ko, D., Kot, Ł., Ganapathy, V., Rasmussen, A., & Halevy, A. (2008). Google's deep web crawl. Proceedings of the VLDB Endowment, 1(2), 1241–52.
          39. ^ Shedden, Sam (June 8, 2014). "How Do You Want Me to Do It? Does It Have to Look like an Accident? – an Assassin Selling a Hit on the Net; Revealed Inside the Deep Web". Sunday Mail. Retrieved May 5, 2017 – via Questia.
          40. ^ Beckett, Andy (November 26, 2009). "The dark side of the internet". Retrieved August 9, 2015.
          41. ^ "Clearing Up Confusion – Deep Web vs. Dark Web". BrightPlanet. March 27, 2014.
          42. ^ Solomon, Jane (May 6, 2015). "The Deep Web vs. The Dark Web". Retrieved May 26, 2015.
          43. ^ NPR Staff (May 25, 2014). "Going Dark: The Internet Behind The Internet". Retrieved May 29, 2015.
          44. ^ Greenberg, Andy (November 19, 2014). "Hacker Lexicon: What Is the Dark Web?". Retrieved June 6, 2015.
          45. ^ "The Impact of the Dark Web on Internet Governance and Cyber Security"(PDF). Retrieved January 15, 2017.
          46. ^ Lam, Kwok-Yan; Chi, Chi-Hung; Qing, Sihan (November 23, 2016). Information and Communications Security: 18th International Conference, ICICS 2016, Singapore, Singapore, November 29 – December 2, 2016, Proceedings. Springer. ISBN 9783319500119. Retrieved January 15, 2017.
          47. ^ "The Deep Web vs. The Dark Web | Dictionary.com Blog". Dictionary Blog. May 6, 2015. Retrieved January 15, 2017.
          48. ^ Akhgar, Babak; Bayerl, P. Saskia; Sampson, Fraser (January 1, 2017). Open Source Intelligence Investigation: From Strategy to Implementation. Springer. ISBN 9783319476711. Retrieved January 15, 2017.
          49. ^ "What is the dark web and who uses it?". The Globe and Mail. Retrieved January 15, 2017.
          50. ^ Jump up to:a b Bergman, Michael K (August 2001). "The Deep Web: Surfacing Hidden Value". The Journal of Electronic Publishing. 7 (1). doi:10.3998/3336451.0007.104.
          51. ^ Garcia, Frank (January 1996). "Business and Marketing on the Internet". Masthead. 15 (1). Archived from the original on December 5, 1996. Retrieved February 24, 2009.
          52. ^ @1 started with 5.7 terabytes of content, estimated to be 30 times the size of the nascent World Wide Web; PLS was acquired by AOL in 1998 and @1 was abandoned. "PLS introduces AT1, the first 'second generation' Internet search service" (Press release). Personal Library Software. December 1996. Archived from the original on October 21, 1997. Retrieved February 24, 2009.
          53. ^ "Hypertext Transfer Protocol (HTTP/1.1): Caching". Internet Engineering Task Force. 2014. Retrieved July 30, 2014.
          54. ^ Wiener-Bronner, Danielle (June 10, 2015). "NASA is indexing the 'Deep Web' to show mankind what Google won't". Fusion. Retrieved June 27, 2015. There are other simpler versions of Memex already available. "If you've ever used the Internet Archive's Wayback Machine", which gives you past versions of a website not accessible through Google, then you've technically searched the Deep Web, said Chris Mattmann.
          55. ^ Wright, Alex (February 22, 2009). "Exploring a 'Deep Web' That Google Can't Grasp". The New York Times. Retrieved February 23, 2009.
          56. ^ "Intute FAQ, dead link". Retrieved October 13, 2012.
          57. ^ "Elsevier to Retire Popular Science Search Engine". library.bldrdoc.gov. December 2013. Archived from the original on June 23, 2015. Retrieved June 22,2015. by end of January 2014, Elsevier will be discontinuing Scirus, its free science search engine. Scirus has been a wide-ranging research tool, with over 575 million items indexed for searching, including webpages, pre-print articles, patents, and repositories.
          58. ^ Sriram Raghavan; Garcia-Molina, Hector (2000). "Crawling the Hidden Web"(PDF). Stanford Digital Libraries Technical Report. Retrieved December 27, 2008.
          59. ^ Raghavan, Sriram; Garcia-Molina, Hector (2001). "Crawling the Hidden Web"(PDF). Proceedings of the 27th International Conference on Very Large Data Bases (VLDB). pp. 129–38.
          60. ^ Alexandros, Ntoulas; Zerfos, Petros; Cho, Junghoo (2005). "Downloading Hidden Web Content" (PDF). UCLA Computer Science. Retrieved February 24, 2009.
          61. ^ Shestakov, Denis; Bhowmick, Sourav S.; Lim, Ee-Peng (2005). "DEQUE: Querying the Deep Web" (PDF). Data & Knowledge Engineering. 52 (3): 273–311.
          62. ^ Barbosa, Luciano; Freire, Juliana (2007). "An Adaptive Crawler for Locating Hidden-Web Entry Points" (PDF). WWW Conference 2007. Retrieved March 20,2009.
          63. ^ Barbosa, Luciano; Freire, Juliana (2005). "Searching for Hidden-Web Databases" (PDF). WebDB 2005. Retrieved March 20, 2009.
          64. ^ Madhavan, Jayant; Ko, David; Kot, Łucja; Ganapathy, Vignesh; Rasmussen, Alex; Halevy, Alon (2008). "Google's Deep-Web Crawl" (PDF). VLDB Endowment, ACM. Retrieved April 17, 2009.
          65. ^ Aaron, Swartz. "In Defense of Anonymity". Retrieved February 4, 2014.
          66. ^ Aaron, Swartz. "In Defense of Anonymity". Retrieved February 4, 2014.eb archives: Web archival services such as the Wayback Machine enable users to see archived versions of web pages across time, including websites which have become inaccessible, and are not indexed by search engines such as Google.         

              Content types.....

              While it is not always possible to directly discover a specific web server's content so that it may be indexed, a site potentially can be accessed indirectly (due to computer vulnerabilities).

              To discover content on the web, search engines use web crawlers that follow hyperlinks through known protocol virtual port numbers. This technique is ideal for discovering content on the surface web but is often ineffective at finding deep web content. For example, these crawlers do not attempt to find dynamic pages that are the result of database queries due to the indeterminate number of queries that are possible.[23] It has been noted that this can be (partially) overcome by providing links to query results, but this could unintentionally inflate the popularity for a member of the deep web.

              DeepPeep, Intute, Deep Web Technologies, Scirus, and Ahmia.fi are a few search engines that have accessed the deep web. Intute ran out of funding and is now a temporary static archive as of July 2011.[24] Scirus retired near the end of January 2013.[25]

              Researchers have been exploring how the deep web can be crawled in an automatic fashion, including content that can be accessed only by special software such as Tor. In 2001, Sriram Raghavan and Hector Garcia-Molina (Stanford Computer Science Department, Stanford University)[26][27] presented an architectural model for a hidden-Web crawler that used key terms provided by users or collected from the query interfaces to query a Web form and crawl the Deep Web content. Alexandros Ntoulas, Petros Zerfos, and Junghoo Cho of UCLA created a hidden-Web crawler that automatically generated meaningful queries to issue against search forms.[28] Several form query languages (e.g., DEQUEL[29]) have been proposed that, besides issuing a query, also allow extraction of structured data from result pages. Another effort is DeepPeep, a project of the University of Utah sponsored by the National Science Foundation, which gathered hidden-web sources (web forms) in different domains based on novel focused crawler techniques.[30][31]

              Commercial search engines have begun exploring alternative methods to crawl the deep web. The Sitemap Protocol (first developed, and introduced by Google in 2005) and OAI-PMH are mechanisms that allow search engines and other interested parties to discover deep web resources on particular web servers. Both mechanisms allow web servers to advertise the URLs that are accessible on them, thereby allowing automatic discovery of resources that are not directly linked to the surface web. Google's deep web surfacing system computes submissions for each HTML form and adds the resulting HTML pages into the Google search engine index. The surfaced results account for a thousand queries per second to deep web content.[32] In this system, the pre-computation of submissions is done using three algorithms:

              1. selecting input values for text search inputs that accept keywords,
              2. identifying inputs which accept only values of a specific type (e.g., date) and
              3. selecting a small number of input combinations that generate URLs suitable for inclusion into the Web search index.

              In 2008, to facilitate users of Tor hidden services in their access and search of a hidden .onion suffix, Aaron Swartz designed Tor2web—a proxy application able to provide access by means of common web browsers.[33] Using this application, deep web links appear as a random string of letters followed by the .onion top-level domain.                              

              References......

              1.  Hamilton, Nigel (2003). "The Mechanics of a Deep Net Metasearch Engine". In Isaías, Pedro; Palma dos Reis, António (eds.). Proceedings of the IADIS International Conference on e-Society. pp. 1034–6. CiteSeerX 10.1.1.90.5847. ISBN 972-98947-0-1.
              2. ^ Devine, Jane; Egger-Sider, Francine (July 2004). "Beyond google: the invisible web in the academic library". The Journal of Academic Librarianship. 30 (4): 265–269. doi:10.1016/j.acalib.2004.04.010.
              3. ^ Raghavan, Sriram; Garcia-Molina, Hector (September 11–14, 2001). "Crawling the Hidden Web". 27th International Conference on Very Large Data Bases.
              4. ^ "Surface Web". Computer Hope. Retrieved June 20, 2018.
              5. ^ Wright, Alex (February 22, 2009). "Exploring a 'Deep Web' That Google Can't Grasp". The New York Times. Retrieved September 2, 2019. [...] Mike Bergman, a computer scientist and consultant who is credited with coining the term Deep Web.
              6. ^ Madhavan, J., Ko, D., Kot, Ł., Ganapathy, V., Rasmussen, A., & Halevy, A. (2008). Google's deep web crawl. Proceedings of the VLDB Endowment, 1(2), 1241–52.
              7. ^ Shedden, Sam (June 8, 2014). "How Do You Want Me to Do It? Does It Have to Look like an Accident? – an Assassin Selling a Hit on the Net; Revealed Inside the Deep Web". Sunday Mail. Retrieved May 5, 2017 – via Questia.
              8. ^ Beckett, Andy (November 26, 2009). "The dark side of the internet". Retrieved August 9, 2015.
              9. ^ "Clearing Up Confusion – Deep Web vs. Dark Web". BrightPlanet. March 27, 2014.
              10. ^ Solomon, Jane (May 6, 2015). "The Deep Web vs. The Dark Web". Retrieved May 26, 2015.
              11. ^ NPR Staff (May 25, 2014). "Going Dark: The Internet Behind The Internet". Retrieved May 29, 2015.
              12. ^ Greenberg, Andy (November 19, 2014). "Hacker Lexicon: What Is the Dark Web?". Retrieved June 6, 2015.
              13. ^ "The Impact of the Dark Web on Internet Governance and Cyber Security"(PDF). Retrieved January 15, 2017.
              14. ^ Lam, Kwok-Yan; Chi, Chi-Hung; Qing, Sihan (November 23, 2016). Information and Communications Security: 18th International Conference, ICICS 2016, Singapore, Singapore, November 29 – December 2, 2016, Proceedings. Springer. ISBN 9783319500119. Retrieved January 15, 2017.
              15. ^ "The Deep Web vs. The Dark Web | Dictionary.com Blog". Dictionary Blog. May 6, 2015. Retrieved January 15, 2017.
              16. ^ Akhgar, Babak; Bayerl, P. Saskia; Sampson, Fraser (January 1, 2017). Open Source Intelligence Investigation: From Strategy to Implementation. Springer. ISBN 9783319476711. Retrieved January 15, 2017.
              17. ^ "What is the dark web and who uses it?". The Globe and Mail. Retrieved January 15, 2017.
              18. ^ Jump up to:a b Bergman, Michael K (August 2001). "The Deep Web: Surfacing Hidden Value". The Journal of Electronic Publishing. 7 (1). doi:10.3998/3336451.0007.104.
              19. ^ Garcia, Frank (January 1996). "Business and Marketing on the Internet". Masthead. 15 (1). Archived from the original on December 5, 1996. Retrieved February 24, 2009.
              20. ^ @1 started with 5.7 terabytes of content, estimated to be 30 times the size of the nascent World Wide Web; PLS was acquired by AOL in 1998 and @1 was abandoned. "PLS introduces AT1, the first 'second generation' Internet search service" (Press release). Personal Library Software. December 1996. Archived from the original on October 21, 1997. Retrieved February 24, 2009.
              21. ^ "Hypertext Transfer Protocol (HTTP/1.1): Caching". Internet Engineering Task Force. 2014. Retrieved July 30, 2014.
              22. ^ Wiener-Bronner, Danielle (June 10, 2015). "NASA is indexing the 'Deep Web' to show mankind what Google won't". Fusion. Retrieved June 27, 2015. There are other simpler versions of Memex already available. "If you've ever used the Internet Archive's Wayback Machine", which gives you past versions of a website not accessible through Google, then you've technically searched the Deep Web, said Chris Mattmann.
              23. ^ Wright, Alex (February 22, 2009). "Exploring a 'Deep Web' That Google Can't Grasp". The New York Times. Retrieved February 23, 2009.
              24. ^ "Intute FAQ, dead link". Retrieved October 13, 2012.
              25. ^ "Elsevier to Retire Popular Science Search Engine". library.bldrdoc.gov. December 2013. Archived from the original on June 23, 2015. Retrieved June 22,2015. by end of January 2014, Elsevier will be discontinuing Scirus, its free science search engine. Scirus has been a wide-ranging research tool, with over 575 million items indexed for searching, including webpages, pre-print articles, patents, and repositories.
              26. ^ Sriram Raghavan; Garcia-Molina, Hector (2000). "Crawling the Hidden Web"(PDF). Stanford Digital Libraries Technical Report. Retrieved December 27, 2008.
              27. ^ Raghavan, Sriram; Garcia-Molina, Hector (2001). "Crawling the Hidden Web"(PDF). Proceedings of the 27th International Conference on Very Large Data Bases (VLDB). pp. 129–38.
              28. ^ Alexandros, Ntoulas; Zerfos, Petros; Cho, Junghoo (2005). "Downloading Hidden Web Content" (PDF). UCLA Computer Science. Retrieved February 24, 2009.
              29. ^ Shestakov, Denis; Bhowmick, Sourav S.; Lim, Ee-Peng (2005). "DEQUE: Querying the Deep Web" (PDF). Data & Knowledge Engineering. 52 (3): 273–311.
              30. ^ Barbosa, Luciano; Freire, Juliana (2007). "An Adaptive Crawler for Locating Hidden-Web Entry Points" (PDF). WWW Conference 2007. Retrieved March 20,2009.
              31. ^ Barbosa, Luciano; Freire, Juliana (2005). "Searching for Hidden-Web Databases" (PDF). WebDB 2005. Retrieved March 20, 2009.
              32. ^ Madhavan, Jayant; Ko, David; Kot, Łucja; Ganapathy, Vignesh; Rasmussen, Alex; Halevy, Alon (2008). "Google's Deep-Web Crawl" (PDF). VLDB Endowment, ACM. Retrieved April 17, 2009

                  .       3.DARK WEB 

                  This article is about darknet websites. For the part of the Internet not accessible by traditional web search engines, see Deep web.

                  The dark web is the World Wide Web content that exists on darknets, overlay networks that use the Internet but require specific software, configurations, or authorization to access.[1][2] The dark web forms a small part of the deep web, the part of the Web not indexed by web search engines, although sometimes the term deep web is mistakenly used to refer specifically to the dark web.[3]

                  The darknets which constitute the dark web include small, friend-to-friend peer-to-peer networks, as well as large, popular networks such as Tor, Freenet, I2P, and Riffle operated by public organizations and individuals. Users of the dark web refer to the regular web as Clearnet due to its unencrypted nature.[4] The Tor dark web or onionland[5] uses the traffic anonymization technique of onion routing under the network's top-level domain suffix .onion.

                  Contents

                  • 1Terminology
                    • 1.1Definition
                  • 2Content
                    • 2.1Botnets
                    • 2.2Bitcoin services
                    • 2.3Darknet markets
                    • 2.4Hacking groups and services
                    • 2.5Financing
                    • 2.6Fraud services
                    • 2.7Hoaxes and unverified content
                    • 2.8Phishing and scams
                    • 2.9Puzzles
                    • 2.10Illegal pornography
                    • 2.11Terrorism
                    • 2.12Social media
                  • 3Commentary and policing
                  • 4Journalism
                  • 5See also
                  • 6References
                  • 7Further reading
                  • 8External links

                  Terminology

                  The dark web has often been conflated with the deep web, the parts of the web not indexed (searchable) by search engines. The dark web forms a small part of the deep web but requires custom software. This confusion dates back to at least 2009.[6] Since then, especially in reporting on Silk Road, the two terms have often been conflated,[7] despite recommendations that they should be distinguished.[1][8]

                  Definition

                  Main article: Darknet

                  Darknet websites are accessible only through networks such as Tor ("The Onion Routing" project) and I2P ("Invisible Internet Project").[9] Tor browser and Tor-accessible sites are widely used among the darknet users and can be identified by the domain ".onion".[10] While Tor focuses on providing anonymous access to the Internet, I2P specializes in allowing anonymous hosting of websites.[11] Identities and locations of darknet users stay anonymous and cannot be tracked due to the layered encryption system. The darknet encryption technology routes users' data through a large number of intermediate servers, which protects the users' identity and guarantees anonymity. The transmitted information can be decrypted only by a subsequent node in the scheme, which leads to the exit node. The complicated system makes it almost impossible to reproduce the node path and decrypt the information layer by layer.[12] Due to the high level of encryption, websites are not able to track geolocation and IP of their users, and users are not able to get this information about the host. Thus, communication between darknet users is highly encrypted allowing users to talk, blog, and share files confidentially.[13]

                  The darknet is also used for illegal activity such as illegal trade, forums, and media exchange for pedophiles and terrorists.[14] At the same time traditional websites have created alternative accessibility for the Tor browser in efforts to connect with their users. ProPublica, for example, launched a new version of its website available exclusively to Tor users.[15]

                  Content

                  Web-based onion services in January 2015[16]CategoryPercentageGambling

                  
                  

                  Illicit links

                  
                  

                  2.3

                  
                  

                  4.3

                  Illicit pornography

                  
                  

                  2.3

                  
                  

                  4.5

                  Extremism

                  
                  

                  2.7

                  
                  

                  5.1

                  Illicit Other

                  
                  

                  3.8

                  
                  

                  7.3

                  Illicit Finance

                  
                  

                  6.3

                  
                  

                  12

                  Illicit Drugs

                  
                  

                  8.1

                  
                  

                  15.5

                  Non-illicit+Unknown

                  
                  

                  22.6

                  
                  

                  43.2

                  Illicit total

                  
                  

                  29.7

                  
                  

                  56.8

                  Inactive

                  
                  

                  47.7

                  Active

                  
                  

                  52.3

                  A December 2014 study by Gareth Owen from the University of Portsmouth found that the most commonly hosted type of content on Tor was child pornography, followed by black markets, while the individual sites with the highest traffic were dedicated to botnet operations (see attached metric).[19] Many whistleblowing sites maintain a presence[20] as well as political discussion forums.[21] Sites associated with Bitcoin, fraud-related services, and mail order services are some of the most prolific.[19]

                  In July 2017, Roger Dingledine, one of the three founders of the Tor Project, said that Facebook is the biggest hidden service. The Dark Web comprises only 3% of the traffic in the Tor network.[22]

                  A February 2016 study from researchers at King's College London gives the following breakdown of content by an alternative category set, highlighting the illicit use of .onion services.[23]

                  Botnets

                  Botnets are often structured with their command-and-control servers based on a censorship-resistant hidden service, creating a large amount of bot-related traffic.[19][24]

                  Bitcoin services

                  Bitcoin services such as tumblers are often available on Tor, and some – such as Grams – offer darknet market integration.[25] A research study undertaken by Jean-Loup Richet, a research fellow at ESSEC, and carried out with the United Nations Office on Drugs and Crime, highlighted new trends in the use of Bitcoin tumblers for money laundering purposes. With Bitcoin, people can hide their intentions as well as their identity.[26] A common approach was to use a digital currency exchanger service which converted Bitcoin into an online game currency (such as gold coins in World of Warcraft) that will later be converted back into money.[27]

                  Darknet markets

                  Main article: Darknet market

                  Commercial darknet markets, which mediate transactions for illegal drugs[28] and other goods, attracted significant media coverage, starting with the popularity of Silk Road and Diabolus Market[29] and its subsequent seizure by legal authorities.[30] Other markets sell software exploits[31] and weapons.[32] Examination of price differences in Dark web markets versus prices in real life or over the World Wide Web have been attempted as well as studies in the quality of goods received over the Dark web. One such study was performed on Evolution, one of the most popular crypto-markets active from January 2013 to March 2015.[33] Although it found the digital information, such as concealment methods and shipping country, "seems accurate", the study uncovered issues with the quality of illegal drugs sold in Evolution, stating that, "... the illicit drugs purity is found to be different from the information indicated on their respective listings."[33] Less is known about consumer motivations for accessing these marketplaces and factors associated with their use.[34]

                  Hacking groups and services

                  Many hackers sell their services either individually or as a part of groups.[35] Such groups include xDedic, hackforum, Trojanforge, Mazafaka, dark0de and the TheRealDeal darknet market.[36] Some have been known to track and extort apparent pedophiles.[37] Cyber crimes and hacking services for financial institutions and banks have also been offered over the Dark web.[38] Attempts to monitor this activity have been made through various government and private organizations, and an examination of the tools used can be found in the Procedia Computer Science journal.[39] Use of Internet-scale DNS Distributed Reflection Denial of Service (DRDoS) attacks have also been made through leveraging the Dark Web.[40] There are many scam .onion sites also present which end up giving tools for download that are infected with trojan horses or backdoors.

                  Financing

                  Scott Dueweke the president and founder of Zebryx Consulting states that Russian cryptocurrency such as WebMoney and Perfect Money are behind the majority of the illegal actions.[26] In April 2015, Flashpoint received 5 million in funding to invest to help their clients gather intelligence from the Deep and Dark web.[41]

                  Fraud services

                  There are numerous carding forums, PayPal and Bitcoin trading websites as well as fraud and counterfeiting services.[42] Many such sites are scams themselves.[43]

                  Hoaxes and unverified content

                  Main article: Hoax

                  There are reports of crowdfunded assassinations and hitmen for hire,[32][44] however, these are believed to be exclusively scams.[45] The creator of Silk Road, Ross Ulbricht, was arrested by Homeland Security investigations (HSI) for his site and allegedly hiring a hitman to kill six people, although the charges were later dropped.[46]

                  There is an urban legend that one can find live murder on the dark web. The term "Red Room" has been coined based on the Japanese animation and urban legend of the same name. However, the evidence points toward all reported instances being hoaxes.[47]

                  On June 25, 2015, the indie game Sad Satan was reviewed by Youtubers Obscure Horror Corner which they claimed to have found via the dark web. Various inconsistencies in the channel's reporting cast doubt on the reported version of events.[48] There are several websites which analyze and monitor the deep web and dark web for threat intelligence.[49]

                  Phishing and scams

                  Phishing via cloned websites and other scam sites are numerous,[50] with darknet markets often advertised with fraudulent URLs.[51]

                  Puzzles

                  Puzzles such as Cicada 3301 and successors will sometimes use hidden services in order to more anonymously provide clues, often increasing speculation as to the identity of their creators.[52]

                  Illegal pornography

                  There is regular law enforcement action against sites distributing child pornography[53] – often via compromising the site by distributing malware to the users.[54] Sites use complex systems of guides, forums and community regulation.[55] Other content includes sexualised torture and killing of animals[56] and revenge porn.[57]

                  Terrorism

                  There are at least some real and fraudulent websites claiming to be used by ISIL (ISIS), including a fake one seized in Operation Onymous.[58] With the increase of technology, it has allowed cyber terrorists to flourish by attacking the weaknesses of the technology.[59] In the wake of the November 2015 Paris attacks, an actual such site was hacked by an Anonymous-affiliated hacker group, GhostSec, and replaced with an advert for Prozac.[60] The Rawti Shax Islamist group was found to be operating on the dark web at one time.[61]

                  Social media

                  Within the dark web, there exist emerging social media platforms similar to those on the World Wide Web.[62] Facebook and other traditional social media platforms have begun to make dark-web versions of their websites to address problems associated with the traditional platforms and to continue their service in all areas of the World Wide Web.[15] Bands with restricted content such as Christian Church have made use of the deep web.[citation needed]

                  Commentary and policing

                  Although much of the dark web is innocuous,[citation needed] some prosecutors and government agencies are concerned that it is a haven for criminal activity.[63] The deep and dark web are applications of integral internet features to provide privacy and anonymity. Policing involves targeting specific activities of the private web deemed illegal or subject to internet censorship.

                  Specialist Clearweb news sites such as DeepDotWeb[64] and All Things Vice[65] provide news coverage and practical information about dark web sites and services. However DeepDotWeb was shut down by authorities in 2019.[66] The Hidden Wiki and its mirrors and forks hold some of the largest directories of content at any given time.

                  Popular sources of dark web .onion links include Pastebin, YouTube, Twitter, Reddit and other Internet forums.[67] Specialist companies with Darksum and Recorded Future track dark-web cybercrime goings-on for law enforcement purposes.[68] In 2015 it was announced that Interpol now offers a dedicated dark web training program featuring technical information on Tor, cybersecurity and simulated darknet market takedowns.[69]

                  In October 2013 the UK's National Crime Agency and GCHQ announced the formation of a 'Joint Operations Cell' to focus on cybercrime. In November 2015 this team would be tasked with tackling child exploitation on the dark web as well as other cybercrime.[70]

                  In March 2017 the Congressional Research Service released an extensive report on the dark web, noting the changing dynamic of how information is accessed and presented on it; characterized by the unknown, it is of increasing interest to researchers, law enforcement, and policymakers.[71]

                  In August 2017, according to reportage, cybersecurity firms which specialize in monitoring and researching the dark web on behalf of banks and retailers routinely share their findings with the FBI and with other law enforcement agencies "when possible and necessary" regarding illegal content. The Russian-speaking underground offering a crime-as-a-service model is regarded as being particularly robust.[72]

                  Journalism

                  Many individual journalists, alternative news organizations, educators, and researchers are influential in their writing and speaking of the Darknet, and making its use clear to the general public.[73]

                  Traditional media and news channels such as ABC News have also featured articles examining the Darknet.[74]

                  See also

                  • Freedom of speech portal
                  • Internet portal
                  • Deepnet
                  • Darknet market
                  • List of Tor onion services

                  
                  

                  References

                  1. ^ Jump up to:a b NPR Staff (25 May 2014). "Going Dark: The Internet Behind The Internet". Archived from the original on 27 May 2015. Retrieved 29 May 2015.
                  2. ^
                     • Greenberg, Andy (19 November 2014). "Hacker Lexicon: What Is the dark web?". Wired. Archived from the original on 7 June 2015. Retrieved 6 June2015.
                     • "Clearing Up Confusion – Deep Web vs. dark web". BrightPlanet. 2014-03-27. Archived from the original on 2015-05-16.
                     • Greenberg, Andy (19 November 2014). "Hacker Lexicon: What Is the dark web?". Wired. Archived from the original on 30 August 2015. Retrieved 27 August 2015.
                     • Egan, Matt (12 January 2015). "What is the dark web? How to access the dark website – How to turn out the lights and access the dark web (and why you might want to)". Archived from the original on 19 June 2015. Retrieved 18 June2015.
                  3. ^
                     • Solomon, Jane (6 May 2015). "The Deep Web vs. The dark web". Archivedfrom the original on 9 May 2015. Retrieved 26 May 2015.
                     • The dark web Revealed. Popular Science. pp. 20–21
                     • Greenberg, Andy (19 November 2014). "Hacker Lexicon: What Is the dark web?". Wired. Archived from the original on 7 June 2015. Retrieved 6 June2015.
                  4. ^ "Clearnet vs hidden services – why you should be careful". DeepDotWeb. Archived from the original on 28 June 2015. Retrieved 4 June 2015.
                  5. ^ Chacos, Brad (12 August 2013). "Meet Darknet, the hidden, anonymous underbelly of the searchable Web". PC World. Archived from the original on 12 August 2015. Retrieved 16 August 2015.
                  6. ^ Beckett, Andy (26 November 2009). "The dark side of the internet". Archivedfrom the original on 8 September 2013. Retrieved 9 August 2015.
                  7. ^ "NASA is indexing the 'Deep Web' to show mankind what Google won't". Fusion. Archived from the original on 2015-06-30.
                  8. ^
                     • "Clearing Up Confusion – Deep Web vs. Dark Web". BrightPlanet. Archivedfrom the original on 2015-05-16.
                     • Solomon, Jane (6 May 2015). "The Deep Web vs. The Dark Web". Archivedfrom the original on 9 May 2015. Retrieved 26 May 2015.
                     • Greenberg, Andy (19 November 2014). "Hacker Lexicon: What Is the Dark Web?". Archived from the original on 7 June 2015. Retrieved 6 June 2015.
                  9. ^ "The Deep Web and Its Darknets – h+ Media". h+ Media. 2015-06-29. Archived from the original on 2015-07-06. Retrieved 2016-11-18.
                  10. ^ Lacson, Wesley; Jones, Beata (2016). "The 21st Century Darknet Market: Lessons From The Fall Of Silk Road" (PDF). International Journal of Cyber Criminology. 10: 40–61. doi:10.5281/zenodo.58521.
                  11. ^ Crenshaw, Adrian. "Darknets and hidden servers: Identifying the true ip/network identity of i2p service hosts, Black Hat (2011)".
                  12. ^ Moore, Daniel (2016). "Cryptopolitik and the Darknet". Survival. 58 (1): 7–38. 32p. doi:10.1080/00396338.2016.1142085.
                  13. ^ Darknet, Social Media, and Extremism: Addressing Indonesian Counterterrorism on the Internet Archived 2017-06-04 at the Wayback Machine
                  14. ^ Kushner, David (2015-10-22). "The Darknet: the Battle for 'the Wild West of the Internet'". Rolling Stone. Retrieved 2019-10-02.
                  15. ^ Jump up to:a b Brooke, Zach (Spring 2016). "A Marketer's Guide to the Dark Web". Marketing Insights. 28 (1): 23–27 – via EBSCOhost.
                  16. ^ Owen, Gareth. "Dr Gareth Owen: Tor: Hidden Services and Deanonymisation". Retrieved 20 June 2015.
                  17. ^ Moore, Daniel. "Cryptopolitik and the Darknet". Survival: Global Politics and Strategy. Retrieved 2016-03-20.
                  18. ^ Cox, Joseph (2016-02-01). "Study Claims Dark Web Sites Are Most Commonly Used for Crimes". Retrieved 2016-03-20.
                  19. ^ Jump up to:a b c Mark, Ward (30 December 2014). "Tor's most visited hidden sites host child abuse images". BBC News. Archived from the original on 25 April 2015. Retrieved 28 May 2015.
                  20. ^ "Everything You Need to Know on Tor & the Deep Web". whoishostingthis. Archived from the original on 2 July 2015. Retrieved 18 June 2015.
                  21. ^ Cox, Joseph (25 February 2015). "What Firewall? China's Fledgling Deep Web Community". Archived from the original on 20 June 2015. Retrieved 19 June2015.
                  22. ^ Thomson, Iain. "Dark web doesn't exist, says Tor's Dingledine. And folks use network for privacy, not crime". Archived from the original on 2017-07-31. Retrieved 2017-07-31.
                  23. ^
                      • Moore, Daniel (2016). "Cryptopolitik and the Darknet". Survival: Global Politics and Strategy. 58: 7–38. doi:10.1080/00396338.2016.1142085.
                      • Cox, Joseph (1 February 2016). "Study Claims Dark Web Sites Are Most Commonly Used for Crime". Archived from the original on 12 March 2016. Retrieved 20 March 2016.
                  24. ^ Reeve, Tom (30 September 2015). "Extortion on the cards". Archived from the original on 10 December 2015. Retrieved 8 December 2015.
                  25. ^
                      • Allison, Ian (11 February 2015). "Bitcoin tumbler: The business of covering tracks in the world of cryptocurrency laundering". Archived from the original on 24 September 2015. Retrieved 8 December 2015.
                      • "Helix Updates: Integrated Markets Can Now Helix Your BTC". 5 August 2015. Archived from the original on 21 February 2016. Retrieved 8 December 2015.
                  26. ^ Jump up to:a b Kirkpatrick, Keith (2017-02-21). "Financing the dark web". Communications of the ACM. 60 (3): 21–22. doi:10.1145/3037386.
                  27. ^
                      • Richet, Jean-Loup (June 2013). "Laundering Money Online: a review of cybercriminals methods". arXiv:1310.2368 [cs.CY].
                      • Richet, Jean-Loup (2012). "How to Become a Black Hat Hacker? An Exploratory Study of Barriers to Entry Into Cybercrime". 17th AIM Symposium. Archivedfrom the original on 2017-01-05.
                  28. ^ "Concepts of illicit drug quality among darknet market users: Purity, embodied experience, craft and chemical knowledge". International Journal of Drug Policy. 35.
                  29. ^ "Stay Clear of the Darknet". Tech Directions. 75.
                  30. ^ Burleigh, Nina (19 February 2015). "The Rise and Fall of Silk Road, the dark web's Amazon". Archived from the original on 25 May 2015. Retrieved 25 May 2015.
                  31. ^ Greenberg, Andy (17 April 2015). "New Dark-Web Market Is Selling Zero-Day Exploits to Hackers". Wired. Archived from the original on 25 May 2015. Retrieved 24 May 2015.
                  32. ^ Jump up to:a b Holden, Alex (10 February 2015). "Ukraine crisis: Combatants scouring dark web for advice on bridge bombing and anti-tank missiles". Archived from the original on 29 May 2015. Retrieved 28 May 2015.
                  33. ^ Jump up to:a b Rhumorbarbe, Damien; Staehli, Ludovic; Broséus, Julian; Rossy, Quentin; Esseiva, Pierre (2016). "Buying drugs on a Darknet market: A better deal? Studying the online illicit drug market through the analysis of digital, physical and chemical data". Forensic Science International. 267: 173–182. doi:10.1016/j.forsciint.2016.08.032. PMID 27611957.
                  34. ^ "Characterising dark net marketplace purchasers in a sample of regular psychostimulant users". International Journal of Drug Policy. 35.
                  35. ^ Holden, Alex (15 January 2015). "A new breed of lone wolf hackers are roaming the deep web – and their prey is getting bigger". Archived from the original on 28 June 2015. Retrieved 19 June 2015.
                  36. ^ "Hacking communities in the Deep Web". 15 May 2015. Archived from the original on 28 April 2016. Retrieved 5 September 2017.
                  37. ^ Cox, Joseph (12 November 2015). "A dark web Hacker Is Hunting Potential Pedophiles to Extort Them for Money". Archived from the original on 15 November 2015. Retrieved 12 November 2015.
                  38. ^ "The Dark Net: Policing the Internet's Underworld". World Policy Journal. 32.
                  39. ^ "Large-Scale Monitoring for Cyber Attacks by Using Cluster Information on Darknet Traffic Features". Procedia Computer Science. 53.
                  40. ^ "Inferring distributed reflection denial of service attacks from darknet". Computer Communications. 62.
                  41. ^ "Flashpoint, Leading Deep and Dark Web Intelligence Provider, Raises $5 Million in Financing Round" (Press release). New York: PRNewswire. April 17, 2015. Retrieved October 2, 2019.
                  42. ^ Cox, Joseph (14 January 2016). "Dark Web Vendor Sentenced for Dealing Counterfeit Coupons". Archived from the original on 24 January 2016. Retrieved 24 January 2016.
                  43. ^ DeepDotWeb (28 May 2015). "Secrets to Unmasking Bitcoin Scams – 4 Eye Opening Case Studies". Archived from the original on 16 November 2015. Retrieved 12 November 2015.
                  44. ^ Greenberg, Andy (18 November 2013). "Meet The 'Assassination Market' Creator Who's Crowdfunding Murder With Bitcoins". Forbes. Archived from the original on 5 September 2015. Retrieved 29 August 2015.
                  45. ^
                      • Cox1, Joseph (18 May 2016). "This Fake Hitman Site Is the Most Elaborate, Twisted Dark Web Scam Yet". Archived from the original on 21 June 2016. Retrieved 20 June 2016.
                      • Ormsby, Eileen (3 August 2012). "Conversation with a hitman (or not)". Archived from the original on 4 September 2015. Retrieved 29 August 2015.
                  46. ^
                      • Nicole Hong, "Silk Road Founder Ross Ulbricht Sentenced to Life in Prison"Archived 2017-06-13 at the Wayback Machine, Wall Street Journal, May 29, 2015.
                      • Andy Greenberg, "Silk Road Creator Ross Ulbricht Sentenced to Life in Prison" Archived 2015-05-29 at the Wayback Machine, Wired, May 29, 2015.
                  47. ^
                      • Ormsby, Eileen (29 August 2015). "Waiting in the Red Room". Archived from the original on 29 August 2015. Retrieved 29 August 2015.
                      • Howell O'Neill, Patrick (28 August 2015). "Dark Net site promised to livestream torture and execution of 7 ISIS jihadists". Archived from the original on 11 September 2015. Retrieved 29 August 2015.
                  48. ^ Barton, Hannah (25 October 2015). "The spooky, twisted saga of the Deep Web horror game 'Sad Satan'". Archived from the original on 23 November 2015. Retrieved 22 November 2015.
                  49. ^ "The Deep Web and its Darknets". 2015-06-29.
                  50. ^
                      • Stockley, Mark (1 July 2015). "Hundreds of Dark Web sites cloned and "booby trapped"". Archived from the original on 11 December 2015. Retrieved 8 December 2015.
                      • Fox-Brewster, Thomas (18 November 2014). "Many Sites That Fell In Epic Onymous Tor Takedown 'Were Scams Or Legit'". Forbes. Archived from the original on 19 June 2015. Retrieved 19 June 2015.
                  51. ^
                      • "Beware of Phishing Scams On Clearnet Sites! (darknetmarkets.org)". DeepDotWeb. 3 July 2015. Archived from the original on 22 February 2016. Retrieved 8 December 2015.
                      • "Warning: More Onion Cloner Phishing Scams". 22 April 2015. Archived from the original on 20 December 2015. Retrieved 8 December 2015.
                  52. ^ Bell, Chris (25 November 2013). "The internet mystery that has the world baffled". Archived from the original on 25 November 2013. Retrieved 8 December 2015.
                  53. ^
                      • Willacy, Mark (26 August 2015). "Secret 'dark net' operation saves scores of children from abuse; ringleader Shannon McCoole behind bars after police take over child porn site". Archived from the original on 26 August 2015. Retrieved 26 August 2015.
                      • Conditt, Jessica (8 January 2016). "FBI hacked the Dark Web to bust 1,500 pedophiles". Archived from the original on 8 January 2016. Retrieved 8 January 2016.
                  54. ^
                      • Cox, Joseph (5 January 2016). "The FBI's 'Unprecedented' Hacking Campaign Targeted Over a Thousand Computers". Archived from the original on 8 January 2016. Retrieved 8 January 2016.
                      • Farivar, Cyrus (16 June 2015). "Feds bust through huge Tor-hidden child porn site using questionable malware". Archived from the original on 9 August 2015. Retrieved 8 August 2015.
                  55. ^ Evans, Robert (16 June 2015). "5 Things I Learned Infiltrating Deep Web Child Molesters". Archived from the original on 26 August 2015. Retrieved 29 August2015.
                  56. ^ Cox, Joseph (11 November 2014). "As the FBI Cleans the Dark Net, Sites Far More Evil Than Silk Road Live On". Archived from the original on 26 July 2015. Retrieved 3 August 2015.
                  57. ^ Markowitz, Eric (10 July 2014). "The Dark Net: A Safe Haven for Revenge Porn?". Archived from the original on 26 November 2015. Retrieved 3 August2015.
                  58. ^ Cub, Nik (17 November 2014). "FBI seizes fake Tor hosted Jihad funding website as part of Operation Onymous, leaves up real site". Archived from the original on 14 January 2016. Retrieved 25 November 2015.
                  59. ^ Vilić, Vida M. (December 2017). "Dark Web, Cyber Terrorism and Cyber Warfare: Dark Side of the Cyberspace" (PDF). Balkan Social Science Review. 10 (10): 7–24.
                  60. ^ Cuthbertson, Anthony (25 November 2015). "Hackers replace dark web Isis propaganda site with advert for Prozac". Archived from the original on 26 November 2015. Retrieved 25 November 2015.
                  61. ^ "Jihadist cell in Europe 'sought recruits for Iraq and Syria'". BBC News. 12 November 2015. Archived from the original on 18 April 2016.
                  62. ^ Gehl, Robert W. (2016). "Power/Freedom on the Dark Web". New Media and Society. 18 (7): 1219–1235. doi:10.1177/1461444814554900. Retrieved 6 December 2019.
                  63. ^ Lev Grossman (11 November 2013). "The Secret Web: Where Drugs, Porn and Murder Live Online". TIME.com. Archived from the original on 28 February 2014.
                  64. ^
                      • Swearingen, Jake (2 October 2014). "A Year After Death of Silk Road, Darknet Markets Are Booming". Archived from the original on 25 May 2015. Retrieved 24 May 2015.
                      • Franceschi-Bicchierai, Lorenzo (13 May 2015). "Hackers Tried To Hold a Darknet Market For a Bitcoin Ransom". Archived from the original on 17 May 2015. Retrieved 19 May 2015.
                  65. ^ Solon, Olivia (3 February 2013). "Police crack down on Silk Road following first drug dealer conviction". Archived from the original on 28 May 2015. Retrieved 27 May 2015.
                  66. ^ Kan, By Michael; May 7, 2019 12:51PM EST; May 7, 2019. "Feds Seize DeepDotWeb for Taking Money From Black Market Sites". PCMAG. Retrieved 2019-12-28.
                  67. ^ Koebler, Jason (23 February 2015). "The Closest Thing to a Map of the Dark Net: Pastebin". Archived from the original on 15 July 2015. Retrieved 14 July 2015.
                  68. ^ Simonite, Tom (18 March 2016). "The Surprising Light Side of the Dark Web". Retrieved 20 March 2016.
                  69. ^ Ricard (2 August 2015). "Interpol dark web Training Course". Archived from the original on 28 April 2016. Retrieved 8 August 2015.
                  70. ^ Box, Joseph (8 November 2015). "The UK Will Police the dark web with a New Task Force". Archived from the original on 10 November 2015. Retrieved 9 November 2015.
                  71. ^ Finklea, Kristin (2017-03-10). "Dark Web" (PDF). Archived (PDF) from the original on 2017-03-20.
                  72. ^ Johnson, Tim (2017-08-02). "Shocked by gruesome crime, cyber execs help FBI on dark web". Idaho Statesman.
                  73. • Burrell, Ian (August 28, 2014). "The Dark Net:Inside the Digital Underworld by Jamie Bartlett, book review". Independent. Archived from the original on June 20, 2015.
                      • "The Growth of Dark Subcultures On the Internet, The Leonard Lopate Show". WNYC. June 2, 2015. Archived from the original on October 20, 2016.
                  74. ^
                      • Viney, Steven (January 27, 2016). "Print Email Facebook Twitter More What is the dark net, and how will it shape the future of the digital age?". ABC. Archived from the original on October 20, 2016.
                      • "The Other Internet". Vanity Fair. 58.                                                                                                                  THANKS FOR VISITING MY SITE....I HOPE THIS CONTENT WOULD BE USEFUL TO YOU.......FROM:NOMAN. BLOGGER