Journey Into The Hidden Web: A Guide For New Researchers
Table Of Contents
There are many words to describe the deep web, including the invisible web, hidden web, and even Deepnet.
The reason it exists is because the Internet has become so dependent upon search engines, and search engines are only as good as the web crawlers that serve up content for the results. Some researchers believe that the searchable web is barely 1% of what’s actually available on the World Wide Web.
Crawlers are excellent at crawling through static web pages, extracting information on those pages, and providing that information in the form of search results. However, there is valuable information tucked away below the surface of those search results – information buried inside online databases and dynamically generated pages that the search spiders are capable of crawling.
Just a few examples of those tremendous databases include information like patents, census data, data collected on space missions, climate data and academic databases filled with scientific papers overflowing with interesting and valuable information.
All of this doesn’t even include the deepest and darkest corner of the Internet where secretive onion websites exist, accessible only through special Tor software. A basic layout of what this looks like is shown below.
Methods of accessing these different parts of the deep web are determined by the data that you want to get at. The tools used to navigate the deep web are outlined here.
- Databases – Information about people, census data, climate data, world information and other searchable information that could be stored in a table format.
- Journals and Books – Information contained in a digital format that is either stored in a format not accessible by web crawlers or exists behind a paid gateway. These files need to be downloaded and opened on a PC.
- Tor Network – Sites that want to remain hidden, and typically include things like illegal porn, stolen personal data, drug contacts, anonymous political dissidents, terrorists, and more.
This manual will take you on a tour through the many levels of the deep web, starting with the databases where you can find information only accessible to those who know the secrets to accessing them. Then, we’ll continue on to the spectrum of information available in academic journals and books where you can browse through volumes of writings about scholarly topics. Finally, we’ll arrive at the gates of Tor, beyond which lies the deep darkness of the entire Internet.
If you are a landlord or if you’ve ever taught in most school systems, then you’re probably more than familiar with one of the most common deep web databases around – the background search.
Most businesses or public institutions like schools will pay for a background check, but there are also databases all throughout the Internet where you can query to learn more about people.
The databases that are available for free include public records, criminal databases, digitized court records, and a variety of “people search” websites that provide basic identifying information, physical address, and family details.
There are a number of reasons to use deep web for people research – everything from finding lost relatives to genealogical research.
A common use of people search databases is by adopted children trying to find their natural parents.
Regular people-search websites and services can be used for adoption research, but usually such research is hit-and-miss, since most of the free services provide only superficial information about people, and the paid websites require the researcher to know things like birth date and current location of residence. In most cases, an adopted child or parent may have some vague idea of the birth date, but no idea where the person is currently located.
This kind of research is so common in fact that there is now an influx of new websites specifically designed to match adopted children with natural parents who want to be found.
These are non-profit “registries” where adopted children and the parents who gave up their children are able to register for finding their child or parent.
These databases are not accessible from search engines, but knowing the right registry databases, either parents or children stand the chance of discovering and reuniting with their family members.
Another common use for people-search websites is when children run away, one parent leaves the family, or extended family members simply lose contact over time. In cases like these, a family member may seek out resources on the Internet to track down those relatives. Typical tools for this sort of research includes things like:
- Social Networks – There have been many family reunions on Facebook
- Search Engines – You’d be surprised what you can find!
- Public Records
- Online White Pages
- People Search Websites
- Birth, Marriage & Death Indexes
Finding lost relatives is probably one of the hardest research activities on the deep web, unless you have a good amount of detailed information about the person. Usually with a birthday, current residence, current age, full name or the names of immediate family members, you should be able to locate nearly anyone to a good degree of certainty.
Most veterans work for a national government, and since most governments that are open with information offer a number of valuable and useful tools for research, veteran research on the Web is actually very fruitful.
For example, the Ministry of Defence in the UK provides a “Subject Access Request” form where veterans can request their own service records from the government.
This form can be found at The National Archives for the UK, and most governments around the world also have their own National Archives online where you can also do veteran research for service members in your country.
In addition to national archives, you can do Veterans research online using the following Deep Web resources not searchable via any search engine.
- FOIA Requests
- Non-Profit Organizations for Veterans
- US Veteran Services Websites
- Historical Research Websites
Because veterans records are maintained by governments, and because they are typically stored in locations that are easy to access, finding the records for specific veterans is usually pretty easy. This is especially true when those records have been digitized, which is more common these days than ever before. The Deep Web is chock-full of valuable veterans information.
MakeUseOf Genealogy Manual is always a great place to start.
One of the more well-known and long running one of those are the various GenWeb projects across the world.
Most major countries have their own branch of the GenWeb website, and each of those is focused on providing a database of local ancestry research resources to genealogists in those local areas.
Other Deep Web databases that you’ll find on the topic are things like:
- Cemetery Records
- Online Obituaries and Birth Notices
- Free Genealogy Databases
- Local Historical Society Databases and File Archives
Whether you’re a landlord trying to verify that your new tenants don’t have a criminal record, or you’re trying to find out if your new boyfriend has some deep hidden secrets he’s not telling you, there are lots of legitimate reasons for wanting to conduct a background check.
Any in-depth background check that you conduct online is likely going to cost a modest fee. However, what many people don’t realize is that there are legitimate ways to look up background information about people at no cost on the web. You can’t get all of the details, but you can pull up information like family members, email addresses, phone numbers and even a criminal record.
If you don’t want to spend any cash right away for the paid online background database information, you can always dig through the Internet for information. With a Google search or by searching on social networks, you can learn a lot about people – but not nearly as much as you can uncover when you start dipping into the Deep Web.
Even paid services offer just enough information in the free “introductory” searches that will let you dig up even more dirt on other sites, like public records databases.
Options to look up background data on your own include:
- County or small regional government websites with searchable databases for local town code citations, birth or marriage records
- State databases for arrest records or criminal history
- Federal databases for licenses and federal criminal records, investigations, and any military service
The benefit of using paid database searches is that it saves you a lot of time and effort to dig up information on individuals. However, you can discover much of the information that turns up in the paid background reports by taking the time to visit various public records websites around the net that offer databases filled with records that are publicly accessible by anyone for free.
Sometimes, when you’re researching the Internet, your needs may go deeper than just researching people. It may involve digging into the history about a certain location or an event. This kind of research can span several areas of the deep web – and these areas include academic resources, government and legal case databases, and of course the many historical resources buried throughout the web, and untouchable by most web crawlers.
No matter where in the world you live, the odds are pretty good that you have a historical society there, or at least some organization who works to preserve and protect the history of that local region.
That local historical society may actually have their own online research database where you can search for digitized historical records.
These databases – unreachable by search engines – contain photos, scanned historical documents, and other records that all together make up a treasure trove of information that you have access to thanks to the Internet.
In additional to historical societies, your local library may actually offer similar database search utilities on their websites that let you look up digitized documents or newspaper scans that cover the history of the region.
Local history is also linked to genealogy. Researchers use just about every records database on the Internet – public records, historical societies, libraries and more, in order to track down the lineage of a family.
One of the most well-known Deep Web databases that is used as part of historical research like this is FamilySearch.org.
This is a website that is astonishingly rich with information and resources for doing genealogy research, considering the fact that the service is provided entirely free, built and supported by The Church of Jesus Christ of Latter-day Saints.
It certainly isn’t the only genealogy database website out there, but it is one of the largest.
Whether or not you’re in trouble with the law doesn’t matter – when it comes to taking a stance on public policy or on any issue that involves legal questions, it’s good to have access to court cases and court decisions that set precedence for future court decisions.
In fact, if you arein trouble with the law, your lawyer will hopefully have a legal researcher who is well aware of the deep web, and capable of exploiting all of the resources that are buried there.
A few examples of legal research websites that you’ll find in the deep web include:
- Law school court opinion search engines
- Law library case databases
- Non-profit legal organization search tools for legal cases
There are literally thousands of high quality legal research databases available on the Internet today, and surprisingly, not one item from that mountain of case documents and court decisions ever makes its way into search engine results. It’s basically a mountain of data about people, companies, organizations and historical events that you have access to if you know where to look.
Academic research goes on around the world every single day. Often, findings are reported in the news, and other times they go unnoticed. However, you can find all of these studies tucked away deep inside of the deep web in the databases stored on various university servers.
Usually these academic databases are accessible and searchable by the public, but there are some systems that will charge you for access to the scientific journals where many of those findings are published.
However, the best option when looking to the deep web for data on academic studies and research findings are the free search tools offered by large organizations like Google (Google Scholar) and Microsoft (Microsoft Academic Research).
These are search forms that will burrow deep into the academic research databases and pull out the research and the findings that are most important to you. You won’t find these through search engines, but only through these academic research database search tools that pull the data out of the deep web for you.
If the informational databases and private search tools of individual organizations make up one small part of the deep web, then Tor represents the secret dark corners where few respectable people dare to go.
Think of Tor as an alternative web. It is literally its own network, where websites don’t have any domain or IP addresses. Because of this, they are completely inaccessible to search engines. You need a special browser — these days known as the “Tor browser bundle” to access those difficult-to-find websites. I’ll give you more details on that later.
The Tor browser is your gateway into the Tor network of websites where you can download pirated movies and music, access questionable pornography or conspire to commit a crime.
Okay — so it isn’t all just about bad stuff. The Tor network is also where journalists, protesters and other people go who are wary about governments or officials trying to track their online activities. The Tor network, being one level removed from the Internet itself, provides a certain degree of privacy and security.
The websites located on the Tor network are known as “onion” sites, because most of the sites located there end with the .onion extension — only readable with the Tor browser.
The Tor browser lets you browse the normal Internet anonymously — under a fake IP address. However, to access the hidden websites, you’ll need to find the Onion directories. You can browse the regular Internet for directories that list active Onion sites.
Some of those sites may also include “Deep Search” sites that act as sort of search engines for the Tor Network. Most Onion sites come and go, so it isn’t useful to list any active ones here because they likely will disappear before long.
The best way to find the sites is to start with a standard Internet search engine for “onion sites” and look for search engines or directories within the Tor network. Access those from your Tor browser, and you’re on your way toward discovering the many secret Onion sites scattered throughout the deep web.
Once you start exploring the Tor network through these directories and search engines, it won’t take long for you to realize just how astonishing this part of the Deep web really is. You’ll find all sorts of downloadable content like books, magazines, and all kinds of other media that you’d be hard-pressed to discover on the open web.
Much of this is content that is openly available for free to the public without any sort of royalty issues, but there is also content throughout the Tor network that is fully licensed and where the owner should legally receive royalties. By downloading the content – like music, movies and more – you are essentially stealing those published works from the creator.
However, that ethical problem doesn’t stop the Tor network from being used as the distribution center for illegal, pirated movies, music and print publications.
In fact, the anonymity provided by the Tor browser, combined with the creation of so many “secret” websites that offer anything you could possibly hope to find, has also resulted in the proliferation of things like illegal pornography, terrorism and crime handbooks, stolen credit card numbers, and more.
This is the darkest part of the web, so the fact that this kind of content and people exist there shouldn’t surprise you – so if you do decide to go there, tread very carefully.
In the next chapters, we’ll provide you with specific instructions on how to go about finding information, data or other content inside the deep web. In addition. you’ll find lots of useful resources in each section, which should offer a good starting point in your own journey through that part of the invisible Internet.
Have you ever wondered how many women vs men use social networks? Are you working on a research paper for school, and need to know the results of the latest studies on disease?
The volume of data that’s available on the Internet outside of the reach of search engines is remarkable, and this is especially true when it comes to statistical research online. The reason for this is that there are two types of organizations that generally make it their business to distribute very detailed statistical information to the public — governments, and educational organizations.
By taking advantage of the free databases made available by these organizations, you can discover information that most people would find surprising. Anyone else who tries to find that data simply by Googling won’t find it, because to get access to that data, you need to know the URL for the search form of those databases.
The following are some of the most valuable deep web databases for statistical data on the web.
Governments around the world offer citizens a virtual warehouse filled to the ceiling with impressive data about regions and people. The following are some examples of government databases around the world.
Nearly every agency inside of the U.S. government performs some form of research. Because of this, the U.S. government as a collective entity contains an unimaginable amount of data. As a service to the public for sifting through all that information, the government offers a website called FedStats that organizes government-created statistical data in one place.
The “Topic Links” section allows visitors to sift through a list of U.S. statistical data on subjects like adoption, state and national historical data, disease rates, educational statistics and much more. FedStats is probably the single most comprehensive statistical database research tool for deep web researchers. Most of the data found here is available in PDF format, or via database search forms.
The Pollak Library at the University Fullerton of California has accumulated its own impressive collection of free government databases for you to sift through for information.
Interesting databases you’ll find here include the Homeland Security Digital Library, the Child Welfare Information Gateway, and the Educator’s Reference Desk [ERIC].
Another valuable resource for government deep web databases is a wiki called GODORT, the Government Documents Round Table of the American Library Association. GODORT offers a list of State agencies across the United States. In this Wiki for every state in the U.S. you can find court docket records, political information, property databases and more.
Other government databases that provide you with information that’s untouchable to search engines includes all of the following:
- CGP– A database of published government ebooks covering research and studies across many different topical areas.
- Christopher Center- Valparaiso University has a nice collection of government databases, organized by genre like Arts & Humanities, Consumer Affairs, Education and more.
- GPO– The U.S. Government Printing office offers a useful search engine for collections of printed documents like government manuals, laws, presidential papers and more.
If you live in Europe and you’re looking for deep web government databases online, there are plenty of options. In Europe, there are just as many (if not more) Departments and organizations where you can find data that may be important to you, but you need to know where to look.
Because the list is so long, the European Union actually provides a directory of government databases organized by subject.
In the EU directory, you’ll find sections for Agriculture, Environment, Public Health and even local development databases like EURYDICE, the Educational system and policies in Europe where you can find facts, figures and reports about the educational systems in Europe, all buried deep inside the website as a collection of PDF reports and data.
Just like FedStats for the U.S., the corresponding starting point for European statistics is a website called Eurostat. It is a little more focused on government financials than anything else.
Here, you can look up database information about government expenditures, government debt, and quarterly financial statements.
This is all great for financial information, but what about the sort of data sources that you’d find at a place like the National Archives in the U.S.? Well, the Harold B. Lee Library at Brigham Young University offers a system called Euro Docs, which is a giant directory linking you to historical documents for European countries.
You never know what you’ll find while browsing through these resources. While many of these are simply links to other informational websites, many of those external websites are databases or documents to volumes of information.
For example, at one link I stumbled upon a digital, interactive map of Roman and Medieval civilizations in Europe.
One of the coolest tools that you could use to efficiently visualize public data from around the world is theGoogle Public Data Explorer, an online data visualization tool that we’ve covered previously at MakeUseOf.
This is an amazing tool that pulls data from many of the same government data sources mentioned above, but in a visual format, allows you to compare and predict data trends across the world for things like domestic issues, economic factors, education, and agriculture.
You can select from the list of any country in the world, and even filter by gender, or narrow the size of the prediction window from 50 years down to just a few.
Across the world, there are many thousands of ongoing scientific studies and research about some of the most important issues facing the world today. Many of the findings in these studies have ramifications that sometimes could influence the health, social beliefs or the laws of entire populations.
Academic databases are probably the deepest part of the invisible Internet, so it’s not an easy task to cover all of them, however there is a very clear shortlist of resources that provide access to the largest bulk of academic journals and books on the Internet. These are search engines or database that are inaccessible to the Google search engine. Once you start using these resources to research for statistics, studies and other data, you’ll wonder how you ever got by without it.
One of the most comprehensive search engines for academic journals and books is JSTOR, a digital library of over 1,500 journals, books and other sources.
The goal of this non-profit is to help researchers, students and others build and use a “wide range of scholarly content”.
Even if you don’t plan to invest in obtaining research material, most of the studies and other sources provide findings in the introduction, so you can at least obtain the ultimate conclusion of the study even though you need to pay to read the entire report.
The results of most searches using this database search tool usually return hundreds or even thousands of results. The journals and other sources that are available are displayed in sample form — but to download the full study or book you do need to pay.
Another very popular resource for digging into the deep web of scholarly works is ironically Google itself, with a resource known as Google Scholar.
Google Scholar will sift through articles published in major journals — utilizing the same search techniques as organizations like JSTOR, and often providing the same results. Google Scholar provides access to journal publications, patents and even case law results from U.S. federal or State courts (U.S.-based only).
The patents search capability of this search tool is worth its weight in gold. There are some amazing discoveries hidden away in the patents database.
One of the most well known academic research tools is the Institute of Education Sciences (ERIC). This system run by the Education Department of the U.S. government has long been a tool of librarians and educators to conduct academic research, and to help students find citations for their work.
ERIC is probably one of the most useful resources for students, because many of the papers and studies provided in the results are available in full from educational institutions or non-profit research organizations. Excerpts are always available, and a direct link to the source is provided for every result.
You can search for only published work that has been peer reviewed, or only for results that provide the full text download straight from the ERIC system. The ease of use and low-cost of many results make this a research tool of choice for academic information on the deep web.
Never to be outdone, Microsoft provides a counterpart to Google Scholar in the form of Microsoft Academic Search.
Like Google Scholar, many results are available for free, but just as many of the results include links to paid academic journals or journal distributors. Excerpts are available however, so if only the results or findings of the paper are desired, this is a quick and easy search tool to find those.
If you’re looking for only freely available papers and journals, then you’ll want to explore the Genamics journal database. This search tool and journal directory is focused only on “freely available journal information”, and allows you to search by Title/ISSN, or browse using the “Category Browser” within the academic area that you’re interested in.
The website doesn’t look very professionally made, but the face of the site betrays the fact that the database contains over 101794 journals available for free, and that list continues to grow.
If academic conferences are your thing, then you’ll definitely want to check out the Conference Alerts website. Conferences are a fantastic way for academics to discuss and share research, and just to meet other professionals within the academic community. Conal is a website that lets you search for conferences by topic, country, or city.
This site isn’t just some dead listing that hardly ever gets updated. This website isn’t entirely a deep web search tool, because the listings themselves are HTML based, so search engines could crawl these results.
However, the Conal advanced search tool lets you search through the entire database by date, and you can subscribe to automated alerts that let you know of upcoming conferences that fit your search criteria.
Other valuable resources if you are an academic researcher looking for information inside of the deep web:
- iSeek– The creators of this tool promise the results are safe, authoritative, intelligent and time-saving.
- Digital Library of the Commons– The DLC is provided by Indiana University so students can research “full-text articles, papers and dissertations.” Most of the results found here include full PDF documents not accessible to search engines.
- Infomine- This search engine from the University of California is what the school library offers to students to find scholarly information on the Internet.
One of the most common areas of the deep web that people dive into are resources available for checking into the background of other people. This might be a journalist trying to vet a source, a landlord looking into the background of a potential tenant, or a number of other reasons to research another person.
Researching people online covers a wide range of different areas and resources, mostly depending on what type of information you’re looking for, how you want to use it, and your connection or relationship to the person you’re researching.
In the following sections, you’ll learn the many different ways that you can do background research on people. In most cases the services are free, but in those cases where there’s a cost, that will be clearly noted.
Between 1999 and 2011, there were roughly 234,000 adoptions. That means that the odds are pretty good that of those thousands of children across the world, either one of the adopted children or one of the natural parents will eventually want to locate and reconnect with each other.
A very good starting point for any adoption research effort is the Adoption Database. This site offers a search tool where you can filter for things like adopted name at birth, date of birth, birth mother’s maiden name, the hospital where the birth took place, and much more.
The volume of detail and the depth of results from this database is tremendous. What you’ll basically find here are records from adopted children or natural parents who’ve submitted their information so that they can be found, in addition to who they are looking for.
This means that the database is balanced on the principle that if both the adopted child and the natural parent both want to be found and submit their information to the database, the odds are good that they’ll find each other. There are thousands of records spanning many years of adoptions in this database, which makes it a powerful tool for adoption research.
Another free tool that can help with adoption research is the Adoption Registry. This registry is run like a classified ads database, where natural parents or adopted children can place an ad describing themselves and who they are looking for.
Another good search tool is called FindMe.org, a non-profit and free “mutual consent” reunion registry. This is a registry that lets both the adoptee and the adopted find each other when they are both interested in being found.
A final, useful deep web search engine for adoption records searches is a registry search tool called Adoptee Connect [Broken URL Removed].
The listings themselves are free to browse or search, but to see more of the details (such as contact info) of the poster, you’ll need to sign up for a free membership. A basic free membership provides you with 5 free entries into the database, and free searching. For more entries, you’ll need to upgrade your account.
Whether you’re a landlord looking to ensure your future tenant isn’t a criminal, or you just met someone new at the local dance club and want to make sure they’re not a creep, searching someone’s background on the Internet is exceedingly easy.
There are a number of websites that will provide you with information about a person’s location, online interests and even the names of their family members for absolutely free. Many of these offer limited information with a paid premium service to see all of the details.
It even provides the town where the name was located in public records, and a list of potentially related names. Many times these names are actually people who lived in the same place as that person, but are not actually relatives — so the service is not perfect.
A similar service to this is Intelius, which provides similar information, as well as a history of most recent places the person has lived. It isn’t always easy to identify the actual person you’re interested in, especially if the name is fairly common.
There are some more advanced free services that do more than just provide basic listings from public records databases, but actually use custom Internet searches to dig up whatever information exists about the person across websites, blogs and social networks throughout the Internet.
One example of this is a site called PeekYou, where you can search for a name in a specific region across the world, and then review profile information that PeekYou has collected about the person based on their activities on Twitter, Facebook, forums and other activities across the net.
Another site like this is Pipl, which provides you with search results that span different people search services across the net, as well as social network activity and regular search results.
If you are concerned that the person you’re dealing with specifically might be a sex offender, there is a National Sex Offender registryquick search available (U.S. only) provided by the U.S. Department of Justice, that will show you whether that person’s name appears in any State’s registry anywhere in the United States.
There are plenty of paid services that will perform a criminal background check for you, but the truth is that in the U.S., if you know the State where a crime probably occurred, you can usually do your own research right at the State website.
Just look for the state Criminal Justice Department website, or the Corrections Department website. These services are usually free and offered for the good of public safety.
If you are more interested in fast, paid services, the following options are available for criminal searches on people:
- Criminal Check– Search all state criminal records databases at once.
- Black Book Online– Lets you search the records of criminal courts, prison inmate records, and even arrest warrants.
- FBI– While you’re the only one who can request your own records, aside from the police, you can submit for an Identity Theft Summary from the FBI to determine if your “rap sheet” is accurate.
International/European services to search criminal records:
- Verified Credentials– Performs an international background check, but you must be a registered business.
- Interpol – Offers a search tool for searching whether someone is listed in the International list of Wanted Persons.
- ICC(International Criminal Court) – Provides search tools for cases, panel discussions and news releases about past cases. This can turn up criminal cases regarding the person you’re researching.
Surprisingly, one of the most useful deep web research tools to find people is actually the simplest — phone directories. The old days of thick paper phone directories being delivered door-to-door are pretty much over.
Now, you can pretty much go online and so long as you know the name of the person you’re looking for and the town where they live, you can probably get their phone number and street address – assuming they haven’t specifically requested that their information be kept private (which usually requires a fee paid to the phone company).
The White Pages Neighbors look-up tool is an excellent example of this. A quick search for my info turned up my full name, phone number, and street address.
It got my age just a tiny bit off – but hey, I’m not complaining!
Other yellow & white page online directories where you can do the same kind of look-up with similar results include:
- WhoWhere.com– U.S. based search that includes a mobile app.
- AnyWho.com– Lets you search for both people and businesses.
- WhitePages International– Use the International directories listing to search phone directories for other countries across the world.
- Reverse Phone Directory– Provides a “people search” option to look up addresses and phone numbers.
- New Ultimates– Lets you search 10 phone directory databases at once from a single page.
- Zaba Search– One of the few phone directory search engines that lets you search names in all 50 U.S. States at once.
Are you looking for information about veterans in your family or want to dig into historical research? There is a surprising wealth of veteran information in the deep web, buried behind uncrawlable military database search tools.
The most impressive, free deep web directory for veteran information is the Veterans History Project.
This is a tremendous historic database filled with volumes of veteran service information, and a very useful resource if you’re looking for information about a specific service member.
Other deep web resources for finding information about veterans include:
- National Archives– At this site you can locate historic military service records and documents online, plus you can request specific veterans records like personnel and medical records.
- VetFriends– A service that helps veterans reunite, is also a great deep web search tool for searching through over 10,000 units and over 1.5 million military names. Search is limited unless you join as a member.
- Grave Locator– An excellent resource for veterans who fought alongside and lost friends in battle. The service is offered by the U.S. Department of Veterans Affairs, and you can locate the graves of soldiers by name and date or birth or death.
- Find a Grave in Scotland– Similar to Grave Locator, except this is focused on graves in Scotland and includes citizens as well as soldiers.
- Ancestry.co.uk– Provides you with a search form to find soldier, veteran and prisoner lists from the past.
After traversing the fields of the deep web, you’ve now arrived at the entrance to a cave. This cave is a deep, dark one where the potential for danger is great, but so is the possibility of finding treasure.
Presenting the Tor network, also known as “Onion sites”, due to the fact that the sites that are hidden away on the network often have the extension of “.onion”.
The Tor network is essentially an Internet within the Internet. You need special software to visit the pages hidden there, and since sites hosted on that network do not use an IP (Internet Protocol), they are not only uncrawlable by search engines, but it is extremely difficult for law enforcement to track down and prosecute sites there with illegal content.
If you dare to enter this deep domain, the first step is to download the Tor Browser Bundle.
Once you’ve installed the Tor browser, your next task is to find all that hidden content. How do you find hidden websites? Well, think back to the early days of the Internet when there were no magical search engines crawling the net and returning results automatically. There were hundreds of “directories” available where you could find what you were looking for.
That is precisely the case here, with directories known as .onion link lists. The three most common of these – and excellent starting points for your journey into this dark land – are the following (access these links with your Tor browser.
- TorLinks- A categorized list covering everything from financial services and drugs to warez, media, political and erotic links.
- The Hidden Wiki- This Wiki page is a frequently updated directory covering all sorts of content like media, books, whistleblower sites and more.
- Deep Web Links- Lots of valuable links to be found on this directory, with an over-arching theme of freedom of speech.
You can find other examples of such directories in Chris Hoffman’s article on how to find active Onion sites .
These are starting points for exploring the darker hidden web of Tor, but they are most certainly not the only places to go. Many of the sites hidden away on the Tor network are provided via word of mouth and through communities of people who are also interested in the same content. Many of this “sharing” takes place on the regular Internet on websites and forums.
Some places to check for onion links thrown out into the public where you may discover them:
- Reddit /r/onions– A dedicated area devoted to Onion sites.
- The Hidden Wiki– This site has a frequently updated blog of new onion links, but you’ll also find user-generated comments throughout, where you might also discover interesting onion links.
- DeepDotWeb– Deep Dot Web is a popular blog that stays on top of not only deep web links and news, but also anything to do with bitcoin, since the two topics and communities are usually tightly intertwined.
- Pastebin– Search this directory frequently for anonymously posted onion links.
- Anonbin– Another popular dropping point for anonymously shared onion sites.
Once you’ve installed Tor and you’ve warmed up your taste buds for all of these interesting deep web links, your final mission – if you choose to accept it – is to read the MakeUseOf Tor Guide , and really start exploring this mysterious area of the Internet.
What Are Your Favourite Deep Web Resources?
There are countless other interesting places to explore in the deep web. What are the best research resources you know of?