The Department of Defense Is about to Enhance Its Deep Web Search Engine


A lot of people have never heard of Memex. Memex is a deep web search engine developed by DARPA (Defense Advanced Research Projects Agency), the agency that created the ARPANET, which served as a basis of the internet we use nowadays.

Memex is a deep web search engine that doesn’t quite work like Google or Bing. DARPA sees Memex as a set of search tools intended for government use, unlike commercial search engines as the ones mentioned above. This deep web search engine powers domain-specific searches that then show sophisticated infographics as results. According to Tech Times, this new search engine can crawl 90 to 95% of the deep web.

The current goal is to battle human trafficking and slavery-related content. In the future, it’ll also be useful to take down drug traffickers, terrorists, and pedophiles. Per the International Labor Organization, almost 21 million people are victims of forced labor worldwide, leading to a private economy of $150 billion in profits a year.

Memex was already successfully used in the past. In 2014, a sex trafficker named Benjamin Gaston was sentenced to 50 years in prison after he was found guilty of several crimes. Among them were sex trafficking, kidnapping, sex abuse and rape.

The deep web search engine is about to grow stronger

According to Venture Beat, the security and intelligence company IST Research has acquired Rescue Forensics. IST Research has worked with DARPA for years now, and the acquisition is going to help their efforts grow in effectiveness.

Rescue Forensics was acquired for an undisclosed amount, but is known their technology is to be used to improve the Department of Defense’s deep web search engine, Memex. It will be used alongside IST’s Pulse Platform.

Rescue Forensics works with the use of big data, analytics and computer forensics, in order to give law enforcement agencies intelligence they can act upon. They work with over 450 agencies throughout the world.

IST’s Pulse Platform is partly funded by the Department of Defense, and works by looking at phone addresses and emails as well as commonalities such as spacing, used in ads on the deep web and aggregation sites.

According to IST’s founder Ryan Paterson, so far the Pulse Platform has been focusing on extracting information from parts of the world where both security and accessibility aren’t great:

We’re interested in child soldiers, we’re doing work in central Africa right now with the Lord’s Resistance Army, fighting the LRA there, that Kony mission, humanitarian assistance and disaster response, what’s happening in Mosul, in Aleppo

Memex is currently crawling the deep web in search for a specific group of criminals, alongside other solutions such as TraffickCam and The Polaris Project. As the previously mentioned report from Sophos mentions, however, if it keeps on being successful, we might need to rename what is currently the deep web.

Image from Shutterstock.

Cryptocurrency enthusiast, writing about financial freedom and the future of money