Bayesian Analysis and OSInt to predict Turkey imposing a No-Fly zone

Deep web can be used in many ways, in this case I've used deep web to dig up some tools from Bayesian statistics used for forecasting.

http://deep-web.org/using-osint-research-and-bayesian-stats-to-predict-turkey-imposing-a-no-fly-zone-in-syria/

Deep Web assets and the illuminati that keep them there

There are heavily funded organizations that will fight fiercely to keep data in the Deep Web where they can  profit from it. This is just one battle of many to come. 

It is a case study of a moral dilemma that is beyond my pay grade. Make of it what you will, but be aware that these battles are raging.

For more go read...

http://deep-web.org/fighting-the-system-trying-to-take-a-deep-web-asset-into-shallow-web/

World Class Science Lectures from the Deep Web

Ok, so maybe I missed a few lectures in college. Perhaps quite a few.  But via research, I've found an excellent deep web resource for high authority, peer reviewed, lectures covering science and technology.  Known at videolectures.net and provided free of charge to the public. The library contains 15,000 lectures of which 66% are in English. Provided to us for free courtesy of the Center for Knowledge Transfer subsidized by Slovenia. Hats off to those guys.

Science deep web portal

The department of energy did something quite nice. They put together or at least funded a very nice deep web portal for academia. For more details go here...

http://deep-web.org/deep-webscience-portal/

 

Cyber Security & Cyber War

There is a large body of knowledge in Video. Video inevitably is deep web as the bots can't understand it.  Infosec tends to have a lot of video therefore this knowledge is hidden from the surface web by the nature of the media.

Today I've updated to entries with a large repository of videos in Infosec-

Cyber War / InfoSec

Iron Geek irongeek.com -- An excellent library of videos explaining many facets of InfoSec and hacking & security

Security Tube - securitytube.net -- A large library of videos covering many topics in InfoSec, cyberwar, and most of the hacking conferences.

DefCon -- The main hackers Con, so well known that now the Feds send their folks here and it has become a wild west training ground for coming trends. Archives go back to Defcon 1. They are now on Defcon 20, I think.

New Deep Web book archive found

The Archaeological Survey of India has quite the index of indian and asian history books. Quite a deep web resource. Some books listed have scanned pdf copies. If not, at least you have identified new sources.

http://deep-web.org/asian-book-archive-found/

Deep Web Newspaper Archives

Newspaper Archives Online

Some deep web research requires digging in the past for events. One good source for that is newspapers, here are some resources that provide lists of online newspaper archives.

US newspaper coverage - ResearchGuides lists links to many newspapers

Library of Congress Newspaper Resource List - LOC does a great job getting the list together of wonderful newspaper archives.

NewspaperArchive.com - (commercial) - Known for a large collection. I haven't used it, so I can't confirm this.

xooxleanswers.com - Great list of newspaper archives from Xooxle. Good list and a funky name. Two thumbs up.

University of Penn Newspaper Archive - List of US newspaper archives and dates. Looked like a deeper list of Texas newspapers, so this effort my be a deep comprehensive list.

The Quandry of Judging Author Authrority

Ever found a really interesting article or book on a subject, but not sure how much you should trust the author as an authority?  This is a common problem researchers have over and over and over.

There are several quantatative methods to figure out how much credibility or authority rank to give that author. Take a peek at the methods over at Deep Web

http://deep-web.org/how-to-assign-authors-authority-rank/

 

Data Clustering Tool for deep web

Some tools for deep web work great, other tools OK. Occasionally, you'll find a tool that does wonderous things, and today we've found one.

It is called Touchgraph, and it shows relationship websites clustered together. http://www.touchgraph.com/seo/launch?q=solar%20power

Using this tool, we've located new deep web assets for several of our projects that we were missing before.  Do give this tool a look over.

Video on Deep Web 101 for Treasure Hunters

Deep Web research is a critical skill for many academics, engineers, and businesses. It is a means to find the right road forward.

However, I had the opportunity to teach Deep Web 101 to a Metal Detecting Club, as it is very useful in helping them find historic location to hunt.

A video presentation of the talk is available at --

http://deep-web.org/treasure-hunting-deep-web-research-video/

10 Steps to Vetting online anonymous sources

We've all been stuck in that spot - digging thru deep web on a project and find a possibly valuable snippet of a report but no author listed and we aren't sure about the source. What do you do?

Here what you can do - go down the merry path to find the author and evaluate him or her as best you can. Possibly unlock their identity, address, and ultimately establish their level of authority on what they wrote.

Here is 10 steps to vet online sources.

Obtaining Historic Aerial Imagery from the Deep Web

A good example of a useful deep web asset is historic aerial imagery

http://learninggis.com/videos-out-on-how-to-get-free-aerial-imagery

there are some tutorials on using USGS to obtain historic imagery for GIS or other purposes.

Deep Web presentation for Treasure Hunters

Thursday I presented the first of a 3 part series on the use of Deep Web for finding leads for treasure hunters.  This will be made into instructional videos available online soon.

Part 1: Deep Web 101 -Basics of Deep Web, how to do good research, how to do Deep Web research, how to vet sources, and an example problem.

The main take aways are:

• Deep Web is anywhere in the Internet where Bots can't index
• 90% won't show up in Google.
• Up to you to figure out what possible databases may have relevant materials
• Some of your research will be off line in a library or collection

Part 2: Digging in the Deep Web - Will go back and show how to get the most of the Surface Web before delving more about Deep Web resources. At the end I'll tease with some aerial photographic resources that can be used.

Part 3: Deep Web Aerial Photography - Covering the main resources for finding historic aerial photos, and then we'll go deep into how to do remote sensing to find the footprint of houses long gone.  If time permits, we'll cover aerial archeology to find other man man features.

Deep Web Tool - Maltego

I've found a useful Deep Web tool of tracing relationships when trying to vet the authority of some websites. The software tool is put out by a company called Panterva (http://www.paterva.com/web5/client/overview.php), which I think is designed for computer security. However, it is rather useful but unfortunately complex. Expext to spend 1-3 hours understanding the tool itself.  BTW, you must register to download the software. It is free, however.