BigSnarf blog

Infosec FTW

Example of OSINT analysis platform with link analysis, NLP and NER

Law Enforcement databases

  • Nexus peering
  • IBIS
  • CIC
  • NCIC
  • AFIS
  • NDex
  • CPIC
  • PIRS
  • 911 databases
Government Sources
  • National offender registries
  • State and Provincial Driver’s Licences databases
  • Birth registry databases
  • Marriage registry
  • Immigration and work permits
  • 311 databases

Social Media sources

  • Facebook – 750 million users – 40 billion photos
  • Google+ – 20 million users
  • Twitter – 100 million users – 2 million tweets per day
  • Myspace – 113 million users
  • Bebo – 12.6 million users
  • Linkedin – 70 million users
  • Friendster – 115 million users
  • YouTube – Comments
  • Forums and Boards
  • Blogs and personal websites
  • Google search results
  • Twitter archives
  • Flickr
  • Picasa
News agency sources
  • LexisNexis
  • Bloomberg
  • Reuters
Traditional news sources
  • NYT
  • BBC
  • Time Magazine
  • Globe and Mail
  • Washington Post
  • Aljazeera
Online Dictionaries and Wikis
  • Wikipedia
  • Dictionary

OSINT includes a wide variety of information and sources

  • Media: newspapers, magazines, radio, television, and computer-based information.
  • Web-based communities and user-generated content: social-networking sites, video sharing sites, wikis, blogs, and folksonomies.
  • Public data: government reports, official data such as budgets, demographics, hearings, legislative debates, press conferences, speeches, marine and aeronautical safety warnings, environmental impact statements and contract awards.
  • Observation and reporting: amateur airplane spotters, radio monitors and satellite observers among many others have provided significant information not otherwise available. The availability of worldwide satellite photography, often of high resolution, on the Web (e.g., Google Earth) has expanded open-source capabilities into areas formerly available only to major intelligence services.
  • Professional and academic: conferences, symposia, professional associations, academic papers, and subject matter experts.[1]
  • Most information has geospatial dimensions, but many often overlook the geospatial side of OSINT: not all open-source data is unstructured text. Examples of geospatial open source include hard and softcopy maps, atlases, gazetteers, port plans, gravity data, aeronautical data, navigation data, geodetic data, human terrain data (cultural and economic), environmental data, commercial imagery, LIDAR, hyper and multi-spectral data, airborne imagery, geo-names, geo-features, urban terrain, vertical obstruction data, boundary marker data, geospatial mashupsspatial databases, and web services. Most of the geospatial data mentioned above is integrated, analyzed, and syndicated using geospatial software like a Geographic Information System (GIS) not a browser per se.
Ingest Listing for OSINT

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: