Week in OSINT #2018–36

Tools, data sets, loads of links and a transform in development!

Sector035
Week in OSINT
3 min readSep 10, 2018

--

Another standard little overview of some interesting links that I gathered during last week. Not a huge set of links, but just open some PDF’s shared in here if you only want links… There will be enough to go through!

  • Satellite Imagery Resources
  • OSINT Gathering Techniques
  • Deep Web Resources 2018
  • Saving Web Pages
  • Google Dataset Search
  • Darknet Osint Graph Explorer
  • Quiztime

PDF: Satellite Imagery Resources

Last week a very nice PDF was shared by Stefanie Proto on Twitter. It is a PDF with loads of resources regarding satellite imagery. Whatever your job or reason, there is a resource for everyone out there!

Link: https://gijn.org/2018/06/19/new-on-gijn-resources-for-finding-and-using-satellite-imagery/

Tutorial: OSINT Gathering Techniques

In April 2017 Riyaz Walikar posted a blog about gathering intelligence via open sources, and now Bharath posted a second part that goes a bit deeper. Where the first post was aiming for the low hanging fruits like IP addresses, DNS records or the ‘robots.txt’, this blog goes a lot deeper.

In this blog you can find tips about searching the certificate transparency logs, a little intro of the Autonomous Systems and how to find net blocks there, and a little explanation about how to find the original IP address of a server behind a CloudFlare account. Curious about a more technical write-up? Enjoy this read!

Part 1: https://blog.appsecco.com/open-source-intelligence-gathering-101-d2861d4429e3

Part 2: https://blog.appsecco.com/open-source-intelligence-gathering-201-covering-12-additional-techniques-b76417b5a544

PDF: Deep Web Resources 2018

And again a shout out to Stefanie, for sharing another very interesting PDF with the world, but this time regarding the deep web. Well over 50 pages full of links that deal with research papers, articles, tutorials, reports and anything else that could be of interest. This PDF alone is worth a month of Week in OSINT’s!

Link: http://whitepapers.virtualprivatelibrary.net/DeepWeb.pdf

Tool: Saving Web Pages

Dutch Osint Guy shared a nifty little tool the other day. A little extension or plug-in for your browser that will enable you to save an entire web page into a single HTML file! Maybe not the best to use if you have to preserve evidence, but for gathering some information for anything that is less strict, this is perfect!

Link: https://github.com/gildas-lormeau/SingleFile

Search: Google Dataset Search

On Friday Mikko Hypponen sent out a tweet mentioning the new Google Dataset Search that went into public beta on September 5. Any data set that can be found on the internet which Google was able to add, can now be found via a single search page. Whether you are looking for medical data, historical weather or car sales, it can all be found in this new tool.

Link: https://toolbox.google.com/datasetsearch

Tool: Darknet Osint Graph Explorer

First Pielco11 created DOT for Maltego,a transform that was assisting the researchers of the dark web. And now there is DOGE!

Even though it is still under development, do keep an eye out for this! Because DOGE will be a Graph Explorer front-end for data collected via DOT. That means even more clarity and insight into the darker parts of the internet!

Link to DOT: https://github.com/pielco11/DOT

Link to DOGE: https://github.com/pielco11/DOGE

News: Quiztime

In Chemnitz Germany there is a lot going on since a few weeks. After it became known that migrants were the suspects in a killing, the extremism is showing their bad side again. The topic itself isn’t nice, but it is good to see that all the verification and fact checking practice that the Quiztime community offers on Twitter, is showing results. A little German thread about one of the many incidents in Chemnitz where some Quiztime regulars help to find the facts in between all the “fake news”.

Link to thread (mostly German): https://threadreaderapp.com/thread/1037850602099953665.html

Link to Quiztime on Medium: https://medium.com/quiztime

And that was it again for this week… A bit of everything, to try and please as many people as possible.

Have a good week and have a good search

--

--

Sector035
Week in OSINT

Just a shadowy nerd… Busy with InfoSec, geolocation and OSINT (archived articles only, Week in OSINT can be found on https://sector035.nl)