Nerd For Tech
Published in

Nerd For Tech

Web scraping and storing unstructured data: An example of scraping

A combination of web scraping and a document database in Python offers a convenient solution to collecting and storing unstructured information from websites.

Photo by: Wonderlane on Unsplash
Source: image by author using

Generating base URLs

Adding rent-range in URLs

Adding page number in URLs

Using document database

Retrieving property information

Cost of housing

Source: Image by author

Scheduling the script

Concluding thoughts



NFT is an Educational Media House. Our mission is to bring the invaluable knowledge and experiences of experts from all over the world to the novice. To know more about us, visit

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Sourabh Jain

Postdoctoral scholar who applies systems thinking to model circular economy running on 100% renewable energy systems and zero waste.