Scraping discourse.mcneel.com


(Willem Derks) #1

Hi,

As a curiosity side project I was trying to read discourse.mcneel.com with python inside Rhino.
However my attempts with urllib urllib2 and some .NET methods all failed due to an issue with hostnames.

I suspect it’s due to the nature of the website and how requests are handled, can anyone share a simple way to do this. If it’s possible at all.

-Willem