HttpWebRequest with JavaScript domain.cookie
I'm trying to use HttpWebRequest to scrape a website.
Unfortunately, this particular site is using BLOCKED SCRIPT document.cookie, to create a cookie. I've been unsuccessful using the CookieContainer to attempt to retrieve the cookie, so I'm now actually searching the html for document.cookie and then manually setting the cookie.
The site is not recognizing the cookie. I believe the problem actually lies in the fact that the domain I'm hitting is a subdomain, for example: https://sub1.sub2.sample.com. The cookie being created via JavaScript simply has domain=".sample.com". When adding a cookie manually, it wants a valid URI, so I've attempted http and https with full domain above and just sample.com, but so far no luck.
This was not the the easiest website to try and scrape.