I wanted to thank you for your help. I wrote a script to scrape over 30,000 courses and textbooks from Arizona State University successfully in a couple days.
So apparently accessing a secure URL isn't straightforward... No login is required, its just an HTTPS but it won't go in curb.