I m using Selenium Webdriver and python to automatically schedule an appointment. Webdriver options: options = Options() options.binary_location = /opt/headless-chromium options.add_argument( --...

I am looking to develop a Web scraper in C# window forms. What I am trying to accomplish is as follows: Get the URL from the user. Load the Web page in the IE UI control(embedded browser) in ...

I am wanting to automate the input of post variables on a login page for the purpose of webscraping. It would improve the process no end if I can get past the login page. Then I can schedule some ...

How do I Capture ASP.NET output and then store it as temp memory so that I can use them in an application to do comparison. example. there s this site which has ASP output. Sorry I do not have ...

I am trying to scrap some data from a website. The scripts I am trying to write, should get the content of the page: http://www.atpworldtour.com/Rankings/Singles.aspx Should simulate the user going ...

I am looking for a library that is similiar to mechanize for perl, ruby. Basically, I can .click() and it will click on form buttons, or navigate to links, etc.

I want to be able to retrieve dynamic data from a web page (share prices). I started out by retrieving the html code before I realised that as it is live data, the html code will be of little use. ...

I need some help comparing different programming languages, such as: C++, Java, Python, Ruby and PHP, for a task which is related for web data mining (developing web crawler, string manipulations and ...