Please note, that sometimes the pages load slower in which case you might need to increase the time.sleep(3) command from 3 to 5 or more if necessary. We let the page load and we get the page resources. In this case we are looking for the second a tag, therefore its path being With this we define a second clickable element and click it. If you see the inspect element section here (second rectangle), the two button options for Fahrenheit/Celsius are under a div tag, then each under a separate a tag. Once this opens, we have a second button in order to change the data to Celsius. Therefore, we use this to define the first clickable element and click it.

If you open this page and right-click, inspect the settings button in the top right corner you will see something like the below:Īs you see the button ID that we want to first click is 'wuSettings' (the first highlighted rectangle). Let's use the Lisboa weather history Wunderground page as an example. What we are doing here is defining a clickable element by finding the button ID.

In order to do instruct the website to load data in Celsius, we need to slightly change the render function as shown below:Įlement = WebDriverWait(driver, 10).until(ĮC.presence_of_element_located((By.ID, 'wuSettings'))ĮC.presence_of_element_located((By.XPATH, = driver.page_source The initial function that would load the data in Fahrenheit looked like this:ĭriver = webdriver.Chrome('path_to/chromedriver') So the wind speed, pressure and precipitation will also be in metric units. Please note that this loads the whole data in metric units. Since by default Wunderground loads the data in Fahrenheit, we need to perform several clicks to instruct the page to load the data in Celsius. If you are landing on this article, I suggest that you first check out the Wunderground Scraper article for better understanding. This article is related to my other wunderground scraper article, and will explain how to use selenium driver in order to load the data directly in Celsius.

Wunderground history