Power Query Web scraping, Dealing with load more button

Power Query
1

Hi,

Please see the attached PowerBI file. I am trying to extract data from 01.01.2018 to 17.02.2021 from a website using link https://coinmarketcap.com/currencies/ethereum/historical-data/?start=20180101&end=EndDate[20210217]. Sadly, I only get data extraction from 17.02.2021 to 18.12.2020 because further data is locked by a button called Load More.

How do I make Power Query to click the button a few times or to click it infinitely so I can get data from the range I selected?

PowerBI file:
Question 2.pbix (31.4 KB) !

Please see below the image with the button that is messing things up for me.
image|690x135

2

Hi @Roboboboberts , have you ever try https://ethereumprice.org

Or use the coinmarketcap API https://coinmarketcap.com/api/

https://coinmarketcap.com/api/documentation/v1/#operation/getV1CryptocurrencyQuotesHistorical

3

Hi,

I would still like to understand if it`s possible to click the load more button with Power Query.

Otherwise, I have to say that Coinmarkecap is a paid product thus I won`t use it. But as for etherumprice.org I do not how to make PowerBI select period all. Do you know this?

Thank you!

Roberts

4

Hi @Roboboboberts check this url , you have the start=2019-01-01 and end=2021-02-17 you can use parameters query ( like for the dimension Date Table) to call the url or manually filled the values

https: / / ethereumprice.org / history / ?start=2019-01-01&end=2021-02-17&currency=USD

5

On Ethereumprise.org

This historical ETH price data is available for free and can be downloaded as a CSV using the button below. Data can be modified and published for commercial and non-commercial purposes under an attribution license – we only require that you link to ethereumprice.org when using this data publicly .

Use the date selection and download bottom. I just download the date range that you looking for.
2018-01-01_2021-02-17_ethereumprice_org.csv (84.3 KB)

6

Hi,

The end game of the file would be adding top 20 cryptos to it. Sadly, I checked and the API does not provide that much information. Are there any alternatives ?

7

Hi,

Please read the following article:

https://medium.com/coinmonks/best-crypto-apis-for-developers-5efe3a597a9f

1 Like
8

I’d suggest LunarCRUSH for cryptocurrency, especially when you’re looking at anything like market share or market dominance.

Other solid options would be:

Along with all the ones in the article posted by @jbressan

9

Hi @Roboboboberts, we’ve noticed that no response has been received from you since the 19th of February. We just want to check if you still need further help with this post? In case there won’t be any activity on it in the next few days, we’ll be tagging this post as Solved.

10

Hi @Roboboboberts, a response on this post has been tagged as “Solution”. If you have a follow question or concern related to this topic, please remove the Solution tag first by clicking the three dots beside Reply and then untick the check box.

We’ve recently launched the Enterprise DNA Forum User Experience Survey, please feel free to answer it and give your insights on how we can further improve the Support forum. Thanks!