Quantcast
Channel: Power Query topics
Viewing all articles
Browse latest Browse all 31460

Getting data from web api in parallel

$
0
0

Hello, first time asking a question here so thank you in advance for any help.

 

I've got a custom m-script that is authenticating to our monitoring platform's api using oauth.  It uses their search api to pull a list of every device we are monitoring.  Following some hints I got online I am able to pull the multiple pages of items one at a time.

 

The platform then has a "get device" api where I can get further details about each individual device.  I want to do this for each device that is returned in the above search but ideally that will be done in parallel as that search can return 8000-10000 devices (and thus 8000-10000 calls to the get device api).

Assuming I could do this in parallel there would be nothing stopping me from pulling the search pages in parallel as well.

How can I run these api calls in parallel with each other?  I believe I could set up separate queries if I knew the number of devices and pages that would be returned, but those things will be very dynamic.


Viewing all articles
Browse latest Browse all 31460

Latest Images

Trending Articles



Latest Images