Quantcast
Channel: Power Query topics
Viewing all articles
Browse latest Browse all 31217

SQL Load huge amount of data already grouped / filtered / formatted

$
0
0

I've been reading several posts in different forums but none of them hits what I'm looking for.

 

I've got a table in a SQL server for server transactions with millions of records that I would like to get in Power BI. 

 

I need to do some statistics so I want to group the data by some columns, extract a server name from a XML look-alike string (with delimiters) and get a count of requests and sum of request & response sizes and time to get them.

 

Here's an example of the desired result. Notice that norequest will be the original number of rows processed. 

 

idnorequestsdatetotaldurationmsusertypetotalrequestsizereturnstatustotalresponsesize
0505.09.201814934user5type2332511980
1805.09.201811540user5type384691321914
262005.09.2018740808user1type418102012813252
343605.09.20181109771user1type51124381766411
4205.09.20182310user2type645811684
5205.09.20181237user2type55361734
62805.09.201895467user5type1357301773762
7105.09.20182411user5type66011696
8140705.09.201826959user1 0121105

 

While I've got all clear in SQL, it takes AGES to run this in Power BI, either in the loading process or afterwards, so my question is:

Any practises to load just the data I want (already grouped, counted, etc.) in a quick manner?


Viewing all articles
Browse latest Browse all 31217

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>