Scenario -I'm looking forward into connecting a replica of a Magento database that runs on a synced Mysql server on-premises. We've got 300+ tables of which 100 are going to be used for analytics purposes. With roughly 2 million rows / month loaded into PowerBI, considering a potentially 10x increase in volume over the next 5-6 months, what are your thoughts about performance and costs on having a neat reporting solution updatable every 24 hrs?
Note -Responding to any of the following questions, based upon your personal experience, will be highly appreciated.
Details - Here are a couple of clues I'd be considering:
Connection [we're talking about Import mode with full DAX functionalities] :
- Are there any database size limits? [I've heard of 1GB under free cloud sharing offering]
- Is there a maximum number of tables to be loaded in order to avoid a connection time out, does it depend on powerbi configuration, connectivity speed or hardware specs?
- How does manual refresh work? It's simply executing queries loading the data each time from scratch or there's a sort of incremental trigger in order to update only the new values?
Building the model:
- PowerBI provides a full-set of options when it comes to data transformation, but how about using a service like Azure Analysis Services in order to create the model and therefore create reports and deploy with powerBI ? Let's consider functionalities vs performance vs cost.
- Is there any feature to connect PowerBI to Azure ML and vice-versa, or manual data-import is the only viable solution?
- Distributing a report on a personal web-site requires powerBI pro for $10/month, what about the limits on shared capacity and does it support [embedded functionality] DAX queries?
Scheduling refresh:
- On powerBI community there's plenty of people running into issues when it comes to setting up a gateway between cloud and on-prem data. Personal vs Enterprise gateway considerations? It seems powerBI requests for a connection for each table it has to import and another unauthorized one at the same time.
- Any specs about how long does it take to update data from gateway vs manual refresh vs azure analysis services?
I know it's a bit of a monolithic thread, but we're facing each of the posted questions in order to evaluate a solution for a single scenario.
Thanks a lot in advance!