Remove all columns of a particular type except one

September 17, 2020, 7:08 am

≫ Next: Ignore Page Filter on One table view and apply one second table view in a Single Page

Question:
I am trying to remove all columns of a particular type with the exception of 1. I already know how to dynamically remove all the columns of a type, but i cant figure out how to exclude one of them. So in other words, remove all columns of type table or record except TRANSACTION_LINES.

Table.RemoveColumns(TRANSACTIONS_Table, Table.ColumnsOfType(TRANSACTIONS_Table, {type record, type table}))

This is what im using for the removal all columns of those types, just need to figure out how to not remove TRANSACTION_LINES which is a type of table.

I know im close but im totally stumped.

↧

Ignore Page Filter on One table view and apply one second table view in a Single Page

September 17, 2020, 10:12 am

≫ Next: Only query new records

≪ Previous: Remove all columns of a particular type except one

Hi,

Please help me with the below requirement.

I have two table views of the same data set. However, one table should work with a page filter, and another table should show all the data. Trying to figure All Expect measure but no luck.

Note: I am using Power BI Data Set as my source. So I cant create multiple tables, I cant create columns.

Dataset:

Phones	Category
Iphone6	No Demand
Iphone7	Demand
Iphone8	Demand
Iphone9	No Demand
Iphone10	Demand
Iphone11	Demand

Result:

↧

Only query new records

September 17, 2020, 1:12 pm

≫ Next: Table of Lists - Are all List Values in Another List

≪ Previous: Ignore Page Filter on One table view and apply one second table view in a Single Page

Hello, all!

I have a dataset pulled from a number of xml files in an Azure blob. In that dataset are some IP addresses that I am querying location data for using a web API. A lot of IP addresses, really, and that's part of the issue. It's pretty wasteful to query all of these addresses again on a refresh so I'm trying to figure out a way to keep the results of the previous query.

I have my function that queries the data using the API. I copied all of the results to a manual (archive) table and then modified my function to check the archive table to see if that IP address exists. If so, I use the data from the archive table, if not I query the data via the API.

This works okay, until I try to add new results to that archive table. I've not been successful in adding data to the archive table without creating some sort of issue with Power BI as it's a pretty cyclical situation: a check to see if a record exists in the archive table is made, it's false so the web api is queried. But, if that record is added to the archive table somehow then the check would be true... Power BI doesn't seem to be handling what I'm trying to do well which means I'm not doing it right, as far as Power BI is concerned...

Does anyone have any suggestions as to how to handle this? Basically, I'm trying to have persistent table that I can add rows to if there isn't already a matching record.

↧

Table of Lists - Are all List Values in Another List

September 17, 2020, 1:24 pm

≫ Next: How to use machine learning/ Python in Azure analysis services ?

≪ Previous: Only query new records

Hi all, I have a table that contains many fields, one of which is List of Orders. This contains a list, where each value is an order. So for example:

And the lists might look like

List 1: {"A", "B"}

List 2: {"C"}

List 3: {"A", "B", "D"}

List 4: {"A", "B", "E"}

List 5: {"C", "D"}

I'd like to add a column [Resubmitted Orders] that says, for each list in [List of Orders], determine if ALL the orders in that list are in another single list. So for the above, List 1 and List 2 would both be TRUE because all of the values in List 1 are in List 3/List 4, and all of the values in List 2 are in List 5.

Thanks in advance for all of your help!

↧

How to use machine learning/ Python in Azure analysis services ?

September 17, 2020, 11:17 pm

≫ Next: Single Cell Duplicates Removal

≪ Previous: Table of Lists - Are all List Values in Another List

We are using Azure Analysis Services with our model which is directly connected to Power Bi Desktop.

But i am facing the following issue :

1. I'm not able to use Python with azure analysis services

2. How can i use Machine leaning with python for azure analysis services

3. I'm not able to use Power query with azure analysis services where i could use Python earlier

So in short i want to know how can i use Machine leaning with python for azure analysis services ?
Thanx in advance

↧

Single Cell Duplicates Removal

September 18, 2020, 12:38 am

≫ Next: Json.FromValue encoding special characters

≪ Previous: How to use machine learning/ Python in Azure analysis services ?

please support with a solution for the below issue, i have column Data as below, i need the result to be as illustarted

Data	Result
1-2-1-3-1	1-2-3
4-1-3-4-5-5	1-3-4-5

↧

Json.FromValue encoding special characters

September 18, 2020, 1:31 am

≫ Next: Power BI - Power Query map to Entity

≪ Previous: Single Cell Duplicates Removal

Hi - I am using the following formula to create some JSON:

Text.FromBinary(Json.FromValue(
[domain=[company.domain],
companyName=[company.company],
speakerName=[speaker.title],
speakerTitle=[speaker.roles.job_title],
speakerCompany=[speaker.roles.company_name],
speakerImageURL=[speaker.thumbnail],
speakerURL=[speaker.permalink],
sessions={[sessions]}]))

But special characters get encoded e.g. Damsgård is contained in the column data but gets encoded to Damsg\u00e5rd in the JSON. I've tried using UTF8 encoding value etc.

How can I stop this or change these back to the actual characters? Note I don't know how many cases of this there are in the data so an individual find & replace is not ideal.

↧

Power BI - Power Query map to Entity

September 18, 2020, 1:39 am

≫ Next: Change the Excel source to an azure blob storage

≪ Previous: Json.FromValue encoding special characters

Hi,

Id' like to write te results of my Power Query in Power BI to a new entity in CDS (map to entity)

What I see is a list of standard entities in a CDM environment but these entities doesn't match te results of my Power query so I want to cerate a new entity in this enviroment. It seems possible because when I open a workspace I can select the option 'Add entities'

If i continue to add a new entity in the Common Data Service, I have to select a server URL.

My question is, what is the server URL for the CDM model I see in Power BI? Or do I have to choose another way to resolve this?

↧

Change the Excel source to an azure blob storage

September 18, 2020, 2:47 am

≫ Next: DAX formula for calculating diff date of consecutive rows

≪ Previous: Power BI - Power Query map to Entity

Hi guys,

you can change the source in the Power Query from an Excel file to an Azure Blob storage. The structure remains exactly the same - only the source changes?

thanks in advance

greetings lukas

↧

DAX formula for calculating diff date of consecutive rows

September 17, 2020, 3:58 pm

≫ Next: Custom column - IF statements within date interval

≪ Previous: Change the Excel source to an azure blob storage

Hi,

I'm new to DAX and I need your help.

I have the following table:

device_id	time	display_time	Calculate
AA	9/10/2020 01:02	9/10/2020 01:02	00:01:00
AA	9/10/2020 13:05	9/10/2020 01:05	00:03:34
AA	9/10/2020 01:06	9/10/2020 01:06	00:00:41
AA	9/10/2020 13:09	9/10/2020 13:09	12:03:34
BB	9/11/2020 00:28	9/11/2020 00:28	00:01:00
BB	9/11/2020 12:30	9/11/2020 12:30	12:02:16
BB	9/11/2020 00:32	9/11/2020 12:32	00:02:37
BB	9/11/2020 12:35	9/11/2020 12:35	00:02:15
CC	9/10/2020 09:59	9/10/2020 09:59	00:01:00
CC	9/10/2020 22:01	9/10/2020 22:01	12:01:30
CC	9/10/2020 10:03	9/10/2020 22:03	00:02:14
CC	9/10/2020 22:05	9/10/2020 22:05	00:02:07

I want to calculate de difference in seconds between two consecutive display times for a device( like in the Calculate column) and if it's possible for the first display_time for a device to insert a value e.g. 60 seconds.

I've tried adding first an index column and after that using the DATEDIFF formula but I can't properly sort the table and get right the consecutive values for display_time when I used an Index column.

Kind regards,

Madalin

↧

Custom column - IF statements within date interval

September 18, 2020, 4:43 am

≫ Next: Getting similarly named tables from PDF files using folder connector

≪ Previous: DAX formula for calculating diff date of consecutive rows

Hello everyone! I have an ecommerce order table with data that looks like below:

Date	Email	Homeloan	Sales value	New column (converted)
2020-01-01	john@doe.com	Yes	0	Yes
2020-01-20	john@doe.com	No	150
2020-01-01	jane@doe.com	Yes	0	No
2020-05-20	jane@doe.com	No	150

I want to add a custom column (marked in red) in power query that calculates if a "Homeloan" is converted or not.

Conversion rule: A homeloan is converted if a purchase (sales value >0) is made within 30 days from homeloan-order (email can be used as common denominator). As per above, first homeloan is converted (purchase made within a month), second one is not.

Thanks in advance!!

↧

Getting similarly named tables from PDF files using folder connector

September 18, 2020, 10:06 am

≫ Next: Reset count of ID once they've all been seen, count how many days it took then reset until next time

≪ Previous: Custom column - IF statements within date interval

I need to combine multiple similarly structured PDF file tables into one data set. Normally I would just use the Folder connector option from get data however I am having a problem.

The PDF table ID changes from file to file and the auto generated M Code hard codes the table ID as part of it's routine so that it looks for the same table ID in every single file:

I am thinking that my M coding skills are just too weak and there must be a solution using some sort of custom M Code for this. I am grateful for any help.

The source files are provided to my company from a consultant and they won't give us the backup data so I'd like to use PowerQuery's PDF connector to combine each quarterly file so we can get multiple period reporting and make our own custom reports etc. The data is very confidential so I can't provide the files and I can't make an example file because I don't have the original backup files to generate the PDF.

↧

Reset count of ID once they've all been seen, count how many days it took then reset until next time

September 18, 2020, 10:39 am

≫ Next: Unpivoting Variable Number of Columns

≪ Previous: Getting similarly named tables from PDF files using folder connector

Hi,

I have 1500 unique IDs, everyday many are seen and some multiple times a day.

I would like to do a cumulative count and know how many days does it takes to see them all 1500, once it reaches that amount, the cumulative sum needs to reset for another count until the next time the goal is met.

I've done a running total after a grouped count by date, but my issue aside from the needed reset is that the duplicates needs to be removed based on the time period needed to attain the goal. If i'm grouping my IDs by date then i'm losing the ability to sort out duplicates...

So i'm guessing I need to first find how much time is needed, then remove the duplicates from a custom column spanning over its own run tower the goal, and then, calculate the running...

Here's an ugly paint mockup of what i'd like my final result to look like (I realize I need my date format to be date.time otherwise i'll never get a correct goal and it'll be tricky)

I've found this solution here from Lind25 but the syntax is wrong, maybe from a previous PQ version:

https://community.powerbi.com/t5/Desktop/Running-total-that-resets-when-equal-to-or-greater-than-a-set/td-p/367214/page/2

let Source = Excel.CurrentWorkbook(){[Name="Table1"]}[Content], AddedIndex = Table.AddIndexColumn(Source, "Index", 1, 1), #"Added Custom" = Table.AddColumn(AddedIndex, "Running total reset", each List.Accumulate(List.FirstN(AddedIndex[Difference],[Index]),0,(state,current)=>if state+current > 60 then 0 else state+current)) in #"Added Custom"

Any takers ? I'm completely lost on that one...

Thanks

↧

Unpivoting Variable Number of Columns

September 18, 2020, 2:07 pm

≫ Next: MS Forms Pro "Customer Voice" Connector

≪ Previous: Reset count of ID once they've all been seen, count how many days it took then reset until next time

Hello,

My dataset is an Excel file that is generated by a very inflexible program. In order to make functional tables, I need to unpivot the columns. My problem is that the number of columns in the Excel file changes every time the file is generated.

My data looks like this:

Date | Property | Product 1 | Product 2 | Product 3 .......

When I unpivot the Product columns the formula is:

= Table.Unpivot(#"Changed Type", {"Product 1", "Product 2", "Product 3", .... }

How can I change the function to unpivot all columns from column #3 up to (and including) the last column?

Thanks!

↧

MS Forms Pro "Customer Voice" Connector

September 18, 2020, 2:40 pm

≫ Next: Very basic, when use # ? (M language)

≪ Previous: Unpivoting Variable Number of Columns

Ive look at the solutions for connection Form/Forms Pro but none of these solutions seem to work now that the service has changed to "Customer Voice".

Has anyone been able to easily connect the data into Power BI?

↧

Very basic, when use # ? (M language)

September 18, 2020, 8:40 pm

≫ Next: Non tabular Excel report to formatted table

≪ Previous: MS Forms Pro "Customer Voice" Connector

Hi, I read documentation but can't find explanation for what mean # and when I need to use it. I se its use for variable name with space... but I saw more this symbol in code something like #date() I suspect what its use for data type... but I can't find some explanation, can you help me with some link to doc?

↧

Non tabular Excel report to formatted table

September 18, 2020, 8:48 pm

≫ Next: Wrong releationship of Table values

≪ Previous: Very basic, when use # ? (M language)

I get daily sales reports from multiple branches in Excel but in a reporting format that is not a standard table. Basically it's a page layout that looks good for printing but is useless as it is for data manipulation in Excel or PowerBI.

I'm looking for a way to automate this so that I don't have to do this manually for every single branch, every single day.

Is there a way to convert this kind of data to a standard table? All the formatting is the same everyday, all the same information is in the same cells, I just don't know how to convert that to a table that I can then use for further work.

I'm not a VBA programmer so I'm sure there's a way to do this via VBA. I'm wondering if there's a way to do this with Power Query.

↧

Wrong releationship of Table values

September 19, 2020, 1:44 am

≫ Next: Need help to get the conditional average in power query

≪ Previous: Non tabular Excel report to formatted table

Hi everybody,

I am facing following issue: I have two tables (see below Table A and Table B) and I want to display the relation of the columns FC and Cat. The releation is given over the the column LookUp. The problem is that for every Cat the matrix is showing me the relation to the very first value of the column FC.

Current result

Cat	FC
ETS_ABA	A
ETS_ETK	A
ETS_KKK	A
ETS_ABA	A
ETS_OII	A
ETS_KKJ	A

Expected Result

Cat	FC
ETS_ABA	A
ETS_ETK	A
ETS_KKK	C
ETS_ABA	B
ETS_OII	C
ETS_KKJ	D

Table A

Cat	LookUp
ETS_ABA	FID_1
ETS_ETK	FID_1
ETS_KKK	FID_3
ETS_ABA	FID_2
ETS_OII	FID_3
ETS_KKJ	FID_4

Table B

LookUp A	FC
FID_1	A
FID_1	A
FID_3	C
FID_2	B
FID_3	C
FID_4	D

↧

Need help to get the conditional average in power query

September 19, 2020, 4:41 am

≫ Next: Power Query: Include all unique columns found in files from folder

≪ Previous: Wrong releationship of Table values

Hi,

I am a newbie to PowerQuery. I need a M Query solution to the below problem

Suppose I have a Country column, Value column. Now I wanted to average the Value column not equal to 0, for each country in the country column. Kindly see the below example.

Let me know if you have any questions.

Thank you...

↧

Power Query: Include all unique columns found in files from folder

September 19, 2020, 6:35 am

≫ Next: Date in a colums

≪ Previous: Need help to get the conditional average in power query

I've recently run into an issue which hopefully is solvable.

Currently, I have power query pointing at a folder containing several CSV files. This is normally no issue, however, in this instance not all of the files have the same columns.

Is there a way to have power query return every unique column found in the folder populating empty data observations with null values?

Assume that my folder has csv files similar to the following (note that the rows are indexed using letters for easy reference):

I would like the final table to look something like:

This seems like it should be pretty simple, but I can't figure it out for the life of me! Any help would be greatly appreciated!

↧