Hi All,
I need to import a table into PQ. The table has 40 mln rows. To maintain the integrity with other tables I need only 50k rows to be imported.
I have 3 tables. let's say A contains city name with all the cities in the world and I need just London and Bristol, B contains tennant name with all the names in the world and I need people named John, C is all the combinations of cities and tennants and prices (40 mln). For first 2- I import tables with only necessary data (the real lists are of course longer and there're multiple conditions applied:). For C I want to retrive the data for John's in Bristol & London.
It works perfectly when I apply the filtering in SQL using where clause and then import the fitlered tbl. However I'd like to achive the same filtering in PQ without crashing the system.
When I import the entire tbl and attempt to filter rows by merging C tbl with A&B - the PQ freezes.
When I import the entire tbl and try to filter rows by lists - it freezes as well.
Any ideas how to filter rows in PQ having the similar efficiency as SQL filtering?