Tool to detect overfeeding?

Post Reply
florian.fasshauer
Posts: 1
Joined: Wed Nov 03, 2010 4:24 pm
OLAP Product: TM1, MS Analysis Services
Version: 9.5.1
Excel Version: several

Tool to detect overfeeding?

Post by florian.fasshauer »

Is there any tool to detect if TM1 rules are fed correctly?
tomok
MVP
Posts: 2831
Joined: Tue Feb 16, 2010 2:39 pm
OLAP Product: TM1, Palo
Version: Beginning of time thru 10.2
Excel Version: 2003-2007-2010-2013
Location: Atlanta, GA
Contact:

Re: Tool to detect overfeeding?

Post by tomok »

florian.fasshauer wrote:Is there any tool to detect if TM1 rules are fed correctly?
Afraid not. If there were that person would be quite rich.
Tom O'Kelley - Manager Finance Systems
American Tower
http://www.onlinecourtreservations.com/
Gregor Koch
MVP
Posts: 263
Joined: Fri Jun 27, 2008 12:15 am
OLAP Product: Cognos TM1, CX
Version: 9.0 and up
Excel Version: 2007 and up

Re: Tool to detect overfeeding?

Post by Gregor Koch »

tomok wrote:
florian.fasshauer wrote:Is there any tool to detect if TM1 rules are fed correctly?
Afraid not. If there were that person would be quite rich.
I have to agree that there is no tool which does this but you can check overfeeding with an additional cube, a simple rule and a simple feeder statement. Unfortunately it has not made me rich so far but let's see.

Happy to mail a sample database which shows how to do this.
sivan307
Posts: 28
Joined: Wed Sep 01, 2010 2:15 pm
OLAP Product: TM1
Version: 9.5.1
Excel Version: 2007

Re: Tool to detect overfeeding?

Post by sivan307 »

Hi Greg:

Can you please send me a sample database.

Thanks,
Kal
sivan307@gmail.com
lotsaram
MVP
Posts: 3651
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Tool to detect overfeeding?

Post by lotsaram »

I think this rule code is suitably generic that there is no issue in quoting it.
Create cube "OVERFEED" with the same dimensions as subject cube.
Add rule to OVERFEED as follows:
SKIPCHECK;
[]=N:IF(DB(’Source’,!dim1 , !dim2, ...)=0,1,0);
Add feeder to subject cube as follows:
[]=>DB(‘OVERFEED’, !dim1 , !dim2, ...);
Rule save can be time-consuming and can chew memory but it will find all cells with zero value that are fed.

(Gregor's model may be different but it would be exactly the same technique.)
sivan307
Posts: 28
Joined: Wed Sep 01, 2010 2:15 pm
OLAP Product: TM1
Version: 9.5.1
Excel Version: 2007

Re: Tool to detect overfeeding?

Post by sivan307 »

Thanks Lotsaram, really helpful.

Regards,
Kal
Gregor Koch
MVP
Posts: 263
Joined: Fri Jun 27, 2008 12:15 am
OLAP Product: Cognos TM1, CX
Version: 9.0 and up
Excel Version: 2007 and up

Re: Tool to detect overfeeding?

Post by Gregor Koch »

It is just the same.
winsonlee
Regular Participant
Posts: 180
Joined: Thu Jul 01, 2010 3:06 am
OLAP Product: Cognos Express
Version: 9.5
Excel Version: 2007
Location: Melbourne, Australia

Re: Tool to detect overfeeding?

Post by winsonlee »

I have create a separate cube and insert the rules for the new cube and the existing cube. From the 0 and 1 how can i tell if it is over feeding or not ?



lotsaram wrote:I think this rule code is suitably generic that there is no issue in quoting it.
Create cube "OVERFEED" with the same dimensions as subject cube.
Add rule to OVERFEED as follows:
SKIPCHECK;
[]=N:IF(DB(’Source’,!dim1 , !dim2, ...)=0,1,0);
Add feeder to subject cube as follows:
[]=>DB(‘OVERFEED’, !dim1 , !dim2, ...);
Rule save can be time-consuming and can chew memory but it will find all cells with zero value that are fed.

(Gregor's model may be different but it would be exactly the same technique.)
lotsaram
MVP
Posts: 3651
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Tool to detect overfeeding?

Post by lotsaram »

winsonlee wrote:I have create a separate cube and insert the rules for the new cube and the existing cube. From the 0 and 1 how can i tell if it is over feeding or not ?
Do you really need to ask that question?
Any value of 1 in the second cube indicated that
- the equivalent cell in the source cube is fed but the cells value is 0, therefore is is by definition overfed

(Although note "overfed" by literal definition does not always equate to "should not have been fed". Sometimes there is a good reason and some overfeeding is a necessary evil for example some allocation models)
rozef
Posts: 74
Joined: Thu Jun 17, 2010 10:35 am
OLAP Product: TM1
Version: 9.4 9.5.1
Excel Version: 2003 - 2007

Re: Tool to detect overfeeding?

Post by rozef »

Thanks lotsaram for your trick, but your missing something in your answer:
lotsaram wrote:Any value of 1 feeded in the second cube indicated that- the equivalent cell in the source cube is fed but the cells value is 0, therefore is is by definition overfed
So you got to check the totals of all your dimensions to get the number of overfed cells.
thomaszabel
Posts: 2
Joined: Wed Mar 19, 2014 4:03 pm
OLAP Product: TM1
Version: 10.2 and previous
Excel Version: 2010

Re: Tool to detect overfeeding?

Post by thomaszabel »

I know this is an old thread, but...

I like this idea to find overfeeding of cells with a zero, but I'm concerned about a cell being fed multiple times by different feeders (overlap).

Is that an issue, and if so, any way to figure it out? I inherited a cube that is moderately large, but takes more than an hour to load Feeders for our nightly restart. I'm trying to reduce restart time.

And yes, I know about persistent feeders. That may be an option, but I want to make sure the feeders on this cube are as optimized as possible first.

Thanks!
User avatar
PavoGa
MVP
Posts: 616
Joined: Thu Apr 18, 2013 6:59 pm
OLAP Product: TM1
Version: 10.2.2 FP7, PA2.0.9.1
Excel Version: 2013 PAW
Location: Charleston, Tennessee

Re: Tool to detect overfeeding?

Post by PavoGa »

The only way I know of is, once a cell (or block of cells) is identified as overfed, review the feeders that are feeding that cube. A quick hint: look for feeders that are feeding a consolidation. If feeding to and from the same consolidation, it is a shortcut for feeding leaf cells. HOWEVER, if one feeds a consolidation from something other than itself or a consolidation sharing like-named leaf elements, you will feed ALL of the leaf elements in the target cube and that gets slow. Really slow. Did I say it gets slow?

Code: Select all

# Really Bad Feeder.  Feeds the 'All Months' consolidation which will FEED every leaf element in All Months regardless of whether it has a value or not.
['Cost'] => DB('The Main Cube', !Version, 'All Months', 'Cost');

# using a consolidation as a shortcut.   All Employees feeds All Employees.  Easily enough done with !Employee as well, but just to demonstrate
['All Employees', 'Salary'] => DB('Labor Calc', !Versions, 'All Employees', 'Salary')
As has been stated, whoever comes up with a way to analyze and perfect feeders is probably going to do all right financially.

Ty
Ty
Cleveland, TN
User avatar
Steve Rowe
Site Admin
Posts: 2410
Joined: Wed May 14, 2008 4:25 pm
OLAP Product: TM1
Version: TM1 v6,v7,v8,v9,v10,v11+PAW
Excel Version: Nearly all of them

Re: Tool to detect overfeeding?

Post by Steve Rowe »

My two p.
There's two kinds of overfeeding.
[Left]=>[Right];

If you overfeed on the right then you end up with slower calculation performance and slower starter up times. This can be detected by the rule approach outlined above.
If you overfeed from the left only then you end up with slow start ups only. (assumes no persistent feeders).

Overfeeding on the left is hard to detect and often ignored as there is no user facing impact. It is also more likely to be logically required by additive type rules that can not be met with consolidations (i.e. a = b + c; You have to feed with b and c).

Options / strategy for start-up time reduction.
Make sure you understand the model and understand that feeders are accurate as possible.
Multi-threaded start-up cfg but expect this to consume RAM
Persistent feeders.
Technical Director
www.infocat.co.uk
thomaszabel
Posts: 2
Joined: Wed Mar 19, 2014 4:03 pm
OLAP Product: TM1
Version: 10.2 and previous
Excel Version: 2010

Re: Tool to detect overfeeding?

Post by thomaszabel »

Good tips and thoughts. Thanks! It's going to take a while to go through all the feeders in this cube, but I'll get it running more efficiently in the end.
Wim Gielis
MVP
Posts: 3105
Joined: Mon Dec 29, 2008 6:26 pm
OLAP Product: TM1, Jedox
Version: PAL 2.0.9.18
Excel Version: Microsoft 365
Location: Brussels, Belgium
Contact:

Re: Tool to detect overfeeding?

Post by Wim Gielis »

Hello,

Take into account that elements need to be fed, but that's it. How they are fed is (in theory) not important.

It's not necessarily reversing your rule, it could also be that 1 element feeds several other elements, even if that one element does not occur in the rule.
Best regards,

Wim Gielis

IBM Champion 2024
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly
User avatar
jim wood
Site Admin
Posts: 3951
Joined: Wed May 14, 2008 1:51 pm
OLAP Product: TM1
Version: PA 2.0.7
Excel Version: Office 365
Location: 37 East 18th Street New York
Contact:

Re: Tool to detect overfeeding?

Post by jim wood »

Wim Gielis wrote: Fri Mar 09, 2018 4:34 pm It's not necessarily reversing your rule, it could also be that 1 element feeds several other elements, even if that one element does not occur in the rule.
Very true. The example I always give for this is product margin. Sales units is the drive of sales, but it's also the driver of Margin, you don't sell anything you don't make margin on it,

Jim.
Struggling through the quagmire of life to reach the other side of who knows where.
Shop at Amazon
Jimbo PC Builds on YouTube
OS: Mac OS 11 PA Version: 2.0.7
User avatar
Elessar
Community Contributor
Posts: 331
Joined: Mon Nov 21, 2011 12:33 pm
OLAP Product: PA 2
Version: 2.0.9
Excel Version: 2016
Contact:

Re: Tool to detect overfeeding?

Post by Elessar »

Hi,

Overfeeding "from the Left" can also affect data input (and data load) time (It can be a few seconds, but this can already annoy users)
Best regards, Alexander Dvoynev

TM1 and Data Science blog: 6th article - PAfE + VBA: Commit each cell without pressing “Commit” button.
Post Reply