Tool to detect overfeeding?
-
- Posts: 1
- Joined: Wed Nov 03, 2010 4:24 pm
- OLAP Product: TM1, MS Analysis Services
- Version: 9.5.1
- Excel Version: several
Tool to detect overfeeding?
Is there any tool to detect if TM1 rules are fed correctly?
-
- MVP
- Posts: 2831
- Joined: Tue Feb 16, 2010 2:39 pm
- OLAP Product: TM1, Palo
- Version: Beginning of time thru 10.2
- Excel Version: 2003-2007-2010-2013
- Location: Atlanta, GA
- Contact:
Re: Tool to detect overfeeding?
Afraid not. If there were that person would be quite rich.florian.fasshauer wrote:Is there any tool to detect if TM1 rules are fed correctly?
-
- MVP
- Posts: 263
- Joined: Fri Jun 27, 2008 12:15 am
- OLAP Product: Cognos TM1, CX
- Version: 9.0 and up
- Excel Version: 2007 and up
Re: Tool to detect overfeeding?
I have to agree that there is no tool which does this but you can check overfeeding with an additional cube, a simple rule and a simple feeder statement. Unfortunately it has not made me rich so far but let's see.tomok wrote:Afraid not. If there were that person would be quite rich.florian.fasshauer wrote:Is there any tool to detect if TM1 rules are fed correctly?
Happy to mail a sample database which shows how to do this.
-
- MVP
- Posts: 3652
- Joined: Fri Mar 13, 2009 11:14 am
- OLAP Product: TableManager1
- Version: PA 2.0.x
- Excel Version: Office 365
- Location: Switzerland
Re: Tool to detect overfeeding?
I think this rule code is suitably generic that there is no issue in quoting it.
(Gregor's model may be different but it would be exactly the same technique.)
Rule save can be time-consuming and can chew memory but it will find all cells with zero value that are fed.Create cube "OVERFEED" with the same dimensions as subject cube.
Add rule to OVERFEED as follows:
SKIPCHECK;
[]=N:IF(DB(’Source’,!dim1 , !dim2, ...)=0,1,0);
Add feeder to subject cube as follows:
[]=>DB(‘OVERFEED’, !dim1 , !dim2, ...);
(Gregor's model may be different but it would be exactly the same technique.)
-
- Posts: 28
- Joined: Wed Sep 01, 2010 2:15 pm
- OLAP Product: TM1
- Version: 9.5.1
- Excel Version: 2007
Re: Tool to detect overfeeding?
Thanks Lotsaram, really helpful.
Regards,
Kal
Regards,
Kal
-
- MVP
- Posts: 263
- Joined: Fri Jun 27, 2008 12:15 am
- OLAP Product: Cognos TM1, CX
- Version: 9.0 and up
- Excel Version: 2007 and up
Re: Tool to detect overfeeding?
It is just the same.
-
- Regular Participant
- Posts: 180
- Joined: Thu Jul 01, 2010 3:06 am
- OLAP Product: Cognos Express
- Version: 9.5
- Excel Version: 2007
- Location: Melbourne, Australia
Re: Tool to detect overfeeding?
I have create a separate cube and insert the rules for the new cube and the existing cube. From the 0 and 1 how can i tell if it is over feeding or not ?
lotsaram wrote:I think this rule code is suitably generic that there is no issue in quoting it.Rule save can be time-consuming and can chew memory but it will find all cells with zero value that are fed.Create cube "OVERFEED" with the same dimensions as subject cube.
Add rule to OVERFEED as follows:
SKIPCHECK;
[]=N:IF(DB(’Source’,!dim1 , !dim2, ...)=0,1,0);
Add feeder to subject cube as follows:
[]=>DB(‘OVERFEED’, !dim1 , !dim2, ...);
(Gregor's model may be different but it would be exactly the same technique.)
-
- MVP
- Posts: 3652
- Joined: Fri Mar 13, 2009 11:14 am
- OLAP Product: TableManager1
- Version: PA 2.0.x
- Excel Version: Office 365
- Location: Switzerland
Re: Tool to detect overfeeding?
Do you really need to ask that question?winsonlee wrote:I have create a separate cube and insert the rules for the new cube and the existing cube. From the 0 and 1 how can i tell if it is over feeding or not ?
Any value of 1 in the second cube indicated that
- the equivalent cell in the source cube is fed but the cells value is 0, therefore is is by definition overfed
(Although note "overfed" by literal definition does not always equate to "should not have been fed". Sometimes there is a good reason and some overfeeding is a necessary evil for example some allocation models)
-
- Posts: 74
- Joined: Thu Jun 17, 2010 10:35 am
- OLAP Product: TM1
- Version: 9.4 9.5.1
- Excel Version: 2003 - 2007
Re: Tool to detect overfeeding?
Thanks lotsaram for your trick, but your missing something in your answer:
So you got to check the totals of all your dimensions to get the number of overfed cells.lotsaram wrote:Any value of 1 feeded in the second cube indicated that- the equivalent cell in the source cube is fed but the cells value is 0, therefore is is by definition overfed
-
- Posts: 2
- Joined: Wed Mar 19, 2014 4:03 pm
- OLAP Product: TM1
- Version: 10.2 and previous
- Excel Version: 2010
Re: Tool to detect overfeeding?
I know this is an old thread, but...
I like this idea to find overfeeding of cells with a zero, but I'm concerned about a cell being fed multiple times by different feeders (overlap).
Is that an issue, and if so, any way to figure it out? I inherited a cube that is moderately large, but takes more than an hour to load Feeders for our nightly restart. I'm trying to reduce restart time.
And yes, I know about persistent feeders. That may be an option, but I want to make sure the feeders on this cube are as optimized as possible first.
Thanks!
I like this idea to find overfeeding of cells with a zero, but I'm concerned about a cell being fed multiple times by different feeders (overlap).
Is that an issue, and if so, any way to figure it out? I inherited a cube that is moderately large, but takes more than an hour to load Feeders for our nightly restart. I'm trying to reduce restart time.
And yes, I know about persistent feeders. That may be an option, but I want to make sure the feeders on this cube are as optimized as possible first.
Thanks!
- PavoGa
- MVP
- Posts: 617
- Joined: Thu Apr 18, 2013 6:59 pm
- OLAP Product: TM1
- Version: 10.2.2 FP7, PA2.0.9.1
- Excel Version: 2013 PAW
- Location: Charleston, Tennessee
Re: Tool to detect overfeeding?
The only way I know of is, once a cell (or block of cells) is identified as overfed, review the feeders that are feeding that cube. A quick hint: look for feeders that are feeding a consolidation. If feeding to and from the same consolidation, it is a shortcut for feeding leaf cells. HOWEVER, if one feeds a consolidation from something other than itself or a consolidation sharing like-named leaf elements, you will feed ALL of the leaf elements in the target cube and that gets slow. Really slow. Did I say it gets slow?
As has been stated, whoever comes up with a way to analyze and perfect feeders is probably going to do all right financially.
Ty
Code: Select all
# Really Bad Feeder. Feeds the 'All Months' consolidation which will FEED every leaf element in All Months regardless of whether it has a value or not.
['Cost'] => DB('The Main Cube', !Version, 'All Months', 'Cost');
# using a consolidation as a shortcut. All Employees feeds All Employees. Easily enough done with !Employee as well, but just to demonstrate
['All Employees', 'Salary'] => DB('Labor Calc', !Versions, 'All Employees', 'Salary')
Ty
Ty
Cleveland, TN
Cleveland, TN
- Steve Rowe
- Site Admin
- Posts: 2416
- Joined: Wed May 14, 2008 4:25 pm
- OLAP Product: TM1
- Version: TM1 v6,v7,v8,v9,v10,v11+PAW
- Excel Version: Nearly all of them
Re: Tool to detect overfeeding?
My two p.
There's two kinds of overfeeding.
[Left]=>[Right];
If you overfeed on the right then you end up with slower calculation performance and slower starter up times. This can be detected by the rule approach outlined above.
If you overfeed from the left only then you end up with slow start ups only. (assumes no persistent feeders).
Overfeeding on the left is hard to detect and often ignored as there is no user facing impact. It is also more likely to be logically required by additive type rules that can not be met with consolidations (i.e. a = b + c; You have to feed with b and c).
Options / strategy for start-up time reduction.
Make sure you understand the model and understand that feeders are accurate as possible.
Multi-threaded start-up cfg but expect this to consume RAM
Persistent feeders.
There's two kinds of overfeeding.
[Left]=>[Right];
If you overfeed on the right then you end up with slower calculation performance and slower starter up times. This can be detected by the rule approach outlined above.
If you overfeed from the left only then you end up with slow start ups only. (assumes no persistent feeders).
Overfeeding on the left is hard to detect and often ignored as there is no user facing impact. It is also more likely to be logically required by additive type rules that can not be met with consolidations (i.e. a = b + c; You have to feed with b and c).
Options / strategy for start-up time reduction.
Make sure you understand the model and understand that feeders are accurate as possible.
Multi-threaded start-up cfg but expect this to consume RAM
Persistent feeders.
Technical Director
www.infocat.co.uk
www.infocat.co.uk
-
- Posts: 2
- Joined: Wed Mar 19, 2014 4:03 pm
- OLAP Product: TM1
- Version: 10.2 and previous
- Excel Version: 2010
Re: Tool to detect overfeeding?
Good tips and thoughts. Thanks! It's going to take a while to go through all the feeders in this cube, but I'll get it running more efficiently in the end.
-
- MVP
- Posts: 3113
- Joined: Mon Dec 29, 2008 6:26 pm
- OLAP Product: TM1, Jedox
- Version: PAL 2.0.9.18
- Excel Version: Microsoft 365
- Location: Brussels, Belgium
- Contact:
Re: Tool to detect overfeeding?
Hello,
Take into account that elements need to be fed, but that's it. How they are fed is (in theory) not important.
It's not necessarily reversing your rule, it could also be that 1 element feeds several other elements, even if that one element does not occur in the rule.
Take into account that elements need to be fed, but that's it. How they are fed is (in theory) not important.
It's not necessarily reversing your rule, it could also be that 1 element feeds several other elements, even if that one element does not occur in the rule.
Best regards,
Wim Gielis
IBM Champion 2024
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly
Wim Gielis
IBM Champion 2024
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly
- jim wood
- Site Admin
- Posts: 3951
- Joined: Wed May 14, 2008 1:51 pm
- OLAP Product: TM1
- Version: PA 2.0.7
- Excel Version: Office 365
- Location: 37 East 18th Street New York
- Contact:
Re: Tool to detect overfeeding?
Very true. The example I always give for this is product margin. Sales units is the drive of sales, but it's also the driver of Margin, you don't sell anything you don't make margin on it,Wim Gielis wrote: ↑Fri Mar 09, 2018 4:34 pm It's not necessarily reversing your rule, it could also be that 1 element feeds several other elements, even if that one element does not occur in the rule.
Jim.
Struggling through the quagmire of life to reach the other side of who knows where.
Shop at Amazon
Jimbo PC Builds on YouTube
OS: Mac OS 11 PA Version: 2.0.7
Shop at Amazon
Jimbo PC Builds on YouTube
OS: Mac OS 11 PA Version: 2.0.7
- Elessar
- Community Contributor
- Posts: 338
- Joined: Mon Nov 21, 2011 12:33 pm
- OLAP Product: PA 2
- Version: 2.0.9
- Excel Version: 2016
- Contact:
Re: Tool to detect overfeeding?
Hi,
Overfeeding "from the Left" can also affect data input (and data load) time (It can be a few seconds, but this can already annoy users)
Overfeeding "from the Left" can also affect data input (and data load) time (It can be a few seconds, but this can already annoy users)
Best regards, Alexander Dvoynev
TM1 and Data Science blog: 6th article - PAfE + VBA: Commit each cell without pressing “Commit” button.
TM1 and Data Science blog: 6th article - PAfE + VBA: Commit each cell without pressing “Commit” button.