Feeder statement cleanup

Post Reply
grusty
Posts: 9
Joined: Thu Oct 11, 2018 10:11 pm
OLAP Product: IBM Planning Analytics
Version: 2.0
Excel Version: 2013 32 bit

Feeder statement cleanup

Post by grusty » Thu Jul 04, 2019 7:27 pm

Hi Experts,

I'm cleaning up some inefficient feeders that I implemented a year ago and now with more experience realize are not necessary. I'm finding that after removing many of the feeder statements that the total memory used for feeders has not changed in }StatsByCube. Does the .feeder file need to be deleted and feeders reprocessed for the memory savings to take effect? Maybe I don't understand how feeder files work, but when I remove some feeder statements some feeders still remain so should the .feeder file not be updated on rule save?

In another example I've removed all feeders for one massive cube that is storing sales information. Can I simply delete the .feeder file on the server?

Thank you in advance for your insight.

User avatar
Steve Rowe
Site Admin
Posts: 1920
Joined: Wed May 14, 2008 4:25 pm
OLAP Product: TM1
Version: 10.2.2., PAW
Excel Version: Nearly all of them

Re: Feeder statement cleanup

Post by Steve Rowe » Thu Jul 04, 2019 9:44 pm

If you've done a major rewrite then I'd suggest deleting all feeder files with the server shut down. It will sort itself out on start-up.

Wim Gielis
MVP
Posts: 2087
Joined: Mon Dec 29, 2008 6:26 pm
OLAP Product: TM1
Version: PAL 2.0.7
Excel Version: Office 365 - latest
Location: Brussels, Belgium
Contact:

Re: Feeder statement cleanup

Post by Wim Gielis » Thu Jul 04, 2019 9:50 pm

Or you could use the TI function DeleteAllPersistentFeeders:
https://www.tm1forum.com/viewtopic.php?t=5294#p22566
Best regards,

Wim Gielis

Excel Most Valuable Professional, 2011-2014
http://www.wimgielis.com ==> 109 TM1 articles and a lot of custom code
Newest blog article: Set up a TM1 service with AutoHotKey

User avatar
paulsimon
MVP
Posts: 694
Joined: Sat Sep 03, 2011 11:10 pm
OLAP Product: TM1
Version: PA 2.0.5
Excel Version: 2016
Contact:

Re: Feeder statement cleanup

Post by paulsimon » Thu Jul 04, 2019 9:52 pm

Hi

Memory is only released when you restart the TM1 Service.

So delete the feeder files, and restart the TM1 Service.

You might find that if you have optiimised your feeders to reduce over-feeding that you no longer need to use feeder files, so you can turn them off.

I used feeder files briefly once, but haven't used them for years. In my view they are more trouble than they are worth. I think you have just found out one of the problems with them. Another issue is that they tend to get invalidated quite frequently which can lead to highly variable server start up times.

In practice the TM1 Server is so much more stable these days than it used to be that the service going down and therefore needing to be restarted quickly during the day is a much rarer occurrence. Feeder files only help reduce start up times. If you have an overnight or weekend batch window where you can restart the TM1 Service then it probably doesn't matter if it takes a bit longer.

Other issues with feeder files is that they can give unexpected bugs. Eg a change is made to rules and feeders which means that something is underfed but you don't notice because the feeder file is still there. However, when something happens to cause the feeder files to be invalidated suddenly the value is no longer fed, and it may be a while before that is spotted. I would never use feeder files in the Dev environment for this reason.

Regards

Paul Simon

User avatar
Steve Rowe
Site Admin
Posts: 1920
Joined: Wed May 14, 2008 4:25 pm
OLAP Product: TM1
Version: 10.2.2., PAW
Excel Version: Nearly all of them

Re: Feeder statement cleanup

Post by Steve Rowe » Thu Jul 04, 2019 10:16 pm

Wow, we're all up late!

grusty
Posts: 9
Joined: Thu Oct 11, 2018 10:11 pm
OLAP Product: IBM Planning Analytics
Version: 2.0
Excel Version: 2013 32 bit

Re: Feeder statement cleanup

Post by grusty » Fri Jul 05, 2019 12:56 am

Thanks everyone, I'm going to go ahead and use the DeleteAllPersistentFeeders function. Hoping server startup won't take too long.

I recall last year it taking a good 8 hours to reprocess all feeders in the model. I've since deleted about 90% of all feeder statements in the model, some I replaced with TI populated values instead of rule calculated. Amazing how much you can learn in a year. The old me just fed the crap out of everything. I think I FINALLY have a solid grasp of how feeders work now though.

Wim Gielis
MVP
Posts: 2087
Joined: Mon Dec 29, 2008 6:26 pm
OLAP Product: TM1
Version: PAL 2.0.7
Excel Version: Office 365 - latest
Location: Brussels, Belgium
Contact:

Re: Feeder statement cleanup

Post by Wim Gielis » Fri Jul 05, 2019 2:31 pm

grusty wrote:
Fri Jul 05, 2019 12:56 am
I've since deleted about 90% of all feeder statements in the model
Which may or may not reflect 90% of your fed cells.
I mean that a very short statement like:

['Actual'] => ['Forecast 1+11'];

may lead to a big number of fed cells.

But I hear you, you removed a LOT of fed cells.
Best regards,

Wim Gielis

Excel Most Valuable Professional, 2011-2014
http://www.wimgielis.com ==> 109 TM1 articles and a lot of custom code
Newest blog article: Set up a TM1 service with AutoHotKey

Post Reply