Persistent Feeders in TM1 9.5.1

lotsaram
MVP
Posts: 3657
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Persistent Feeders in TM1 9.5.1

Post by lotsaram »

This is a pretty old thread and most if not all of the comments relate to 9.5.1. IBM have sorted out most if not all of the issues around saving of feeder files and the timestamp evaluation vs cube file. Assuming you are using 10.1 I would see absolutely no reason whatsoever not to use persistent feeders. The advantages of quicker server startup are clear. There may be some models with tricky conditional feeding based on values in lookup cubes but these are rare and anyone with such a model would know about it. For everyone else it is a switch that should be on by default.
User avatar
jameswebber
Community Contributor
Posts: 188
Joined: Sun Nov 21, 2010 8:00 pm
OLAP Product: Cognos Express 10
Version: CE 10.1.1
Excel Version: 2010
Location: Wellington, New Zealand
Contact:

Re: Persistent Feeders in TM1 9.5.1

Post by jameswebber »

Thanks heaps Lotsaram
Duncan P
MVP
Posts: 600
Joined: Wed Aug 17, 2011 1:19 pm
OLAP Product: TM1
Version: 9.5.2 10.1 10.2
Excel Version: 2003 2007
Location: York, UK

Re: Persistent Feeders in TM1 9.5.1

Post by Duncan P »

However - before you turn on the switch make sure you have enough disk space. It's a bit of a beggar to get to the end of a 10 hour server load to find that it failed with "Out of disk space" trying to save its feeder files. Been there.
User avatar
garry cook
Community Contributor
Posts: 209
Joined: Thu May 22, 2008 7:45 am
OLAP Product: TM1
Version: Various
Excel Version: Various

Re: Persistent Feeders in TM1 9.5.1

Post by garry cook »

Just be careful of http://www.tm1forum.com/viewtopic.php?f=3&t=9023 if you're on 10.1 base version.
User avatar
jameswebber
Community Contributor
Posts: 188
Joined: Sun Nov 21, 2010 8:00 pm
OLAP Product: Cognos Express 10
Version: CE 10.1.1
Excel Version: 2010
Location: Wellington, New Zealand
Contact:

Re: Persistent Feeders in TM1 9.5.1

Post by jameswebber »

Thanks heaps guys,
That is a tricky one Gary. I have FP1 installed in CE 10 so hopefully that wont be an issue.
(Had to goto FP1 to fix dynamic subsets)
iansdigby
Community Contributor
Posts: 109
Joined: Thu Feb 26, 2009 8:44 am
OLAP Product: TM1
Version: 9 + 10 + Plan An
Excel Version: All
Location: Isle of Wight, UK

Re: Persistent Feeders in TM1 9.5.1

Post by iansdigby »

We tried the persistent feeders feature and found it reduced our server load time from 35 mins to about 5 mins but that it frequently failed for obscure reasons.
When it failed we would be back to waiting 35 mins (whilst dodging flak from users) to get it up and running again.
The reasons for the failures are obscure but we vaguely recognise the scenario described above where rules files contain inter-cube feeders but no internal ones.

There has been a good spinoff though: as we loved the short load times but couldn't get PersistentFeeders working reliably, we turned it off and tried other approaches to reducing load time, finding that there was lots of inefficiency in our cubes. Indeed, I believe we will have gotten our load time down to 5 minutes anyway soon, via a combination of:

- auditing cubes and removing historic data that non-one actually needs;
- 'freezing' historic data in cubes so it is no longer rule-calculated and thus needs no feeders - resulting in perhaps up to 80% less feeding;
- considering whether calculated data needs consolidating at all and if not, removing unnecessary feeders thereto. (e.g. a prime costs cube whose data is only ever read at the N level)
- reviewing the message log to target cubes that take longest to load their feeders.

Regards, Ian
"the earth is but one country, and mankind its citizens" - Baha'u'llah
User avatar
George Regateiro
MVP
Posts: 326
Joined: Fri May 16, 2008 3:35 pm
OLAP Product: TM1
Version: 10.1.1
Excel Version: 2007 SP3
Location: Tampa FL USA

Re: Persistent Feeders in TM1 9.5.1

Post by George Regateiro »

iansdigby wrote:We tried the persistent feeders feature and found it reduced our server load time from 35 mins to about 5 mins but that it frequently failed for obscure reasons.
When it failed we would be back to waiting 35 mins (whilst dodging flak from users) to get it up and running again.
The reasons for the failures are obscure but we vaguely recognise the scenario described above where rules files contain inter-cube feeders but no internal ones.
We had this problem alot in the 9.5 area, but all of our random invalidation issues have been solved in the 10.1 version. We spent alot of time with IBM on this since it continually bit us because of BI related crashes and constant invalidation. If you have upgraded it may be worth another look since outside a few quirks around conditional feeders there is almost no reason to not use persistent feeders.
iansdigby
Community Contributor
Posts: 109
Joined: Thu Feb 26, 2009 8:44 am
OLAP Product: TM1
Version: 9 + 10 + Plan An
Excel Version: All
Location: Isle of Wight, UK

Re: Persistent Feeders in TM1 9.5.1

Post by iansdigby »

I have also noticed on one occasion that, despite TM1 reporting that it discovered a mismatch on a .cub vs .feeders timestamp, and would therefore delete and re-create all feeder files, this did not actually happen. .feeders files still existed on the server 4 hours later with timestamps from 10 days earlier.

Despite all these niggles, and given the absence of any or many conditional feeders, I still think it's a great feature.

Ian
"the earth is but one country, and mankind its citizens" - Baha'u'llah
Post Reply