Cube View takes an hour to appear

Post Reply
Waterlily
Posts: 2
Joined: Wed Sep 15, 2010 3:39 am
OLAP Product: TM1
Version: 9.5
Excel Version: 2003

Cube View takes an hour to appear

Post by Waterlily »

Cube view takes a long long time, 1 hour to come up. Something is wrong, but do not know why. Cube is small, 150k, it has 8 dimensions ( dim1 has 7 elements, Scenario has 12 elements, Company has 3 elements, Machine Group has 12 elements, Year has 10 elements, Period has 18 elements, Measure has 20 elements, Part has 10,000 elements). I have a view that has all dimensions and 20 Parts, it comes up no problem. If I try to show all Total All Parts, then the system will come up with message that says "Cube View Processing - Building Cube View (Stop Building View)". This will take over 30 minutes and still not come up with view. If I pick "Stop Building View", it will have "TM1 Error : CubeViewer - :Error creating view array:". There are plenty of RAM, 60G, with 8G dedicated to tm1sd.exe and 24G available.

I did try to reorder the cube dimension, using System suggested method. I have not used Stargate VMM and VMT yet. Something is fundamentally not well, can you give me a hand? Thanks.
User avatar
Alan Kirk
Site Admin
Posts: 6606
Joined: Sun May 11, 2008 2:30 am
OLAP Product: TM1
Version: PA2.0.9.18 Classic NO PAW!
Excel Version: 2013 and Office 365
Location: Sydney, Australia
Contact:

Re: Cube View takes an hour to appear

Post by Alan Kirk »

Waterlily wrote:Cube view takes a long long time, 1 hour to come up. Something is wrong, but do not know why. Cube is small, 150k, it has 8 dimensions ( dim1 has 7 elements, Scenario has 12 elements, Company has 3 elements, Machine Group has 12 elements, Year has 10 elements, Period has 18 elements, Measure has 20 elements, Part has 10,000 elements). I have a view that has all dimensions and 20 Parts, it comes up no problem. If I try to show all Total All Parts, then the system will come up with message that says "Cube View Processing - Building Cube View (Stop Building View)". This will take over 30 minutes and still not come up with view. If I pick "Stop Building View", it will have "TM1 Error : CubeViewer - :Error creating view array:". There are plenty of RAM, 60G, with 8G dedicated to tm1sd.exe and 24G available.

I did try to reorder the cube dimension, using System suggested method. I have not used Stargate VMM and VMT yet. Something is fundamentally not well, can you give me a hand? Thanks.
Does it have any rules? If so, are you using SkipCheck and feeders?
"To them, equipment failure is terrifying. To me, it’s 'Tuesday.' "
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
User avatar
mce
Community Contributor
Posts: 352
Joined: Tue Jul 20, 2010 5:01 pm
OLAP Product: Cognos TM1
Version: Planning Analytics Local 2.0.x
Excel Version: 2013 2016
Location: Istanbul, Turkey

Re: Cube View takes an hour to appear

Post by mce »

Try calculating the view after enabling zero suppression.
tomok
MVP
Posts: 2831
Joined: Tue Feb 16, 2010 2:39 pm
OLAP Product: TM1, Palo
Version: Beginning of time thru 10.2
Excel Version: 2003-2007-2010-2013
Location: Atlanta, GA
Contact:

Re: Cube View takes an hour to appear

Post by tomok »

The ONLY reason a cube of this size would take that long to load is because you've got some serious calculations going on and you forgot to use SKIPCHECK and then wrote FEEDERS.
Tom O'Kelley - Manager Finance Systems
American Tower
http://www.onlinecourtreservations.com/
Gregor Koch
MVP
Posts: 263
Joined: Fri Jun 27, 2008 12:15 am
OLAP Product: Cognos TM1, CX
Version: 9.0 and up
Excel Version: 2007 and up

Re: Cube View takes an hour to appear

Post by Gregor Koch »

Hi

If the zero suppression doesn't fix your problem than you might have a Feeder problem. But there are a few considerations to take into account.
Really depends on wether you indeed have rules on that cube and what your view does.
With what you are saying about the size of the cube I doubt that you actually have a lot of Feeders set, as they need memory as well.

You mentioned your view has "all dimensions and 20 Parts" and that it works fine.

I assume that your view shows certain elements out of all the other dimension apart from the Part dimension and not all elements.
When you change to "all Total All Parts" is that a consolidation or are you trying to show or the 10.000 parts on N-Level?

Note, even if you have no rules at all but try to create a non zero suppressed view which tries to display 200.000.000 zeroes, TM1 obviously will have a hard time doing that.

Cheers
Waterlily
Posts: 2
Joined: Wed Sep 15, 2010 3:39 am
OLAP Product: TM1
Version: 9.5
Excel Version: 2003

Re: Cube View takes an hour to appear

Post by Waterlily »

"If the zero suppression doesn't fix your problem than you might have a Feeder problem. But there are a few considerations to take into account.Really depends on wether you indeed have rules on that cube and what your view does.
With what you are saying about the size of the cube I doubt that you actually have a lot of Feeders set, as they need memory as well.

You mentioned your view has "all dimensions and 20 Parts" and that it works fine.

I assume that your view shows certain elements out of all the other dimension apart from the Part dimension and not all elements.
When you change to "all Total All Parts" is that a consolidation or are you trying to show or the 10.000 parts on N-Level?

Note, even if you have no rules at all but try to create a non zero suppressed view which tries to display 200.000.000 zeroes, TM1 obviously will have a hard time doing that."

REPLY =>

1. There is zero suppression, SKIPCHECK and FEEDERS in rule
2. I inherit the cube from someone who left, the cube does have some crazy and serious conditional rules, total 160 lines, connecting 4 cubes, perhaps I need to review the rules...
3. The view does have zero suppression, so I will not be displaying 200,000,000 zeroes.

I recently changed cfg "MaximumCubeLoadThreads" to properly use the multi cpu cores, it seems to improve the situation. Before the change, system will always hang cause only 1/8 of the cpu is available, then I have to restart service. After service is restarted, the RAM of tm1sd.exe is always brought down to 5-6 G, then I have to reload all the views, after 2 hours and the views are loaded, tm1sd.exe then goes up to 9-10G, then the system will hang due to some other reasons, and the tm1sd.exe will go down again to 5-6 G. The cycle will repeat.

Now with the change of "MaximumCubeLoadThreads", the system seems to be much more stable, the tm1sd.exe remains at 9-10 G even after the restart, thus I do not have to manually reload the views again. I cannot really explain all these. Will report back if the system really stabilize.
Gregor Koch
MVP
Posts: 263
Joined: Fri Jun 27, 2008 12:15 am
OLAP Product: Cognos TM1, CX
Version: 9.0 and up
Excel Version: 2007 and up

Re: Cube View takes an hour to appear

Post by Gregor Koch »

Hi

"MaximumCubeLoadThreads" does not improve how you retrieve a view. It is a setting purely for the way you start up your server.
TM1 will always only use one Thread/Core to retrieve the values for a view for one user.
So I'd say this is coincidental rather than a real fix for your problem.

I should have mentioned this earlier:
Could you start the performance monitor and check (in }statscube) how many feeders are set against the cube?
Just to sort out the Feeder question. Still not convinced that it is the only issue, at least for that specific cube.

You could also check whether you actually get a result for your ‘Total Parts’ consolidation at all if you pick one N- Level element each out of all other dimensions. In that case you would be consolidating 10.000 cells which are usually a piece of cake for TM1.
If that takes a long time, your rules are crazy and they need an overhaul.
It’s also possible that you have a circular reference in your rules.

Cheers
User avatar
bihints.com
Posts: 52
Joined: Tue May 20, 2008 8:56 am
OLAP Product: TM1
Version: 9.0.3
Excel Version: 2003
Contact:

Re: Cube View takes an hour to appear

Post by bihints.com »

Waterlily wrote: 2. I inherit the cube from someone who left, the cube does have some crazy and serious conditional rules, total 160 lines
...
Now with the change of "MaximumCubeLoadThreads", the system seems to be much more stable, the tm1sd.exe remains at 9-10 G even after the restart, thus I do not have to manually reload the views again. I cannot really explain all these. Will report back if the system really stabilize.
Did you mean you also have conditional feeders? These do not mix well with that parameter as explained in the manual.
http://publib.boulder.ibm.com/infocente ... 503FE.html

If this is the case that could explain these conditional feeders were previously causing trouble and have been skipped with that multi-thread load?
jstrygner
MVP
Posts: 195
Joined: Wed Jul 22, 2009 10:35 pm
OLAP Product: TM1
Version: 9.5.2 FP3
Excel Version: 2010

Re: Cube View takes an hour to appear

Post by jstrygner »

Gregor Koch wrote: If the zero suppression doesn't fix your problem
(...)
Note, even if you have no rules at all but try to create a non zero suppressed view which tries to display 200.000.000 zeroes, TM1 obviously will have a hard time doing that.
Guys,
I was just hit by the "Error creating view array" problem.
I have a larger cube (20 Dimensions, two biggest are 600 000 and 1 000 000 elements) and want to display a view with 600 000 rows and 30 columns.
For now I have only zeroes in my view (it will get some data later).
I have rules for the cube, but just a few with a SKIPCHECK and without FEEDERS (not needed for consolidations in my case). Anyway those rules don't "touch" cells I want to see in my view.
Zero suppression does NOT fix my problem.

Does it mean I need to build smaller arrays while looking for data in the cube (those work fine)?
Or maybe there are some settings I could set to make such views work?

Regards.

Server: Windows Server 2008, version 9.5.1
Client: Windows XP, version 9.5.1 HF9, Excel 2003
tomok
MVP
Posts: 2831
Joined: Tue Feb 16, 2010 2:39 pm
OLAP Product: TM1, Palo
Version: Beginning of time thru 10.2
Excel Version: 2003-2007-2010-2013
Location: Atlanta, GA
Contact:

Re: Cube View takes an hour to appear

Post by tomok »

jstrygner wrote:I was just hit by the "Error creating view array" problem.
I have a larger cube (20 Dimensions, two biggest are 600 000 and 1 000 000 elements) and want to display a view with 600 000 rows and 30 columns.
For now I have only zeroes in my view (it will get some data later).
I have rules for the cube, but just a few with a SKIPCHECK and without FEEDERS (not needed for consolidations in my case). Anyway those rules don't "touch" cells I want to see in my view.
Zero suppression does NOT fix my problem.

Does it mean I need to build smaller arrays while looking for data in the cube (those work fine)?
Or maybe there are some settings I could set to make such views work?
You're not going to be able to open a view that large in the Cube Viewer, not even close. I don't know what the maximum size is going to be because it depends on your environment. I would try starting with a view that has 10,000 rows and go up from there by 10,000 until it crashes, That will then be your maximum.
Tom O'Kelley - Manager Finance Systems
American Tower
http://www.onlinecourtreservations.com/
Post Reply