Cube View takes an hour to appear
-
- Posts: 2
- Joined: Wed Sep 15, 2010 3:39 am
- OLAP Product: TM1
- Version: 9.5
- Excel Version: 2003
Cube View takes an hour to appear
Cube view takes a long long time, 1 hour to come up. Something is wrong, but do not know why. Cube is small, 150k, it has 8 dimensions ( dim1 has 7 elements, Scenario has 12 elements, Company has 3 elements, Machine Group has 12 elements, Year has 10 elements, Period has 18 elements, Measure has 20 elements, Part has 10,000 elements). I have a view that has all dimensions and 20 Parts, it comes up no problem. If I try to show all Total All Parts, then the system will come up with message that says "Cube View Processing - Building Cube View (Stop Building View)". This will take over 30 minutes and still not come up with view. If I pick "Stop Building View", it will have "TM1 Error : CubeViewer - :Error creating view array:". There are plenty of RAM, 60G, with 8G dedicated to tm1sd.exe and 24G available.
I did try to reorder the cube dimension, using System suggested method. I have not used Stargate VMM and VMT yet. Something is fundamentally not well, can you give me a hand? Thanks.
I did try to reorder the cube dimension, using System suggested method. I have not used Stargate VMM and VMT yet. Something is fundamentally not well, can you give me a hand? Thanks.
- Alan Kirk
- Site Admin
- Posts: 6606
- Joined: Sun May 11, 2008 2:30 am
- OLAP Product: TM1
- Version: PA2.0.9.18 Classic NO PAW!
- Excel Version: 2013 and Office 365
- Location: Sydney, Australia
- Contact:
Re: Cube View takes an hour to appear
Does it have any rules? If so, are you using SkipCheck and feeders?Waterlily wrote:Cube view takes a long long time, 1 hour to come up. Something is wrong, but do not know why. Cube is small, 150k, it has 8 dimensions ( dim1 has 7 elements, Scenario has 12 elements, Company has 3 elements, Machine Group has 12 elements, Year has 10 elements, Period has 18 elements, Measure has 20 elements, Part has 10,000 elements). I have a view that has all dimensions and 20 Parts, it comes up no problem. If I try to show all Total All Parts, then the system will come up with message that says "Cube View Processing - Building Cube View (Stop Building View)". This will take over 30 minutes and still not come up with view. If I pick "Stop Building View", it will have "TM1 Error : CubeViewer - :Error creating view array:". There are plenty of RAM, 60G, with 8G dedicated to tm1sd.exe and 24G available.
I did try to reorder the cube dimension, using System suggested method. I have not used Stargate VMM and VMT yet. Something is fundamentally not well, can you give me a hand? Thanks.
"To them, equipment failure is terrifying. To me, it’s 'Tuesday.' "
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
- mce
- Community Contributor
- Posts: 352
- Joined: Tue Jul 20, 2010 5:01 pm
- OLAP Product: Cognos TM1
- Version: Planning Analytics Local 2.0.x
- Excel Version: 2013 2016
- Location: Istanbul, Turkey
Re: Cube View takes an hour to appear
Try calculating the view after enabling zero suppression.
-
- MVP
- Posts: 2831
- Joined: Tue Feb 16, 2010 2:39 pm
- OLAP Product: TM1, Palo
- Version: Beginning of time thru 10.2
- Excel Version: 2003-2007-2010-2013
- Location: Atlanta, GA
- Contact:
Re: Cube View takes an hour to appear
The ONLY reason a cube of this size would take that long to load is because you've got some serious calculations going on and you forgot to use SKIPCHECK and then wrote FEEDERS.
-
- MVP
- Posts: 263
- Joined: Fri Jun 27, 2008 12:15 am
- OLAP Product: Cognos TM1, CX
- Version: 9.0 and up
- Excel Version: 2007 and up
Re: Cube View takes an hour to appear
Hi
If the zero suppression doesn't fix your problem than you might have a Feeder problem. But there are a few considerations to take into account.
Really depends on wether you indeed have rules on that cube and what your view does.
With what you are saying about the size of the cube I doubt that you actually have a lot of Feeders set, as they need memory as well.
You mentioned your view has "all dimensions and 20 Parts" and that it works fine.
I assume that your view shows certain elements out of all the other dimension apart from the Part dimension and not all elements.
When you change to "all Total All Parts" is that a consolidation or are you trying to show or the 10.000 parts on N-Level?
Note, even if you have no rules at all but try to create a non zero suppressed view which tries to display 200.000.000 zeroes, TM1 obviously will have a hard time doing that.
Cheers
If the zero suppression doesn't fix your problem than you might have a Feeder problem. But there are a few considerations to take into account.
Really depends on wether you indeed have rules on that cube and what your view does.
With what you are saying about the size of the cube I doubt that you actually have a lot of Feeders set, as they need memory as well.
You mentioned your view has "all dimensions and 20 Parts" and that it works fine.
I assume that your view shows certain elements out of all the other dimension apart from the Part dimension and not all elements.
When you change to "all Total All Parts" is that a consolidation or are you trying to show or the 10.000 parts on N-Level?
Note, even if you have no rules at all but try to create a non zero suppressed view which tries to display 200.000.000 zeroes, TM1 obviously will have a hard time doing that.
Cheers
-
- Posts: 2
- Joined: Wed Sep 15, 2010 3:39 am
- OLAP Product: TM1
- Version: 9.5
- Excel Version: 2003
Re: Cube View takes an hour to appear
"If the zero suppression doesn't fix your problem than you might have a Feeder problem. But there are a few considerations to take into account.Really depends on wether you indeed have rules on that cube and what your view does.
With what you are saying about the size of the cube I doubt that you actually have a lot of Feeders set, as they need memory as well.
You mentioned your view has "all dimensions and 20 Parts" and that it works fine.
I assume that your view shows certain elements out of all the other dimension apart from the Part dimension and not all elements.
When you change to "all Total All Parts" is that a consolidation or are you trying to show or the 10.000 parts on N-Level?
Note, even if you have no rules at all but try to create a non zero suppressed view which tries to display 200.000.000 zeroes, TM1 obviously will have a hard time doing that."
REPLY =>
1. There is zero suppression, SKIPCHECK and FEEDERS in rule
2. I inherit the cube from someone who left, the cube does have some crazy and serious conditional rules, total 160 lines, connecting 4 cubes, perhaps I need to review the rules...
3. The view does have zero suppression, so I will not be displaying 200,000,000 zeroes.
I recently changed cfg "MaximumCubeLoadThreads" to properly use the multi cpu cores, it seems to improve the situation. Before the change, system will always hang cause only 1/8 of the cpu is available, then I have to restart service. After service is restarted, the RAM of tm1sd.exe is always brought down to 5-6 G, then I have to reload all the views, after 2 hours and the views are loaded, tm1sd.exe then goes up to 9-10G, then the system will hang due to some other reasons, and the tm1sd.exe will go down again to 5-6 G. The cycle will repeat.
Now with the change of "MaximumCubeLoadThreads", the system seems to be much more stable, the tm1sd.exe remains at 9-10 G even after the restart, thus I do not have to manually reload the views again. I cannot really explain all these. Will report back if the system really stabilize.
With what you are saying about the size of the cube I doubt that you actually have a lot of Feeders set, as they need memory as well.
You mentioned your view has "all dimensions and 20 Parts" and that it works fine.
I assume that your view shows certain elements out of all the other dimension apart from the Part dimension and not all elements.
When you change to "all Total All Parts" is that a consolidation or are you trying to show or the 10.000 parts on N-Level?
Note, even if you have no rules at all but try to create a non zero suppressed view which tries to display 200.000.000 zeroes, TM1 obviously will have a hard time doing that."
REPLY =>
1. There is zero suppression, SKIPCHECK and FEEDERS in rule
2. I inherit the cube from someone who left, the cube does have some crazy and serious conditional rules, total 160 lines, connecting 4 cubes, perhaps I need to review the rules...
3. The view does have zero suppression, so I will not be displaying 200,000,000 zeroes.
I recently changed cfg "MaximumCubeLoadThreads" to properly use the multi cpu cores, it seems to improve the situation. Before the change, system will always hang cause only 1/8 of the cpu is available, then I have to restart service. After service is restarted, the RAM of tm1sd.exe is always brought down to 5-6 G, then I have to reload all the views, after 2 hours and the views are loaded, tm1sd.exe then goes up to 9-10G, then the system will hang due to some other reasons, and the tm1sd.exe will go down again to 5-6 G. The cycle will repeat.
Now with the change of "MaximumCubeLoadThreads", the system seems to be much more stable, the tm1sd.exe remains at 9-10 G even after the restart, thus I do not have to manually reload the views again. I cannot really explain all these. Will report back if the system really stabilize.
-
- MVP
- Posts: 263
- Joined: Fri Jun 27, 2008 12:15 am
- OLAP Product: Cognos TM1, CX
- Version: 9.0 and up
- Excel Version: 2007 and up
Re: Cube View takes an hour to appear
Hi
"MaximumCubeLoadThreads" does not improve how you retrieve a view. It is a setting purely for the way you start up your server.
TM1 will always only use one Thread/Core to retrieve the values for a view for one user.
So I'd say this is coincidental rather than a real fix for your problem.
I should have mentioned this earlier:
Could you start the performance monitor and check (in }statscube) how many feeders are set against the cube?
Just to sort out the Feeder question. Still not convinced that it is the only issue, at least for that specific cube.
You could also check whether you actually get a result for your ‘Total Parts’ consolidation at all if you pick one N- Level element each out of all other dimensions. In that case you would be consolidating 10.000 cells which are usually a piece of cake for TM1.
If that takes a long time, your rules are crazy and they need an overhaul.
It’s also possible that you have a circular reference in your rules.
Cheers
"MaximumCubeLoadThreads" does not improve how you retrieve a view. It is a setting purely for the way you start up your server.
TM1 will always only use one Thread/Core to retrieve the values for a view for one user.
So I'd say this is coincidental rather than a real fix for your problem.
I should have mentioned this earlier:
Could you start the performance monitor and check (in }statscube) how many feeders are set against the cube?
Just to sort out the Feeder question. Still not convinced that it is the only issue, at least for that specific cube.
You could also check whether you actually get a result for your ‘Total Parts’ consolidation at all if you pick one N- Level element each out of all other dimensions. In that case you would be consolidating 10.000 cells which are usually a piece of cake for TM1.
If that takes a long time, your rules are crazy and they need an overhaul.
It’s also possible that you have a circular reference in your rules.
Cheers
- bihints.com
- Posts: 52
- Joined: Tue May 20, 2008 8:56 am
- OLAP Product: TM1
- Version: 9.0.3
- Excel Version: 2003
- Contact:
Re: Cube View takes an hour to appear
Did you mean you also have conditional feeders? These do not mix well with that parameter as explained in the manual.Waterlily wrote: 2. I inherit the cube from someone who left, the cube does have some crazy and serious conditional rules, total 160 lines
...
Now with the change of "MaximumCubeLoadThreads", the system seems to be much more stable, the tm1sd.exe remains at 9-10 G even after the restart, thus I do not have to manually reload the views again. I cannot really explain all these. Will report back if the system really stabilize.
http://publib.boulder.ibm.com/infocente ... 503FE.html
If this is the case that could explain these conditional feeders were previously causing trouble and have been skipped with that multi-thread load?
-
- MVP
- Posts: 195
- Joined: Wed Jul 22, 2009 10:35 pm
- OLAP Product: TM1
- Version: 9.5.2 FP3
- Excel Version: 2010
Re: Cube View takes an hour to appear
Guys,Gregor Koch wrote: If the zero suppression doesn't fix your problem
(...)
Note, even if you have no rules at all but try to create a non zero suppressed view which tries to display 200.000.000 zeroes, TM1 obviously will have a hard time doing that.
I was just hit by the "Error creating view array" problem.
I have a larger cube (20 Dimensions, two biggest are 600 000 and 1 000 000 elements) and want to display a view with 600 000 rows and 30 columns.
For now I have only zeroes in my view (it will get some data later).
I have rules for the cube, but just a few with a SKIPCHECK and without FEEDERS (not needed for consolidations in my case). Anyway those rules don't "touch" cells I want to see in my view.
Zero suppression does NOT fix my problem.
Does it mean I need to build smaller arrays while looking for data in the cube (those work fine)?
Or maybe there are some settings I could set to make such views work?
Regards.
Server: Windows Server 2008, version 9.5.1
Client: Windows XP, version 9.5.1 HF9, Excel 2003
-
- MVP
- Posts: 2831
- Joined: Tue Feb 16, 2010 2:39 pm
- OLAP Product: TM1, Palo
- Version: Beginning of time thru 10.2
- Excel Version: 2003-2007-2010-2013
- Location: Atlanta, GA
- Contact:
Re: Cube View takes an hour to appear
You're not going to be able to open a view that large in the Cube Viewer, not even close. I don't know what the maximum size is going to be because it depends on your environment. I would try starting with a view that has 10,000 rows and go up from there by 10,000 until it crashes, That will then be your maximum.jstrygner wrote:I was just hit by the "Error creating view array" problem.
I have a larger cube (20 Dimensions, two biggest are 600 000 and 1 000 000 elements) and want to display a view with 600 000 rows and 30 columns.
For now I have only zeroes in my view (it will get some data later).
I have rules for the cube, but just a few with a SKIPCHECK and without FEEDERS (not needed for consolidations in my case). Anyway those rules don't "touch" cells I want to see in my view.
Zero suppression does NOT fix my problem.
Does it mean I need to build smaller arrays while looking for data in the cube (those work fine)?
Or maybe there are some settings I could set to make such views work?