Listing of all numerical TI process property values in .pro

Ideas and tips for enhancing your TM1 application
Post Reply
lotsaram
MVP
Posts: 3140
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Listing of all numerical TI process property values in .pro

Post by lotsaram » Mon Jun 29, 2015 1:51 pm

Hi All,

Sorry if this has come up before but a search of the forum for +TI +parameter or +TI +properties as you would expect lists too many hits to be of any use for finding something specific.

What I am after is a complete (or nearly complete will do) listing of all defined technical TI process control properties that are encoded in the .pro file.
For example:
602=Process Name
562=DatasourceType
560=Parameter count & names
577=Datasource variable count and names
572=Prolog line count & code
573=Metadata line count & code
574=Data line count & code
575=Epilog line count & code

This must exist, ... somewhere. (Maybe not somewhere publicly documented by IBM but somewhere I'm sure)

The reason being I'm doing a directory compare for the code base of multiple server instances and rules is no problem but for TI processes there is a not of "white noise" which blocks out the actual signal. I need to know for which control parameters I can ignore changes and for which do I need to care about if they are different?
Please place all requests for help in a public thread. I will not answer PMs requesting assistance.

User avatar
qml
MVP
Posts: 1059
Joined: Mon Feb 01, 2010 1:01 pm
OLAP Product: TM1 / Planning Analytics
Version: 2.0.4 and all previous
Excel Version: 2007 - 2016
Location: London, UK, Europe

Re: Listing of all numerical TI process parameter values in

Post by qml » Mon Jun 29, 2015 2:17 pm

Maybe someone will chip in with a full list. All I can offer is that the parameter I always ignore when comparing *.pro files is 565, which seems to be some hash/gibberish field whose contents change every time a TI is saved.
Kamil Arendt

lotsaram
MVP
Posts: 3140
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Listing of all numerical TI process parameter values in

Post by lotsaram » Mon Jun 29, 2015 2:28 pm

qml wrote:Maybe someone will chip in with a full list. All I can offer is that the parameter I always ignore when comparing *.pro files is 565, which seems to be some hash/gibberish field whose contents change every time a TI is saved.
Thanks, that one I know.
Please place all requests for help in a public thread. I will not answer PMs requesting assistance.

User avatar
gtonkin
MVP
Posts: 638
Joined: Thu May 06, 2010 3:03 pm
OLAP Product: TM1
Version: PAL 2.0.3
Excel Version: 2016 64-bit
Location: JHB, South Africa
Contact:

Re: Listing of all numerical TI process property values in .

Post by gtonkin » Mon Jun 29, 2015 3:26 pm

Removed-see next post-table had too much white space which I could not remove.
Last edited by gtonkin on Mon Jun 29, 2015 6:37 pm, edited 1 time in total.

User avatar
gtonkin
MVP
Posts: 638
Joined: Thu May 06, 2010 3:03 pm
OLAP Product: TM1
Version: PAL 2.0.3
Excel Version: 2016 64-bit
Location: JHB, South Africa
Contact:

Re: Listing of all numerical TI process property values in .

Post by gtonkin » Mon Jun 29, 2015 3:30 pm

This is what I have built through observation and many moons editing .PRO files in VIM (removed my previous post with the table as it created huge white space)

Section|Purpose
559|Use Unicode
560|Parameter count & names
561|Parameter types-1=Numeric,2=Strings
562|DatasourceType (view, ODBO cube,ODBC etc)
564|DataSource-Username
565|Possibly Date/Time/UpdatedBy information
566|ODBC query for Data source page (also ODBO MDX)
567|Field Delimeter
568|Quote Character
569|ProcessDataSourceASCIIHeaderRecords
570|Datasource-ViewName
571|Datasource-SubsetName
572|Prolog line count & code
573|Metadata line count & code
574|Data line count & code
575|Epilog line count & code
576|Relates to MAPS tab (default of No Action, Store Values, no Cube loggin)
577|Datasource variable count and names
578|Variables-Types 1=numeric,2 string
579|Variables-Numeric ID 1 to n
580|Variables-0 (possible future use)
581|Variables-0 (possible future use)
582|Variables-Types 32=String,33=Numeric, Type-Indicates Ignore,Other(827) etc.
585|Datasource-Name
586|Datasource-Name on Server
588|Decimal Separator
589|Thousand Separator
590|Parameters-Default values
592|-
593|Datasource-Provider (TM1OLAP)
594|Datasource-Location (ODBO Location)
595|DataSource-ODBOCatalog
596|Datasource-Additional Connection Parameters
597|-
598|-
599|MinorErrorLogMax (Possibly-equals 1000 usually)
601|-
602|Name of Process
603|Relates to MAPS tab (Dimensions mapping)
637|Parameters-Prompts
638|Compiled and saved without issues/Syntaxically correct
800|DataSource-ASCIIHeaderRecords
801|DataSource-ODBOCubeName
804|-
900|-
901|-
902|-
903|-
904|-
905|-
906|TM1 Package connector - variable for which dimension process is generated
907|-
908|-
909|-
911|-
912|-
913|-
914|-
915|-
916|-
917|-
918|-
919|-
920|Possible default packet size for SAP
921|-
922|-
923|TM1 Package connector
924|-
925|-
926|-
927|-
928|Use Active Sandbox
929|TM1 Package connector - process name from which dimension processes come
930|-
932|-
933|-
934|-
935|-
936|-
937|-
938|-
1217|Run with security admin access

Updated with Wim's items posted below
Last edited by gtonkin on Tue Jun 30, 2015 8:04 am, edited 1 time in total.

Wim Gielis
MVP
Posts: 1826
Joined: Mon Dec 29, 2008 6:26 pm
OLAP Product: TM1
Version: PAL 2.0
Excel Version: 2016
Location: Brussels, Belgium
Contact:

Re: Listing of all numerical TI process property values in .

Post by Wim Gielis » Tue Jun 30, 2015 7:33 am

559 = use Unicode
569 = ProcessDataSourceASCIIHeaderRecords
595 = ProcessDataSourceODBOCatalog
638 = Is the process syntaxically correct ?
800 = ProcessDataSourceODBOHierarchyName
801 = ProcessDataSourceODBOCubeName
906 = TM1 Package connector - variable for which dimension process is generated
923 = TM1 Package connector, nr or lines
928 = use active sandbox
929 = TM1 Package connector - process name from which dimension processes come
1217 = Run with security admin access
Best regards,

Wim Gielis

Excel Most Valuable Professional, 2011-2014
http://www.wimgielis.com ==> 105 TM1 articles and a lot of custom code
Newest blog article: Looping over input files

User avatar
gtonkin
MVP
Posts: 638
Joined: Thu May 06, 2010 3:03 pm
OLAP Product: TM1
Version: PAL 2.0.3
Excel Version: 2016 64-bit
Location: JHB, South Africa
Contact:

Re: Listing of all numerical TI process property values in .

Post by gtonkin » Tue Jun 30, 2015 8:05 am

Thanks for the updates Wim. I have amended and updated the list I posted to keep one list for those that want to copy and paste it.

BariAbdul
Regular Participant
Posts: 419
Joined: Sat Mar 10, 2012 1:03 pm
OLAP Product: TM1,Cognos
Version: 9.5.2
Excel Version: 2007

Re: Listing of all numerical TI process property values in .

Post by BariAbdul » Tue Jun 30, 2015 11:07 am

Thanks a lot gtonkin and Wim,quite useful.
"You Never Fail Until You Stop Trying......"

Duncan P
MVP
Posts: 587
Joined: Wed Aug 17, 2011 1:19 pm
OLAP Product: TM1
Version: 9.5.2 10.1 10.2
Excel Version: 2003 2007
Location: York, UK

Re: Listing of all numerical TI process property values in .

Post by Duncan P » Tue Jun 30, 2015 6:33 pm

CAVEAT - this info was certainly true in 9.5 but may be out of date. Could anyone who knows better please update it?

When comparing pro files you should look at what kind of datasource it is and then strip out anything that is only relevant to other data-sources. The reason for this is that they can be full of random values. TM1 is a C program and in C memory is not initialised to zero by the runtime when it is allocated. In the running TM1 server the TI process is represented by a data structure which starts out full of whatever gibberish previously occupied that area of memory. TM1 correctly initialises the parts of that structure that are relevant to the type of process and it leaves the rest as is. When it comes to save the process to disk it just dumps the lot. Every time you save a text file data source TI you could get a new value for the e.g. 801:ProcessDataSourceODBOCubeName, which is completely irrelevant.

lotsaram
MVP
Posts: 3140
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Listing of all numerical TI process property values in .

Post by lotsaram » Tue Jun 30, 2015 9:03 pm

Thank's Duncan. Useful information, I had observed that a process which start life as ODBC then get saved as VIEW or CHARACTERDELIMITED will forever retain the original DataSourceQuery variable as well as the ODBC connection variables. I didn't know that other non-used properties could just be random junk.

I was thinking of just limiting the compare to:
Parameter number of, names, default values & prompts
Datasource Type & Datasourcenameforserver
Variable number of & names
The 4 code tabs
Run with security access

Can anyone think of some other properties which you would deem essential for a compare? And anyone done this before and can share experience with whatever tool was used to do it?
Please place all requests for help in a public thread. I will not answer PMs requesting assistance.

User avatar
Steve Rowe
Site Admin
Posts: 1818
Joined: Wed May 14, 2008 4:25 pm
OLAP Product: TM1
Version: 10.2.2., PAW
Excel Version: Nearly all of them

Re: Listing of all numerical TI process property values in .pro

Post by Steve Rowe » Wed Jun 27, 2018 4:01 pm

Moved and bumped on request

User avatar
PavoGa
Community Contributor
Posts: 262
Joined: Thu Apr 18, 2013 6:59 pm
OLAP Product: TM1
Version: 10.2.2 FP7, PA2.0
Excel Version: 2013
Location: Cleveland, Tennessee

Re: Listing of all numerical TI process property values in .pro

Post by PavoGa » Wed Jun 27, 2018 4:51 pm

For what it is worth, I used Beyond Compare 4.0 and have a script that does exactly what you are wanting to do it seems. Only TIs with significant (i.e. ignores the white noise) variances show up in the results window.

If interested, hit me up.
Ty
Cleveland, TN

Drg
Posts: 84
Joined: Fri Aug 12, 2016 10:02 am
OLAP Product: tm1
Version: 10.2.0 - 10.3.0
Excel Version: 2010

Re: Listing of all numerical TI process property values in .pro

Post by Drg » Wed Sep 19, 2018 2:41 pm

use java extension to parse *.pro files and collect his variable name with type [string,numeric].
if this is someone I need to post with examples

Post Reply