Page 1 of 1

Trains AI Competition

Posted: 09 Jul 2016 18:04
by xarick
Testing Train AIs from time to time, for 100 years, from 1950 to 2051.

Parameters and AIs who reached 2051:
[+] Spoiler

Code: Select all

(v25)            AdmiralAI = always_autorenew=1,start_date=1,use_busses=0,use_planes=0,use_trucks=0                                       - finished (1.6.1-RC1)
(v95)                 AIAI = PAX_plane=0,clear_signs=1,hide_contact_information=1,start_date=1,use_buses=0,use_trucks=0                   - finished (1.6.1-RC1)
(v97)                 AIAI = PAX_plane=0,clear_signs=1,hide_contact_information=1,start_date=1,use_buses=0,use_mail_trucks=0,use_trucks=0 - finished (1.6.1)
(v409)            ChooChoo = ActivitySigns=0,PathfinderMultiplier=1,start_date=1                                                          - finished (1.6.1-RC1)
(v412)            ChooChoo = ActivitySigns=0,PathfinderMultiplier=1,start_date=1                                                          - finished (1.7.2)
(v1) "Denver & Rio Grande" = bridge_max_len=20,min_route_dist=100,randomize_station_picks=0,start_date=1                                  - finished (1.6.1-RC1)
(v183)          DictatorAI = PresidentName=1,allow_scp=0,keep_road=0,start_date=1,station_balance=1,use_air=0,use_boat=0,use_road=0       - finished but never built (1.6.1-RC1?)
(v4)             FastPTPAI = start_date=1                                                                                                 - finished (1.6.1-RC1)
(v21)               MailAI = level_of_easiness=0,show_debug=0,start_date=1,use_ISR=0,use_art_trucks=0,use_trucks=0                        - finished (1.6.1-RC1)
(v499)               NoCAB = Allow trains town to town=1,Enable airplanes=0,Enable road vehicles=0,Enable ships=0,start_date=1            - finished (1.6.1-RC1)
(v2)               NoNoCAB = Allow trains town to town=1,Enable airplanes=0,Enable road vehicles=0,Enable ships=0,start_date=1            - finished (1.6.1)
(v3)               NoNoCAB = Allow trains town to town=1,Enable airplanes=0,Enable road vehicles=0,Enable ships=0,start_date=1            - finished (1.6.1)
(v5)               NoNoCAB = Allow trains town to town=1,Enable airplanes=0,Enable road vehicles=0,Enable ships=0,start_date=1            - finished (1.7.2)
(v418)              OtviAI = start_date=1                                                                                                 - finished (1.6.1-RC1)
(v10)             SimpleAI = newgrf_stations=0,signaltype=3,start_date=1,subsidy_chance=10,use_aircraft=0,use_roadvehs=0                  - finished (1.6.1-RC1)
(v12)             SimpleAI = newgrf_stations=0,signaltype=3,start_date=1,subsidy_chance=10,use_aircraft=0,use_roadvehs=0                  - finished (1.7.2)
(v15)             SynTrans = start_date=1                                                                                                 - finished (1.6.1-RC1)
(v1)                TracAI = min_town_size=100,start_date=1,use_planes=0                                                                  - crashed  (1.6.1-RC1?)
(v2)                trAIns = start_date=1                                                                                                 - finished (1.6.1-RC1)
(v130722)            Trans = Air Vehicle=0,Road Vehicle=0,Water Vehicle=0,start_date=1                                                    - finished but never built (1.6.1-RC1?)
(v6)                WormAI = min_town_size=100,start_date=1,use_planes=0                                                                  - finished (1.6.1-RC1)
(v7)                WormAI = min_town_size=100,start_date=1,use_planes=0                                                                  - finished (1.7.2)
A short summary about those who crashed:
TracAI v1, 1.6.1-RC1?: viewtopic.php?p=1171501#p1171501

A few AIs could not do autosaves due to taking too long to save. I still tested them, but only made one save in the entire session, on the last day, 1st Jan 2051. Otherwise, they would also crash. They were:
NoCAB v499, 1.6.1-RC1?
SimpleAI v10, 1.6.1-RC1?
SimpleAI v12, 1.7.2 - viewtopic.php?p=1203269#p1203269

Here's a summary of results of those who reached 2051 (and built something):

Code: Select all

AI name        (version);  company value;     profit trs %;    served sts  %;  profit ly tr;      avg/best tr     %; pieces rl; eff rl; OTTD ver

AdmiralAI          (v25); £3,791,890,763; 1,521/2,140  71%; 1,200/1,604  75%;  +£73,039,993;  £34,131/£193,172  18%;   245,901;    297; 1.6.1-RC1
AIAI               (v95); £2,010,700,820;   363/  408  89%;   192/  222  86%;  +£36,114,654;  £88,516/£679,078  13%;    61,954;    583; 1.6.1-RC1
AIAI               (v97); £1,663,974,711;   292/  356  82%;   156/  200  78%;  +£25,082,921;  £70,458/£463,589  15%;    55,517;    452; 1.6.1
ChooChoo          (v409);   £414,838,987;   177/  179  99%;   219/  282  78%;   +£6,031,135;  £33,693/ £78,645  43%;    67,995;     89; 1.6.1-RC1
ChooChoo          (v412);   £931,508,897;   493/  530  93%;   200/  277  72%;  +£13,538,682;  £25,545/ £69,384  37%;    66,743;    203; 1.7.2
Denver & Rio Grande (v1);   £337,755,289;     0/   13   0%;     0/  114   0%;      -£22,303;  -£1,716/ -£1,599   0%;    54,207;      0; 1.6.1-RC1
FastPTPAI           (v4);   £643,838,100;   200/  259  77%;   217/  750  29%;   +£6,254,256;  £24,148/ £94,004  26%;    64,303;     97; 1.6.1-RC1
MailAI             (v21);    £21,905,431;    12/   12 100%;    12/   12 100%;     +£314,482;  £26,207/ £65,149  40%;     1,687;    186; 1.6.1-RC1
NoCAB             (v499);   £606,769,758;     0/  947   0%;     0/  432   0%;      -£48,489;     -£51/      £0   0%;   164,764;      0; 1.6.1-RC1
NoNoCAB             (v2); £2,520,115,704;     0/1,649   0%;     0/  574   0%;     -£228,681;    -£139/      £0   0%;   174,402;      0; 1.6.1
NoNoCAB             (v3); £3,418,676,064;    87/  157  55%;    10/  333   3%;   +£9,339,572;  £59,488/£144,991  41%;   167,158;     56; 1.6.1
NoNoCAB             (v5); £2,924,835,442;    38/   38 100%;    13/  350   4%;   +£4,427,326; £116,509/£171,670  68%;   141,550;     31; 1.7.2
OtviAI            (v418);   £217,568,247;   137/  143  96%;   199/  257  77%;   +£4,354,979;  £30,454/£143,653  21%;    31,320;    139; 1.6.1-RC1
SimpleAI           (v10); £3,425,933,565; 2,150/2,163  99%; 2,664/2,813  95%;  +£74,903,282;  £34,629/£173,045  20%;   238,035;    315; 1.6.1-RC1
SimpleAI           (v12); £3,200,449,943; 2,236/2,242 100%; 2,712/2,886  94%;  +£76,139,294;  £33,960/£194,992  17%;   246,115;    309; 1.7.2
SynTrans           (v15);     £5,491,269;     1/    3  33%;     1/    6  17%;      +£29,713;   £9,904/ £33,976  29%;       577;     51; 1.6.1-RC1
trAIns              (v2); £9,416,629,894; 1,426/1,558  92%;   416/  445  93%; +£175,691,802; £112,768/£396,116  28%;   198,659;    884; 1.6.1-RC1
WormAI              (v6); £5,046,924,992; 2,113/2,121 100%; 1,613/1,758  92%;  +£99,526,939;  £46,925/£203,411  23%;   210,017;    474; 1.6.1-RC1
WormAI              (v7); £4,959,217,513; 2,055/2,061 100%; 1,606/1,732  93%;  +£98,908,675;  £47,991/£203,654  24%;   205,295;    482; 1.7.2
EDIT: Added NoNoCAB v2 and v3
EDIT2: Added AIAI v97, updated savegames, updated parameter presentation, updated score presentation
EDIT3: Added 1.7.2 tests: ChooChoo v412, NoNoCAB v5, SimpleAI v12, WormAI v7. Updated savegames, result summary and parameter summary with the OpenTTD version used for testing.

Re: Trains AI Competition

Posted: 09 Jul 2016 18:59
by Wormnest
Thanks for another extensive AI review.
I'm glad to see that WormAI performed pretty well although it's average profit per vehicle could use some improvements.

Re: Trains AI Competition

Posted: 15 Jul 2016 14:46
by Brumi
Thank you very much for the test!