Page 1 of 1

Fresh 1.8.0 Install 100 Years Solo AI Competition

Posted: 19 Oct 2018 15:58
by xarick
[+] Spoiler

Code: Select all

AdmiralAI          (v25) - finished
AIAI               (v97) - finished
AroAI             (v127) - finished
BorkAI             (v23) - finished
ChooChoo          (v412) - finished
Chopper            (v10) - finished
CivilAI            (v16) - finished
CluelessPlus       (v38) - finished
Convoy             (v11) - finished
CPU                 (v5) - bankrupted 04-2049
Denver & Rio Grande (v1) - bankrupted 04-2045
DictatorAI        (v183) - finished
DumbAI              (v1) - finished
EmotionAI           (v1) - finished
EpicTrans           (v1) - bankrupted 02-2046
FastPTPAI           (v4) - finished
gelignAIte          (v1) - finished
HeliFerry           (v3) - finished
LuDiAI              (v1) - finished
LuDiAI AfterFix     (v5) - finished
MailAI             (v21) - finished (crashed 12-2016)
MogulAI          (v5900) - finished
MpAI                (v1) - bankrupted 11-1960
NoCAB             (v499) - finished
NoNoCAB             (v5) - finished
OtviAI            (v422) - finished
PathZilla           (v6) - finished
PAXLink            (v14) - finished
RailwAI             (v7) - finished
RoadAI              (v5) - finished
RoadRunner         (v12) - finished
rocketAI            (v1) - finished (crashed 12-1950)
Rondje            (v384) - finished
Rythorn Airline AI  (v3) - finished (crashed 01-1950)
ShipAI              (v5) - finished
SimpleAI           (v13) - finished
SmallTownAI         (v5) - finished
SnakeAI             (v9) - finished
SynTrans           (v15) - finished
Terron            (v209) - finished
TeshiNet            (v4) - finished (crashed 05-1958)
TracAI              (v1) - finished (crashed 08-1961)
trAIns              (v2) - finished
Trans          (v180622) - finished
WmDOT              (v14) - bankrupted 07-1955
WormAI              (v7) - finished
WrightAI            (v3) - finished

Code: Select all

AI Name    (version);  company value;       num vehicles; profiting vehs %; served sts %;      best profit/income ly %;          infrastructure usage; perf; OTTDv
                                       tr   rv   sh   ac                                                                   rl      rd   cl  ap     st
AdmiralAI      (v25); £1,135,991,187; 465+ 500+   0+ 142;   706/1,107  64%; 156/193  81%; £32,210,622/£51,682,256 62%; 13,012+  4,743+   0+ 39+   670;  900; 1.8.0
AIAI           (v97);   £585,052,906;  41+ 466+   0+ 160;   396/  667  59%;  92/106  87%; £18,413,000/£28,990,959 64%;  3,428+  4,452+   0+ 36+   308;  900; 1.8.0
AroAI         (v127);    £77,697,472;   0+ 190+   0+   0;   190/  190 100%;  27/ 27 100%;  £1,077,718/ £1,782,403 60%;      0+  2,704+   0+  0+    38;  701; 1.8.0
BorkAI         (v23);   £122,082,793;   0+ 353+   0+   9;   283/  362  78%; 360/561  64%;  £1,872,594/ £7,241,615 26%;      0+  5,920+   0+ 44+   517;  900; 1.8.0
ChooChoo      (v412);    £69,434,354;  12+  16+   0+   0;    28/   28 100%;  40/ 39 103%;    £873,356/ £1,269,471 69%;  4,281+    666+   0+  0+   235;  468; 1.8.0
Chopper        (v10);    £23,158,449;   0+   0+   0+  34;    34/   34 100%;  25/ 33  76%;    £771,347/ £1,439,794 54%;      0+      0+   0+ 32+     0;  467; 1.8.0
CivilAI        (v16);   £212,575,872;  30+ 366+   0+   0;   379/  396  96%;  82/ 66 124%;  £4,926,776/ £8,424,745 58%;  2,241+  4,598+   8+  0+   198;  893; 1.8.0
CluelessPlus   (v38);   £238,504,863;   0+ 311+   0+   0;   283/  311  91%;  48/ 48 100%;  £6,111,441/ £9,051,480 68%;      0+  3,460+   0+  0+    48;  772; 1.8.0
Convoy         (v11);   £104,960,066;   0+ 341+   0+   0;   341/  341 100%;  22/ 22 100%;  £1,513,505/ £2,674,074 57%;      0+  2,320+   0+  0+    22;  663; 1.8.0
DictatorAI    (v183);    £76,275,415;   0+  95+   0+   0;    95/   95 100%;  19/ 19 100%;  £1,630,949/ £2,489,035 66%;      0+  2,102+   0+  0+    24;  617; 1.8.0
DumbAI          (v1);    £26,520,535;   0+ 316+   0+   0;   212/  316  67%;  40/ 40 100%;  £1,063,884/ £3,717,450 29%;      0+  4,422+   0+  0+    40;  673; 1.8.0
EmotionAI       (v1);   £820,832,220;  67+ 169+   0+  29;   259/  265  98%; 175/184  95%; £22,994,356/£28,079,141 82%;  7,603+  7,259+   0+ 12+   488;  905; 1.8.0
FastPTPAI       (v4);    £21,745,161;  21+   0+   0+   0;     9/   21  43%;  10/ 57  18%;   -£249,704/   £345,979  0%;      0+  4,997+   0+  0+   285;  153; 1.8.0
gelignAIte      (v1);     £1,564,777;   0+   6+   0+   0;     6/    6 100%;   4/  2 200%;     £50,453/   £108,070 47%;      0+      4+   0+  0+     4;  172; 1.8.0
HeliFerry       (v3);    £64,628,683;   0+   0+  20+  24;    44/   44 100%;  17/ 23  74%;  £2,265,890/ £3,194,552 71%;      0+      0+   4+ 21+     4;  720; 1.8.0
LuDiAI          (v1);   £335,307,038;   0+ 364+   0+  57;   408/  421  97%;  44/ 43 102%;  £9,652,261/£15,522,204 62%;      0+  2,710+   0+ 28+   103;  817; 1.8.0
LuDiAI AfterFix (v5); £1,250,999,156;   0+ 500+   0+ 114;   602/  614  98%;  76/ 76 100%; £43,044,161/£52,828,396 81%;      0+  3,339+   0+ 24+    52;  872; 1.8.0
MogulAI      (v5900);   £322,379,662;   0+ 500+   0+   0;   487/  500  97%;  40/ 40 100%;  £7,340,010/£11,506,549 64%;      0+ 10,989+   0+  0+    74;  800; 1.8.0
NoCAB         (v499);   £397,877,096;   3+ 340+   3+  13;   338/  359  94%;  50/ 61  82%; £14,793,193/£18,455,913 80%;  2,312+  8,889+  16+  6+    94;  862; 1.8.0
NoNoCAB         (v5);   £828,031,397;  28+ 499+  15+  27;   559/  569  98%;  99/106  93%; £19,607,256/£25,911,512 76%;  2,893+  7,068+   8+ 24+   168;  908; 1.8.0
OtviAI        (v422);   £158,809,472;   2+ 421+   2+   0;   377/  425  89%; 111/124  90%;  £4,361,504/ £8,255,918 53%;  2,243+ 11,888+ 516+  0+   249;  900; 1.8.0
PathZilla       (v6);     £3,400,399;   0+ 155+   0+   0;   153/  155  99%;  32/ 43  74%;    £198,167/   £938,011 21%;      0+  1,932+   0+  0+    43;  451; 1.8.0
PAXLink        (v14);        £20,419;   0+  15+   0+  18;    17/   33  52%;  16/ 16 100%;    £119,533/   £975,290 12%;      0+    586+   0+  6+    38;  357; 1.8.0
RailwAI         (v7);   £324,958,053; 115+ 139+  34+   0;   240/  288  83%;  50/ 55  91%;  £8,242,445/£12,325,291 67%; 18,197+  4,070+ 141+  0+   371;  805; 1.8.0
RoadAI          (v5);             £1;   0+   0+   0+   0;     0/    0   0%;   0/  1   0%;    -£22,242/        -£0  0%;      0+     10+   0+  0+     2;    0; 1.8.0
RoadRunner     (v12);     £5,603,583;   0+ 500+   0+   0;   315/  500  63%;  40/102  39%;    £568,964/ £3,529,424 16%;      0+  7,680+   0+  0+   102;  698; 1.8.0
Rondje        (v384);             £1;   0+   0+   0+   0;     0/    0   0%;   0/  0   0%;    -£34,666/        -£0  0%;      0+      0+   0+  0+     0;    0; 1.8.0
ShipAI          (v5);    £22,953,372;   0+   0+  22+   0;    22/   22 100%;   6/ 13  46%;    £953,113/ £1,309,518 73%;      0+      0+  40+  0+    18;  516; 1.8.0
SimpleAI       (v13);   £767,679,660;  78+ 202+   0+  22;   284/  302  94%; 216/222  97%; £21,588,425/£27,038,422 80%;  8,132+ 10,236+   0+  8+   560;  900; 1.8.0
SmallTownAI     (v5);       £399,936;   0+   8+   0+   0;     8/    8 100%;   6/  9  67%;     -£3,846/    £58,736  0%;      0+    766+   0+  0+     9;   98; 1.8.0
SnakeAI         (v9);   £589,405,078;   0+ 498+   0+  37;   523/  535  98%;  70/ 70 100%; £15,875,630/£21,871,863 73%;      0+  8,515+   0+ 10+   346;  887; 1.8.0
SynTrans       (v15);    £62,790,437;   3+ 496+   0+ 114;   513/  613  84%;  76/ 89  85%;  £7,749,797/£16,214,718 48%;    619+  4,117+   0+ 21+   167;  760; 1.8.0
Terron        (v209);   £117,061,585;   0+ 447+   0+   0;   444/  447  99%;  45/ 46  98%;  £3,689,884/ £7,604,049 49%;      0+  3,502+   0+  0+   164;  855; 1.8.0
trAIns          (v2); £1,202,216,842; 228+   0+   0+   0;   190/  228  83%;  24/ 28  86%; £45,163,411/£50,682,100 89%; 10,834+      0+   0+  0+   280;  811; 1.8.0
Trans      (v180622);   £338,020,818;  21+  50+   0+  65;   127/  136  93%;  51/ 66  77%;  £7,024,376/ £9,819,096 71%;  7,938+  4,332+   0+ 22+   349;  856; 1.8.0
WormAI          (v7);   £790,383,519; 137+   0+   0+  16;   149/  153  97%; 114/118  97%; £23,825,975/£28,512,496 84%; 10,153+      0+   0+ 14+   888;  900; 1.8.0
WrightAI        (v3);    £90,063,200;   0+   0+   0+  46;    44/   46  96%;  16/ 20  80%;  £6,818,213/ £9,162,512 74%;      0+      0+   0+ 20+     0;  818; 1.8.0

Re: Fresh 1.8.0 Install 100 Years Solo AI Competition

Posted: 29 Oct 2018 16:50
by Brumi
This is so cool :)

Are you using some kind of script for your tests? Testing this many AIs is quite the undertaking. I really appreciate the effort!

Re: Fresh 1.8.0 Install 100 Years Solo AI Competition

Posted: 30 Oct 2018 08:46
by _Steffl_
Thanks for all the effort you put in this competition and sorry to complain about this, but I found that you set the AI difficulty to "easy" in your config file.
[script]
settings_profile = easy

You can't compare the results when you don't let all AIs play at hardest level. Each AI has different approaches to make them easier to play against and some might even ignore this setting complete, which are in advantage in your competition then.

Re: Fresh 1.8.0 Install 100 Years Solo AI Competition

Posted: 30 Oct 2018 14:09
by xarick
Brumi wrote:This is so cool :)

Are you using some kind of script for your tests? Testing this many AIs is quite the undertaking. I really appreciate the effort!
No, not really. I have a few batch files that start openttd as dedicated, and also to output the AI log into a .txt file.

I still retrieve all these results by manually loading the last savegame of all AIs. Yeah, it's a daunting task.
_Steffl_ wrote:Thanks for all the effort you put in this competition and sorry to complain about this, but I found that you set the AI difficulty to "easy" in your config file.
[script]
settings_profile = easy

You can't compare the results when you don't let all AIs play at hardest level. Each AI has different approaches to make them easier to play against and some might even ignore this setting complete, which are in advantage in your competition then.
For this test, I decided to use a fresh openttd.cfg file which is created on the first run. It defaults AI difficult to easy. I still had a few changes to make in the openttd.cfg file, to enforce the same map seed for every AI, and also enabled it to keep all autosaves. I've also changed a few network related settings, only to ensure I can keep an openttd client observing every dedicated server. But these changes should, in theory, not affect the "freshness" config.