Thu 10 Jul 2003 06:33:29 AM UTC, comment #2:
Thankyou very much, the changes you have made look great. Here's some more suggestions for your consideration:
1) Show the "Move filter" settings. I've often deviated from the "normal" setting and experimented with an initial 2-ply setting such as "Add extra: 3 moves within 0.03", to surprisingly good effect in rollout accuracy terms. If adding this much info is overkill, perhaps just stating that the move filter was "large" , "tiny", "user defined", etc would do. Incidentally, I've also tried doing rollouts where I use 0-ply evaluations first, then move to 2-ply evaluations later (when nothing much is happening for the next few moves, but there is likely to be a lot of skill required later in the game), so early and late move filter info would be good.
2) I quite often stop a rollout before it's run it's course because the outcome has become obvious. Unfortunately, this isn't reflected in the generated output. Eg, if I set up a cube action position for 1296 trials, but stop it after 500 trials, the output will tell me I did 1296. Not a big deal perhaps, but one more thing I have to remember to edit.
3) Now we have the "Stop rollouts when STDs are small enough" option it would be nice if the generated output reflected that this option had been used and what the settings were.
About this option: I think it's a great idea and has potential, but not necessarily in it's current form (my early impressions). What I'd like to see is not a "ratio" but an "absolute" value entered. For example, you are looking at two close moves that both produce an equity around 1.500 then this option is close to useless unless you "guess" a ratio of something like 0.005. Conversly, if the position is close to 0.0000 equity the option is equally useless, you could have a ratio of 10 and still take 50,000 trials to get there.
I suggest that being able to enter a value of 0.0071 (absolute), or something similar, would be a good idea. In this particular case, if you had two moves that differed by 0.0196 equity, you would a 95% CI that the two moves were indeed different. If it's not clear what I'm getting at and you're interested in the idea, I'll re-post this in a much better form later.
That will do for the moment :)
Keep up the good work,
Ian.
|
Wed 09 Jul 2003 06:19:41 AM UTC, original submission:
I often use the "seperate evaluations" feature on the general rollout menu. Unfortunately these rollout settings are not shown in the GOL html output that I most commonly generate. I can "edit in" that the rollout evaluation changed at depth 12, from 2-ply, 50% speed, add 3 moves etc, etc, but it would be nice if I didn't have to. It's great having so much flexibility in rollout settings, but it's also important to keep track of exactly what the settings were for any given rollout.
If your interested in making some changes I'm happy to provide a sample of the rollout parameter information I'd like to see. Again, no hurry on this.
(My apologies if this is a double posting. I thought I had posted this same request yesterday, but it's not showing up on the browswer list)
|