Season 8 stage 2 after 3 rounds

Stage 2 is here!!

No weak engines left (except The Baron) and games should be harder and more balanced. Changes for this stage:

• The openings for this stage have a preset of 2 moves to create more variability as well as excitement. 
• All games will be played in pairs where the engines play both sides.
• The time controls are 120 minutes per engine and 30 seconds increment per move. There is more time to think than in stage 1, and the games will be about a hour longer.

The standings after 3 rounds are:

The high draw rate came as a surprise to me. It was expected to rise compared to stage 1 but over 70% seems a bit extreme. Are the engines better? Is it the increase in time? Are the openings drawish? Will the reverse games make a difference?

Houdini and Stockfish are leading with 2.5 points, and because there were so many draws most engines have 1 or 1.5 points. Komodo has had three draws so far. In the game against Hannibal it had to fight for a draw with a rook against bishop and pawns. I expect it will have better performances in later rounds.

The Baron is playing better than expected, with two draws and a loss. It almost drew with Houdini in a game with over 150 moves containing long stretches of shuffling. The Houdini win came as a surprise.

The 2-move 'book' openings are a bit strange. Many of them are unorthodox but instead of creating unbalanced exciting games they seem to invite cautios play and drawn positions. Surprisingly many openings converge on known openings after a few moves. I liked the no-book option of stage 1 better.

Notable game
Stockfish - Protector, round 3
Game in TCEC archive

After 23 moves the position was:

Stockfish had a small eval advantage (positional? equal material). With almost all pawns on the board not a lot could be done. The two engines took their time setting up the pawns and arranging the pieces behind them. This was the position just before the storm:

Now came a series of exchange combinations, opening files and taking the knights off the board. Both engines evaluated the position as a clear white advantage.

In the following moves Stockfish was sure the queens would be exchanged, but Protector refused to do it. Then suddenly with no warning Stockfish found the light and the eval hit the roof:

What followed was a tricky queen+pawns endgame. It took a few moves before Protector realized it was losing, and the game stopped in a 7-man position with a mate in about 20 moves according to the tablebase. As always, Stockfish was first to see it from a mile away.

Season 8 group 1b final results

The final results for group 1b are:

The six qualifiers are Stockfish, Houdini, Hannibal, Nirvana, Chiron and ... The Baron, believe it or not. Equinox and Junior were not allowed to qualify because of their multiple crashes (Pedone too but well...). This was especially sad for Equinox which played at a high level when it didn't crash. The Baron won't stand a chance in stage 2.

Crash report: Equinox crashed against Houdini late in their game, while having a small advantage as black. Junior crashed on the first move (second time this happens), forfeiting the battle for sixth place. Pedone crashed on move 9 against Junior, saving Junior from another crash.

Stockfish converted another rook ending which appeared to be drawn against Scorpio. Altogether Stockfish obtained a perfect 11/11 score in this round, remarkable. Yes, three wins were crashes but this just demonstrates the fear other engines have of Stockfish.

Crafty managed to get 1.5 points in the last two rounds, including a win against Nightmare. Not too bad for a low ranked last minute replacement.

Notable Game
Hannibal - Houdini, round 11
Game on TCEC archive

This was the battle for second place in group 1b, Hannibal in third had to win to overtake Houdini.

After 16 moves the position was:

Hannibal thought it had a small advantage. All the pawns were still on the board and white's pawn structure was unusual with two doubled pawns. Cute pattern though. A few moves and a pawn exchange later there started a long stretch of shuffling moves by the engines. Both seemed reluctant to advance pawns and the game appeared to be heading for a draw. Things started to change when Houdini took initiative and opened up the position a little.

Hannibal's forces on the king side were not enough for a significant attack, and when the dust cleared after some exchanges black had strong connected passed pawns on the queen side.

Ultimately Hannibal had to offer a bishop to get rid of these pawns, leading to a lost position.

White soon lost its passed pawns, and though it was still not clear for me how to win the two engines agreed that white was lost. Houdini managed to finish second, Hannibal a respectible third.

Season 8 group 1b statistics

Group 1b had a 11 games that ended prematurely in an engine crash (not including the first Alfil game that was later replaced by Crafty). I did not include these games in the statistics in order to avoid biases in some of the results - draw rate is an obvious example.

For each category I briefly compare to the group 1a results. The differences represent the preferences of the engines in the two groups.

Draw rate, wins

This is quite similar to the group 1a graph, within 3% in each category.


Moves per game

median = 60.0
average = 63.67

Again similar to group 1a, medians and averages within 4 moves.


Time per game (hours)

median = 3:31
average = 3:35

Medians and averages within 4 minutes of group 1a stats.


First move

Group 1b had a significant bias for 1. e4 games, 64%. In group 1a it was 56%.

Openings

Using ECO codes there were 32 different openings. The top 3 ECO codes were:
C01 6 times - French Exchange
C12 4 times - French: MacCutcheon
C68 4 times - Spanish: Exchange

Using full opening name there were 45 different openings, a little more repetative that in group 1a. There were three openings that were repeated 3 times:
- French: Exchange, 4.Nc3 Nf6 5.Nf3
- French: MacCutcheon, Chigorin Variation
- Spanish: Exchange, 5.O-O Bg4 6.h3

Using only the first letter of the ECO codes we get the following distribution:

Compared to group 1a there were less Queen Gambit games, and more Sicillians and Indians.

If we use the opening 'family name' (using format FAMILY_NAME: VARIANT....) the top 3 are:
French - 16 times
Spanish - 8 times
Nimzo-Indian - 6 times

The French was very popular in group 1a as well, but the Spanish and Nimzo-Indian openings were very rare there.

Season 8 group 1b after 9 rounds

The crosstable of group 1b after 9 rounds is:

With two rounds left qualification is almost fixed. Stockfish, Houdini and Hannibal have qualified while for Nirvana and Equinox there is only a slim theoretical chance they will not qualify. The sixth qualifier will probably be Chiron. Nightmare and Scorpio have a game against Stockfish, I don't believe they have a chance. Junior has a real chance, only if it beats Chiron in the last round.

Pedone - Houdini was nearly a huge surprise. Houdini reached the endgame with an advantage of R to BP, and for many moves it seemed that both engines are shuffling pieces with no plan. According to the chat Houdini missed several opportunities to win, and made an important pawn advance only when the 50 move draw was near. In the end Houdini saw the light (perhaps Pedone blundered, it was very low on time for most of the endgame) and managed to win, but it was very close.

Hannibal - Nightmare was also a very long game. Nightmare played a rare gambit which gave Hannibal an early pawn advantage. The endgame however was very drawish and long, Hannibal made pawn moves only when close to the 50 move draw. Apparently Nightmare blundered when only opposite colored bishops remained on the board, allowing Hannibal to sacrifice the bishop for two pawns and find a win.

Nightmare played the same gambit again as black against Nirvana and lost again, perhaps not a good choice?

Crafty managed a draw against Scorpio, its first score not counting the game where Pedone crashed.

Equinox crashed twice, against Nirvana and Stockfish. It's really a shame since it is a strong engine. In the game against Stockfish the two engines were shuffling for 30 moves, and the game could have been a draw if Equinox didn't crash. Stockfish's record remains perfect.

Notable game
Houdini - Stockfish, round 8
Game on TCEC archive

This was the main attraction of group 1b, the epic battle between giants. Of course it had little effect on the qualification, and there will be many more games between these opponents in later rounds. In the context of stage 1 this was a highlight.

The game was played at a level way above my ability to describe. For the first 35 moves the evaluation scores were close to 0 for both engines. When pieces started coming off the board Stockfish started showing signs it had a small advantage, and indeed by move 49 it was up a pawn:

Was one pawn enough for this endgame?  The game progressed without changing the evaluations significantly, knights were exchanged and black added a second passed pawn on the a file.

A few moves later a pair of rooks was exchanged, as well as the passers on the d and h files, and only 7 pieces were left on the board.

Those with access to 7-man tablebases announced a draw. Houdini and Stockfish played on though, and the evaluations remained stable until around move 80 when Stockfish's evaluations started to jump. On move 84 the 7-man people announced that Houdini made a mistake and now the game was a win for black. The game continued on for another 20 moves and was adjudicated at this position:

The same 7 pieces are still on the board, but now both engines see the black win. For me it is difficult to see the difference, and the mate is still over 30 moves away. Stockfish was able to see it with 5-man tablebases, Houdini could not handle the difficult ending.

Season 8 group 1b after 6 rounds

I have only glimpsed at the games when they were live, this post is mostly from going quickly over the archives.

The situation after 6 rounds is as follows:

Stockfish, Houdini and Equinox will qualify for sure. My bet for the other three is Chiron, Hannibal and Nirvana. Nightmare is also a surprise contender with low rating. I don't think any of the others has any chance, including Junior which is having a bad tournament with too many crashes.

Junior recorded the quickest crash possible when it crashed as white before making a move against Stockfish. Some say it was too scared to play. And this was with reduced threads and hash to "improve stability".

Stockfish had two impressive wins against strong opponents, Hannibal and Nirvana. So far I am happy with its performance, no time trouble and a good attacking style. The real tests are still to come in the following stages.

In rounds 5 and 6 Crafty's evaluation was somehow inverted. It played as black and gave positive scores for black's advantage, contrary to the convention of TCEC. As a result the GUI could not adjudicate when white was winning since Crafty gave high negative scores. The games played on until a TB adjudication was possible. This was later fixed.

Notable game
Nightmare - The Baron, round 4
Game on TCEC archive

The game was balanced from the start, with evaluation scores close to 0 from both engines. We join the action after move 24.

The Baron saw an opportunity to take the f2 pawn, but this allowed Nightmare to trap the black rook. After exchanging pawns on the queen side Nightmare created a passed pawn on the c file, backed by a rook.

The a pawn was next to go, Nightmare had two passed pawns backed by rooks. The trapped rook broke free but only to aid in the blocking of the white pawns.

White now used its queen to break the blockade preventing the white pawns advance to the 8th row.

What a beautiful position! White threatens to take the rook, and black cannot take the queen because it loses the rook.The game was over within a few moves.

Season 8 group 1b after 3 rounds

It's been a busy week and I didn't follow all the action in the 1b group very closely, these are my impressions so far.

Group 1b standings after 3 rounds:

Unfortunately the issue that was in focus in the first rounds was the crashes. There were too many of these, especially in contrast to the 1a group.

In the Pedone - Alfil, Alfil replied immediately from book, and Pedone crashed on move 2. Since books are not allowed Alfil was disqualified and Crafty replaced it - that's why you don't see Alfil in the table. However, when the game was replayed with Crafty, Pedone crashed on move 7. Pedone's troubles continued when it crashed against Stockfish in round 2, on move 9 this time. After limiting the number of threads and hash size it managed to complete a game in round 3, hopefully stable enough to play now.

Junior is also causing problems with 2 crashes against Houdini and Nirvana in the first three rounds. Martin wrote in the chat that he was certain that this version of Junior wasn't stable enough and recommended using a prior version, but he was overruled (developers? viewers? someone insisted on the new version).

Stockfish with 3 wins out of 3 (one was a crash), it seems to be back after a problematic season 7. Still early though, and the opponents are too weak for a real assessment.

Chiron - Nirvana was a miniature, ending in 3-fold repetition after 11 moves.

Notable game
Hannibal - Junior, round 1
Game on TCEC archive

Junior's 6th move allowed Hannibal to advance to e5 attacking a knight:

This led to an exchange of knights and the opening of the king side:

Black is a pawn up temporarily, but has no development on the queen side and its king pawns are undefended. Junior tried to attack the white king, forcing it to advance. The king soon found a safe spot, allowing Hannibal to eliminate all of black's king side pawns.

White now was a pawn up and had two passed pawns, black still had development problems on the queen's side. The queens were exchanged next, and white gained another pawn. The rest of the game was a straightforward case of exchanging pieces until the advantage is converted to a win. Well done Hannibal !

Season 8 group 1a statistics

Draw rate, wins

 

Moves per game

median = 56.75
average = 65.93


Time per game

median = 3:35
average = 3:39

First move

Openings
Using ECO codes there were 39 different openings. The top 3 ECO codes were:
C01 7 times - French Exchange
D37 6 times - QGD
C54 5 times - Giuoco Pianissimo

Using full opening name there were 58 different openings, so almost no repeated opening. The QGD: Classical, 5...O-O was the only opening repeated 3 times

Using only the first letter of the ECO codes we get the following distribution:

Very few Indians and Sicillians.

If we use the opening 'family name' (using format FAMILY_NAME: VARIANT....) the top 3 are:
French - 18 times
QGD - 12 times
Two Knights - 4 times