Discussion:
TWIC Archive
Robert Ryan
2010-03-03 01:31:12 UTC
Permalink
If anyone is interested, here is a SCID database containing all of the
TWIC downloads through and including #799.

I've updated the ECO codes, spell checked, and removed all the
duplicates in the database.

http://www.mediafire.com/?bjomkxaovjn

Enjoy!
--
Robert Ryan

My PGP keys: http://tinyurl.com/5snkgq

===================================
Robert Ryan
2010-03-03 05:22:30 UTC
Permalink
How did you proceed, for clarity's sake?
Well, that really a two part question :)

To create the database I used DownLoadThemAll! (a Firefox extension) to
down load all of the TWIC zip files at one time. Then I used 7-zip to
extract all of the files to a temp folder. I appended all of the files
together using an MS-DOS command.

Then SCID was used to spell check, update ECO and find duplicates. See
attached for the options I used to find the duplicates.

Maintaining the database is also a multi-step process:
1.) Download and extract the latest TWICxxx.pgn
2.) Copy all the games from TWICxxx.pgn to the clipbase
3.) Update the ECO codes
4.) Spell check players, sites, events, rounds
5.) Copy the modified games from the clipbase to the TWIC SCID database
6.) Search for duplicates in TWIC database and remove them
7.) Sort the TWIC database (optional)
8.) Compact the TWIC database

Whew, hope I didn't leave anything out.
--
Robert Ryan

My PGP keys: http://tinyurl.com/5snkgq

===================================
Fulvio
2010-03-03 08:45:34 UTC
Permalink
Post by Robert Ryan
How did you proceed, for clarity's sake?
Well, that really a two part question :)
To create the database I used DownLoadThemAll! (a Firefox extension) to
down load all of the TWIC zip files at one time. Then I used 7-zip to
extract all of the files to a temp folder. I appended all of the files
together using an MS-DOS command.
On linux i use this little script:

#!/bin/sh
FIRST="$1"
LAST="$2"

while [ $FIRST -le $LAST ]; do
URL="http://www.chesscenter.com/twic/zips/twic${FIRST}g.zip"
wget $URL -nv 2>>wget-twic.log
let FIRST=FIRST+1
done

unzip \*.zip
rm *.zip
ALLFILE="twic${1}-${LAST}"
cat *.pgn > $ALLFILE
rm *.pgn
mv "$ALLFILE" "${ALLFILE}.pgn"
Post by Robert Ryan
Then SCID was used to spell check, update ECO and find duplicates. See
attached for the options I used to find the duplicates.
That's the annoying part: thanks for your work!
Mikel Larreategi
2010-03-03 09:50:33 UTC
Permalink
How did you proceed, for clarity's sake?
Well, that really a two part question :)
To create the database I used DownLoadThemAll! (a Firefox extension) to
down load all of the TWIC zip files at one time. Then I used 7-zip to
extract all of the files to a temp folder. I appended all of the files
together using an MS-DOS command.
#!/bin/sh
FIRST="$1"
LAST="$2"
while [  $FIRST -le $LAST ]; do
    URL="http://www.chesscenter.com/twic/zips/twic${FIRST}g.zip"
    wget $URL -nv 2>>wget-twic.log
    let FIRST=FIRST+1
done
unzip \*.zip
rm *.zip
ALLFILE="twic${1}-${LAST}"
cat *.pgn > $ALLFILE
rm *.pgn
mv "$ALLFILE" "${ALLFILE}.pgn"
Then SCID was used to spell check, update ECO and find duplicates. See
attached for the options I used to find the duplicates.
I'm new to this scid world, but I think there are some twic
commandline programs (at least on Linux) to merge create a SCID
database from PGN files, merge to SCID database files and after that
spellcheck, sort and pack the databases, aren't there?



Mikel
--
Mikel Larreategi
http://eibar.org/blogak/erral/es
j.f.r
2010-03-03 09:04:56 UTC
Permalink
Post by Robert Ryan
If anyone is interested, here is a SCID database containing all of the
TWIC downloads through and including #799.
I've updated the ECO codes, spell checked, and removed all the
duplicates in the database.
http://www.mediafire.com/?bjomkxaovjn
Enjoy!
Maybe I just have this error, but in place of a particular player is
something that looks like part of a movement. Like the attached image.

Does anyone else have this?

Loading Image...
Hartmut Riedel
2010-03-03 09:51:44 UTC
Permalink
Post by j.f.r
Post by Robert Ryan
If anyone is interested, here is a SCID database containing all of the
TWIC downloads through and including #799.
I've updated the ECO codes, spell checked, and removed all the
duplicates in the database.
http://www.mediafire.com/?bjomkxaovjn
Enjoy!
Maybe I just have this error,
Hi,

there's another strange fact: games from 1900 ... When did TWIC start? 1994?

Greetings,

Hartmut Riedel
--
Hartmut Riedel
http://www.moutard.de/
http://www.kantschule-falkensee.de/
http://www.zitaschach.de/
-- Man kann die Kinder erziehen, wie man will: Sie machen einen doch
nach. --
Robert Ryan
2010-03-03 13:56:42 UTC
Permalink
Post by j.f.r
Maybe I just have this error, but in place of a particular player is
something that looks like part of a movement. Like the attached image.
These are actually positions that are analyzed. I assume by the one
player that is listed.
--
Robert Ryan

My PGP keys: http://tinyurl.com/5snkgq

===================================
Alexander Wagner
2010-03-03 16:52:24 UTC
Permalink
j.f.r wrote:

Hi!
Post by j.f.r
Post by Robert Ryan
http://www.mediafire.com/?bjomkxaovjn
Enjoy!
Maybe I just have this error, but in place of a particular player is
something that looks like part of a movement. Like the attached image.
Does anyone else have this?
http://img43.imageshack.us/img43/5498/dziwnybd.jpg
I'm not 100% sure but I think this is an artifact caused by just putting
together all you can get from TWIC. The section you're refering to shows
the Mainz tournament, and this is actually a 960 tournament. As Scid
does not like 960 at all chances are good that things get screwed up there.
--
Kind regards, / War is Peace.
| Freedom is Slavery.
Alexander Wagner | Ignorance is Strength.
|
| Theory : G. Orwell, "1984"
/ In practice: USA, since 2001
Alexander Wagner
2010-03-03 17:16:35 UTC
Permalink
Israel Chauca F. wrote:

Hi!
Post by Alexander Wagner
Post by j.f.r
Post by Robert Ryan
Enjoy!
Maybe I just have this error, but in place of a particular player is
something that looks like part of a movement. Like the attached image.
Does anyone else have this?
http://img43.imageshack.us/img43/5498/dziwnybd.jpg
I'm not 100% sure but I think this is an artifact caused by just putting
together all you can get from TWIC. The section you're refering to shows
the Mainz tournament, and this is actually a 960 tournament. As Scid
does not like 960 at all chances are good that things get screwed up there.
Shouldn't that just raise an error? if it's a bug that could happen with non-960 games too, a 960 game's PGN is just a bad PGN for Scid, right?
It should, indeed. Still, Chess960 PGN is not that illegal. It's
primarily just a PGN game with a given startup FEN. Anyway, I wonder
what was the original source of this base.
--
Kind regards, / War is Peace.
| Freedom is Slavery.
Alexander Wagner | Ignorance is Strength.
|
| Theory : G. Orwell, "1984"
/ In practice: USA, since 2001
Joost 't Hart
2010-03-03 17:29:22 UTC
Permalink
Post by Alexander Wagner
Hi!
Post by Alexander Wagner
Post by j.f.r
Post by Robert Ryan
Enjoy!
Maybe I just have this error, but in place of a particular player is
something that looks like part of a movement. Like the attached image.
Does anyone else have this?
http://img43.imageshack.us/img43/5498/dziwnybd.jpg
I'm not 100% sure but I think this is an artifact caused by just putting
together all you can get from TWIC. The section you're refering to shows
the Mainz tournament, and this is actually a 960 tournament. As Scid
does not like 960 at all chances are good that things get screwed up there.
Shouldn't that just raise an error? if it's a bug that could happen with non-960 games too, a 960 game's PGN is just a bad PGN for Scid, right?
It should, indeed. Still, Chess960 PGN is not that illegal. It's
primarily just a PGN game with a given startup FEN.
PLUS the adjusted rules for castling, which should appear (and being
reported as such) as "illegal castling" to any regular pgn interpreter.
Post by Alexander Wagner
Anyway, I wonder
what was the original source of this base.
Israel Chauca F.
2010-03-03 17:12:58 UTC
Permalink
Post by Alexander Wagner
Hi!
Post by j.f.r
Post by Robert Ryan
http://www.mediafire.com/?bjomkxaovjn
Enjoy!
Maybe I just have this error, but in place of a particular player is
something that looks like part of a movement. Like the attached image.
Does anyone else have this?
http://img43.imageshack.us/img43/5498/dziwnybd.jpg
I'm not 100% sure but I think this is an artifact caused by just putting
together all you can get from TWIC. The section you're refering to shows
the Mainz tournament, and this is actually a 960 tournament. As Scid
does not like 960 at all chances are good that things get screwed up there.
Shouldn't that just raise an error? if it's a bug that could happen with non-960 games too, a 960 game's PGN is just a bad PGN for Scid, right?

Israel
Robert Ryan
2010-03-03 13:50:41 UTC
Permalink
thx for your job, but there are games in your database from 1900 - did
twic really start so early in the 20th century?
Actually there are games from as far back as 1801. Many of the great
games from history are represented. There are also a dozen or so
end-games analyzed in depth. I can only conclude that:

A.) TWIC must at one time had a historical games section
B.) TWIC must at one time had a analysis section
--
Robert Ryan

My PGP keys: http://tinyurl.com/5snkgq

===================================
Continue reading on narkive:
Loading...