BABYL OPTIONS: -*- rmail -*- Version: 5 Labels: Note: This is the header of an rmail file. Note: If you are seeing it in rmail, Note: it means the file has no messages in it.  1, filed,, Summary-line: 8-Jul to: irex@karc.crl.go.jp #[irex 226] Final NE result, Preliminary IREX workshop program Mail-from: From owner-irex@po.crl.go.jp Thu Jul 8 18:07:32 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.6W/hotaka/98122515) with ESMTP id SAA23926 for ; Thu, 8 Jul 1999 18:07:32 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Wwidefw/99041417) with ESMTP id SAA13520 for ; Thu, 8 Jul 1999 18:07:31 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id SAA08416; Thu, 8 Jul 1999 18:00:37 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id SAA26197; Thu, 8 Jul 1999 18:00:30 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id RAA24558; Thu, 8 Jul 1999 17:58:12 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id RAA24553 for ; Thu, 8 Jul 1999 17:58:10 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id RAA09848 for ; Thu, 8 Jul 1999 17:52:48 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id SAA26188 for ; Thu, 8 Jul 1999 18:00:22 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id SAA05575 for ; Thu, 8 Jul 1999 18:00:21 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99060216) with ESMTP id SAA66347 for ; Thu, 8 Jul 1999 18:00:20 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.6W/hotaka/98122515) id SAA23428; Thu, 8 Jul 1999 18:00:20 +0900 (JST) Date: Thu, 8 Jul 1999 18:00:20 +0900 (JST) From: Satoshi Sekine Message-Id: <199907080900.SAA23428@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 226 Subject: [irex 226] Final NE result, Preliminary IREX workshop program Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Thu, 8 Jul 1999 18:00:20 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 226 Subject: [irex 226] Final NE result, Preliminary IREX workshop program Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp Dear IREX-ML member: I was asked to distribute the final NE results. It is included at the end of this message. Also, a preliminary program of the IREX workshop is included. If you find bugs or comments, please let me know. Reminder: the due of your IREX workshop paper is 6th of August. Please submit it on time, otherwise your paper may not be appeared on the proceedings. Have a nice summar!! Satoshi Sekine -------------------------------- IREX-MLの皆様： NEの最終評価結果を公表して欲しいというリクエストを受けましたので このメイルに入れます。 また、IREXワークショップの暫定バージョンのプログラムを作成しました。 バグ、コメントなどありましたらお知らせ下さい。 IREXワークショップの予稿の〆切は８月６日です。遅れますと予稿集に入らな い可能性もありますので、期日までに提出してください。 よろしくお願い致します。 関根 ------------------ Final NE results ARR GEN 1201 54.17 57.66 1205 78.08 80.22 1213 59.87 66.73 1214 80.37 70.64 1215 74.56 66.71 1223 74.90 71.92 1224 77.61 75.12 1227 85.02 77.42 1229 64.81 57.91 1231 81.94 75.30 1234 72.77 71.75 1240 58.46 60.77 1247 87.43 83.97 1250a 70.12 69.71 1250b 55.24 57.63 ------------------ Preliminary program of IREX workshop September 2, 1999 (IR) 9:00- 9:20 Overview by Sekine 9:20- 9:35 Adin 9:35- 9:50 CRL 9:50-10:05 Gifu-u 10:05-10:20 Justsystem 10:45-11:05 Analysis of Qs by Mr.Nakawatase 11:05-11:20 Kyoto-u 11:20-11:35 NACSIS 11:35-11:50 NARC 13:25-13:45 Analysis of judgements by Mr.Matsuo 13:45-14:00 NEC 14:00-14:15 Matsushita 14:15-14:30 Sharp 14:30-14:45 Tokushima-u 15:10-15:30 Analysis of system performance by Mr.Sasaki 15:30-15:45 Toshiba 15:45-16:00 Tosyokan Jouhou-u 16:00-16:15 Toyohashi-u 16:15-16:30 Tsuda-u 16:30-17:00 General discussion ------------------ September 3, 1999 (NE) 9:00- 9:20 Overview by Sekine 9:20- 9:35 CRL 9:35- 9:50 Fujitsu-Matsui 9:50-10:05 Fujitsu-Nishino 10:05-10:20 Ibaraki-u 10:45-11:05 Talk by ?? 11:05-11:20 Kyoto-u 11:20-11:35 Matsushita 11:35-11:50 NEC 13:25-13:45 Analysis of system performance by Mr.Miyamoto 13:45-14:00 NTT-Isozaski 14:00-14:15 NTT-Katoh 14:15-14:30 NYU 14:30-14:45 Teragram 15:10-15:30 Talk by Mr.Eriguchi 15:30-15:45 Tokyo-u 15:45-16:00 Toyohashi-u 16:00-16:15 Yokohanma-kokurisu-u 16:15-17:00 General discussion  1,, Summary-line: 21-Jul to: irex@karc.crl.go.jp #[irex 227] NE result revised Mail-from: From owner-irex@po.crl.go.jp Wed Jul 21 15:08:39 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id PAA08576 for ; Wed, 21 Jul 1999 15:08:38 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id PAA03643 for ; Wed, 21 Jul 1999 15:08:38 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id OAA14286; Wed, 21 Jul 1999 14:59:30 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id OAA03065; Wed, 21 Jul 1999 14:59:24 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id OAA25292; Wed, 21 Jul 1999 14:56:59 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id OAA25286 for ; Wed, 21 Jul 1999 14:56:58 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id OAA14425 for ; Wed, 21 Jul 1999 14:51:35 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id OAA03057 for ; Wed, 21 Jul 1999 14:59:15 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id OAA09283 for ; Wed, 21 Jul 1999 14:59:13 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id OAA63860 for ; Wed, 21 Jul 1999 14:59:13 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id OAA07907; Wed, 21 Jul 1999 14:59:12 +0900 (JST) Date: Wed, 21 Jul 1999 14:59:12 +0900 (JST) From: Satoshi Sekine Message-Id: <199907210559.OAA07907@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 227 Subject: [irex 227] NE result revised Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Wed, 21 Jul 1999 14:59:12 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 227 Subject: [irex 227] NE result revised Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp IREX-ML member: Due to duplicated articles in NE general formal run (100000015 & 100000067), we will revise the NE result. It does NOT take the result of 100000067 into account. The new scorer which can hundle this situation (see @exclude_docnum) and the revised scores are included in this mail. Sorry for the inconvenience. Satoshi ----------------------------- IREXメイリングリストの皆様： NEの総合の本試験の記事の中に、重複している記事がありました。これまでの 評価では、この点を考慮されていませんでしたが、このような状況に対処でき る新たなNEscorerを作成し、最終評価結果は100000067を除いて行なうことと します。以下に新たな評価結果とNEscorer.perlをお送りします。 御迷惑をおかけして申し訳ありません。 関根 -------------------------- ARR GEN 1201 54.17 57.69 1205 78.08 80.05 1213 59.87 66.60 1214 80.37 70.34 1215 74.56 66.74 1223 74.90 72.18 1224 77.61 75.30 1227 85.02 77.37 1229 64.81 57.63 1231 81.94 74.82 1234 72.77 71.96 1240 58.46 60.96 1247 87.43 83.86 1250a 70.12 69.82 1250b 55.24 57.76 ------------------------- #!/usr/local/bin/jperl # This file is part of IREX tools. # Please refer "Copyright file" at the root directory. # (C) IREX committee IREX実行委員会. All rights reserved. # ----------------------------------------------------------------------------- # NEタスクの正解ファイル(goldenfile)と回答ファイル(systemfile)とを比較 # 各ドキュメントごとにスコア(*.scr)、レポート(*.rep)を表示したファイルを作成 # ----------------------------------------------------------------------------- package NESCR; # use I18N::Japanese; use strict; ($#ARGV == 1) || die "Usage : $0 [goldenfile] [systemfile]\n"; # ----------------------------------------------------------------------------- # グローバル変数 # ----------------------------------------------------------------------------- # カスタマイズ my $inputfile_suffix = '.idx'; my $scorefile_suffix = '.scr'; my $reportfile_suffix = '.rep'; my $tag = 'TAGSET'; my $doc = 'DOCNO'; my $optional_tag = 'OPTIONAL'; my $ind = '\@'; my $comment = '\#'; my @exclude_docnum = (100000067); #my @exclude_docnum = (); # 入力ファイル my $goldenfile = shift(@ARGV); my $systemfile = shift(@ARGV); # 出力ファイル my $scrfile; my $repfile; ($scrfile = $systemfile) =~ s/$inputfile_suffix/$scorefile_suffix/; if ($scrfile eq $systemfile) { die "Use the suffix \"$inputfile_suffix\" for the input file.\n"; } ($repfile = $systemfile) =~ s/$inputfile_suffix/$reportfile_suffix/; # 配列 my $golden = NESCR->bless_ref; my $system = NESCR->bless_ref; my $eval = NESCR->bless_ref; my $item = NESCR->bless_ref; my $order; # Document, TAGSET の出力順序を保存 # ----------------------------------------------------------------------------- # メインプログラム # ----------------------------------------------------------------------------- #-----------------------# # goldenfile の読み込み # #-----------------------# $order = $golden->read_file($goldenfile); #-----------------------# # systemfile の読み込み # #-----------------------# $system->read_file($systemfile); #---------------------------------# # goldenfile と systemfile の比較 # #---------------------------------# foreach (keys %$golden) { my $docnum = $_; # 正解タグが正しく推定されたか(cor)、誤って推定されたか(mis)を調べる # foreach (keys %{$golden->{$docnum}}) { my $offset_gld = $_; unless (defined($golden->{$docnum}{$offset_gld})) { next; } my ($gld_tag, $gld_body) = split(/$;/, $golden->{$docnum}{$offset_gld}); my ($offset_gld_start, $offset_gld_end) = split(/$;/, $offset_gld); if ($gld_tag eq $optional_tag) { # OPTIONAL tag のとき # foreach (keys %{$system->{$docnum}}) { my $offset_sys = $_; if (defined($system->{$docnum}{$offset_sys})) { my ($sys_tag, $sys_body) = split(/$;/, $system->{$docnum}{$offset_sys}); my ($offset_sys_start, $offset_sys_end) = split(/$;/, $offset_sys); # OPTIONAL tag の範囲内のものは評価対象外とする # if ($offset_sys_start >= $offset_gld_start && $offset_sys_end <= $offset_gld_end) { my $rep = sprintf(" opt-s %6d %6d %-15s %s\n", $offset_sys_start, $offset_sys_end, $sys_tag, $sys_body); push(@{$item->{$docnum}{$offset_sys_start}}, $rep); undef($system->{$docnum}{$offset_sys}); } } } my $rep = sprintf(" opt-a %6d %6d %-15s %s\n", $offset_gld_start, $offset_gld_end, $gld_tag, $gld_body); push(@{$item->{$docnum}{$offset_gld_start}}, $rep); undef($golden->{$docnum}{$offset_gld}); $eval->{$gld_tag}{'ALL'}{'OPT'}++; $eval->{$gld_tag}{$docnum}{'OPT'}++; } else { # OPTIONAL tag 以外のとき # if (defined($system->{$docnum}{$offset_gld})) { my ($sys_tag, $sys_body) = split(/$;/, $system->{$docnum}{$offset_gld}); if ($gld_tag eq $sys_tag) { $eval->{$gld_tag}{'ALL'}{'COR'}++; $eval->{$gld_tag}{$docnum}{'COR'}++; my $rep = sprintf(" cor %6d %6d %-15s %s\n", $offset_gld_start, $offset_gld_end, $gld_tag, $gld_body); push(@{$item->{$docnum}{$offset_gld_start}}, $rep); } else { my $rep = sprintf(" mis %6d %6d %-15s %s\n", $offset_gld_start, $offset_gld_end, $gld_tag, $gld_body); push(@{$item->{$docnum}{$offset_gld_start}}, $rep); } } else { my $rep = sprintf(" mis %6d %6d %-15s %s\n", $offset_gld_start, $offset_gld_end, $gld_tag, $gld_body); push(@{$item->{$docnum}{$offset_gld_start}}, $rep); } $eval->{$gld_tag}{'ALL'}{'GLD'}++; $eval->{$gld_tag}{$docnum}{'GLD'}++; } } # システムが誤って推定した(ovg)タグを調べる # foreach (keys %{$system->{$docnum}}) { my $offset_sys = $_; if (defined($system->{$docnum}{$offset_sys})) { my ($sys_tag, $sys_body) = split(/$;/, $system->{$docnum}{$offset_sys}); my ($offset_sys_start, $offset_sys_end) = split(/$;/, $offset_sys); $eval->{$sys_tag}{'ALL'}{'SYS'}++; $eval->{$sys_tag}{$docnum}{'SYS'}++; if (defined($golden->{$docnum}{$offset_sys})) { my ($gld_tag, $gld_body) = split(/$;/, $golden->{$docnum}{$offset_sys}); if ($gld_tag ne $sys_tag) { my $rep = sprintf(" ovg %6d %6d %-15s %s\n", $offset_sys_start, $offset_sys_end, $sys_tag, $sys_body); push(@{$item->{$docnum}{$offset_sys_start}}, $rep); } } else { my $rep = sprintf(" ovg %6d %6d %-15s %s\n", $offset_sys_start, $offset_sys_end, $sys_tag, $sys_body); push(@{$item->{$docnum}{$offset_sys_start}}, $rep); } } } } #------------------# # 評価と結果の表示 # #------------------# open(SCR, ">".$scrfile) || die "Can't open $scrfile: $!\n"; open(REP, ">".$repfile) || die "Can't open $repfile: $!\n"; push(@{$order->{$doc}}, 'ALL'); my $document; foreach $document (@{$order->{$doc}}) { #--------------------# # scorefile への出力 # #--------------------# my ($all_gld, $all_sys, $all_cor, $all_mis, $all_ovg); my ($all_rec, $all_pre, $f); # Document number、罫線、項目名の表示 # if ($document eq 'ALL') { print SCR " * * * SUMMARY SCORES * * *\n"; } else { print SCR "Document: $document\n"; } print SCR "-----------------------------+"; print SCR "--------+-------------+---------------\n"; printf SCR "%14s %6s %6s | %6s | %5s %5s | %6s %6s\n", ' ', 'GLD', 'SYS', 'COR', 'MIS', 'OVG', 'REC', 'PRE'; print SCR "-----------------------------+"; print SCR "--------+-------------+---------------\n"; # ここのタグごとに Recall、Precision を計算し結果を出力する # my $tagname; foreach $tagname (@{$order->{$tag}}) { my $mis = $eval->{$tagname}{$document}{'GLD'} - $eval->{$tagname}{$document}{'COR'}; my $ovg = $eval->{$tagname}{$document}{'SYS'} - $eval->{$tagname}{$document}{'COR'}; my $rec; if (defined($eval->{$tagname}{$document}{'GLD'})) { $rec = $eval->{$tagname}{$document}{'COR'} / $eval->{$tagname}{$document}{'GLD'} * 100; } else { $rec = '-'; } my $pre; if (defined($eval->{$tagname}{$document}{'SYS'})) { $pre = $eval->{$tagname}{$document}{'COR'} / $eval->{$tagname}{$document}{'SYS'} * 100; } else { $pre = '-'; } # ここのタグごとの Recall、Precision を出力 # if ($tagname eq $optional_tag) { printf SCR "%-14s %6d ", $tagname, $eval->{$tagname}{$document}{'OPT'}; printf SCR "%6s ", '-'; if ($mis > 0) { printf SCR "| %6d ", $eval->{$tagname}{$document}{'COR'}; printf SCR "| %5d %5s ", $mis, '-'; } else { printf SCR "| %6s ", '-'; printf SCR "| %5s %5s ", '-', '-'; } } else { printf SCR "%-14s %6d ", $tagname, $eval->{$tagname}{$document}{'GLD'}; printf SCR "%6d ", $eval->{$tagname}{$document}{'SYS'}; printf SCR "| %6d ", $eval->{$tagname}{$document}{'COR'}; printf SCR "| %5d %5d ", $mis, $ovg; } if ($rec eq '-' && $pre eq '-') { printf SCR "| %6s %6s\n", $rec, $pre; } elsif ($rec eq '-') { printf SCR "| %6s %6.2f\n", $rec, $pre; } elsif ($pre eq '-') { printf SCR "| %6.2f %6s\n", $rec, $pre; } else { printf SCR "| %6.2f %6.2f\n", $rec, $pre; } $all_gld += $eval->{$tagname}{$document}{'GLD'}; $all_sys += $eval->{$tagname}{$document}{'SYS'}; $all_cor += $eval->{$tagname}{$document}{'COR'}; $all_mis += $mis; $all_ovg += $ovg; } # 各記事ごとに f-measure を計算 # if ($all_gld == 0) { $all_rec = '-'; } else { $all_rec = $all_cor / $all_gld * 100; } if ($all_sys == 0) { $all_pre = '-'; } else { $all_pre = $all_cor / $all_sys * 100; } if ($all_rec == 0 && $all_pre == 0) { $f = '-'; } else { $f = 2 * $all_rec * $all_pre / ($all_rec + $all_pre); } # 各記事の評価結果を出力 # print SCR "-----------------------------+"; print SCR "--------+-------------+---------------\n"; printf SCR "%-14s ", 'ALL SLOTS'; printf SCR "%6d %6d | %6d | %5d %5d ", $all_gld, $all_sys, $all_cor, $all_mis, $all_ovg; if ($all_rec eq '-' && $all_pre eq '-') { printf SCR "| %6s %6s\n", $all_rec, $all_pre; } elsif ($all_rec eq '-') { printf SCR "| %6s %6.2f\n", $all_rec, $all_pre; } elsif ($all_pre eq '-') { printf SCR "| %6.2f %6s\n", $all_rec, $all_pre; } else { printf SCR "| %6.2f %6.2f\n", $all_rec, $all_pre; } if ($f eq '-') { printf SCR "%-61s%6s\n", 'F-MEASURES', $f; } else { printf SCR "%-61s%6.2f\n", 'F-MEASURES', $f; } if ($document eq 'ALL') { next; } print SCR " \n"; #---------------------# # reportfile への出力 # #---------------------# # Document number、罫線、項目名の表示 # print REP "Document: $document\n"; print REP "----------------------------------------"; print REP "---------------------------------------\n"; printf REP " %-7s%-16s%-16s%-6s\n", 'RESULT', 'OFFSET', 'TAG', 'STRING'; printf REP "%15s%7s\n", '(start)', '(end)'; print REP "----------------------------------------"; print REP "---------------------------------------\n"; # 各記事ごとに先頭からレポートを出力 # my @item; foreach (keys %{$item->{$document}}) { my ($offset_start, $offset_end) = split(/$;/); push(@item, $offset_start); } my @item_sort = sort {$a <=> $b} @item; foreach (@item_sort) { foreach (@{$item->{$document}{$_}}) { print REP $_; } } unless ($document eq $order->{$doc}[$#{$order->{$doc}}-1]) { print REP " \n"; } } close(SCR); close(REP); exit(0); # ----------------------------------------------------------------------------- # サブルーチン # ----------------------------------------------------------------------------- sub bless_ref { #--------------------------------# # 連想配列へのリファレンスを宣言 # #--------------------------------# shift; my $self = {}; bless $self; } # bless_ref sub read_file { #--------------------# # ファイルの読み込み # #--------------------# my $self = shift; my $file = shift; my $num = 0; my $docnum; my $order = {}; my $excluded = 0; open(FILE, $file) || die "Can't open $file: $!\n"; while () { $num++; chomp; if (/^$comment/ || /^[\s]*$/) { next; } elsif (/^$tag (.+)$/) { push(@{$order->{$tag}}, $1); } elsif (/^$doc (\d+)$/) { $docnum = $1; $excluded = grep($docnum == $_, @exclude_docnum); if ($excluded > 0) { next; } else { $excluded = 0; } $self->{$docnum} = NESCR->bless_ref; push(@{$order->{$doc}}, $docnum); } elsif (/^$ind/ && $excluded == 0) { unless (defined($docnum)) { print "Warning: $doc is not defined. In line $num.\n"; } # フォーマットのチェック my $offset_start; my $offset_end; my $tag_start; my $tag_end; my $body; if (/^\@ (\d+) (\d+) \<$optional_tag[^\>]*\> \<\/([^\>]+)\> (.*)/) { # OPTIONAL tag の場合 $offset_start = $1; $offset_end = $2; $tag_start = $optional_tag; $tag_end = $3; $body = $4; } elsif (/^\@ (\d+) (\d+) \<([^\>]+)\> \<\/([^\>]+)\> (.*)/) { $offset_start = $1; $offset_end = $2; $tag_start = $3; $tag_end = $4; $body = $5; } else { print "Warning: Tag format is illegal. In line $num.\n"; } my $offset = join($;, $offset_start, $offset_end); if ($tag_start eq $tag_end) { # ファイルの情報を保存 if (defined($body)) { $self->{$docnum}{$offset} = join($;, $tag_start, $body); } else { $self->{$docnum}{$offset} = join($;, $tag_start, 'NIL'); } } else { print "Warning: Start tag name and end tag name don't correspond."; print " In line $num.\n"; } } elsif($excluded > 0) { next; } else { print "Warning: Format is illegal. In line $num.\n"; } } close(FILE); bless $order; } # read_file  1, filed,, Summary-line: 23-Jul to: irex@karc.crl.go.jp #[irex 228] Publication Mail-from: From owner-irex@po.crl.go.jp Fri Jul 23 15:35:26 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id PAA13657 for ; Fri, 23 Jul 1999 15:35:25 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id PAA21361 for ; Fri, 23 Jul 1999 15:35:25 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id PAA17310; Fri, 23 Jul 1999 15:28:06 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id PAA08963; Fri, 23 Jul 1999 15:28:00 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id PAA20536; Fri, 23 Jul 1999 15:25:33 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id PAA20531 for ; Fri, 23 Jul 1999 15:25:32 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id PAA15526 for ; Fri, 23 Jul 1999 15:20:10 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id PAA08954 for ; Fri, 23 Jul 1999 15:27:52 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id PAA22260 for ; Fri, 23 Jul 1999 15:27:51 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id PAA96631 for ; Fri, 23 Jul 1999 15:07:06 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id PAA11755; Fri, 23 Jul 1999 15:07:05 +0900 (JST) Date: Fri, 23 Jul 1999 15:07:05 +0900 (JST) From: Satoshi Sekine Message-Id: <199907230607.PAA11755@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 228 Subject: [irex 228] Publication Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Fri, 23 Jul 1999 15:07:05 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 228 Subject: [irex 228] Publication Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp Dear IREX-ML members: This message concerns publications of IREX result of individual systems. Remember that you have agreed Make no use of the result of the evaluation (i.e. ranking, score etc) to advertise our own merchandise, group, or company, or to criticeze of others. But you also agreed You can report your result in scholarly articles. You can also report the score of the top system or median system or anything reported in the IREX workshop (it means anything reported in this mailing list, too), as the workshop is open for public. Of course, it is not appropriate to report the rank or score of other participants even you can find it from the papers or presentations at the workshop. Remember, these rule are ONLY appricable when you make scholarly articles. You can NOT do it in order to advertise your own merchandise, group, or company, or to criticeze of others. Accordning to the contract with Mainichi newspaper, you have to send a copy of your publications to them. Please do this by yourself. You can find the address at the bottom of this message. # Remember the due date of the IREX proceedings paper submission is # August 6. Please send two hard copies so that it arrives at CRL on the # day. Satoshi Sekine -------------------- IREXメイリングリストの皆様： 個々のシステムのIREX評価結果の報告についての確認です。 すべての参加者の方には、以下の項目のある制約書に印をいただきました。 ＩＲＥＸの結果をいかなる商品、サービスの宣伝、誹謗に利用しない。 ただし、これは、学術論文などでの評価結果の報告を禁止するものではありま せん。また、予稿集に報告されたものやこのメイリングリストで流れているも のは公知なので、その内容を学術論文で引用することは何ら差し支えありませ ん。つまり、最高のスコアなどを述べるのは構いません。 もちろん、これらは自分のシステムに関する場合であって、他の参加者のスコ アや順位などは、たとえワークショップの発表や予稿集などから分かってしま う場合にも、それを述べることは研究者（または人間）の態度として不適切と 考えます。 繰り返しますが、これらはすべて学術論文などでの報告に限り、商品、サービ スの宣伝、誹謗に利用した場合には罰則を適用します。 また、毎日新聞社との契約（以下に抜粋）により、毎日新聞を利用した研究の 発表の際には別刷を毎日新聞社に提出しなければいけません。これは各自で行 なって下さい。（ただし、IREXワークショップの予稿集はこちらで送りますの で、この予稿については構いません。） 関根 ＃ なお、予稿の提出〆切は８月６日（必着）です。この日までに通総研に届 ＃ くように提出してください。 以下の覚書の全文は９９年６月以降のIREXパッケージの NE_FORMAL/mainichi_keiyaku.txtにあります。 ーーーーーーーーーーーーーーーーーーーーー 毎日新聞データ使用許諾に関する覚書 毎日新聞社(以下「甲」という)とＩＲＥＸ実行委員会(以下「乙」という) は、毎日新聞社が所有する毎日新聞記事データに関して、以下の通りの 覚書を結ぶこととする。 。。。。 第七条(知見の発表) 1.乙および第六条に述べられた利用者は、本覚書に違反しない内容に おいて、新聞記事データを使用して得られた知見に関する研究発表 おるいは成果の公表を行なうことができる。 2.研究論文には、毎日新聞記事データを使用したことを明記するもの とする。また提出学会、発表年月日とともに論文の別刷またはコピ ーを一部甲に提出するものとする。 3.研究成果の公表には、第四条に違反しない範囲において、新聞記事 データを利用して得られたデータまたは処理プログラムの公開を含 むものとする。成果には毎日新聞記事データによる成果であること を明記し、成果の公開と同時にその内容を書面により甲に報告する ものとする。 。。。。。。 (甲) 東京都千代田区一ッ橋1-1-1 株式会社 毎日新聞社 総合メディア事業局長 渡辺良行 Mr. Yoshiyuki Watanabe 1-1-1 Hitotsubashi, Chiyoda-ku, Tokyo Mainichi Shinbun Sha Sougou Media Jigyoubu  1, filed,, Summary-line: 26-Jul to: irex@karc.crl.go.jp #[irex 229] IR result bug-fix, new IREX package Mail-from: From owner-irex@po.crl.go.jp Mon Jul 26 12:17:49 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id MAA16774 for ; Mon, 26 Jul 1999 12:17:49 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id MAA23130 for ; Mon, 26 Jul 1999 12:17:49 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id MAA04811; Mon, 26 Jul 1999 12:13:43 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id MAA16642; Mon, 26 Jul 1999 12:13:37 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id MAA07854; Mon, 26 Jul 1999 12:11:09 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id MAA07847 for ; Mon, 26 Jul 1999 12:11:08 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id MAA16086 for ; Mon, 26 Jul 1999 12:05:45 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id MAA16634 for ; Mon, 26 Jul 1999 12:13:29 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id MAA16823 for ; Mon, 26 Jul 1999 12:13:27 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id MAA49519 for ; Mon, 26 Jul 1999 12:13:27 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id MAA16624; Mon, 26 Jul 1999 12:13:26 +0900 (JST) Date: Mon, 26 Jul 1999 12:13:26 +0900 (JST) From: Satoshi Sekine Message-Id: <199907260313.MAA16624@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp CC: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 229 Subject: [irex 229] IR result bug-fix, new IREX package Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Mon, 26 Jul 1999 12:13:26 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp CC: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 229 Subject: [irex 229] IR result bug-fix, new IREX package Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp Dear IREX-ML member: We found (and fix) bugs in IR answers. It changes at most 0.0019 exact precision at an individual system. Please find the revised result at the end of this message as well as some statistics of the changes. A new IREX package, revising this change and including the latest NEscorer (which has already sent by e-mail), is available. The IREX homepage has temporarily moved to the following address. http://www.csl.sony.co.jp/person/sekine/IREX/ You can get the new package from the URL, which is actually http://www.csl.sony.co.jp/person/sekine/IREX/Package/IREX990726.tar.gz Or from the ordinal ftp directory > ftp cs.nyu.edu ftp> cd pub/local/sekine ftp> bin ftp> get IREX990726.tar.gz ftp> quit Sorry for the inconvenience. Satoshi Sekine -------------------------------------------------------- IREXメイリングリストの皆様： IRの正解に２種類のバグが発見されました。（共に関根の不注意によるもの です。１つは９５年８月２３、２４日の記事を入れたままにしていたのと、も う１種類は何人かの最終判定者が判定をしなかった記事が発見されたというも のです。申し訳ありません。） この修正により、各システムのExact Precisionは最大で0.0019（大部分が 0.0010以下）変化し、順位としては、A判定のみ、A&B判定の結果とも１つづつ 入れ替わっております。 評価する際には各システムのデーターから95年8月23,4日のデータを削除しな ければいけません。（以下にそのためのperlプログラムを入れておきます。） これらのバグを修正したものをIREXパッケージ990726として公開します。 (取り方は上記の英語の部分を参考にして下さい。） 以下に変更による変化の統計をいくつか載せます。 御迷惑をおかけして申し訳ありません。 関根 -------------------------------------------------- バージョン（Stage number) IRの結果は以下のようにStage number（irjファイルではs?）がついています。 一般に公開するのはStage 7のデータです。 参加者、判定者に公開するデータは６のものになります。 公開はワークショップ時にする予定です。 0: 参加システムのデータをまとめたもの 1: 0から参加システムのデータを抜いて、記事番号のみにしたもの 2: ２人の学生判定の結果が乗ったもの 3: 最終判定も乗ったもの 4: 参加システムのデータと判定データすべてが乗ったもの 5: 4に対し、最終判定のみが乗ったもの 6: 4に対し、950823|4 BugとJudge bugを解消したもの 7: 6に対し、最終判定のみが乗ったもの -------------------------------------------------- 記事数の変化 TOPIC s4/5 s6/7 950823|4 Judge ID bug bug 1007 2256 2246 -10 1008 2571 2565 -6 1009 1592 1588 -4 1010 2225 2222 -3 1011 2103 2130 -3 +30 1012 1538 1535 -3 1013 1314 1308 -6 1014 1478 1473 -5 1015 1511 1505 -6 1016 2452 2446 -6 1017 2252 2248 -4 1018 2089 2086 -3 1019 1863 1859 -4 1020 1293 1291 -2 1021 2033 2030 -3 1022 2021 2015 -6 1023 2858 2853 -5 1024 2936 2934 -2 1025 2049 2047 -2 1026 1916 1914 -2 1027 2519 2513 -6 1028 2810 2806 -5 +1 1029 1881 1878 -3 1030 2057 2053 -4 1031 2141 2134 -7 1032 2270 2268 -2 1033 2995 2989 -6 1034 1912 1911 -1 1035 2012 2008 -4 1036 2306 2299 -7 --------------------------------- # # perl del9508234.perl 11??.trt > 11??_new.trt # $rank = 1; while( <> ){ @f = split(); unless( $f[2] =~ /^95082[34]/ ){ print $f[0],"\t",$f[1],"\t",$f[2],"\t",$rank,"\t",$f[4],"\t",$f[5] ,"\n"; $rank++; } } --------------------------------- Exact Precision (s4が訂正前、s6が訂正後） A as answer s4 s6 1103a 0.4505 0.4512 1103b 0.4657 0.4667 1106 0.2360 0.2352 1110 0.3329 0.3335 1112 0.2790 0.2788 1120 0.2713 0.2707 1122a 0.3808 0.3803 1122b 0.4034 0.4032 1126 0.0966 0.0954 1128a 0.3384 0.3388 1128b 0.3924 0.3917 1132 0.0602 0.0604 1133a 0.2383 0.2382 1133b 0.2457 0.2460 1135a 0.4926 0.4929 1135b 0.4827 0.4829 1142 0.4455 0.4456 1144a 0.4658 0.4656 1144b 0.4592 0.4592 1145a 0.3352 0.3350 1145b 0.2553 0.2544 1146 0.2220 0.2225 A&B as answer 1103a 0.4888 0.4882 1103b 0.5201 0.5192 1106 0.2120 0.2110 1110 0.4276 0.4276 1112 0.3343 0.3340 1120 0.3339 0.3345 1122a 0.4689 0.4681 1122b 0.4747 0.4735 1126 0.0891 0.0883 1128a 0.3897 0.3897 1128b 0.4175 0.4156 1132 0.0791 0.0792 1133a 0.2277 0.2282 1133b 0.2248 0.2248 1135a 0.5119 0.5102 1135b 0.4878 0.4868 1142 0.4929 0.4929 1144a 0.5510 0.5499 1144b 0.5442 0.5434 1145a 0.3424 0.3419 1145b 0.2935 0.2927 1146 0.2742 0.2744  1, filed,, Summary-line: 26-Jul to: irex@karc.crl.go.jp #[irex 230] IREX workshop information Mail-from: From owner-irex@po.crl.go.jp Mon Jul 26 17:56:11 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id RAA09334 for ; Mon, 26 Jul 1999 17:56:11 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id RAA26112 for ; Mon, 26 Jul 1999 17:56:10 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id RAA08262; Mon, 26 Jul 1999 17:47:18 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id RAA25863; Mon, 26 Jul 1999 17:47:09 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id RAA13234; Mon, 26 Jul 1999 17:44:41 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id RAA13229 for ; Mon, 26 Jul 1999 17:44:40 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id RAA16221 for ; Mon, 26 Jul 1999 17:39:17 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id RAA25856 for ; Mon, 26 Jul 1999 17:47:02 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id RAA22566 for ; Mon, 26 Jul 1999 17:47:01 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id RAA58565 for ; Mon, 26 Jul 1999 17:47:01 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id RAA08709; Mon, 26 Jul 1999 17:47:00 +0900 (JST) Date: Mon, 26 Jul 1999 17:47:00 +0900 (JST) From: Satoshi Sekine Message-Id: <199907260847.RAA08709@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp CC: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 230 Subject: [irex 230] IREX workshop information Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Mon, 26 Jul 1999 17:47:00 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp CC: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 230 Subject: [irex 230] IREX workshop information Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp IREX-ML member: We have IREX workshop homepage at http://www.csl.sony.co.jp/person/sekine/IREX/workshop.html Please have a look for the time schedule (Four presentations have moved due to my studip mistake) and paper submission detail. For the foreign participants (NYU and Teragram), please contact Mr.Uchimoto (uchimoto@crl.go.jp) about e-mail submission if you prefer it. Regarding NTCIR/IREX joint workshop (Sept.1, 99), NACSIS is preparing its homepage at the moment. Satoshi Sekine ---------------------------------------- IREXメイリングリストの皆様： IREXワークショップのホームページを作成しました。 http://www.csl.sony.co.jp/person/sekine/IREX/workshopj.html プログラムおよび原稿の提出方法などありますので御覧下さい。 前にメイルしたのに比べて４つの団体の発表時間が変更されています。 また、海外の参加者(NYUとteragram)で電子メイルでの提出を希望される方は 内元さん(uchimoto@crl.go.jp)と相談して下さい。 ９月１日のNTCIR/IREX合同ワークショップについては学情の方でホームページ を準備中です。しばらくお待ち下さい。 よろしくお願いします。 関根  1, filed,, Summary-line: 28-Jul to: irex@karc.crl.go.jp #[irex 231] IREX workshop presentation Mail-from: From owner-irex@po.crl.go.jp Wed Jul 28 18:00:05 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id SAA04010 for ; Wed, 28 Jul 1999 18:00:05 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id SAA15390 for ; Wed, 28 Jul 1999 18:00:04 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id RAA29708; Wed, 28 Jul 1999 17:53:14 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id RAA16382; Wed, 28 Jul 1999 17:53:08 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id RAA08984; Wed, 28 Jul 1999 17:50:38 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id RAA08978 for ; Wed, 28 Jul 1999 17:50:37 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id RAA17067 for ; Wed, 28 Jul 1999 17:45:15 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id RAA16368 for ; Wed, 28 Jul 1999 17:53:01 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id RAA24735 for ; Wed, 28 Jul 1999 17:53:00 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id RAA94181 for ; Wed, 28 Jul 1999 17:52:59 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id RAA03519; Wed, 28 Jul 1999 17:52:58 +0900 (JST) Date: Wed, 28 Jul 1999 17:52:58 +0900 (JST) From: Satoshi Sekine Message-Id: <199907280852.RAA03519@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp CC: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 231 Subject: [irex 231] IREX workshop presentation Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Wed, 28 Jul 1999 17:52:58 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp CC: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 231 Subject: [irex 231] IREX workshop presentation Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp Dear IREX-ML member, I was asked if people can present some results or research done after the evaluation. We appreciate such presentations. I recommend people to report comparative experiments etc. Sorry that it was not very clear. Satoshi Sekine ------------------------- IREXメイリングリストの皆様： IREXワークショップで、本試験評価後の実験結果などを報告して良いかという 質問を受けました。もちろん大丈夫ですし、比較実験なども含めたそのような 発表が多くあることを期待しています。これまでの所で明らかでなかったこと をお詫びします。 関根  1, filed,, Summary-line: 29-Jul to: irex@karc.crl.go.jp #[irex 232] CFP: NTCIR/IREX Joint Workshop Mail-from: From owner-irex@po.crl.go.jp Thu Jul 29 11:16:59 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id LAA23189 for ; Thu, 29 Jul 1999 11:16:58 +0900 (JST) Received: from griffin.cs.nyu.edu (GRIFFIN.CS.NYU.EDU [128.122.140.54]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id LAA20984 for ; Thu, 29 Jul 1999 11:16:45 +0900 (JST) Received: from cs.nyu.edu (cs.nyu.edu [128.122.80.78]) by griffin.cs.nyu.edu (8.9.1/8.9.1) with ESMTP id WAA18440; Wed, 28 Jul 1999 22:16:26 -0400 (EDT) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by cs.nyu.edu (8.9.1/8.9.1) with ESMTP id WAA04557; Wed, 28 Jul 1999 22:16:24 -0400 (EDT) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id LAA06219; Thu, 29 Jul 1999 11:08:34 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id LAA01175; Thu, 29 Jul 1999 11:08:29 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id LAA16090; Thu, 29 Jul 1999 11:05:59 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id LAA16085 for ; Thu, 29 Jul 1999 11:05:58 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id LAA17282 for ; Thu, 29 Jul 1999 11:00:35 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id LAA01168 for ; Thu, 29 Jul 1999 11:08:22 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id LAA04453 for ; Thu, 29 Jul 1999 11:08:21 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id LAA04590 for ; Thu, 29 Jul 1999 11:08:20 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id LAA22624; Thu, 29 Jul 1999 11:08:20 +0900 (JST) Date: Thu, 29 Jul 1999 11:08:20 +0900 (JST) From: Satoshi Sekine Message-Id: <199907290208.LAA22624@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 232 Subject: [irex 232] CFP: NTCIR/IREX Joint Workshop Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Thu, 29 Jul 1999 11:08:20 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 232 Subject: [irex 232] CFP: NTCIR/IREX Joint Workshop Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp [English Announcement] *********************************************** (Sorry if you receive multiple copies.) Call For Participation NTCIR/IREX Joint Workshop - Information Retrieval and Information Extraction - http://www.rd.nacsis.ac.jp/~ntcadm/workshop/joint/ Co-organized by NTCIR/NACSIS and IREX In cooperation with IPSJ, SIG-FI/IPSJ September 1, 1999 KKR Hotel Tokyo Tokyo, JAPAN The joint workshop of NTCIR (NACSIS Test Collection for IR) and IREX (Information Retrieval and EXtraction) will be held. Your participation is most welcome. o Date: 9:00 - 17:00 September 1, 1999 (18:00 - 18:30 Banquet) o Venue: KKR Hotel Tokyo 1-4-1 Ohtemachi, Chiyoda-ku, Tokyo 100-0004 JAPAN Phone: +81-3-3287-2921; Fax: +81-3-3287-2913 Just in front of the Takebashi Station of the Tozai Line Subway (0 minute to walk!!). Situated in 5-minite drive from Tokyo Station and across the street from the Imperial Palace. From the Narita International Airport to the Tokyo Station, there are frequent services of Shuttle trains and Limousine buses. o Fee: Admission is free Banquet: 8,500 Yen per person o Application for Participation: Send e-mail to ntcadm@rd.nacsis.ac.jp with (1) your name, (2) affiliation, (3) postal address, phone/fax number, e-mail address, (4) participation in reception or not. Participation will be first-come-first-served base. o Program (preliminary): 9:30 - 9:45 Opening Remarks 9:45 - 11:00 Keynote Speech(1) "TREC": Donna Harman (NIST, USA) 11:15 - 12:00 NTCIR Workshop Overview: Noriko Kando (NACSIS, Japan) 13:30 - 14:45 Keynote Speech(2) "TBA": Ralph Grishman (NYU, USA) 15:00 - 15:45 IREX Workshop Overview: Satoshi Sekine (NYU, USA) 15:45 - 16:45 Panel Discussion 16:45 - 17:00 Closing Remarks - - - - - - 18:00 - 19:30 Reception o Contact Information: NTCIR/IREX Joint Workshop Project (Attn: Toshihiko NOZUE) E-mail: ntcadm@rd.nacsis.ac.jp; Fax: +81-3-5395-7064 * Officail Language is English. * NTCIR Workshop is supported by JSPS "Research for the Future Program: Studies on Ubiquitous Information Systems for Utilization of Highly Distributed Information Resources." [Japanese Announcement] ********************************************** 　　　　　（同じメールを複数受け取られた方、ご容赦ください。） NTCIR/IREX合同ワークショップ -- 情報検索、情報抽出の現状と将来 -- http://www.rd.nacsis.ac.jp/~ntcadm/workshop/joint/ 　近年、インタネットの普及と電子的な文書の増大に伴い、情報検索、情報抽 出への関心が高まり、研究開発も盛んになっています。今年は、わが国ではじ めて、日本語文書を対象とした情報検索・情報抽出システムの評価を行なう、 コンペティション型ワークショップ NTCIR (NACSIS Test Collection for IR) と IREX (Information Retrieval and EXtraction) が開催され、多くの参加 者の賛同とご協力を得て、成果を納めました。 　これらのワークショップの概要の報告と、今後の情報検索・抽出研究を展望 する合同ワークショップを開催いたします。招待講演者としては、国際的な情 報検索の評価会議である TREC の議長 Dr. Donna Harman、情報抽出の評価会 議である MUC の議長 Prof. Ralph Grishman をお招きしました。 　どうぞ奮ってご参加ください。 　　日　　時：　1999年9月1日（水）9:00 -- 17:00 　　　 　（懇親会 18:00 -- 19:30） 　　会　　場：　KKRホテル 東京 　　　　　　　　　東京都千代田区大手町1-4-1 tel: 03-3287-2921 　　　　　　　　　地下鉄東西線竹橋下車（大手町寄3b出口から専用通路） 　首都高速環状線神田橋出口から2分 　　　　　　　　　JR東京駅（丸の内口）から車で5分 　　参 加 費：　無料（先着順受付） 懇親会費は8,500円（当日支払） 　　主　　催：　学術情報センター、IREX実行委員会 　　協　　賛：　情報処理学会 　　後　　援：　情報処理学会情報学基礎研究会 　　申込方法：　参加希望の方は、事前に電子メールにてお申し込みください。 　　　　　　　「氏名（ふりがな）」「所属」「連絡先（住所・電話・FAX・電 　　　　　　　　子メール）」「懇親会への参加／不参加」を明記ください。 　　照会／申込先：　NTCIR/IREX合同ワークショップ事務局 　　　　　　　　　　担当：野末俊比古（学術情報センター） 　 　fax: 03-5395-7064 mail: ntcadm@rd.nacsis.ac.jp 　　プログラム： 　　　 9:00 - 受付 　　　 9:30 - 9:45 開会挨拶 　　　 9:45 - 11:00 基調講演(1)"TREC" 　　　　　　Donna Harman (NIST） 　　　11:15 - 12:00 NTCIR ワークショップ報告　神門典子（学情センター） 　　　13:30 - 14:45 基調講演(2)"TBA"　Ralph Grishman（ニューヨーク大） 　　　15:00 - 15:45 IREX ワークショップ報告　 関根聡（ニューヨーク大） 　　　15:45 - 16:45 パネルディスカッション「評価型プロジェクトの今後」 　　　16:45 - 17:00 閉会挨拶 　　　18:00 - 19:30 懇親会 *使用言語は英語です（講演要旨の日本語訳を準備する予定です）。 * NTCIR ワークショップは、日本学術振興会「未来開拓学術研究推進事業 　 『高度分散情報資源活用のためのユービキタス情報システムに関する研 　　究』」のサポートを受けています **********************************************************************  1, filed,, Summary-line: 29-Jul to: irex@karc.crl.go.jp #[irex 233] re-revise IR result bug-fix Mail-from: From owner-irex@po.crl.go.jp Thu Jul 29 11:48:42 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id LAA25354 for ; Thu, 29 Jul 1999 11:48:42 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id LAA21237 for ; Thu, 29 Jul 1999 11:48:41 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id LAA06793; Thu, 29 Jul 1999 11:41:53 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id LAA02551; Thu, 29 Jul 1999 11:41:47 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id LAA16700; Thu, 29 Jul 1999 11:39:17 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id LAA16694 for ; Thu, 29 Jul 1999 11:39:16 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id LAA17325 for ; Thu, 29 Jul 1999 11:33:52 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id LAA02542 for ; Thu, 29 Jul 1999 11:41:39 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id LAA05255 for ; Thu, 29 Jul 1999 11:41:37 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id LAA04993 for ; Thu, 29 Jul 1999 11:41:37 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id LAA24806; Thu, 29 Jul 1999 11:41:36 +0900 (JST) Date: Thu, 29 Jul 1999 11:41:36 +0900 (JST) From: Satoshi Sekine Message-Id: <199907290241.LAA24806@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 233 Subject: [irex 233] re-revise IR result bug-fix Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Thu, 29 Jul 1999 11:41:36 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 233 Subject: [irex 233] re-revise IR result bug-fix Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp IREX-ML member: I made a mistake in the report of the IR result bug fix. Sorry for the inconvenience. s4 and s6 in the result table have to be replaced. Satoshi Sekine ------------------------------------------------------- IREXメイリングリストの皆様： 以下でお知らせしたIRの結果の報告の中で重要な部分に間違えがありました。 たびたび申し訳ありません。結果の報告部分でs4とs6が逆でした。 （詳しくは、以下の＃で始まるコメント部分を参照下さい。） 関根 ------------------------------------------------------- > IREXメイリングリストの皆様： > > IRの正解に２種類のバグが発見されました。（共に関根の不注意によるもの > です。１つは９５年８月２３、２４日の記事を入れたままにしていたのと、も > う１種類は何人かの最終判定者が判定をしなかった記事が発見されたというも > のです。申し訳ありません。） > > この修正により、各システムのExact Precisionは最大で0.0019（大部分が > 0.0010以下）変化し、順位としては、A判定のみ、A&B判定の結果とも１つづつ > 入れ替わっております。 > > 評価する際には各システムのデーターから95年8月23,4日のデータを削除しな > ければいけません。（以下にそのためのperlプログラムを入れておきます。） > > これらのバグを修正したものをIREXパッケージ990726として公開します。 > (取り方は上記の英語の部分を参考にして下さい。） > > 以下に変更による変化の統計をいくつか載せます。 > > > 御迷惑をおかけして申し訳ありません。 > > > 関根 > > -------------------------------------------------- > バージョン（Stage number) > > IRの結果は以下のようにStage number（irjファイルではs?）がついています。 > 一般に公開するのはStage 7のデータです。 > 参加者、判定者に公開するデータは６のものになります。 > 公開はワークショップ時にする予定です。 > > 0: 参加システムのデータをまとめたもの > 1: 0から参加システムのデータを抜いて、記事番号のみにしたもの > 2: ２人の学生判定の結果が乗ったもの > 3: 最終判定も乗ったもの > 4: 参加システムのデータと判定データすべてが乗ったもの > 5: 4に対し、最終判定のみが乗ったもの > 6: 4に対し、950823|4 BugとJudge bugを解消したもの > 7: 6に対し、最終判定のみが乗ったもの > > -------------------------------------------------- > 記事数の変化 > > TOPIC s4/5 s6/7 950823|4 Judge > ID bug bug > 1007 2256 2246 -10 > 1008 2571 2565 -6 > 1009 1592 1588 -4 > 1010 2225 2222 -3 > 1011 2103 2130 -3 +30 > 1012 1538 1535 -3 > 1013 1314 1308 -6 > 1014 1478 1473 -5 > 1015 1511 1505 -6 > 1016 2452 2446 -6 > 1017 2252 2248 -4 > 1018 2089 2086 -3 > 1019 1863 1859 -4 > 1020 1293 1291 -2 > 1021 2033 2030 -3 > 1022 2021 2015 -6 > 1023 2858 2853 -5 > 1024 2936 2934 -2 > 1025 2049 2047 -2 > 1026 1916 1914 -2 > 1027 2519 2513 -6 > 1028 2810 2806 -5 +1 > 1029 1881 1878 -3 > 1030 2057 2053 -4 > 1031 2141 2134 -7 > 1032 2270 2268 -2 > 1033 2995 2989 -6 > 1034 1912 1911 -1 > 1035 2012 2008 -4 > 1036 2306 2299 -7 > > --------------------------------- > # > # perl del9508234.perl 11??.trt > 11??_new.trt > # > $rank = 1; > > while( <> ){ > > @f = split(); > unless( $f[2] =~ /^95082[34]/ ){ > print $f[0],"\t",$f[1],"\t",$f[2],"\t",$rank,"\t",$f[4],"\t",$f[5] > ,"\n"; > $rank++; > } > } > > --------------------------------- > Exact Precision (s4が訂正前、s6が訂正後） > > A as answer > > s4 s6 ＃ ここのs4,s6が逆、正しくは以下の通り。 ＃ s6 s4 > 1103a 0.4505 0.4512 > 1103b 0.4657 0.4667 > 1106 0.2360 0.2352 > 1110 0.3329 0.3335 > 1112 0.2790 0.2788 > 1120 0.2713 0.2707 > 1122a 0.3808 0.3803 > 1122b 0.4034 0.4032 > 1126 0.0966 0.0954 > 1128a 0.3384 0.3388 > 1128b 0.3924 0.3917 > 1132 0.0602 0.0604 > 1133a 0.2383 0.2382 > 1133b 0.2457 0.2460 > 1135a 0.4926 0.4929 > 1135b 0.4827 0.4829 > 1142 0.4455 0.4456 > 1144a 0.4658 0.4656 > 1144b 0.4592 0.4592 > 1145a 0.3352 0.3350 > 1145b 0.2553 0.2544 > 1146 0.2220 0.2225 > > A&B as answer > > 1103a 0.4888 0.4882 > 1103b 0.5201 0.5192 > 1106 0.2120 0.2110 > 1110 0.4276 0.4276 > 1112 0.3343 0.3340 > 1120 0.3339 0.3345 > 1122a 0.4689 0.4681 > 1122b 0.4747 0.4735 > 1126 0.0891 0.0883 > 1128a 0.3897 0.3897 > 1128b 0.4175 0.4156 > 1132 0.0791 0.0792 > 1133a 0.2277 0.2282 > 1133b 0.2248 0.2248 > 1135a 0.5119 0.5102 > 1135b 0.4878 0.4868 > 1142 0.4929 0.4929 > 1144a 0.5510 0.5499 > 1144b 0.5442 0.5434 > 1145a 0.3424 0.3419 > 1145b 0.2935 0.2927 > 1146 0.2742 0.2744  1,, Summary-line: 29-Jul to: irex@karc.crl.go.jp #[irex 234] CFP to the panelist at NTCIR/IREX workshop, Future of IREX Mail-from: From owner-irex@po.crl.go.jp Thu Jul 29 12:25:47 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id MAA27611 for ; Thu, 29 Jul 1999 12:25:46 +0900 (JST) Received: from griffin.cs.nyu.edu (GRIFFIN.CS.NYU.EDU [128.122.140.54]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id MAA21583 for ; Thu, 29 Jul 1999 12:25:45 +0900 (JST) Received: from cs.nyu.edu (cs.nyu.edu [128.122.80.78]) by griffin.cs.nyu.edu (8.9.1/8.9.1) with ESMTP id XAA18793; Wed, 28 Jul 1999 23:25:41 -0400 (EDT) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by cs.nyu.edu (8.9.1/8.9.1) with ESMTP id XAA05043; Wed, 28 Jul 1999 23:25:39 -0400 (EDT) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id MAA07244; Thu, 29 Jul 1999 12:11:52 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id MAA03630; Thu, 29 Jul 1999 12:11:47 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id MAA17285; Thu, 29 Jul 1999 12:09:17 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id MAA17280 for ; Thu, 29 Jul 1999 12:09:16 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id MAA17363 for ; Thu, 29 Jul 1999 12:03:52 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id MAA03626 for ; Thu, 29 Jul 1999 12:11:40 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id MAA05959 for ; Thu, 29 Jul 1999 12:11:39 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id MAA05282 for ; Thu, 29 Jul 1999 12:11:38 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id MAA26764; Thu, 29 Jul 1999 12:11:37 +0900 (JST) Date: Thu, 29 Jul 1999 12:11:37 +0900 (JST) From: Satoshi Sekine Message-Id: <199907290311.MAA26764@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 234 Subject: [irex 234] CFP to the panelist at NTCIR/IREX workshop, Future of IREX Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Thu, 29 Jul 1999 12:11:37 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 234 Subject: [irex 234] CFP to the panelist at NTCIR/IREX workshop, Future of IREX Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp IREX-ML member: 1. WE ARE LOOKING FOR PANELISTS. We will have a panel discussion at the NTCIR/IREX joint workshop at September 1, 1999 (CFP was sent to this ML a few minutes ago). Please raise your hand if you have comment/suggestion/critics to the IREX project, the way of organization/operation/evaluation, the task selection/definition or anything related to the project. Please send me (sekine@csl.sony.co.jp) e-mail if you are interested in. 2. For the future IREX, we heard that many people desire IREX and NTCIR to be joined. We disccuss this isuue with NTCIR/NACSIS people. And we agreed to have next event jointly under NACSIS's management. Satoshi ---------------------------------------------------------------- IREXメイリングリストの皆様： たびたび申し訳ありません。２つあります。 １.パネラーを公募します。 ９月１日に行なわれるNTCIR/IREX合同ワークショップでは、今回の反省と将 来への方向というものをテーマにしたパネルを計画しています。それ以外の 発表が、NTCIR,IREXプロジェクトの報告だったり、TREC,MUCの活動状況の話 しなので、是非、今回参加した方に色々と意見を行っていただく場を持とう ということで、パネルを企画しました。IREXではこのパネルの参加していた だく方を公募することにしました。NTCIRとのバランス（両方に参加してい る方の扱いなど）で変わることはあるかも知れませんが、現在の所２名の方 を募集します。発表時間は５分で、発表は英語です。時間が短いですが、今 後のプロジェクトの方向を考える上でも重要な場になると思いますので、積 極的な応募を期待します。〆切は８月１０日とします。１、２段落（１０行 くらい）の簡単な説明を添えて関根(sekine@csl.sony.co.jp)まで連絡して 下さい。 応募者が大勢の場合などには、バランス(IR/NE/判定者,企業/大学,NTCIRに も参加した方/IREXのみの方など）を考慮し、相談の上選択させていただき ます。 ＃ 私としては耳が痛い意見を（も）期待します。 ２.将来のコンテストの形式 将来のコンテストについて色々な意見を聞いていますが、ひとつはNTCIRと IREXが一緒にできないかという希望が多くあります。この点について学情の 方と話し合ってきましたが、次回のコンテストは学情の下統一して行なおう という方向でまとまりました。IREXは基本的に個人のボランティアベースの 運営ですが、今回の状況を見てもこれはかなり厳しいものでした。その点、 ちゃんとした組織である学情は、実際このようなコンテストを主催するにも 適切な場所であると思われますし、関根も井佐原も学情の方に運営をお願い するという方向が一番であると判断しました。もちろん２人とも今後のこの ようなプロジェクトが発展していくことを希望していますし、そのためにで きることはしていきたいと思っています。御理解を賜わりたく思います。 関根  1,, Mail-from: From owner-irex@po.crl.go.jp Thu Jul 29 18:03:07 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id SAA20756 for ; Thu, 29 Jul 1999 18:03:07 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id SAA24481 for ; Thu, 29 Jul 1999 18:03:06 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id RAA11017; Thu, 29 Jul 1999 17:54:40 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id RAA12871; Thu, 29 Jul 1999 17:54:35 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id RAA22519; Thu, 29 Jul 1999 17:52:05 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id RAA22514 for ; Thu, 29 Jul 1999 17:52:04 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id RAA17577 for ; Thu, 29 Jul 1999 17:46:41 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id RAA12867 for ; Thu, 29 Jul 1999 17:54:28 +0900 (JST) Received: from tama5.ecl.ntt.co.jp (tama5.ecl.ntt.co.jp [129.60.39.102]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id RAA11287 for ; Thu, 29 Jul 1999 17:54:27 +0900 (JST) Received: from nttmail3.ecl.ntt.co.jp (nttmail3.ecl.ntt.co.jp [129.60.39.100]) by tama5.ecl.ntt.co.jp (8.9.3+3.1W/3.7W/05/18/99) with ESMTP id RAA09444; Thu, 29 Jul 1999 17:54:25 +0900 (JST) (envelope-from sasaki@cslab.kecl.ntt.co.jp) Received: from mail2.kecl.ntt.co.jp by nttmail3.ecl.ntt.co.jp (8.9.3+3.1W/3.7W/06/10/99) with ESMTP id RAA16827; Thu, 29 Jul 1999 17:53:34 +0900 (JST) (envelope-from sasaki@cslab.kecl.ntt.co.jp) Received: from gentzen.icl.kecl.ntt.co.jp by mail2.kecl.ntt.co.jp (8.8.8/kecl2.1/MX-2b) with ESMTP id RAA15918; Thu, 29 Jul 1999 17:54:24 +0900 (JST) Received: by gentzen.icl.kecl.ntt.co.jp (8.8.8/kecl2.1b/Std-1) with ESMTP id RAA15463; Thu, 29 Jul 1999 17:55:34 +0900 (JST) Message-Id: <199907290855.RAA15463@gentzen.icl.kecl.ntt.co.jp> To: irex@karc.crl.go.jp cc: sekine@csl.sony.co.jp In-reply-to: Your message of "Sun, 20 Jun 1999 13:08:40 JST." <199906200408.NAA14458@hotaka.csl.sony.co.jp> Date: Thu, 29 Jul 1999 17:55:33 +0900 From: Yutaka SASAKI Reply-To: irex@karc.crl.go.jp X-Sequence: irex 235 Subject: [irex 235] Re: IREX package, IR result, workshop (paper due) Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f To: irex@karc.crl.go.jp cc: sekine@csl.sony.co.jp In-reply-to: Your message of "Sun, 20 Jun 1999 13:08:40 JST." <199906200408.NAA14458@hotaka.csl.sony.co.jp> Date: Thu, 29 Jul 1999 17:55:33 +0900 From: Yutaka SASAKI Reply-To: irex@karc.crl.go.jp X-Sequence: irex 235 Subject: [irex 235] Re: IREX package, IR result, workshop (paper due) Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp 関根様 IREX ワークショップの原稿についてですが、 > 日本語の場合には半ページ以上のExtended Abstractをつ > けること。カメラレディ２部を以下の提出先まで と書かれている "Extended Abstract" は英語のアブストラクトを を指しているという解釈で合っているでしょうか？ 以上、よろしくお願いします。 --- {^g^} 佐々木裕＠ＮＴＴコミュニケーション科学基礎研究所 (sasaki@cslab.kecl.ntt.co.jp)  1, filed,, Mail-from: From owner-irex@po.crl.go.jp Thu Jul 29 18:19:28 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id SAA21849 for ; Thu, 29 Jul 1999 18:19:27 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id SAA24643 for ; Thu, 29 Jul 1999 18:19:27 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id SAA11190; Thu, 29 Jul 1999 18:12:08 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id SAA13306; Thu, 29 Jul 1999 18:12:02 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id SAA22781; Thu, 29 Jul 1999 18:09:33 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id SAA22776 for ; Thu, 29 Jul 1999 18:09:31 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id SAA17591 for ; Thu, 29 Jul 1999 18:04:08 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id SAA13302 for ; Thu, 29 Jul 1999 18:11:55 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id SAA11539 for ; Thu, 29 Jul 1999 18:11:55 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615/smtpfeed 1.01) with ESMTP id SAA10128; Thu, 29 Jul 1999 18:11:54 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id SAA21510; Thu, 29 Jul 1999 18:11:53 +0900 (JST) Date: Thu, 29 Jul 1999 18:11:53 +0900 (JST) From: Satoshi Sekine Message-Id: <199907290911.SAA21510@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp CC: sasaki@cslab.kecl.ntt.co.jp In-reply-to: <199907290855.RAA15463@gentzen.icl.kecl.ntt.co.jp> (message from Yutaka SASAKI on Thu, 29 Jul 1999 17:55:33 +0900) Reply-To: irex@karc.crl.go.jp X-Sequence: irex 236 Subject: [irex 236] Re: IREX package, IR result, workshop (paper due) Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Thu, 29 Jul 1999 18:11:53 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp CC: sasaki@cslab.kecl.ntt.co.jp In-reply-to: <199907290855.RAA15463@gentzen.icl.kecl.ntt.co.jp> (message from Yutaka SASAKI on Thu, 29 Jul 1999 17:55:33 +0900) Reply-To: irex@karc.crl.go.jp X-Sequence: irex 236 Subject: [irex 236] Re: IREX package, IR result, workshop (paper due) Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp This message saying that "please write a half page abstract in English if you write the content in Japanses for the IREX workshop proceedings." Thank you, Satoshi Sekine -------------------------------------------------------- 佐々木様、皆様： > 日本語の場合には半ページ以上のExtended Abstractをつ > けること。カメラレディ２部を以下の提出先まで と書かれている "Extended Abstract" は英語のアブストラクトを を指しているという解釈で合っているでしょうか？ はい、英語のアブストラクトの意味です。 よろしくお願い致します。 関根  1, filed,, Mail-from: From owner-irex@po.crl.go.jp Tue Aug 3 10:50:31 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id KAA28463 for ; Tue, 3 Aug 1999 10:50:31 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id KAA28333 for ; Tue, 3 Aug 1999 10:50:31 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id KAA16514; Tue, 3 Aug 1999 10:47:33 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id KAA07223; Tue, 3 Aug 1999 10:47:27 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id KAA10298; Tue, 3 Aug 1999 10:44:53 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id KAA10291 for ; Tue, 3 Aug 1999 10:44:51 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id KAA19316 for ; Tue, 3 Aug 1999 10:39:29 +0900 (JST) Received: from mailgate.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id KAA07219 for ; Tue, 3 Aug 1999 10:47:19 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by mailgate.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id KAA11638 for ; Tue, 3 Aug 1999 10:47:18 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id KAA78310 for ; Tue, 3 Aug 1999 10:47:18 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id KAA28309; Tue, 3 Aug 1999 10:47:17 +0900 (JST) Date: Tue, 3 Aug 1999 10:47:17 +0900 (JST) From: Satoshi Sekine Message-Id: <199908030147.KAA28309@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 237 Subject: [irex 237] Reminder: paper due Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Tue, 3 Aug 1999 10:47:17 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp Cc: sekine@csl.sony.co.jp Reply-To: irex@karc.crl.go.jp X-Sequence: irex 237 Subject: [irex 237] Reminder: paper due Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp Dear IREX-ML member: Reminder: Paper due for the IREX workshop proceedings is this Friday. All evaluation participants are expected to submit a paper. You can fin the detail at http://www.csl.sony.co.jp/person/sekine/IREX/workshop.html Also, we wll make CDROM. Please notify me (sekine@csl.sony.co.jp) by this Friday, if you find a bug or others in the latest IREX-Package. Satoshi Sekine ------------ IREXメイリングリストの皆様： IREXワークショップ予稿集の〆切は今週の金曜日（８月６日）です。 参加者の方は遅れないように提出して下さい。詳細は以下のページに。 http://www.csl.sony.co.jp/person/sekine/IREX/workshopj.html また、CDROMを作成することを計画しています。もし最新のIREXパッケージに バグや問題点がありましたら金曜までに関根(sekine@csl.sony.co.jp)にお知 らせください。 なお、IRの結果ファイルに評価結果には全く影響しないバグ（記事のない記事 ID(9508268 in 1013_s7)が存在する）が発見されております。連絡していただ いた方どうもありがとうございます。最終データでは削除する予定です。 関根  1, filed, answered,, Mail-from: From owner-irex@po.crl.go.jp Tue Aug 3 11:11:54 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id LAA29719 for ; Tue, 3 Aug 1999 11:11:54 +0900 (JST) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id LAA28509 for ; Tue, 3 Aug 1999 11:11:53 +0900 (JST) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id LAA16825; Tue, 3 Aug 1999 11:08:26 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id LAA07931; Tue, 3 Aug 1999 11:08:15 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id LAA10678; Tue, 3 Aug 1999 11:05:40 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id LAA10673 for ; Tue, 3 Aug 1999 11:05:39 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id LAA19321 for ; Tue, 3 Aug 1999 11:00:17 +0900 (JST) Received: from c-ring1.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id LAA07925 for ; Tue, 3 Aug 1999 11:08:08 +0900 (JST) Received: from netsv1.shibuya.tao.go.jp (netsv1.shibuya.tao.go.jp [210.226.179.65]) by c-ring1.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id LAA04397 for ; Tue, 3 Aug 1999 11:08:07 +0900 (JST) Received: from npcra201.shibuya.tao.go.jp by netsv1.shibuya.tao.go.jp (8.8.8+2.7Wbeta7/3.7W-NEC) id LAA12957; Tue, 3 Aug 1999 11:11:00 +0900 (JST) Message-ID: <005101bedd55$c3ce7a00$20c8a8c0@shibuya.tao.go.jp> From: "Takahiro Fukushima" To: Cc: "Fukushima Takahiro" References: <199908030147.KAA28309@hotaka.csl.sony.co.jp> Date: Tue, 3 Aug 1999 11:13:23 +0900 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-2022-jp" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 5.00.2014.211 X-MimeOLE: Produced By Microsoft MimeOLE V5.00.2014.211 Reply-To: irex@karc.crl.go.jp X-Sequence: irex 238 Subject: [irex 238] アンケート結果 Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f From: "Takahiro Fukushima" To: Cc: "Fukushima Takahiro" References: <199908030147.KAA28309@hotaka.csl.sony.co.jp> Date: Tue, 3 Aug 1999 11:13:23 +0900 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-2022-jp" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 5.00.2014.211 X-MimeOLE: Produced By Microsoft MimeOLE V5.00.2014.211 Reply-To: irex@karc.crl.go.jp X-Sequence: irex 238 Subject: [irex 238] アンケート結果 Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp 関根さん 通信・放送機構の福島です。 システムに関するアンケートですが、 これは、ＩＲＥＸのワークショップで その結果について報告があるのでしょうか。 まとめが聞ければ嬉しいなと思っています。 福島　孝博 通信・放送機構 渋谷上原リサーチセンター Tel 03-5790-7065 Fax 03-5790-7066 Email fukushima@shibuya.tao.go.jp Web http://www.shibuya.tao.go.jp  1, filed,, Summary-line: 3-Aug to: irex@karc.crl.go.jp #[irex 239] Re: アンケート結果 Mail-from: From owner-irex@po.crl.go.jp Tue Aug 3 11:53:14 1999 Received: from widefw.csl.sony.co.jp (widefw.csl.sony.co.jp [43.27.100.1]) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) with ESMTP id LAA02388 for ; Tue, 3 Aug 1999 11:53:14 +0900 (JST) Received: from griffin.cs.nyu.edu (GRIFFIN.CS.NYU.EDU [128.122.140.54]) by widefw.csl.sony.co.jp (8.9.3/3.7Ws3widefw/99071615) with ESMTP id LAA28836 for ; Tue, 3 Aug 1999 11:53:12 +0900 (JST) Received: from cs.nyu.edu (cs.nyu.edu [128.122.80.78]) by griffin.cs.nyu.edu (8.9.1/8.9.1) with ESMTP id WAA28462; Mon, 2 Aug 1999 22:52:53 -0400 (EDT) Received: from ns.crl.go.jp (ns.crl.go.jp [133.243.18.30]) by cs.nyu.edu (8.9.1/8.9.1) with ESMTP id WAA01999; Mon, 2 Aug 1999 22:52:52 -0400 (EDT) Received: from crlgw.crl.go.jp ([133.243.18.250]) by ns.crl.go.jp (8.9.3+3.1W/3.7W) with ESMTP id LAA17203; Tue, 3 Aug 1999 11:50:24 +0900 (JST) Received: from po.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id LAA08849; Tue, 3 Aug 1999 11:50:18 +0900 (JST) Received: (from uchimoto@localhost) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id LAA11367; Tue, 3 Aug 1999 11:47:44 +0900 (JST) X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Received: from karc.crl.go.jp (karc [133.243.25.98]) by po.crl.go.jp (8.9.3+3.1W/3.7Wpl2-990405) id LAA11362 for ; Tue, 3 Aug 1999 11:47:43 +0900 (JST) Received: from crlgw.crl.go.jp (crlgw [133.243.18.250]) by karc.crl.go.jp (8.8.2+2.6Wbeta9/3.4W4) with ESMTP id LAA19348 for ; Tue, 3 Aug 1999 11:42:21 +0900 (JST) Received: from c-ring1.crl.go.jp (localhost [127.0.0.1]) by crlgw.crl.go.jp (8.8.8+2.7Wbeta7/3.5Wpl7-MS980331) with ESMTP id LAA08841 for ; Tue, 3 Aug 1999 11:50:11 +0900 (JST) Received: from inetfw.sonycsl.co.jp (inetfw.sonycsl.co.jp [203.137.129.4]) by c-ring1.crl.go.jp (8.8.8+2.7Wbeta7/3.6W) with ESMTP id LAA04938 for ; Tue, 3 Aug 1999 11:50:10 +0900 (JST) Received: from hotaka.csl.sony.co.jp (sekine@hotaka.csl.sony.co.jp [43.27.98.57]) by inetfw.sonycsl.co.jp (8.9.3+3.2W/3.7Ws3/99071615) with ESMTP id LAA78607; Tue, 3 Aug 1999 11:23:48 +0900 (JST) Received: (from sekine@localhost) by hotaka.csl.sony.co.jp (8.8.8/3.7Ws3/hotaka/99071615) id LAA00622; Tue, 3 Aug 1999 11:23:47 +0900 (JST) Date: Tue, 3 Aug 1999 11:23:47 +0900 (JST) From: Satoshi Sekine Message-Id: <199908030223.LAA00622@hotaka.csl.sony.co.jp> To: irex@karc.crl.go.jp CC: fukushima@shibuya.tao.go.jp, sekine@csl.sony.co.jp In-reply-to: <005101bedd55$c3ce7a00$20c8a8c0@shibuya.tao.go.jp> (fukushima@shibuya.tao.go.jp) Reply-To: irex@karc.crl.go.jp X-Sequence: irex 239 Subject: [irex 239] Re: アンケート結果 Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp *** EOOH *** X-Authentication-Warning: po.crl.go.jp: uchimoto set sender to owner-irex@po using -f Date: Tue, 3 Aug 1999 11:23:47 +0900 (JST) From: Satoshi Sekine To: irex@karc.crl.go.jp CC: fukushima@shibuya.tao.go.jp, sekine@csl.sony.co.jp In-reply-to: <005101bedd55$c3ce7a00$20c8a8c0@shibuya.tao.go.jp> (fukushima@shibuya.tao.go.jp) Reply-To: irex@karc.crl.go.jp X-Sequence: irex 239 Subject: [irex 239] Re: アンケート結果 Errors-To: owner-irex@po.crl.go.jp Sender: owner-irex@po.crl.go.jp 福島さん、コメントありがとうございます。 アンケート結果は表にして予稿集に載せる予定になっています。 もちろん、アンケートやその表は公開予定の物ですから、CDROMに入ります。 また、アンケート結果を利用したシステムパフォーマンスの分析も 学生の分析者が行なっており、ワークショップではその発表がありますので、 （私を含めて）皆さんの期待されているような話しが聞けるものと思います。 関根