m/2015/okada/diary/2016-02-22
をテンプレートにして作成
[
トップ
] [
新規
|
一覧
|
単語検索
|
最終更新
|
ヘルプ
|
ログイン
]
開始行:
#contents
*前回の続きの実験 [#xae04b89]
-3.&br;
2の実験でCNNであれば、元画像のスケール変化、位置の変化が...
次の実験においては、位置の変化を2.の時の倍程度にして、実...
NNの場合は前回の場合で汎化性能を獲得できていなかったので...
全体画像の縦のサイズは50、横のサイズは190とする。&br;
実験用画像(https://drive.google.com/a/mail.ryukoku.ac.jp/...
-4.&br;
3.の実験をベースに縦、横のスケールを変化させてみて、位置...
4_1.全体の幅285、高さ50の場合&br;
(https://drive.google.com/a/mail.ryukoku.ac.jp/file/d/0B8...
4_2.全体の幅190、高さ95の場合&br;
(https://drive.google.com/a/mail.ryukoku.ac.jp/file/d/0B8...
**まとめ [#k3d6e555]
実験結果&br;
-3.&br;(https://drive.google.com/a/mail.ryukoku.ac.jp/fil...
画像全体のサイズを大きくして、実験を行ってみた。&br;
strideを大きくして、前回と大体同じ程度の出力マップサイズ...
CPFFのcostが振動している部分も見られるが、CPCPFFにした場...
-4.&br;
(https://drive.google.com/a/mail.ryukoku.ac.jp/file/d/0B8...
3.の実験で、全体画像の幅が大きくても、位置推定出来そうだ...
3の実験条件からさらに幅を大きくしたもの、幅は同じで画像の...
CPCPFFのみで実験を行ったが、両方とも位置はほぼ推定出来る...
現在、1chでの簡単なタスクなためか、今以上に全体画像のスケ...
ネットワークをそれなりに多層にすることで、位置を推定する...
ただ、画像を大きくした時の、CNNのパラメータ調整が難しく、...
計算コストを減らすか、トレードオフの関係でもあると思うの...
一定サイズ以上になった時には、この前高橋さんと話していた...
Data Augumentationに近いような処理を行った方がチューニン...
Data Augumentationにすると、順伝搬をウインドウ数分行わな...
精度は良くなりそうだとは思う。&br;
mnistの実験は、とりあえずこれで終了とし、2変量正規分布を...
***CPFF [#z7db458a]
#pre{{
Using gpu device 1: Tesla K20c
Start Data Load
Data Setting
Setting Layer
MNIST Digit
# nclass : 10 row : 50 col : 190 #
Training data : ndata 50000
Validation data : ndata 4000
Test data : ndata 8000
Parameters
eta : 0.01 epoch : 100 A : 0.9 batch_size : 100 #
### conv_layer ###
# kernel: (64, 5, 10) output_size: (64, 46, 46) act_fun...
# stride: [1, 4] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (7, 7) output_size: (64, 6, 6) ignore_border: Tru...
# stride: None padding: (0, 0) act_func: False dropo...
### Fully_Conected_Layer ###
# input: 2304 output: 1024 iniW: -0.01 - 0.01 act_func: ...
### Detector ###
# input: 1024 output: 2 iniWv: 0 - 0.1 iniWm: 0 - 0.5 dr...
iteration: 0 Lcost:0.638316 Vcost:0.638232
LM LMt VM VMt
1.088785 0.863158 1.091387 0.178947
1.066368 0.468421 1.051771 0.186842
1.037933 0.765789 1.100853 0.678947
1.016783 0.257895 1.104967 0.094737
1.092697 0.481579 1.083656 0.876316
1.082487 0.657895 1.086347 0.450000
1.085572 0.273684 1.073238 0.768421
1.100245 0.102632 1.044455 0.305263
1.054475 0.460526 1.021504 0.526316
1.060762 0.505263 1.056764 0.671053
LD LDt VD VDt
1.116750 0.458831 1.115213 0.397360
1.112590 0.435286 1.112191 0.429198
1.110032 0.507833 1.114866 0.397360
1.107090 0.458831 1.117343 0.410391
1.117641 0.416754 1.115578 0.464531
1.114394 0.410391 1.114200 0.441290
1.113884 0.447214 1.115022 0.481227
1.115337 0.390681 1.109247 0.470162
1.110113 0.453060 1.105942 0.502625
1.111299 0.435286 1.111610 0.453060
Start Training
iteration: 1 cost:0.051544 Vcost:0.016994 Tcost:0.017...
LM LMt VM VMt
0.817451 0.863158 0.239372 0.178947
0.463656 0.468421 0.212909 0.186842
0.785995 0.765789 0.551204 0.678947
0.205841 0.257895 0.177046 0.094737
0.441503 0.481579 0.767246 0.876316
0.587130 0.657895 0.422712 0.450000
0.227175 0.273684 0.761777 0.768421
0.176460 0.102632 0.292792 0.305263
0.458876 0.460526 0.535349 0.526316
0.484502 0.505263 0.635693 0.671053
LD LDt VD VDt
0.465369 0.458831 0.450528 0.397360
0.455594 0.435286 0.450492 0.429198
0.464592 0.507833 0.457257 0.397360
0.450902 0.458831 0.449514 0.410391
0.455266 0.416754 0.463825 0.464531
0.458410 0.410391 0.454330 0.441290
0.451572 0.447214 0.463533 0.481227
0.449678 0.390681 0.452349 0.470162
0.455085 0.453060 0.457177 0.502625
0.456998 0.435286 0.459788 0.453060
iteration: 2 cost:0.014841 Vcost:0.012630 Tcost:0.012...
LM LMt VM VMt
0.832215 0.863158 0.232702 0.178947
0.491838 0.468421 0.207856 0.186842
0.768027 0.765789 0.596443 0.678947
0.212602 0.257895 0.166379 0.094737
0.458102 0.481579 0.810389 0.876316
0.633016 0.657895 0.457057 0.450000
0.242228 0.273684 0.745048 0.768421
0.164894 0.102632 0.320214 0.305263
0.497079 0.460526 0.535488 0.526316
0.506410 0.505263 0.668718 0.671053
LD LDt VD VDt
0.463199 0.458831 0.448854 0.397360
0.454480 0.435286 0.449144 0.429198
0.461536 0.507833 0.455966 0.397360
0.450119 0.458831 0.447516 0.410391
0.453575 0.416754 0.462633 0.464531
0.457583 0.410391 0.453372 0.441290
0.451256 0.447214 0.460744 0.481227
0.447671 0.390681 0.452353 0.470162
0.454187 0.453060 0.455438 0.502625
0.455945 0.435286 0.458470 0.453060
iteration: 3 cost:0.012476 Vcost:0.011800 Tcost:0.012...
LM LMt VM VMt
0.817290 0.863158 0.210327 0.178947
0.490834 0.468421 0.196380 0.186842
0.769781 0.765789 0.604340 0.678947
0.203542 0.257895 0.146136 0.094737
0.447481 0.481579 0.808212 0.876316
0.634989 0.657895 0.458696 0.450000
0.240880 0.273684 0.737754 0.768421
0.145509 0.102632 0.324034 0.305263
0.497998 0.460526 0.524323 0.526316
0.505642 0.505263 0.663426 0.671053
LD LDt VD VDt
0.461606 0.458831 0.447823 0.397360
0.453984 0.435286 0.449054 0.429198
0.460669 0.507833 0.454935 0.397360
0.450103 0.458831 0.446409 0.410391
0.452708 0.416754 0.461088 0.464531
0.456671 0.410391 0.453132 0.441290
0.452247 0.447214 0.459705 0.481227
0.446659 0.390681 0.453322 0.470162
0.453619 0.453060 0.454895 0.502625
0.455943 0.435286 0.457477 0.453060
iteration: 4 cost:0.011382 Vcost:0.011312 Tcost:0.011...
LM LMt VM VMt
0.872712 0.863158 0.229669 0.178947
0.521001 0.468421 0.205925 0.186842
0.832814 0.765789 0.654381 0.678947
0.221069 0.257895 0.155442 0.094737
0.477190 0.481579 0.868027 0.876316
0.673053 0.657895 0.493721 0.450000
0.265581 0.273684 0.797358 0.768421
0.156500 0.102632 0.352508 0.305263
0.531631 0.460526 0.548008 0.526316
0.540611 0.505263 0.707297 0.671053
LD LDt VD VDt
0.461542 0.458831 0.447264 0.397360
0.453713 0.435286 0.448784 0.429198
0.460974 0.507833 0.454222 0.397360
0.450360 0.458831 0.445551 0.410391
0.452567 0.416754 0.460449 0.464531
0.456225 0.410391 0.453082 0.441290
0.453734 0.447214 0.459988 0.481227
0.445824 0.390681 0.454314 0.470162
0.453274 0.453060 0.455090 0.502625
0.456598 0.435286 0.457268 0.453060
iteration: 5 cost:0.010407 Vcost:0.012035 Tcost:0.012...
LM LMt VM VMt
0.882395 0.863158 0.236304 0.178947
0.523890 0.468421 0.205889 0.186842
0.845739 0.765789 0.673881 0.678947
0.226999 0.257895 0.153608 0.094737
0.485012 0.481579 0.884085 0.876316
0.683599 0.657895 0.505439 0.450000
0.274344 0.273684 0.814298 0.768421
0.158487 0.102632 0.359355 0.305263
0.547707 0.460526 0.558236 0.526316
0.550193 0.505263 0.714859 0.671053
LD LDt VD VDt
0.460513 0.458831 0.446458 0.397360
0.452947 0.435286 0.448317 0.429198
0.460491 0.507833 0.452832 0.397360
0.450553 0.458831 0.444434 0.410391
0.452038 0.416754 0.458864 0.464531
0.455308 0.410391 0.452755 0.441290
0.454968 0.447214 0.459301 0.481227
0.444715 0.390681 0.455002 0.470162
0.452585 0.453060 0.455383 0.502625
0.456899 0.435286 0.456342 0.453060
iteration: 10 cost:0.007367 Vcost:0.007094 Tcost:0.007...
LM LMt VM VMt
0.862944 0.863158 0.200204 0.178947
0.492438 0.468421 0.188288 0.186842
0.806921 0.765789 0.658852 0.678947
0.229416 0.257895 0.122352 0.094737
0.459030 0.481579 0.857092 0.876316
0.661931 0.657895 0.484726 0.450000
0.282941 0.273684 0.801758 0.768421
0.124560 0.102632 0.342446 0.305263
0.518038 0.460526 0.517128 0.526316
0.529132 0.505263 0.674977 0.671053
LD LDt VD VDt
0.458986 0.458831 0.438085 0.397360
0.448412 0.435286 0.446427 0.429198
0.463961 0.507833 0.440421 0.397360
0.451597 0.458831 0.435949 0.410391
0.447556 0.416754 0.449675 0.464531
0.449183 0.410391 0.451965 0.441290
0.465109 0.447214 0.460839 0.481227
0.434843 0.390681 0.459506 0.470162
0.446714 0.453060 0.459799 0.502625
0.460803 0.435286 0.452629 0.453060
iteration: 20 cost:0.002925 Vcost:0.003003 Tcost:0.003...
LM LMt VM VMt
0.863975 0.863158 0.177166 0.178947
0.487234 0.468421 0.173951 0.186842
0.774518 0.765789 0.629182 0.678947
0.234554 0.257895 0.096713 0.094737
0.452910 0.481579 0.831157 0.876316
0.655221 0.657895 0.477218 0.450000
0.273442 0.273684 0.790471 0.768421
0.095618 0.102632 0.315850 0.305263
0.478824 0.460526 0.519243 0.526316
0.519309 0.505263 0.649067 0.671053
LD LDt VD VDt
0.471299 0.458831 0.413012 0.397360
0.432591 0.435286 0.440011 0.429198
0.500618 0.507833 0.407332 0.397360
0.455082 0.458831 0.414791 0.410391
0.427800 0.416754 0.441535 0.464531
0.426869 0.410391 0.441588 0.441290
0.476591 0.447214 0.482610 0.481227
0.410235 0.390681 0.465195 0.470162
0.435163 0.453060 0.479140 0.502625
0.466293 0.435286 0.444625 0.453060
iteration: 30 cost:0.001995 Vcost:0.002625 Tcost:0.002...
LM LMt VM VMt
0.890389 0.863158 0.185413 0.178947
0.505980 0.468421 0.185872 0.186842
0.798022 0.765789 0.670670 0.678947
0.246426 0.257895 0.095492 0.094737
0.479085 0.481579 0.867871 0.876316
0.684295 0.657895 0.491515 0.450000
0.285745 0.273684 0.809998 0.768421
0.098159 0.102632 0.322674 0.305263
0.482039 0.460526 0.539919 0.526316
0.540643 0.505263 0.672543 0.671053
LD LDt VD VDt
0.465227 0.458831 0.406051 0.397360
0.427707 0.435286 0.435217 0.429198
0.504554 0.507833 0.400203 0.397360
0.459286 0.458831 0.412662 0.410391
0.420436 0.416754 0.439101 0.464531
0.421076 0.410391 0.436268 0.441290
0.465195 0.447214 0.484084 0.481227
0.405617 0.390681 0.465215 0.470162
0.439409 0.453060 0.490357 0.502625
0.458151 0.435286 0.446230 0.453060
iteration: 40 cost:0.001590 Vcost:0.001771 Tcost:0.001...
LM LMt VM VMt
0.870551 0.863158 0.175144 0.178947
0.493758 0.468421 0.181546 0.186842
0.778835 0.765789 0.664495 0.678947
0.241992 0.257895 0.083099 0.094737
0.472483 0.481579 0.858398 0.876316
0.669725 0.657895 0.475508 0.450000
0.280168 0.273684 0.789013 0.768421
0.091388 0.102632 0.313769 0.305263
0.471269 0.460526 0.528317 0.526316
0.533632 0.505263 0.656426 0.671053
LD LDt VD VDt
0.462689 0.458831 0.403667 0.397360
0.427738 0.435286 0.434588 0.429198
0.504029 0.507833 0.398466 0.397360
0.464422 0.458831 0.410992 0.410391
0.419313 0.416754 0.441762 0.464531
0.420953 0.410391 0.436597 0.441290
0.460763 0.447214 0.485641 0.481227
0.402704 0.390681 0.466761 0.470162
0.444406 0.453060 0.497835 0.502625
0.454277 0.435286 0.450003 0.453060
iteration: 50 cost:0.001384 Vcost:0.001603 Tcost:0.001...
LM LMt VM VMt
0.876258 0.863158 0.174308 0.178947
0.492385 0.468421 0.182692 0.186842
0.781252 0.765789 0.671736 0.678947
0.244184 0.257895 0.081907 0.094737
0.475271 0.481579 0.867324 0.876316
0.667267 0.657895 0.474654 0.450000
0.279834 0.273684 0.786507 0.768421
0.092563 0.102632 0.313712 0.305263
0.472879 0.460526 0.526979 0.526316
0.532883 0.505263 0.661011 0.671053
LD LDt VD VDt
0.461297 0.458831 0.401834 0.397360
0.427714 0.435286 0.434718 0.429198
0.503758 0.507833 0.397844 0.397360
0.466148 0.458831 0.409250 0.410391
0.418737 0.416754 0.444326 0.464531
0.420942 0.410391 0.436644 0.441290
0.457303 0.447214 0.485682 0.481227
0.400626 0.390681 0.467190 0.470162
0.445965 0.453060 0.500359 0.502625
0.452207 0.435286 0.452692 0.453060
iteration: 60 cost:0.001259 Vcost:0.001532 Tcost:0.001...
LM LMt VM VMt
0.854733 0.863158 0.167076 0.178947
0.476346 0.468421 0.175120 0.186842
0.765924 0.765789 0.660638 0.678947
0.239419 0.257895 0.077437 0.094737
0.463912 0.481579 0.849572 0.876316
0.650628 0.657895 0.460322 0.450000
0.273168 0.273684 0.766209 0.768421
0.090851 0.102632 0.304811 0.305263
0.463164 0.460526 0.515567 0.526316
0.519778 0.505263 0.648621 0.671053
LD LDt VD VDt
0.462136 0.458831 0.402547 0.397360
0.429154 0.435286 0.436427 0.429198
0.505706 0.507833 0.399017 0.397360
0.468267 0.458831 0.409527 0.410391
0.420041 0.416754 0.447543 0.464531
0.422209 0.410391 0.438857 0.441290
0.456809 0.447214 0.487231 0.481227
0.400951 0.390681 0.469805 0.470162
0.448038 0.453060 0.503096 0.502625
0.453376 0.435286 0.456473 0.453060
iteration: 70 cost:0.001090 Vcost:0.001311 Tcost:0.001...
LM LMt VM VMt
0.859520 0.863158 0.170653 0.178947
0.481209 0.468421 0.179067 0.186842
0.772702 0.765789 0.667583 0.678947
0.245612 0.257895 0.080131 0.094737
0.470089 0.481579 0.855657 0.876316
0.652654 0.657895 0.465042 0.450000
0.278514 0.273684 0.770045 0.768421
0.093909 0.102632 0.309584 0.305263
0.468268 0.460526 0.520348 0.526316
0.525783 0.505263 0.655221 0.671053
LD LDt VD VDt
0.461926 0.458831 0.401656 0.397360
0.429075 0.435286 0.436016 0.429198
0.506131 0.507833 0.399055 0.397360
0.468668 0.458831 0.408529 0.410391
0.420194 0.416754 0.449375 0.464531
0.421894 0.410391 0.439705 0.441290
0.455203 0.447214 0.487721 0.481227
0.400146 0.390681 0.470818 0.470162
0.448439 0.453060 0.504053 0.502625
0.453122 0.435286 0.458012 0.453060
iteration: 80 cost:0.001029 Vcost:0.001260 Tcost:0.001...
LM LMt VM VMt
0.867204 0.863158 0.173032 0.178947
0.488087 0.468421 0.177769 0.186842
0.779858 0.765789 0.683897 0.678947
0.247270 0.257895 0.080068 0.094737
0.479009 0.481579 0.867006 0.876316
0.664368 0.657895 0.469769 0.450000
0.278536 0.273684 0.775320 0.768421
0.095258 0.102632 0.310037 0.305263
0.474685 0.460526 0.526659 0.526316
0.533416 0.505263 0.664895 0.671053
LD LDt VD VDt
0.460286 0.458831 0.399545 0.397360
0.427185 0.435286 0.433868 0.429198
0.505042 0.507833 0.398479 0.397360
0.466955 0.458831 0.406517 0.410391
0.418688 0.416754 0.449603 0.464531
0.420547 0.410391 0.438466 0.441290
0.452112 0.447214 0.486321 0.481227
0.398222 0.390681 0.469415 0.470162
0.446962 0.453060 0.502888 0.502625
0.451510 0.435286 0.458001 0.453060
iteration: 90 cost:0.000946 Vcost:0.001266 Tcost:0.001...
LM LMt VM VMt
0.869317 0.863158 0.173933 0.178947
0.489073 0.468421 0.178717 0.186842
0.784026 0.765789 0.689513 0.678947
0.248380 0.257895 0.080497 0.094737
0.480616 0.481579 0.870000 0.876316
0.663071 0.657895 0.468814 0.450000
0.278482 0.273684 0.776753 0.768421
0.097024 0.102632 0.310125 0.305263
0.474463 0.460526 0.528465 0.526316
0.533240 0.505263 0.664385 0.671053
LD LDt VD VDt
0.459101 0.458831 0.398005 0.397360
0.425859 0.435286 0.432315 0.429198
0.503973 0.507833 0.398223 0.397360
0.465645 0.458831 0.405022 0.410391
0.417757 0.416754 0.449655 0.464531
0.419408 0.410391 0.437818 0.441290
0.450148 0.447214 0.485468 0.481227
0.396809 0.390681 0.468617 0.470162
0.446352 0.453060 0.501935 0.502625
0.450076 0.435286 0.457894 0.453060
iteration: 100 cost:0.000941 Vcost:0.001482 Tcost:0.001...
LM LMt VM VMt
0.875343 0.863158 0.179221 0.178947
0.494845 0.468421 0.183210 0.186842
0.790028 0.765789 0.697695 0.678947
0.253812 0.257895 0.085618 0.094737
0.488194 0.481579 0.875626 0.876316
0.669335 0.657895 0.474482 0.450000
0.284035 0.273684 0.781986 0.768421
0.102401 0.102632 0.316504 0.305263
0.479806 0.460526 0.535061 0.526316
0.538886 0.505263 0.669535 0.671053
LD LDt VD VDt
0.460551 0.458831 0.398612 0.397360
0.426896 0.435286 0.433007 0.429198
0.505774 0.507833 0.399831 0.397360
0.466348 0.458831 0.405660 0.410391
0.418963 0.416754 0.451745 0.464531
0.420536 0.410391 0.439220 0.441290
0.450504 0.447214 0.486905 0.481227
0.397562 0.390681 0.469949 0.470162
0.447840 0.453060 0.503249 0.502625
0.451090 0.435286 0.460036 0.453060
TM TMt
0.524321 0.510526
0.159701 0.160526
0.272685 0.231579
0.503283 0.500000
0.364345 0.355263
0.264702 0.250000
0.600120 0.589474
0.835771 0.821053
0.547304 0.523684
0.585145 0.573684
TD TDt
0.399208 0.410391
0.437315 0.441290
0.387712 0.383886
0.497240 0.492042
0.404018 0.390681
0.476434 0.464531
0.425538 0.410391
0.442095 0.447214
0.506913 0.486664
0.480815 0.481227
real 88m2.923s
user 75m3.192s
sys 12m20.792s
}}
***CPCPFF [#m8ef83dd]
#pre{{
Start Data Load
Data Setting
Setting Layer
MNIST Digit
# nclass : 10 row : 50 col : 190 #
Training data : ndata 50000
Validation data : ndata 4000
Test data : ndata 8000
Parameters
eta : 0.01 epoch : 100 A : 0.9 batch_size : 100 #
### conv_layer ###
# kernel: (64, 5, 10) output_size: (64, 46, 46) act_fun...
# stride: [1, 4] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (3, 3) output_size: (64, 15, 15) ignore_border: T...
# stride: None padding: (0, 0) act_func: False dropo...
### conv_layer ###
# kernel: (64, 3, 3) output_size: (64, 13, 13) act_func...
# stride: [1, 1] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (2, 2) output_size: (64, 6, 6) ignore_border: Tru...
# stride: None padding: (0, 0) act_func: False dropo...
### Fully_Conected_Layer ###
# input: 2304 output: 1024 iniW: -0.01 - 0.01 act_func: ...
### Detector ###
# input: 1024 output: 2 iniWv: 0 - 0.5 iniWm: 0 - 0.5 dr...
iteration: 0 Lcost:0.534293 Vcost:0.535034
LM LMt VM VMt
0.107155 0.373684 0.112243 0.236842
0.110176 0.207895 0.107448 0.171053
0.111526 0.600000 0.117185 0.100000
0.113372 0.736842 0.110775 0.742105
0.116691 0.178947 0.114692 0.771053
0.114439 0.410526 0.114562 0.607895
0.109291 0.200000 0.109881 0.526316
0.109529 0.515789 0.112987 0.184211
0.111544 0.447368 0.116134 0.684211
0.116090 0.747368 0.110148 0.536842
LD LDt VD VDt
1.050681 0.470162 1.053379 0.423022
1.053066 0.497361 1.051614 0.497361
1.052401 0.458831 1.054873 0.397360
1.054526 0.435286 1.052726 0.470162
1.055780 0.383886 1.054551 0.416754
1.053769 0.410391 1.055227 0.390681
1.052894 0.481227 1.051164 0.502625
1.051879 0.492042 1.053778 0.458831
1.052243 0.502625 1.055772 0.410391
1.053913 0.481227 1.052286 0.458831
Start Training
iteration: 1 cost:0.066117 Vcost:0.012392 Tcost:0.012...
LM LMt VM VMt
0.385399 0.373684 0.204387 0.236842
0.217259 0.207895 0.199606 0.171053
0.574232 0.600000 0.280932 0.100000
0.770826 0.736842 0.833605 0.742105
0.249189 0.178947 0.822425 0.771053
0.406295 0.410526 0.543595 0.607895
0.203355 0.200000 0.551702 0.526316
0.505569 0.515789 0.194008 0.184211
0.449516 0.447368 0.646052 0.684211
0.849912 0.747368 0.529295 0.536842
LD LDt VD VDt
0.465930 0.470162 0.438081 0.423022
0.449304 0.497361 0.445002 0.497361
0.457849 0.458831 0.425630 0.397360
0.470709 0.435286 0.479452 0.470162
0.424646 0.383886 0.477645 0.416754
0.443319 0.410391 0.447820 0.390681
0.445279 0.481227 0.467334 0.502625
0.463464 0.492042 0.441743 0.458831
0.465380 0.502625 0.456215 0.410391
0.482052 0.481227 0.458113 0.458831
iteration: 2 cost:0.009962 Vcost:0.006175 Tcost:0.006...
LM LMt VM VMt
0.383446 0.373684 0.216834 0.236842
0.221780 0.207895 0.191453 0.171053
0.591931 0.600000 0.218681 0.100000
0.754796 0.736842 0.791729 0.742105
0.215581 0.178947 0.836862 0.771053
0.390622 0.410526 0.572698 0.607895
0.206353 0.200000 0.543054 0.526316
0.503614 0.515789 0.191794 0.184211
0.438295 0.447368 0.672587 0.684211
0.800642 0.747368 0.524709 0.536842
LD LDt VD VDt
0.477248 0.470162 0.444825 0.423022
0.472716 0.497361 0.463993 0.497361
0.459276 0.458831 0.407708 0.397360
0.452718 0.435286 0.470095 0.470162
0.408878 0.383886 0.457130 0.416754
0.429704 0.410391 0.433260 0.390681
0.463489 0.481227 0.480169 0.502625
0.475201 0.492042 0.459242 0.458831
0.479048 0.502625 0.439026 0.410391
0.474113 0.481227 0.459342 0.458831
iteration: 3 cost:0.005177 Vcost:0.003889 Tcost:0.003...
LM LMt VM VMt
0.383038 0.373684 0.229748 0.236842
0.220738 0.207895 0.180477 0.171053
0.604364 0.600000 0.181099 0.100000
0.771079 0.736842 0.806513 0.742105
0.212745 0.178947 0.842741 0.771053
0.403910 0.410526 0.593851 0.607895
0.204420 0.200000 0.547172 0.526316
0.509698 0.515789 0.186032 0.184211
0.447628 0.447368 0.697776 0.684211
0.809341 0.747368 0.530188 0.536842
LD LDt VD VDt
0.477658 0.470162 0.442080 0.423022
0.485906 0.497361 0.474448 0.497361
0.455810 0.458831 0.394292 0.397360
0.446036 0.435286 0.477671 0.470162
0.395706 0.383886 0.444179 0.416754
0.417166 0.410391 0.417111 0.390681
0.471257 0.481227 0.489637 0.502625
0.482523 0.492042 0.468065 0.458831
0.491250 0.502625 0.425370 0.410391
0.484682 0.481227 0.457823 0.458831
iteration: 4 cost:0.003217 Vcost:0.002651 Tcost:0.002...
LM LMt VM VMt
0.379911 0.373684 0.240166 0.236842
0.217018 0.207895 0.174845 0.171053
0.605973 0.600000 0.157626 0.100000
0.766774 0.736842 0.801737 0.742105
0.210226 0.178947 0.831297 0.771053
0.405800 0.410526 0.598356 0.607895
0.202709 0.200000 0.540935 0.526316
0.507294 0.515789 0.182965 0.184211
0.447941 0.447368 0.698774 0.684211
0.803678 0.747368 0.531435 0.536842
LD LDt VD VDt
0.478037 0.470162 0.439164 0.423022
0.493306 0.497361 0.483261 0.497361
0.452204 0.458831 0.388443 0.397360
0.442523 0.435286 0.485685 0.470162
0.388710 0.383886 0.436509 0.416754
0.411082 0.410391 0.405980 0.390681
0.476264 0.481227 0.495186 0.502625
0.487692 0.492042 0.475170 0.458831
0.501362 0.502625 0.415867 0.410391
0.494994 0.481227 0.458244 0.458831
iteration: 5 cost:0.002231 Vcost:0.001919 Tcost:0.001...
LM LMt VM VMt
0.376834 0.373684 0.245414 0.236842
0.210985 0.207895 0.170275 0.171053
0.606965 0.600000 0.138695 0.100000
0.762363 0.736842 0.790943 0.742105
0.202794 0.178947 0.818572 0.771053
0.406218 0.410526 0.598052 0.607895
0.197799 0.200000 0.536813 0.526316
0.505192 0.515789 0.179237 0.184211
0.446774 0.447368 0.697654 0.684211
0.791759 0.747368 0.531748 0.536842
LD LDt VD VDt
0.477503 0.470162 0.436742 0.423022
0.495999 0.497361 0.488936 0.497361
0.449708 0.458831 0.386454 0.397360
0.439697 0.435286 0.488635 0.470162
0.385205 0.383886 0.430823 0.416754
0.408932 0.410391 0.399169 0.390681
0.478573 0.481227 0.497803 0.502625
0.490399 0.492042 0.478871 0.458831
0.507567 0.502625 0.409660 0.410391
0.498277 0.481227 0.459226 0.458831
iteration: 10 cost:0.000916 Vcost:0.000830 Tcost:0.000...
LM LMt VM VMt
0.369173 0.373684 0.245649 0.236842
0.201966 0.207895 0.166389 0.171053
0.602704 0.600000 0.110018 0.100000
0.745743 0.736842 0.758488 0.742105
0.184831 0.178947 0.798404 0.771053
0.402028 0.410526 0.592500 0.607895
0.192152 0.200000 0.528077 0.526316
0.507203 0.515789 0.177186 0.184211
0.443982 0.447368 0.685696 0.684211
0.761583 0.747368 0.534731 0.536842
LD LDt VD VDt
0.479519 0.470162 0.429847 0.423022
0.496258 0.497361 0.498504 0.497361
0.450238 0.458831 0.388763 0.397360
0.432674 0.435286 0.486897 0.470162
0.381342 0.383886 0.419478 0.416754
0.410131 0.410391 0.391972 0.390681
0.481267 0.481227 0.501794 0.502625
0.493607 0.492042 0.482543 0.458831
0.513758 0.502625 0.401103 0.410391
0.495653 0.481227 0.462699 0.458831
iteration: 20 cost:0.000438 Vcost:0.000420 Tcost:0.000...
LM LMt VM VMt
0.365755 0.373684 0.236581 0.236842
0.203656 0.207895 0.168169 0.171053
0.604458 0.600000 0.100427 0.100000
0.746382 0.736842 0.751151 0.742105
0.181697 0.178947 0.803541 0.771053
0.404523 0.410526 0.597457 0.607895
0.195312 0.200000 0.522271 0.526316
0.510889 0.515789 0.175728 0.184211
0.448917 0.447368 0.689203 0.684211
0.758088 0.747368 0.537319 0.536842
LD LDt VD VDt
0.482074 0.470162 0.425064 0.423022
0.490134 0.497361 0.497027 0.497361
0.452976 0.458831 0.391025 0.397360
0.430833 0.435286 0.481797 0.470162
0.378988 0.383886 0.414446 0.416754
0.408826 0.410391 0.391751 0.390681
0.479430 0.481227 0.501998 0.502625
0.492852 0.492042 0.478170 0.458831
0.509543 0.502625 0.400387 0.410391
0.488633 0.481227 0.461877 0.458831
iteration: 30 cost:0.000318 Vcost:0.000312 Tcost:0.000...
LM LMt VM VMt
0.368525 0.373684 0.236667 0.236842
0.209256 0.207895 0.172238 0.171053
0.607276 0.600000 0.099941 0.100000
0.745044 0.736842 0.747233 0.742105
0.181395 0.178947 0.798713 0.771053
0.408187 0.410526 0.602031 0.607895
0.198994 0.200000 0.522433 0.526316
0.517008 0.515789 0.177140 0.184211
0.453699 0.447368 0.690975 0.684211
0.754785 0.747368 0.539653 0.536842
LD LDt VD VDt
0.484090 0.470162 0.424078 0.423022
0.488894 0.497361 0.496845 0.497361
0.454151 0.458831 0.392170 0.397360
0.431942 0.435286 0.479797 0.470162
0.378411 0.383886 0.412639 0.416754
0.408240 0.410391 0.392456 0.390681
0.478446 0.481227 0.503676 0.502625
0.494990 0.492042 0.476556 0.458831
0.510137 0.502625 0.401455 0.410391
0.486560 0.481227 0.462410 0.458831
iteration: 40 cost:0.000263 Vcost:0.000258 Tcost:0.000...
LM LMt VM VMt
0.367054 0.373684 0.235392 0.236842
0.209217 0.207895 0.171412 0.171053
0.603519 0.600000 0.098626 0.100000
0.740709 0.736842 0.740217 0.742105
0.179576 0.178947 0.791683 0.771053
0.407239 0.410526 0.600252 0.607895
0.199336 0.200000 0.518886 0.526316
0.515219 0.515789 0.175736 0.184211
0.449732 0.447368 0.687024 0.684211
0.748579 0.747368 0.535993 0.536842
LD LDt VD VDt
0.484062 0.470162 0.423927 0.423022
0.488685 0.497361 0.496395 0.497361
0.453732 0.458831 0.392965 0.397360
0.432653 0.435286 0.478636 0.470162
0.378363 0.383886 0.411828 0.416754
0.407509 0.410391 0.392063 0.390681
0.478157 0.481227 0.502805 0.502625
0.494530 0.492042 0.475284 0.458831
0.509187 0.502625 0.402089 0.410391
0.485661 0.481227 0.461590 0.458831
iteration: 50 cost:0.000232 Vcost:0.000224 Tcost:0.000...
LM LMt VM VMt
0.367346 0.373684 0.235653 0.236842
0.209654 0.207895 0.171722 0.171053
0.604618 0.600000 0.099006 0.100000
0.743582 0.736842 0.744392 0.742105
0.178933 0.178947 0.791612 0.771053
0.408166 0.410526 0.602023 0.607895
0.199570 0.200000 0.520355 0.526316
0.516361 0.515789 0.176643 0.184211
0.449575 0.447368 0.688787 0.684211
0.752213 0.747368 0.536243 0.536842
LD LDt VD VDt
0.483705 0.470162 0.424064 0.423022
0.488929 0.497361 0.496503 0.497361
0.454274 0.458831 0.393785 0.397360
0.434048 0.435286 0.478984 0.470162
0.378421 0.383886 0.412202 0.416754
0.407249 0.410391 0.392203 0.390681
0.478246 0.481227 0.502693 0.502625
0.494766 0.492042 0.474781 0.458831
0.509062 0.502625 0.403209 0.410391
0.486368 0.481227 0.461834 0.458831
iteration: 60 cost:0.000210 Vcost:0.000205 Tcost:0.000...
LM LMt VM VMt
0.366058 0.373684 0.235057 0.236842
0.208510 0.207895 0.170865 0.171053
0.602064 0.600000 0.098755 0.100000
0.742149 0.736842 0.742560 0.742105
0.177733 0.178947 0.789410 0.771053
0.407253 0.410526 0.601609 0.607895
0.199376 0.200000 0.519358 0.526316
0.515446 0.515789 0.176571 0.184211
0.447728 0.447368 0.687723 0.684211
0.750639 0.747368 0.534266 0.536842
LD LDt VD VDt
0.482640 0.470162 0.423653 0.423022
0.488271 0.497361 0.495709 0.497361
0.453780 0.458831 0.393898 0.397360
0.434582 0.435286 0.478282 0.470162
0.378029 0.383886 0.412282 0.416754
0.406536 0.410391 0.391785 0.390681
0.477663 0.481227 0.501770 0.502625
0.494150 0.492042 0.473625 0.458831
0.508028 0.502625 0.403545 0.410391
0.486331 0.481227 0.461154 0.458831
iteration: 70 cost:0.000192 Vcost:0.000189 Tcost:0.000...
LM LMt VM VMt
0.366551 0.373684 0.235460 0.236842
0.209194 0.207895 0.171263 0.171053
0.602385 0.600000 0.098299 0.100000
0.740920 0.736842 0.740973 0.742105
0.176912 0.178947 0.785770 0.771053
0.407912 0.410526 0.602037 0.607895
0.199937 0.200000 0.519677 0.526316
0.515620 0.515789 0.177606 0.184211
0.448260 0.447368 0.687646 0.684211
0.748277 0.747368 0.534288 0.536842
LD LDt VD VDt
0.482442 0.470162 0.423972 0.423022
0.488732 0.497361 0.495760 0.497361
0.454396 0.458831 0.394567 0.397360
0.435656 0.435286 0.477990 0.470162
0.378217 0.383886 0.412567 0.416754
0.406743 0.410391 0.392037 0.390681
0.477821 0.481227 0.501831 0.502625
0.494534 0.492042 0.473336 0.458831
0.508283 0.502625 0.404500 0.410391
0.486492 0.481227 0.461490 0.458831
iteration: 80 cost:0.000179 Vcost:0.000176 Tcost:0.000...
LM LMt VM VMt
0.367097 0.373684 0.235862 0.236842
0.208833 0.207895 0.170683 0.171053
0.602723 0.600000 0.098402 0.100000
0.741796 0.736842 0.743590 0.742105
0.177261 0.178947 0.785572 0.771053
0.408356 0.410526 0.602654 0.607895
0.199423 0.200000 0.520444 0.526316
0.516455 0.515789 0.177881 0.184211
0.448164 0.447368 0.687853 0.684211
0.750466 0.747368 0.534466 0.536842
LD LDt VD VDt
0.482320 0.470162 0.424270 0.423022
0.489234 0.497361 0.495827 0.497361
0.454468 0.458831 0.395204 0.397360
0.436486 0.435286 0.477985 0.470162
0.378481 0.383886 0.413047 0.416754
0.406856 0.410391 0.392030 0.390681
0.477929 0.481227 0.501519 0.502625
0.494597 0.492042 0.473069 0.458831
0.508128 0.502625 0.405127 0.410391
0.486929 0.481227 0.461416 0.458831
iteration: 90 cost:0.000169 Vcost:0.000166 Tcost:0.000...
LM LMt VM VMt
0.366988 0.373684 0.236175 0.236842
0.208779 0.207895 0.170821 0.171053
0.602531 0.600000 0.098847 0.100000
0.740340 0.736842 0.742411 0.742105
0.177404 0.178947 0.783984 0.771053
0.409128 0.410526 0.603074 0.607895
0.199686 0.200000 0.520541 0.526316
0.516704 0.515789 0.178554 0.184211
0.448392 0.447368 0.687279 0.684211
0.749017 0.747368 0.534648 0.536842
LD LDt VD VDt
0.481418 0.470162 0.423920 0.423022
0.488865 0.497361 0.495262 0.497361
0.453951 0.458831 0.395242 0.397360
0.436351 0.435286 0.476913 0.470162
0.378167 0.383886 0.412811 0.416754
0.406544 0.410391 0.391529 0.390681
0.477354 0.481227 0.500639 0.502625
0.494082 0.492042 0.472009 0.458831
0.507442 0.502625 0.405065 0.410391
0.486284 0.481227 0.460876 0.458831
iteration: 100 cost:0.000160 Vcost:0.000166 Tcost:0.000...
LM LMt VM VMt
0.369301 0.373684 0.238464 0.236842
0.211108 0.207895 0.173110 0.171053
0.604930 0.600000 0.100630 0.100000
0.742970 0.736842 0.745455 0.742105
0.179242 0.178947 0.785821 0.771053
0.411218 0.410526 0.605378 0.607895
0.202172 0.200000 0.523012 0.526316
0.518761 0.515789 0.181217 0.184211
0.451301 0.447368 0.689549 0.684211
0.752027 0.747368 0.536521 0.536842
LD LDt VD VDt
0.481579 0.470162 0.424403 0.423022
0.489570 0.497361 0.495860 0.497361
0.454504 0.458831 0.395883 0.397360
0.436988 0.435286 0.476772 0.470162
0.378446 0.383886 0.413225 0.416754
0.406999 0.410391 0.391708 0.390681
0.477788 0.481227 0.501076 0.502625
0.494758 0.492042 0.472035 0.458831
0.508106 0.502625 0.405687 0.410391
0.486670 0.481227 0.461307 0.458831
TM TMt
0.439529 0.436842
0.642913 0.639474
0.772218 0.768421
0.184144 0.184211
0.168227 0.157895
0.326834 0.328947
0.306608 0.307895
0.626106 0.618421
0.640100 0.642105
0.874542 0.873684
TD TDt
0.511883 0.512989
0.401670 0.403928
0.494831 0.502625
0.411236 0.410391
0.504640 0.512989
0.469669 0.475727
0.469352 0.464531
0.406509 0.403928
0.411623 0.410391
0.492071 0.481227
real 94m54.800s
user 79m21.916s
sys 14m48.856s
}}
**全体の幅285、高さ50の場合 [#kf6e283f]
#pre{{
Start Data Load
Data Setting
Setting Layer
MNIST Digit
# nclass : 10 row : 50 col : 285 #
Training data : ndata 50000
Validation data : ndata 4000
Test data : ndata 8000
Parameters
eta : 0.01 epoch : 100 A : 0.9 batch_size : 100 #
### conv_layer ###
# kernel: (64, 5, 15) output_size: (64, 46, 46) act_fun...
# stride: [1, 6] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (3, 3) output_size: (64, 15, 15) ignore_border: T...
# stride: None padding: (0, 0) act_func: False dropo...
### conv_layer ###
# kernel: (64, 3, 3) output_size: (64, 13, 13) act_func...
# stride: [1, 1] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (2, 2) output_size: (64, 6, 6) ignore_border: Tru...
# stride: None padding: (0, 0) act_func: False dropo...
### Fully_Conected_Layer ###
# input: 2304 output: 1024 iniW: -0.01 - 0.01 act_func: ...
### Detector ###
# input: 1024 output: 2 iniWv: 0 - 0.5 iniWm: 0 - 0.5 dr...
iteration: 0 Lcost:0.712819 Vcost:0.712262
LM LMt VM VMt
0.119311 0.080702 0.118604 0.512281
0.122844 0.861404 0.118067 0.342105
0.115383 0.815789 0.119438 0.384211
0.119259 0.407018 0.117567 0.387719
0.121355 0.089474 0.122917 0.340351
0.116543 0.807018 0.122672 0.356140
0.119233 0.303509 0.114185 0.550877
0.122478 0.178947 0.119092 0.124561
0.125327 0.887719 0.114498 0.142105
0.121215 0.098246 0.115548 0.719298
LD LDt VD VDt
1.059973 0.345396 1.060063 0.345396
1.061560 0.318990 1.058241 0.340279
1.058228 0.414644 1.059846 0.329806
1.058074 0.313442 1.058442 0.379288
1.060147 0.388429 1.061110 0.313442
1.058281 0.410391 1.060452 0.329806
1.058248 0.318990 1.056417 0.418854
1.062828 0.355409 1.058366 0.397360
1.061586 0.355409 1.056614 0.379288
1.060555 0.365148 1.057548 0.374634
Start Training
iteration: 1 cost:0.124232 Vcost:0.023372 Tcost:0.022...
LM LMt VM VMt
0.153680 0.080702 0.500693 0.512281
0.768619 0.861404 0.336452 0.342105
0.931429 0.815789 0.349253 0.384211
0.406636 0.407018 0.371415 0.387719
0.133984 0.089474 0.357110 0.340351
0.854853 0.807018 0.304380 0.356140
0.310934 0.303509 0.555906 0.550877
0.165277 0.178947 0.135206 0.124561
0.824841 0.887719 0.146835 0.142105
0.134991 0.098246 0.694764 0.719298
LD LDt VD VDt
0.347334 0.345396 0.370154 0.345396
0.394268 0.318990 0.364141 0.340279
0.409865 0.414644 0.363356 0.329806
0.362555 0.313442 0.376474 0.379288
0.349830 0.388429 0.360611 0.313442
0.401141 0.410391 0.360938 0.329806
0.360469 0.318990 0.385414 0.418854
0.359914 0.355409 0.353999 0.397360
0.400006 0.355409 0.356954 0.379288
0.349693 0.365148 0.383936 0.374634
iteration: 2 cost:0.016417 Vcost:0.009285 Tcost:0.009...
LM LMt VM VMt
0.092214 0.080702 0.494959 0.512281
0.864403 0.861404 0.341210 0.342105
0.871225 0.815789 0.347276 0.384211
0.390239 0.407018 0.378966 0.387719
0.100980 0.089474 0.353169 0.340351
0.822190 0.807018 0.310617 0.356140
0.323317 0.303509 0.553160 0.550877
0.167782 0.178947 0.125902 0.124561
0.888168 0.887719 0.132919 0.142105
0.101684 0.098246 0.690694 0.719298
LD LDt VD VDt
0.343272 0.345396 0.358965 0.345396
0.376414 0.318990 0.354385 0.340279
0.388519 0.414644 0.354696 0.329806
0.346712 0.313442 0.382817 0.379288
0.357680 0.388429 0.344859 0.313442
0.378544 0.410391 0.350594 0.329806
0.347443 0.318990 0.405343 0.418854
0.369293 0.355409 0.367636 0.397360
0.380164 0.355409 0.369378 0.379288
0.353657 0.365148 0.375821 0.374634
iteration: 3 cost:0.008920 Vcost:0.004448 Tcost:0.004...
LM LMt VM VMt
0.089928 0.080702 0.501690 0.512281
0.871110 0.861404 0.336237 0.342105
0.863116 0.815789 0.361102 0.384211
0.389940 0.407018 0.380128 0.387719
0.093307 0.089474 0.354247 0.340351
0.820133 0.807018 0.322298 0.356140
0.326629 0.303509 0.543323 0.550877
0.162525 0.178947 0.116501 0.124561
0.926949 0.887719 0.124404 0.142105
0.096042 0.098246 0.707885 0.719298
LD LDt VD VDt
0.342414 0.345396 0.348925 0.345396
0.362065 0.318990 0.343006 0.340279
0.396631 0.414644 0.346316 0.329806
0.334558 0.313442 0.384915 0.379288
0.364573 0.388429 0.332271 0.313442
0.379850 0.410391 0.340432 0.329806
0.334022 0.318990 0.416908 0.418854
0.369348 0.355409 0.377282 0.397360
0.370745 0.355409 0.377342 0.379288
0.356643 0.365148 0.383133 0.374634
iteration: 4 cost:0.003790 Vcost:0.002997 Tcost:0.003...
LM LMt VM VMt
0.091467 0.080702 0.522886 0.512281
0.886552 0.861404 0.343852 0.342105
0.882613 0.815789 0.375352 0.384211
0.403012 0.407018 0.394336 0.387719
0.092938 0.089474 0.354808 0.340351
0.841430 0.807018 0.335765 0.356140
0.327743 0.303509 0.555279 0.550877
0.169493 0.178947 0.120075 0.124561
0.932859 0.887719 0.128876 0.142105
0.103056 0.098246 0.726280 0.719298
LD LDt VD VDt
0.341299 0.345396 0.344152 0.345396
0.353621 0.318990 0.338312 0.340279
0.406453 0.414644 0.340136 0.329806
0.327988 0.313442 0.386064 0.379288
0.368304 0.388429 0.324354 0.313442
0.385605 0.410391 0.334445 0.329806
0.325547 0.318990 0.421172 0.418854
0.365881 0.355409 0.382915 0.397360
0.364956 0.355409 0.381448 0.379288
0.358773 0.365148 0.385780 0.374634
iteration: 5 cost:0.002601 Vcost:0.002032 Tcost:0.002...
LM LMt VM VMt
0.086351 0.080702 0.510713 0.512281
0.875041 0.861404 0.332466 0.342105
0.854308 0.815789 0.367567 0.384211
0.393344 0.407018 0.384489 0.387719
0.085735 0.089474 0.341892 0.340351
0.817138 0.807018 0.328408 0.356140
0.314911 0.303509 0.539486 0.550877
0.164440 0.178947 0.118200 0.124561
0.913473 0.887719 0.127069 0.142105
0.100227 0.098246 0.708850 0.719298
LD LDt VD VDt
0.341470 0.345396 0.341766 0.345396
0.348947 0.318990 0.336581 0.340279
0.408317 0.414644 0.336991 0.329806
0.324685 0.313442 0.386583 0.379288
0.371070 0.388429 0.321087 0.313442
0.386237 0.410391 0.331574 0.329806
0.321629 0.318990 0.422028 0.418854
0.363478 0.355409 0.387143 0.397360
0.361560 0.355409 0.384262 0.379288
0.360458 0.365148 0.383751 0.374634
iteration: 10 cost:0.001097 Vcost:0.001193 Tcost:0.001...
LM LMt VM VMt
0.080075 0.080702 0.506964 0.512281
0.860828 0.861404 0.333891 0.342105
0.827171 0.815789 0.376301 0.384211
0.395684 0.407018 0.388408 0.387719
0.080552 0.089474 0.335281 0.340351
0.794183 0.807018 0.338496 0.356140
0.306702 0.303509 0.531424 0.550877
0.165791 0.178947 0.121257 0.124561
0.886653 0.887719 0.132696 0.142105
0.102764 0.098246 0.705657 0.719298
LD LDt VD VDt
0.341903 0.345396 0.341829 0.345396
0.338388 0.318990 0.339576 0.340279
0.414757 0.414644 0.334112 0.329806
0.321593 0.313442 0.389160 0.379288
0.378549 0.388429 0.319751 0.313442
0.392473 0.410391 0.331097 0.329806
0.319718 0.318990 0.421581 0.418854
0.358632 0.355409 0.395889 0.397360
0.357889 0.355409 0.389922 0.379288
0.365296 0.365148 0.381627 0.374634
iteration: 20 cost:0.000588 Vcost:0.000564 Tcost:0.000...
LM LMt VM VMt
0.080098 0.080702 0.511433 0.512281
0.871134 0.861404 0.337942 0.342105
0.823592 0.815789 0.385146 0.384211
0.401631 0.407018 0.390300 0.387719
0.086043 0.089474 0.337789 0.340351
0.801895 0.807018 0.348743 0.356140
0.307730 0.303509 0.541869 0.550877
0.170873 0.178947 0.122150 0.124561
0.896420 0.887719 0.138009 0.142105
0.107112 0.098246 0.717558 0.719298
LD LDt VD VDt
0.340496 0.345396 0.342568 0.345396
0.332845 0.318990 0.340935 0.340279
0.414311 0.414644 0.331317 0.329806
0.319338 0.313442 0.386933 0.379288
0.384130 0.388429 0.319207 0.313442
0.397721 0.410391 0.330752 0.329806
0.319261 0.318990 0.416569 0.418854
0.356235 0.355409 0.399611 0.397360
0.359167 0.355409 0.389901 0.379288
0.367878 0.365148 0.380503 0.374634
iteration: 30 cost:0.000435 Vcost:0.000484 Tcost:0.000...
LM LMt VM VMt
0.080725 0.080702 0.516455 0.512281
0.873076 0.861404 0.342167 0.342105
0.826951 0.815789 0.390604 0.384211
0.406500 0.407018 0.393401 0.387719
0.090447 0.089474 0.341794 0.340351
0.808074 0.807018 0.355818 0.356140
0.310147 0.303509 0.547109 0.550877
0.175695 0.178947 0.123029 0.124561
0.900580 0.887719 0.142605 0.142105
0.109702 0.098246 0.723483 0.719298
LD LDt VD VDt
0.340438 0.345396 0.343622 0.345396
0.329054 0.318990 0.341590 0.340279
0.413092 0.414644 0.330245 0.329806
0.318350 0.313442 0.386566 0.379288
0.388405 0.388429 0.318883 0.313442
0.398991 0.410391 0.331043 0.329806
0.319641 0.318990 0.415421 0.418854
0.356985 0.355409 0.401148 0.397360
0.359525 0.355409 0.389009 0.379288
0.369870 0.365148 0.379407 0.374634
iteration: 40 cost:0.000367 Vcost:0.000382 Tcost:0.000...
LM LMt VM VMt
0.077430 0.080702 0.509723 0.512281
0.865805 0.861404 0.336337 0.342105
0.818800 0.815789 0.385339 0.384211
0.401172 0.407018 0.387115 0.387719
0.088938 0.089474 0.337177 0.340351
0.801395 0.807018 0.351179 0.356140
0.303378 0.303509 0.538972 0.550877
0.173579 0.178947 0.119374 0.124561
0.894693 0.887719 0.140052 0.142105
0.106469 0.098246 0.717836 0.719298
LD LDt VD VDt
0.339420 0.345396 0.343303 0.345396
0.327219 0.318990 0.340810 0.340279
0.412254 0.414644 0.328841 0.329806
0.317306 0.313442 0.384778 0.379288
0.389440 0.388429 0.317776 0.313442
0.400017 0.410391 0.330338 0.329806
0.319165 0.318990 0.413069 0.418854
0.356025 0.355409 0.400047 0.397360
0.359889 0.355409 0.385929 0.379288
0.369441 0.365148 0.378221 0.374634
iteration: 50 cost:0.000318 Vcost:0.000322 Tcost:0.000...
LM LMt VM VMt
0.079142 0.080702 0.511292 0.512281
0.867320 0.861404 0.338803 0.342105
0.821324 0.815789 0.387300 0.384211
0.403620 0.407018 0.388232 0.387719
0.091709 0.089474 0.339579 0.340351
0.804973 0.807018 0.353276 0.356140
0.304513 0.303509 0.542928 0.550877
0.176736 0.178947 0.121641 0.124561
0.896684 0.887719 0.142519 0.142105
0.108263 0.098246 0.719739 0.719298
LD LDt VD VDt
0.339087 0.345396 0.343130 0.345396
0.325648 0.318990 0.340661 0.340279
0.411163 0.414644 0.328066 0.329806
0.316713 0.313442 0.383936 0.379288
0.390442 0.388429 0.317166 0.313442
0.400296 0.410391 0.330048 0.329806
0.319130 0.318990 0.412426 0.418854
0.355822 0.355409 0.399425 0.397360
0.359499 0.355409 0.384214 0.379288
0.369286 0.365148 0.376767 0.374634
iteration: 60 cost:0.000284 Vcost:0.000300 Tcost:0.000...
LM LMt VM VMt
0.077729 0.080702 0.510505 0.512281
0.865970 0.861404 0.338162 0.342105
0.819565 0.815789 0.386961 0.384211
0.402667 0.407018 0.387048 0.387719
0.090570 0.089474 0.339195 0.340351
0.804483 0.807018 0.352699 0.356140
0.302433 0.303509 0.542984 0.550877
0.175755 0.178947 0.119989 0.124561
0.896012 0.887719 0.141376 0.142105
0.106365 0.098246 0.719633 0.719298
LD LDt VD VDt
0.338998 0.345396 0.343179 0.345396
0.324392 0.318990 0.340440 0.340279
0.410532 0.414644 0.327504 0.329806
0.316182 0.313442 0.383249 0.379288
0.391154 0.388429 0.316597 0.313442
0.400632 0.410391 0.329683 0.329806
0.319050 0.318990 0.412305 0.418854
0.355575 0.355409 0.398725 0.397360
0.359534 0.355409 0.383025 0.379288
0.369142 0.365148 0.375815 0.374634
iteration: 70 cost:0.000262 Vcost:0.000275 Tcost:0.000...
LM LMt VM VMt
0.078567 0.080702 0.510107 0.512281
0.865997 0.861404 0.338764 0.342105
0.818469 0.815789 0.386978 0.384211
0.402240 0.407018 0.387352 0.387719
0.091683 0.089474 0.339292 0.340351
0.803862 0.807018 0.353049 0.356140
0.301789 0.303509 0.543373 0.550877
0.177417 0.178947 0.121069 0.124561
0.895266 0.887719 0.143113 0.142105
0.106815 0.098246 0.719367 0.719298
LD LDt VD VDt
0.339546 0.345396 0.343713 0.345396
0.323581 0.318990 0.340857 0.340279
0.410992 0.414644 0.327812 0.329806
0.316188 0.313442 0.383695 0.379288
0.392331 0.388429 0.316482 0.313442
0.401448 0.410391 0.330008 0.329806
0.319490 0.318990 0.413341 0.418854
0.356072 0.355409 0.398673 0.397360
0.359870 0.355409 0.382915 0.379288
0.369554 0.365148 0.375817 0.374634
iteration: 80 cost:0.000244 Vcost:0.000252 Tcost:0.000...
LM LMt VM VMt
0.078636 0.080702 0.511431 0.512281
0.867592 0.861404 0.340455 0.342105
0.820250 0.815789 0.388378 0.384211
0.403839 0.407018 0.388483 0.387719
0.091228 0.089474 0.341198 0.340351
0.806468 0.807018 0.355087 0.356140
0.303069 0.303509 0.545296 0.550877
0.177474 0.178947 0.120583 0.124561
0.897312 0.887719 0.142800 0.142105
0.106190 0.098246 0.721818 0.719298
LD LDt VD VDt
0.339490 0.345396 0.344050 0.345396
0.323106 0.318990 0.341196 0.340279
0.411145 0.414644 0.327802 0.329806
0.316197 0.313442 0.383599 0.379288
0.392286 0.388429 0.316455 0.313442
0.402222 0.410391 0.330304 0.329806
0.319810 0.318990 0.413728 0.418854
0.355833 0.355409 0.397904 0.397360
0.360113 0.355409 0.382081 0.379288
0.369132 0.365148 0.375499 0.374634
iteration: 90 cost:0.000229 Vcost:0.000257 Tcost:0.000...
LM LMt VM VMt
0.078458 0.080702 0.509208 0.512281
0.863847 0.861404 0.339710 0.342105
0.815271 0.815789 0.387022 0.384211
0.402081 0.407018 0.387611 0.387719
0.091647 0.089474 0.340198 0.340351
0.802075 0.807018 0.354367 0.356140
0.302119 0.303509 0.543400 0.550877
0.177882 0.178947 0.121087 0.124561
0.893654 0.887719 0.143465 0.142105
0.106029 0.098246 0.716744 0.719298
LD LDt VD VDt
0.339289 0.345396 0.343510 0.345396
0.322269 0.318990 0.341067 0.340279
0.410592 0.414644 0.327355 0.329806
0.315700 0.313442 0.382969 0.379288
0.392286 0.388429 0.316050 0.313442
0.402031 0.410391 0.330150 0.329806
0.319663 0.318990 0.412777 0.418854
0.355512 0.355409 0.397410 0.397360
0.359846 0.355409 0.381551 0.379288
0.368711 0.365148 0.374214 0.374634
iteration: 100 cost:0.000216 Vcost:0.000228 Tcost:0.000...
LM LMt VM VMt
0.079470 0.080702 0.511809 0.512281
0.868065 0.861404 0.341166 0.342105
0.819981 0.815789 0.388439 0.384211
0.403852 0.407018 0.389832 0.387719
0.092599 0.089474 0.341649 0.340351
0.806841 0.807018 0.356264 0.356140
0.303251 0.303509 0.547579 0.550877
0.179090 0.178947 0.121915 0.124561
0.897182 0.887719 0.144588 0.142105
0.106589 0.098246 0.721664 0.719298
LD LDt VD VDt
0.339644 0.345396 0.344078 0.345396
0.322173 0.318990 0.341247 0.340279
0.411333 0.414644 0.327503 0.329806
0.315765 0.313442 0.383123 0.379288
0.392782 0.388429 0.315967 0.313442
0.402884 0.410391 0.330358 0.329806
0.319771 0.318990 0.413943 0.418854
0.355689 0.355409 0.397381 0.397360
0.360294 0.355409 0.381490 0.379288
0.368783 0.365148 0.374564 0.374634
TM TMt
0.909971 0.896491
0.660288 0.659649
0.525536 0.521053
0.610740 0.607018
0.790808 0.787719
0.312694 0.308772
0.838794 0.842105
0.536332 0.536842
0.500565 0.498246
0.630944 0.629825
TD TDt
0.331172 0.318990
0.379741 0.374634
0.336575 0.340279
0.365679 0.365148
0.395563 0.397360
0.317239 0.313442
0.325185 0.324443
0.364692 0.365148
0.413024 0.418854
0.389331 0.388429
real 69m11.355s
user 58m54.672s
sys 9m41.976s
}}
**画像全体の幅190、高さ95の場合 [#a1e1f209]
#pre{{
Using gpu device 1: Tesla K20c
Start Data Load
Data Setting
Setting Layer
MNIST Digit
# nclass : 10 row : 95 col : 190 #
Training data : ndata 50000
Validation data : ndata 4000
Test data : ndata 8000
Parameters
eta : 0.01 epoch : 100 A : 0.9 batch_size : 100 #
### conv_layer ###
# kernel: (64, 5, 10) output_size: (64, 46, 46) act_fun...
# stride: [2, 4] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (3, 3) output_size: (64, 15, 15) ignore_border: T...
# stride: None padding: (0, 0) act_func: False dropo...
### conv_layer ###
# kernel: (64, 3, 3) output_size: (64, 13, 13) act_func...
# stride: [1, 1] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (2, 2) output_size: (64, 6, 6) ignore_border: Tru...
# stride: None padding: (0, 0) act_func: False dropo...
### Fully_Conected_Layer ###
# input: 2304 output: 1024 iniW: -0.01 - 0.01 act_func: ...
### Detector ###
# input: 1024 output: 2 iniWv: 0 - 0.5 iniWm: 0 - 0.5 dr...
iteration: 0 Lcost:0.378894 Vcost:0.381813
LM LMt VM VMt
0.080673 0.586842 0.091890 0.626316
0.092097 0.392105 0.081559 0.347368
0.081604 0.392105 0.083329 0.552632
0.073442 0.657895 0.092660 0.726316
0.080810 0.605263 0.091964 0.815789
0.091668 0.565789 0.092341 0.492105
0.095112 0.534211 0.085601 0.286842
0.089143 0.273684 0.080332 0.407895
0.095610 0.802632 0.091686 0.607895
0.095210 0.668421 0.094088 0.671053
LD LDt VD VDt
1.040256 0.628281 1.045557 0.502625
1.046503 0.518094 1.039922 0.656947
1.040901 0.644817 1.041857 0.640723
1.036377 0.695852 1.046017 0.458831
1.039435 0.703375 1.045313 0.533114
1.045332 0.416754 1.046227 0.390681
1.047490 0.403928 1.042155 0.619847
1.044224 0.542897 1.039955 0.668856
1.048193 0.528155 1.045639 0.538028
1.047514 0.470162 1.046403 0.429198
Start Training
iteration: 1 cost:0.053136 Vcost:0.015868 Tcost:0.015...
LM LMt VM VMt
0.603411 0.586842 0.632287 0.626316
0.387499 0.392105 0.369934 0.347368
0.421198 0.392105 0.583102 0.552632
0.697029 0.657895 0.751135 0.726316
0.686731 0.605263 0.830366 0.815789
0.551832 0.565789 0.497771 0.492105
0.521345 0.534211 0.307570 0.286842
0.246327 0.273684 0.436824 0.407895
0.846901 0.802632 0.610481 0.607895
0.678670 0.668421 0.631039 0.671053
LD LDt VD VDt
0.611984 0.628281 0.534740 0.502625
0.533035 0.518094 0.645756 0.656947
0.653455 0.644817 0.633945 0.640723
0.637173 0.695852 0.538165 0.458831
0.669650 0.703375 0.556049 0.533114
0.505989 0.416754 0.497527 0.390681
0.501342 0.403928 0.600240 0.619847
0.524088 0.542897 0.669964 0.668856
0.558273 0.528155 0.545677 0.538028
0.527588 0.470162 0.516969 0.429198
iteration: 2 cost:0.009099 Vcost:0.005477 Tcost:0.005...
LM LMt VM VMt
0.586297 0.586842 0.627719 0.626316
0.398542 0.392105 0.342284 0.347368
0.400709 0.392105 0.565496 0.552632
0.662460 0.657895 0.777861 0.726316
0.646822 0.605263 0.847363 0.815789
0.575555 0.565789 0.506218 0.492105
0.541364 0.534211 0.297501 0.286842
0.262251 0.273684 0.415255 0.407895
0.868280 0.802632 0.616294 0.607895
0.681512 0.668421 0.645517 0.671053
LD LDt VD VDt
0.627972 0.628281 0.503853 0.502625
0.510057 0.518094 0.670316 0.656947
0.666197 0.644817 0.649345 0.640723
0.680880 0.695852 0.491564 0.458831
0.717730 0.703375 0.519286 0.533114
0.457498 0.416754 0.446527 0.390681
0.451616 0.403928 0.627317 0.619847
0.536090 0.542897 0.689217 0.668856
0.522293 0.528155 0.527035 0.538028
0.482429 0.470162 0.467726 0.429198
iteration: 3 cost:0.004474 Vcost:0.003242 Tcost:0.002...
LM LMt VM VMt
0.569464 0.586842 0.604780 0.626316
0.387447 0.392105 0.338635 0.347368
0.392622 0.392105 0.546592 0.552632
0.639179 0.657895 0.741429 0.726316
0.612439 0.605263 0.814775 0.815789
0.573112 0.565789 0.491830 0.492105
0.530267 0.534211 0.288472 0.286842
0.261095 0.273684 0.414545 0.407895
0.833687 0.802632 0.604209 0.607895
0.662560 0.668421 0.631201 0.671053
LD LDt VD VDt
0.628981 0.628281 0.498169 0.502625
0.510085 0.518094 0.673180 0.656947
0.660917 0.644817 0.645673 0.640723
0.686436 0.695852 0.473655 0.458831
0.715070 0.703375 0.508567 0.533114
0.442534 0.416754 0.430859 0.390681
0.436304 0.403928 0.634998 0.619847
0.551464 0.542897 0.685105 0.668856
0.511537 0.528155 0.527912 0.538028
0.470377 0.470162 0.452642 0.429198
iteration: 4 cost:0.002871 Vcost:0.002389 Tcost:0.002...
LM LMt VM VMt
0.573152 0.586842 0.615530 0.626316
0.391550 0.392105 0.344729 0.347368
0.396765 0.392105 0.553207 0.552632
0.644288 0.657895 0.736261 0.726316
0.610777 0.605263 0.817992 0.815789
0.584445 0.565789 0.499591 0.492105
0.535918 0.534211 0.288006 0.286842
0.263690 0.273684 0.418951 0.407895
0.832475 0.802632 0.607238 0.607895
0.671249 0.668421 0.641334 0.671053
LD LDt VD VDt
0.630300 0.628281 0.498236 0.502625
0.512428 0.518094 0.673720 0.656947
0.658145 0.644817 0.645368 0.640723
0.688541 0.695852 0.465179 0.458831
0.713509 0.703375 0.506865 0.533114
0.436311 0.416754 0.423793 0.390681
0.429966 0.403928 0.635244 0.619847
0.557453 0.542897 0.681244 0.668856
0.509718 0.528155 0.530270 0.538028
0.466492 0.470162 0.445898 0.429198
iteration: 5 cost:0.002207 Vcost:0.002030 Tcost:0.001...
LM LMt VM VMt
0.577879 0.586842 0.629659 0.626316
0.397565 0.392105 0.344506 0.347368
0.394728 0.392105 0.555250 0.552632
0.654697 0.657895 0.742657 0.726316
0.615015 0.605263 0.828108 0.815789
0.597018 0.565789 0.514040 0.492105
0.546239 0.534211 0.285634 0.286842
0.263585 0.273684 0.417409 0.407895
0.834453 0.802632 0.613327 0.607895
0.684449 0.668421 0.655633 0.671053
LD LDt VD VDt
0.625413 0.628281 0.494537 0.502625
0.510390 0.518094 0.666013 0.656947
0.650036 0.644817 0.637380 0.640723
0.683808 0.695852 0.458824 0.458831
0.704666 0.703375 0.505779 0.533114
0.431103 0.416754 0.418459 0.390681
0.424597 0.403928 0.629588 0.619847
0.555025 0.542897 0.671909 0.668856
0.507115 0.528155 0.528365 0.538028
0.462551 0.470162 0.439832 0.429198
iteration: 10 cost:0.001017 Vcost:0.000977 Tcost:0.000...
LM LMt VM VMt
0.581829 0.586842 0.623290 0.626316
0.390425 0.392105 0.349787 0.347368
0.394476 0.392105 0.556750 0.552632
0.656735 0.657895 0.719098 0.726316
0.611477 0.605263 0.815657 0.815789
0.589952 0.565789 0.498390 0.492105
0.530805 0.534211 0.288817 0.286842
0.263029 0.273684 0.415288 0.407895
0.814105 0.802632 0.606656 0.607895
0.682475 0.668421 0.655820 0.671053
LD LDt VD VDt
0.628762 0.628281 0.495488 0.502625
0.517038 0.518094 0.663344 0.656947
0.648888 0.644817 0.639344 0.640723
0.686801 0.695852 0.452647 0.458831
0.709344 0.703375 0.518079 0.533114
0.421551 0.416754 0.409624 0.390681
0.417123 0.403928 0.627009 0.619847
0.552159 0.542897 0.670113 0.668856
0.517296 0.528155 0.534389 0.538028
0.461587 0.470162 0.430071 0.429198
iteration: 20 cost:0.000526 Vcost:0.000532 Tcost:0.000...
LM LMt VM VMt
0.577574 0.586842 0.624820 0.626316
0.386682 0.392105 0.351500 0.347368
0.391962 0.392105 0.557585 0.552632
0.652833 0.657895 0.715647 0.726316
0.609823 0.605263 0.807305 0.815789
0.585997 0.565789 0.495556 0.492105
0.525602 0.534211 0.291695 0.286842
0.272551 0.273684 0.410449 0.407895
0.804208 0.802632 0.599620 0.607895
0.678615 0.668421 0.659797 0.671053
LD LDt VD VDt
0.625934 0.628281 0.495509 0.502625
0.519359 0.518094 0.655328 0.656947
0.646335 0.644817 0.635024 0.640723
0.684950 0.695852 0.451689 0.458831
0.709137 0.703375 0.525784 0.533114
0.415382 0.416754 0.402801 0.390681
0.410866 0.403928 0.624274 0.619847
0.543873 0.542897 0.665696 0.668856
0.523977 0.528155 0.532522 0.538028
0.462404 0.470162 0.422745 0.429198
iteration: 30 cost:0.000368 Vcost:0.000376 Tcost:0.000...
LM LMt VM VMt
0.578604 0.586842 0.630098 0.626316
0.387107 0.392105 0.350803 0.347368
0.392524 0.392105 0.559950 0.552632
0.655146 0.657895 0.718114 0.726316
0.611519 0.605263 0.804848 0.815789
0.585320 0.565789 0.497504 0.492105
0.528500 0.534211 0.288993 0.286842
0.274186 0.273684 0.409815 0.407895
0.799884 0.802632 0.601318 0.607895
0.679689 0.668421 0.665528 0.671053
LD LDt VD VDt
0.627635 0.628281 0.498287 0.502625
0.520969 0.518094 0.652965 0.656947
0.646878 0.644817 0.634929 0.640723
0.686492 0.695852 0.453498 0.458831
0.709439 0.703375 0.530176 0.533114
0.414667 0.416754 0.400836 0.390681
0.409530 0.403928 0.624502 0.619847
0.542327 0.542897 0.664803 0.668856
0.526535 0.528155 0.533647 0.538028
0.465824 0.470162 0.422134 0.429198
iteration: 40 cost:0.000288 Vcost:0.000301 Tcost:0.000...
LM LMt VM VMt
0.578464 0.586842 0.629409 0.626316
0.386534 0.392105 0.350455 0.347368
0.392796 0.392105 0.559544 0.552632
0.657067 0.657895 0.719629 0.726316
0.612200 0.605263 0.805458 0.815789
0.580278 0.565789 0.495928 0.492105
0.526918 0.534211 0.289576 0.286842
0.275520 0.273684 0.410169 0.407895
0.799517 0.802632 0.599815 0.607895
0.677463 0.668421 0.666360 0.671053
LD LDt VD VDt
0.629098 0.628281 0.499440 0.502625
0.522053 0.518094 0.652871 0.656947
0.647849 0.644817 0.634972 0.640723
0.687576 0.695852 0.455070 0.458831
0.709446 0.703375 0.532969 0.533114
0.414024 0.416754 0.399319 0.390681
0.408610 0.403928 0.625932 0.619847
0.543147 0.542897 0.665398 0.668856
0.527585 0.528155 0.533367 0.538028
0.467712 0.470162 0.421619 0.429198
iteration: 50 cost:0.000237 Vcost:0.000248 Tcost:0.000...
LM LMt VM VMt
0.580535 0.586842 0.631652 0.626316
0.386479 0.392105 0.350954 0.347368
0.392308 0.392105 0.560184 0.552632
0.659371 0.657895 0.724966 0.726316
0.613801 0.605263 0.808934 0.815789
0.581525 0.565789 0.497744 0.492105
0.530098 0.534211 0.289121 0.286842
0.275713 0.273684 0.410535 0.407895
0.801573 0.802632 0.601846 0.607895
0.678608 0.668421 0.670939 0.671053
LD LDt VD VDt
0.628985 0.628281 0.499618 0.502625
0.521917 0.518094 0.652002 0.656947
0.647102 0.644817 0.634122 0.640723
0.687301 0.695852 0.456203 0.458831
0.708576 0.703375 0.534148 0.533114
0.413938 0.416754 0.398216 0.390681
0.408274 0.403928 0.625477 0.619847
0.543288 0.542897 0.664725 0.668856
0.527075 0.528155 0.532641 0.538028
0.468614 0.470162 0.421054 0.429198
iteration: 60 cost:0.000205 Vcost:0.000216 Tcost:0.000...
LM LMt VM VMt
0.582211 0.586842 0.632523 0.626316
0.387237 0.392105 0.350863 0.347368
0.392621 0.392105 0.560747 0.552632
0.661421 0.657895 0.725059 0.726316
0.613703 0.605263 0.808735 0.815789
0.580853 0.565789 0.497801 0.492105
0.531573 0.534211 0.289041 0.286842
0.274840 0.273684 0.410770 0.407895
0.799989 0.802632 0.603432 0.607895
0.677919 0.668421 0.671264 0.671053
LD LDt VD VDt
0.629655 0.628281 0.499980 0.502625
0.522172 0.518094 0.652110 0.656947
0.647388 0.644817 0.634694 0.640723
0.688026 0.695852 0.456899 0.458831
0.708702 0.703375 0.534711 0.533114
0.413957 0.416754 0.397482 0.390681
0.408171 0.403928 0.625421 0.619847
0.543930 0.542897 0.664983 0.668856
0.526369 0.528155 0.532881 0.538028
0.469235 0.470162 0.420664 0.429198
iteration: 70 cost:0.000181 Vcost:0.000193 Tcost:0.000...
LM LMt VM VMt
0.583888 0.586842 0.632974 0.626316
0.387566 0.392105 0.350734 0.347368
0.393625 0.392105 0.561644 0.552632
0.662764 0.657895 0.727408 0.726316
0.613940 0.605263 0.808803 0.815789
0.580671 0.565789 0.497717 0.492105
0.531937 0.534211 0.289669 0.286842
0.274760 0.273684 0.411518 0.407895
0.798534 0.802632 0.604518 0.607895
0.678639 0.668421 0.673072 0.671053
LD LDt VD VDt
0.629538 0.628281 0.499603 0.502625
0.521597 0.518094 0.651126 0.656947
0.646778 0.644817 0.634623 0.640723
0.688274 0.695852 0.457521 0.458831
0.708389 0.703375 0.534459 0.533114
0.413891 0.416754 0.396617 0.390681
0.407863 0.403928 0.624421 0.619847
0.543764 0.542897 0.664230 0.668856
0.525152 0.528155 0.532476 0.538028
0.469645 0.470162 0.420456 0.429198
iteration: 80 cost:0.000164 Vcost:0.000180 Tcost:0.000...
LM LMt VM VMt
0.585176 0.586842 0.633618 0.626316
0.389113 0.392105 0.350733 0.347368
0.394306 0.392105 0.562033 0.552632
0.665283 0.657895 0.728502 0.726316
0.614829 0.605263 0.811490 0.815789
0.580038 0.565789 0.498397 0.492105
0.532626 0.534211 0.290286 0.286842
0.275700 0.273684 0.411627 0.407895
0.799726 0.802632 0.605375 0.607895
0.678687 0.668421 0.673746 0.671053
LD LDt VD VDt
0.629888 0.628281 0.499839 0.502625
0.522219 0.518094 0.651548 0.656947
0.647470 0.644817 0.635354 0.640723
0.689210 0.695852 0.458319 0.458831
0.709058 0.703375 0.535309 0.533114
0.414112 0.416754 0.396455 0.390681
0.408115 0.403928 0.624767 0.619847
0.544916 0.542897 0.664543 0.668856
0.525060 0.528155 0.532770 0.538028
0.470183 0.470162 0.420589 0.429198
iteration: 90 cost:0.000150 Vcost:0.000163 Tcost:0.000...
LM LMt VM VMt
0.584068 0.586842 0.631341 0.626316
0.388430 0.392105 0.349543 0.347368
0.393942 0.392105 0.560084 0.552632
0.663871 0.657895 0.726275 0.726316
0.612336 0.605263 0.809609 0.815789
0.577741 0.565789 0.496983 0.492105
0.531157 0.534211 0.288987 0.286842
0.274497 0.273684 0.410959 0.407895
0.796365 0.802632 0.603852 0.607895
0.675484 0.668421 0.672015 0.671053
LD LDt VD VDt
0.629578 0.628281 0.499712 0.502625
0.522042 0.518094 0.651284 0.656947
0.647664 0.644817 0.635646 0.640723
0.689288 0.695852 0.458436 0.458831
0.708748 0.703375 0.535251 0.533114
0.413984 0.416754 0.395943 0.390681
0.407968 0.403928 0.624228 0.619847
0.544949 0.542897 0.664491 0.668856
0.524135 0.528155 0.532781 0.538028
0.470219 0.470162 0.420437 0.429198
iteration: 100 cost:0.000139 Vcost:0.000154 Tcost:0.000...
LM LMt VM VMt
0.584808 0.586842 0.630913 0.626316
0.388352 0.392105 0.349546 0.347368
0.393688 0.392105 0.559884 0.552632
0.664738 0.657895 0.726401 0.726316
0.612452 0.605263 0.810347 0.815789
0.575922 0.565789 0.495603 0.492105
0.530172 0.534211 0.288435 0.286842
0.273569 0.273684 0.410325 0.407895
0.796237 0.802632 0.604085 0.607895
0.674765 0.668421 0.671714 0.671053
LD LDt VD VDt
0.628972 0.628281 0.499166 0.502625
0.521738 0.518094 0.651440 0.656947
0.647735 0.644817 0.635768 0.640723
0.689102 0.695852 0.458296 0.458831
0.708290 0.703375 0.534775 0.533114
0.413587 0.416754 0.395224 0.390681
0.407509 0.403928 0.624111 0.619847
0.545070 0.542897 0.664366 0.668856
0.523196 0.528155 0.532401 0.538028
0.469903 0.470162 0.420046 0.429198
TM TMt
0.806992 0.813158
0.734635 0.723684
0.199785 0.200000
0.342636 0.347368
0.624296 0.618421
0.622018 0.621053
0.240377 0.242105
0.780148 0.771053
0.394160 0.394737
0.717617 0.713158
TD TDt
0.505623 0.507833
0.590286 0.593828
0.525625 0.523148
0.698166 0.695852
0.656419 0.652929
0.699810 0.703375
0.602667 0.598243
0.619667 0.619847
0.384726 0.383886
0.492185 0.497361
real 125m5.242s
user 106m16.908s
sys 17m42.440s
}}
終了行:
#contents
*前回の続きの実験 [#xae04b89]
-3.&br;
2の実験でCNNであれば、元画像のスケール変化、位置の変化が...
次の実験においては、位置の変化を2.の時の倍程度にして、実...
NNの場合は前回の場合で汎化性能を獲得できていなかったので...
全体画像の縦のサイズは50、横のサイズは190とする。&br;
実験用画像(https://drive.google.com/a/mail.ryukoku.ac.jp/...
-4.&br;
3.の実験をベースに縦、横のスケールを変化させてみて、位置...
4_1.全体の幅285、高さ50の場合&br;
(https://drive.google.com/a/mail.ryukoku.ac.jp/file/d/0B8...
4_2.全体の幅190、高さ95の場合&br;
(https://drive.google.com/a/mail.ryukoku.ac.jp/file/d/0B8...
**まとめ [#k3d6e555]
実験結果&br;
-3.&br;(https://drive.google.com/a/mail.ryukoku.ac.jp/fil...
画像全体のサイズを大きくして、実験を行ってみた。&br;
strideを大きくして、前回と大体同じ程度の出力マップサイズ...
CPFFのcostが振動している部分も見られるが、CPCPFFにした場...
-4.&br;
(https://drive.google.com/a/mail.ryukoku.ac.jp/file/d/0B8...
3.の実験で、全体画像の幅が大きくても、位置推定出来そうだ...
3の実験条件からさらに幅を大きくしたもの、幅は同じで画像の...
CPCPFFのみで実験を行ったが、両方とも位置はほぼ推定出来る...
現在、1chでの簡単なタスクなためか、今以上に全体画像のスケ...
ネットワークをそれなりに多層にすることで、位置を推定する...
ただ、画像を大きくした時の、CNNのパラメータ調整が難しく、...
計算コストを減らすか、トレードオフの関係でもあると思うの...
一定サイズ以上になった時には、この前高橋さんと話していた...
Data Augumentationに近いような処理を行った方がチューニン...
Data Augumentationにすると、順伝搬をウインドウ数分行わな...
精度は良くなりそうだとは思う。&br;
mnistの実験は、とりあえずこれで終了とし、2変量正規分布を...
***CPFF [#z7db458a]
#pre{{
Using gpu device 1: Tesla K20c
Start Data Load
Data Setting
Setting Layer
MNIST Digit
# nclass : 10 row : 50 col : 190 #
Training data : ndata 50000
Validation data : ndata 4000
Test data : ndata 8000
Parameters
eta : 0.01 epoch : 100 A : 0.9 batch_size : 100 #
### conv_layer ###
# kernel: (64, 5, 10) output_size: (64, 46, 46) act_fun...
# stride: [1, 4] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (7, 7) output_size: (64, 6, 6) ignore_border: Tru...
# stride: None padding: (0, 0) act_func: False dropo...
### Fully_Conected_Layer ###
# input: 2304 output: 1024 iniW: -0.01 - 0.01 act_func: ...
### Detector ###
# input: 1024 output: 2 iniWv: 0 - 0.1 iniWm: 0 - 0.5 dr...
iteration: 0 Lcost:0.638316 Vcost:0.638232
LM LMt VM VMt
1.088785 0.863158 1.091387 0.178947
1.066368 0.468421 1.051771 0.186842
1.037933 0.765789 1.100853 0.678947
1.016783 0.257895 1.104967 0.094737
1.092697 0.481579 1.083656 0.876316
1.082487 0.657895 1.086347 0.450000
1.085572 0.273684 1.073238 0.768421
1.100245 0.102632 1.044455 0.305263
1.054475 0.460526 1.021504 0.526316
1.060762 0.505263 1.056764 0.671053
LD LDt VD VDt
1.116750 0.458831 1.115213 0.397360
1.112590 0.435286 1.112191 0.429198
1.110032 0.507833 1.114866 0.397360
1.107090 0.458831 1.117343 0.410391
1.117641 0.416754 1.115578 0.464531
1.114394 0.410391 1.114200 0.441290
1.113884 0.447214 1.115022 0.481227
1.115337 0.390681 1.109247 0.470162
1.110113 0.453060 1.105942 0.502625
1.111299 0.435286 1.111610 0.453060
Start Training
iteration: 1 cost:0.051544 Vcost:0.016994 Tcost:0.017...
LM LMt VM VMt
0.817451 0.863158 0.239372 0.178947
0.463656 0.468421 0.212909 0.186842
0.785995 0.765789 0.551204 0.678947
0.205841 0.257895 0.177046 0.094737
0.441503 0.481579 0.767246 0.876316
0.587130 0.657895 0.422712 0.450000
0.227175 0.273684 0.761777 0.768421
0.176460 0.102632 0.292792 0.305263
0.458876 0.460526 0.535349 0.526316
0.484502 0.505263 0.635693 0.671053
LD LDt VD VDt
0.465369 0.458831 0.450528 0.397360
0.455594 0.435286 0.450492 0.429198
0.464592 0.507833 0.457257 0.397360
0.450902 0.458831 0.449514 0.410391
0.455266 0.416754 0.463825 0.464531
0.458410 0.410391 0.454330 0.441290
0.451572 0.447214 0.463533 0.481227
0.449678 0.390681 0.452349 0.470162
0.455085 0.453060 0.457177 0.502625
0.456998 0.435286 0.459788 0.453060
iteration: 2 cost:0.014841 Vcost:0.012630 Tcost:0.012...
LM LMt VM VMt
0.832215 0.863158 0.232702 0.178947
0.491838 0.468421 0.207856 0.186842
0.768027 0.765789 0.596443 0.678947
0.212602 0.257895 0.166379 0.094737
0.458102 0.481579 0.810389 0.876316
0.633016 0.657895 0.457057 0.450000
0.242228 0.273684 0.745048 0.768421
0.164894 0.102632 0.320214 0.305263
0.497079 0.460526 0.535488 0.526316
0.506410 0.505263 0.668718 0.671053
LD LDt VD VDt
0.463199 0.458831 0.448854 0.397360
0.454480 0.435286 0.449144 0.429198
0.461536 0.507833 0.455966 0.397360
0.450119 0.458831 0.447516 0.410391
0.453575 0.416754 0.462633 0.464531
0.457583 0.410391 0.453372 0.441290
0.451256 0.447214 0.460744 0.481227
0.447671 0.390681 0.452353 0.470162
0.454187 0.453060 0.455438 0.502625
0.455945 0.435286 0.458470 0.453060
iteration: 3 cost:0.012476 Vcost:0.011800 Tcost:0.012...
LM LMt VM VMt
0.817290 0.863158 0.210327 0.178947
0.490834 0.468421 0.196380 0.186842
0.769781 0.765789 0.604340 0.678947
0.203542 0.257895 0.146136 0.094737
0.447481 0.481579 0.808212 0.876316
0.634989 0.657895 0.458696 0.450000
0.240880 0.273684 0.737754 0.768421
0.145509 0.102632 0.324034 0.305263
0.497998 0.460526 0.524323 0.526316
0.505642 0.505263 0.663426 0.671053
LD LDt VD VDt
0.461606 0.458831 0.447823 0.397360
0.453984 0.435286 0.449054 0.429198
0.460669 0.507833 0.454935 0.397360
0.450103 0.458831 0.446409 0.410391
0.452708 0.416754 0.461088 0.464531
0.456671 0.410391 0.453132 0.441290
0.452247 0.447214 0.459705 0.481227
0.446659 0.390681 0.453322 0.470162
0.453619 0.453060 0.454895 0.502625
0.455943 0.435286 0.457477 0.453060
iteration: 4 cost:0.011382 Vcost:0.011312 Tcost:0.011...
LM LMt VM VMt
0.872712 0.863158 0.229669 0.178947
0.521001 0.468421 0.205925 0.186842
0.832814 0.765789 0.654381 0.678947
0.221069 0.257895 0.155442 0.094737
0.477190 0.481579 0.868027 0.876316
0.673053 0.657895 0.493721 0.450000
0.265581 0.273684 0.797358 0.768421
0.156500 0.102632 0.352508 0.305263
0.531631 0.460526 0.548008 0.526316
0.540611 0.505263 0.707297 0.671053
LD LDt VD VDt
0.461542 0.458831 0.447264 0.397360
0.453713 0.435286 0.448784 0.429198
0.460974 0.507833 0.454222 0.397360
0.450360 0.458831 0.445551 0.410391
0.452567 0.416754 0.460449 0.464531
0.456225 0.410391 0.453082 0.441290
0.453734 0.447214 0.459988 0.481227
0.445824 0.390681 0.454314 0.470162
0.453274 0.453060 0.455090 0.502625
0.456598 0.435286 0.457268 0.453060
iteration: 5 cost:0.010407 Vcost:0.012035 Tcost:0.012...
LM LMt VM VMt
0.882395 0.863158 0.236304 0.178947
0.523890 0.468421 0.205889 0.186842
0.845739 0.765789 0.673881 0.678947
0.226999 0.257895 0.153608 0.094737
0.485012 0.481579 0.884085 0.876316
0.683599 0.657895 0.505439 0.450000
0.274344 0.273684 0.814298 0.768421
0.158487 0.102632 0.359355 0.305263
0.547707 0.460526 0.558236 0.526316
0.550193 0.505263 0.714859 0.671053
LD LDt VD VDt
0.460513 0.458831 0.446458 0.397360
0.452947 0.435286 0.448317 0.429198
0.460491 0.507833 0.452832 0.397360
0.450553 0.458831 0.444434 0.410391
0.452038 0.416754 0.458864 0.464531
0.455308 0.410391 0.452755 0.441290
0.454968 0.447214 0.459301 0.481227
0.444715 0.390681 0.455002 0.470162
0.452585 0.453060 0.455383 0.502625
0.456899 0.435286 0.456342 0.453060
iteration: 10 cost:0.007367 Vcost:0.007094 Tcost:0.007...
LM LMt VM VMt
0.862944 0.863158 0.200204 0.178947
0.492438 0.468421 0.188288 0.186842
0.806921 0.765789 0.658852 0.678947
0.229416 0.257895 0.122352 0.094737
0.459030 0.481579 0.857092 0.876316
0.661931 0.657895 0.484726 0.450000
0.282941 0.273684 0.801758 0.768421
0.124560 0.102632 0.342446 0.305263
0.518038 0.460526 0.517128 0.526316
0.529132 0.505263 0.674977 0.671053
LD LDt VD VDt
0.458986 0.458831 0.438085 0.397360
0.448412 0.435286 0.446427 0.429198
0.463961 0.507833 0.440421 0.397360
0.451597 0.458831 0.435949 0.410391
0.447556 0.416754 0.449675 0.464531
0.449183 0.410391 0.451965 0.441290
0.465109 0.447214 0.460839 0.481227
0.434843 0.390681 0.459506 0.470162
0.446714 0.453060 0.459799 0.502625
0.460803 0.435286 0.452629 0.453060
iteration: 20 cost:0.002925 Vcost:0.003003 Tcost:0.003...
LM LMt VM VMt
0.863975 0.863158 0.177166 0.178947
0.487234 0.468421 0.173951 0.186842
0.774518 0.765789 0.629182 0.678947
0.234554 0.257895 0.096713 0.094737
0.452910 0.481579 0.831157 0.876316
0.655221 0.657895 0.477218 0.450000
0.273442 0.273684 0.790471 0.768421
0.095618 0.102632 0.315850 0.305263
0.478824 0.460526 0.519243 0.526316
0.519309 0.505263 0.649067 0.671053
LD LDt VD VDt
0.471299 0.458831 0.413012 0.397360
0.432591 0.435286 0.440011 0.429198
0.500618 0.507833 0.407332 0.397360
0.455082 0.458831 0.414791 0.410391
0.427800 0.416754 0.441535 0.464531
0.426869 0.410391 0.441588 0.441290
0.476591 0.447214 0.482610 0.481227
0.410235 0.390681 0.465195 0.470162
0.435163 0.453060 0.479140 0.502625
0.466293 0.435286 0.444625 0.453060
iteration: 30 cost:0.001995 Vcost:0.002625 Tcost:0.002...
LM LMt VM VMt
0.890389 0.863158 0.185413 0.178947
0.505980 0.468421 0.185872 0.186842
0.798022 0.765789 0.670670 0.678947
0.246426 0.257895 0.095492 0.094737
0.479085 0.481579 0.867871 0.876316
0.684295 0.657895 0.491515 0.450000
0.285745 0.273684 0.809998 0.768421
0.098159 0.102632 0.322674 0.305263
0.482039 0.460526 0.539919 0.526316
0.540643 0.505263 0.672543 0.671053
LD LDt VD VDt
0.465227 0.458831 0.406051 0.397360
0.427707 0.435286 0.435217 0.429198
0.504554 0.507833 0.400203 0.397360
0.459286 0.458831 0.412662 0.410391
0.420436 0.416754 0.439101 0.464531
0.421076 0.410391 0.436268 0.441290
0.465195 0.447214 0.484084 0.481227
0.405617 0.390681 0.465215 0.470162
0.439409 0.453060 0.490357 0.502625
0.458151 0.435286 0.446230 0.453060
iteration: 40 cost:0.001590 Vcost:0.001771 Tcost:0.001...
LM LMt VM VMt
0.870551 0.863158 0.175144 0.178947
0.493758 0.468421 0.181546 0.186842
0.778835 0.765789 0.664495 0.678947
0.241992 0.257895 0.083099 0.094737
0.472483 0.481579 0.858398 0.876316
0.669725 0.657895 0.475508 0.450000
0.280168 0.273684 0.789013 0.768421
0.091388 0.102632 0.313769 0.305263
0.471269 0.460526 0.528317 0.526316
0.533632 0.505263 0.656426 0.671053
LD LDt VD VDt
0.462689 0.458831 0.403667 0.397360
0.427738 0.435286 0.434588 0.429198
0.504029 0.507833 0.398466 0.397360
0.464422 0.458831 0.410992 0.410391
0.419313 0.416754 0.441762 0.464531
0.420953 0.410391 0.436597 0.441290
0.460763 0.447214 0.485641 0.481227
0.402704 0.390681 0.466761 0.470162
0.444406 0.453060 0.497835 0.502625
0.454277 0.435286 0.450003 0.453060
iteration: 50 cost:0.001384 Vcost:0.001603 Tcost:0.001...
LM LMt VM VMt
0.876258 0.863158 0.174308 0.178947
0.492385 0.468421 0.182692 0.186842
0.781252 0.765789 0.671736 0.678947
0.244184 0.257895 0.081907 0.094737
0.475271 0.481579 0.867324 0.876316
0.667267 0.657895 0.474654 0.450000
0.279834 0.273684 0.786507 0.768421
0.092563 0.102632 0.313712 0.305263
0.472879 0.460526 0.526979 0.526316
0.532883 0.505263 0.661011 0.671053
LD LDt VD VDt
0.461297 0.458831 0.401834 0.397360
0.427714 0.435286 0.434718 0.429198
0.503758 0.507833 0.397844 0.397360
0.466148 0.458831 0.409250 0.410391
0.418737 0.416754 0.444326 0.464531
0.420942 0.410391 0.436644 0.441290
0.457303 0.447214 0.485682 0.481227
0.400626 0.390681 0.467190 0.470162
0.445965 0.453060 0.500359 0.502625
0.452207 0.435286 0.452692 0.453060
iteration: 60 cost:0.001259 Vcost:0.001532 Tcost:0.001...
LM LMt VM VMt
0.854733 0.863158 0.167076 0.178947
0.476346 0.468421 0.175120 0.186842
0.765924 0.765789 0.660638 0.678947
0.239419 0.257895 0.077437 0.094737
0.463912 0.481579 0.849572 0.876316
0.650628 0.657895 0.460322 0.450000
0.273168 0.273684 0.766209 0.768421
0.090851 0.102632 0.304811 0.305263
0.463164 0.460526 0.515567 0.526316
0.519778 0.505263 0.648621 0.671053
LD LDt VD VDt
0.462136 0.458831 0.402547 0.397360
0.429154 0.435286 0.436427 0.429198
0.505706 0.507833 0.399017 0.397360
0.468267 0.458831 0.409527 0.410391
0.420041 0.416754 0.447543 0.464531
0.422209 0.410391 0.438857 0.441290
0.456809 0.447214 0.487231 0.481227
0.400951 0.390681 0.469805 0.470162
0.448038 0.453060 0.503096 0.502625
0.453376 0.435286 0.456473 0.453060
iteration: 70 cost:0.001090 Vcost:0.001311 Tcost:0.001...
LM LMt VM VMt
0.859520 0.863158 0.170653 0.178947
0.481209 0.468421 0.179067 0.186842
0.772702 0.765789 0.667583 0.678947
0.245612 0.257895 0.080131 0.094737
0.470089 0.481579 0.855657 0.876316
0.652654 0.657895 0.465042 0.450000
0.278514 0.273684 0.770045 0.768421
0.093909 0.102632 0.309584 0.305263
0.468268 0.460526 0.520348 0.526316
0.525783 0.505263 0.655221 0.671053
LD LDt VD VDt
0.461926 0.458831 0.401656 0.397360
0.429075 0.435286 0.436016 0.429198
0.506131 0.507833 0.399055 0.397360
0.468668 0.458831 0.408529 0.410391
0.420194 0.416754 0.449375 0.464531
0.421894 0.410391 0.439705 0.441290
0.455203 0.447214 0.487721 0.481227
0.400146 0.390681 0.470818 0.470162
0.448439 0.453060 0.504053 0.502625
0.453122 0.435286 0.458012 0.453060
iteration: 80 cost:0.001029 Vcost:0.001260 Tcost:0.001...
LM LMt VM VMt
0.867204 0.863158 0.173032 0.178947
0.488087 0.468421 0.177769 0.186842
0.779858 0.765789 0.683897 0.678947
0.247270 0.257895 0.080068 0.094737
0.479009 0.481579 0.867006 0.876316
0.664368 0.657895 0.469769 0.450000
0.278536 0.273684 0.775320 0.768421
0.095258 0.102632 0.310037 0.305263
0.474685 0.460526 0.526659 0.526316
0.533416 0.505263 0.664895 0.671053
LD LDt VD VDt
0.460286 0.458831 0.399545 0.397360
0.427185 0.435286 0.433868 0.429198
0.505042 0.507833 0.398479 0.397360
0.466955 0.458831 0.406517 0.410391
0.418688 0.416754 0.449603 0.464531
0.420547 0.410391 0.438466 0.441290
0.452112 0.447214 0.486321 0.481227
0.398222 0.390681 0.469415 0.470162
0.446962 0.453060 0.502888 0.502625
0.451510 0.435286 0.458001 0.453060
iteration: 90 cost:0.000946 Vcost:0.001266 Tcost:0.001...
LM LMt VM VMt
0.869317 0.863158 0.173933 0.178947
0.489073 0.468421 0.178717 0.186842
0.784026 0.765789 0.689513 0.678947
0.248380 0.257895 0.080497 0.094737
0.480616 0.481579 0.870000 0.876316
0.663071 0.657895 0.468814 0.450000
0.278482 0.273684 0.776753 0.768421
0.097024 0.102632 0.310125 0.305263
0.474463 0.460526 0.528465 0.526316
0.533240 0.505263 0.664385 0.671053
LD LDt VD VDt
0.459101 0.458831 0.398005 0.397360
0.425859 0.435286 0.432315 0.429198
0.503973 0.507833 0.398223 0.397360
0.465645 0.458831 0.405022 0.410391
0.417757 0.416754 0.449655 0.464531
0.419408 0.410391 0.437818 0.441290
0.450148 0.447214 0.485468 0.481227
0.396809 0.390681 0.468617 0.470162
0.446352 0.453060 0.501935 0.502625
0.450076 0.435286 0.457894 0.453060
iteration: 100 cost:0.000941 Vcost:0.001482 Tcost:0.001...
LM LMt VM VMt
0.875343 0.863158 0.179221 0.178947
0.494845 0.468421 0.183210 0.186842
0.790028 0.765789 0.697695 0.678947
0.253812 0.257895 0.085618 0.094737
0.488194 0.481579 0.875626 0.876316
0.669335 0.657895 0.474482 0.450000
0.284035 0.273684 0.781986 0.768421
0.102401 0.102632 0.316504 0.305263
0.479806 0.460526 0.535061 0.526316
0.538886 0.505263 0.669535 0.671053
LD LDt VD VDt
0.460551 0.458831 0.398612 0.397360
0.426896 0.435286 0.433007 0.429198
0.505774 0.507833 0.399831 0.397360
0.466348 0.458831 0.405660 0.410391
0.418963 0.416754 0.451745 0.464531
0.420536 0.410391 0.439220 0.441290
0.450504 0.447214 0.486905 0.481227
0.397562 0.390681 0.469949 0.470162
0.447840 0.453060 0.503249 0.502625
0.451090 0.435286 0.460036 0.453060
TM TMt
0.524321 0.510526
0.159701 0.160526
0.272685 0.231579
0.503283 0.500000
0.364345 0.355263
0.264702 0.250000
0.600120 0.589474
0.835771 0.821053
0.547304 0.523684
0.585145 0.573684
TD TDt
0.399208 0.410391
0.437315 0.441290
0.387712 0.383886
0.497240 0.492042
0.404018 0.390681
0.476434 0.464531
0.425538 0.410391
0.442095 0.447214
0.506913 0.486664
0.480815 0.481227
real 88m2.923s
user 75m3.192s
sys 12m20.792s
}}
***CPCPFF [#m8ef83dd]
#pre{{
Start Data Load
Data Setting
Setting Layer
MNIST Digit
# nclass : 10 row : 50 col : 190 #
Training data : ndata 50000
Validation data : ndata 4000
Test data : ndata 8000
Parameters
eta : 0.01 epoch : 100 A : 0.9 batch_size : 100 #
### conv_layer ###
# kernel: (64, 5, 10) output_size: (64, 46, 46) act_fun...
# stride: [1, 4] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (3, 3) output_size: (64, 15, 15) ignore_border: T...
# stride: None padding: (0, 0) act_func: False dropo...
### conv_layer ###
# kernel: (64, 3, 3) output_size: (64, 13, 13) act_func...
# stride: [1, 1] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (2, 2) output_size: (64, 6, 6) ignore_border: Tru...
# stride: None padding: (0, 0) act_func: False dropo...
### Fully_Conected_Layer ###
# input: 2304 output: 1024 iniW: -0.01 - 0.01 act_func: ...
### Detector ###
# input: 1024 output: 2 iniWv: 0 - 0.5 iniWm: 0 - 0.5 dr...
iteration: 0 Lcost:0.534293 Vcost:0.535034
LM LMt VM VMt
0.107155 0.373684 0.112243 0.236842
0.110176 0.207895 0.107448 0.171053
0.111526 0.600000 0.117185 0.100000
0.113372 0.736842 0.110775 0.742105
0.116691 0.178947 0.114692 0.771053
0.114439 0.410526 0.114562 0.607895
0.109291 0.200000 0.109881 0.526316
0.109529 0.515789 0.112987 0.184211
0.111544 0.447368 0.116134 0.684211
0.116090 0.747368 0.110148 0.536842
LD LDt VD VDt
1.050681 0.470162 1.053379 0.423022
1.053066 0.497361 1.051614 0.497361
1.052401 0.458831 1.054873 0.397360
1.054526 0.435286 1.052726 0.470162
1.055780 0.383886 1.054551 0.416754
1.053769 0.410391 1.055227 0.390681
1.052894 0.481227 1.051164 0.502625
1.051879 0.492042 1.053778 0.458831
1.052243 0.502625 1.055772 0.410391
1.053913 0.481227 1.052286 0.458831
Start Training
iteration: 1 cost:0.066117 Vcost:0.012392 Tcost:0.012...
LM LMt VM VMt
0.385399 0.373684 0.204387 0.236842
0.217259 0.207895 0.199606 0.171053
0.574232 0.600000 0.280932 0.100000
0.770826 0.736842 0.833605 0.742105
0.249189 0.178947 0.822425 0.771053
0.406295 0.410526 0.543595 0.607895
0.203355 0.200000 0.551702 0.526316
0.505569 0.515789 0.194008 0.184211
0.449516 0.447368 0.646052 0.684211
0.849912 0.747368 0.529295 0.536842
LD LDt VD VDt
0.465930 0.470162 0.438081 0.423022
0.449304 0.497361 0.445002 0.497361
0.457849 0.458831 0.425630 0.397360
0.470709 0.435286 0.479452 0.470162
0.424646 0.383886 0.477645 0.416754
0.443319 0.410391 0.447820 0.390681
0.445279 0.481227 0.467334 0.502625
0.463464 0.492042 0.441743 0.458831
0.465380 0.502625 0.456215 0.410391
0.482052 0.481227 0.458113 0.458831
iteration: 2 cost:0.009962 Vcost:0.006175 Tcost:0.006...
LM LMt VM VMt
0.383446 0.373684 0.216834 0.236842
0.221780 0.207895 0.191453 0.171053
0.591931 0.600000 0.218681 0.100000
0.754796 0.736842 0.791729 0.742105
0.215581 0.178947 0.836862 0.771053
0.390622 0.410526 0.572698 0.607895
0.206353 0.200000 0.543054 0.526316
0.503614 0.515789 0.191794 0.184211
0.438295 0.447368 0.672587 0.684211
0.800642 0.747368 0.524709 0.536842
LD LDt VD VDt
0.477248 0.470162 0.444825 0.423022
0.472716 0.497361 0.463993 0.497361
0.459276 0.458831 0.407708 0.397360
0.452718 0.435286 0.470095 0.470162
0.408878 0.383886 0.457130 0.416754
0.429704 0.410391 0.433260 0.390681
0.463489 0.481227 0.480169 0.502625
0.475201 0.492042 0.459242 0.458831
0.479048 0.502625 0.439026 0.410391
0.474113 0.481227 0.459342 0.458831
iteration: 3 cost:0.005177 Vcost:0.003889 Tcost:0.003...
LM LMt VM VMt
0.383038 0.373684 0.229748 0.236842
0.220738 0.207895 0.180477 0.171053
0.604364 0.600000 0.181099 0.100000
0.771079 0.736842 0.806513 0.742105
0.212745 0.178947 0.842741 0.771053
0.403910 0.410526 0.593851 0.607895
0.204420 0.200000 0.547172 0.526316
0.509698 0.515789 0.186032 0.184211
0.447628 0.447368 0.697776 0.684211
0.809341 0.747368 0.530188 0.536842
LD LDt VD VDt
0.477658 0.470162 0.442080 0.423022
0.485906 0.497361 0.474448 0.497361
0.455810 0.458831 0.394292 0.397360
0.446036 0.435286 0.477671 0.470162
0.395706 0.383886 0.444179 0.416754
0.417166 0.410391 0.417111 0.390681
0.471257 0.481227 0.489637 0.502625
0.482523 0.492042 0.468065 0.458831
0.491250 0.502625 0.425370 0.410391
0.484682 0.481227 0.457823 0.458831
iteration: 4 cost:0.003217 Vcost:0.002651 Tcost:0.002...
LM LMt VM VMt
0.379911 0.373684 0.240166 0.236842
0.217018 0.207895 0.174845 0.171053
0.605973 0.600000 0.157626 0.100000
0.766774 0.736842 0.801737 0.742105
0.210226 0.178947 0.831297 0.771053
0.405800 0.410526 0.598356 0.607895
0.202709 0.200000 0.540935 0.526316
0.507294 0.515789 0.182965 0.184211
0.447941 0.447368 0.698774 0.684211
0.803678 0.747368 0.531435 0.536842
LD LDt VD VDt
0.478037 0.470162 0.439164 0.423022
0.493306 0.497361 0.483261 0.497361
0.452204 0.458831 0.388443 0.397360
0.442523 0.435286 0.485685 0.470162
0.388710 0.383886 0.436509 0.416754
0.411082 0.410391 0.405980 0.390681
0.476264 0.481227 0.495186 0.502625
0.487692 0.492042 0.475170 0.458831
0.501362 0.502625 0.415867 0.410391
0.494994 0.481227 0.458244 0.458831
iteration: 5 cost:0.002231 Vcost:0.001919 Tcost:0.001...
LM LMt VM VMt
0.376834 0.373684 0.245414 0.236842
0.210985 0.207895 0.170275 0.171053
0.606965 0.600000 0.138695 0.100000
0.762363 0.736842 0.790943 0.742105
0.202794 0.178947 0.818572 0.771053
0.406218 0.410526 0.598052 0.607895
0.197799 0.200000 0.536813 0.526316
0.505192 0.515789 0.179237 0.184211
0.446774 0.447368 0.697654 0.684211
0.791759 0.747368 0.531748 0.536842
LD LDt VD VDt
0.477503 0.470162 0.436742 0.423022
0.495999 0.497361 0.488936 0.497361
0.449708 0.458831 0.386454 0.397360
0.439697 0.435286 0.488635 0.470162
0.385205 0.383886 0.430823 0.416754
0.408932 0.410391 0.399169 0.390681
0.478573 0.481227 0.497803 0.502625
0.490399 0.492042 0.478871 0.458831
0.507567 0.502625 0.409660 0.410391
0.498277 0.481227 0.459226 0.458831
iteration: 10 cost:0.000916 Vcost:0.000830 Tcost:0.000...
LM LMt VM VMt
0.369173 0.373684 0.245649 0.236842
0.201966 0.207895 0.166389 0.171053
0.602704 0.600000 0.110018 0.100000
0.745743 0.736842 0.758488 0.742105
0.184831 0.178947 0.798404 0.771053
0.402028 0.410526 0.592500 0.607895
0.192152 0.200000 0.528077 0.526316
0.507203 0.515789 0.177186 0.184211
0.443982 0.447368 0.685696 0.684211
0.761583 0.747368 0.534731 0.536842
LD LDt VD VDt
0.479519 0.470162 0.429847 0.423022
0.496258 0.497361 0.498504 0.497361
0.450238 0.458831 0.388763 0.397360
0.432674 0.435286 0.486897 0.470162
0.381342 0.383886 0.419478 0.416754
0.410131 0.410391 0.391972 0.390681
0.481267 0.481227 0.501794 0.502625
0.493607 0.492042 0.482543 0.458831
0.513758 0.502625 0.401103 0.410391
0.495653 0.481227 0.462699 0.458831
iteration: 20 cost:0.000438 Vcost:0.000420 Tcost:0.000...
LM LMt VM VMt
0.365755 0.373684 0.236581 0.236842
0.203656 0.207895 0.168169 0.171053
0.604458 0.600000 0.100427 0.100000
0.746382 0.736842 0.751151 0.742105
0.181697 0.178947 0.803541 0.771053
0.404523 0.410526 0.597457 0.607895
0.195312 0.200000 0.522271 0.526316
0.510889 0.515789 0.175728 0.184211
0.448917 0.447368 0.689203 0.684211
0.758088 0.747368 0.537319 0.536842
LD LDt VD VDt
0.482074 0.470162 0.425064 0.423022
0.490134 0.497361 0.497027 0.497361
0.452976 0.458831 0.391025 0.397360
0.430833 0.435286 0.481797 0.470162
0.378988 0.383886 0.414446 0.416754
0.408826 0.410391 0.391751 0.390681
0.479430 0.481227 0.501998 0.502625
0.492852 0.492042 0.478170 0.458831
0.509543 0.502625 0.400387 0.410391
0.488633 0.481227 0.461877 0.458831
iteration: 30 cost:0.000318 Vcost:0.000312 Tcost:0.000...
LM LMt VM VMt
0.368525 0.373684 0.236667 0.236842
0.209256 0.207895 0.172238 0.171053
0.607276 0.600000 0.099941 0.100000
0.745044 0.736842 0.747233 0.742105
0.181395 0.178947 0.798713 0.771053
0.408187 0.410526 0.602031 0.607895
0.198994 0.200000 0.522433 0.526316
0.517008 0.515789 0.177140 0.184211
0.453699 0.447368 0.690975 0.684211
0.754785 0.747368 0.539653 0.536842
LD LDt VD VDt
0.484090 0.470162 0.424078 0.423022
0.488894 0.497361 0.496845 0.497361
0.454151 0.458831 0.392170 0.397360
0.431942 0.435286 0.479797 0.470162
0.378411 0.383886 0.412639 0.416754
0.408240 0.410391 0.392456 0.390681
0.478446 0.481227 0.503676 0.502625
0.494990 0.492042 0.476556 0.458831
0.510137 0.502625 0.401455 0.410391
0.486560 0.481227 0.462410 0.458831
iteration: 40 cost:0.000263 Vcost:0.000258 Tcost:0.000...
LM LMt VM VMt
0.367054 0.373684 0.235392 0.236842
0.209217 0.207895 0.171412 0.171053
0.603519 0.600000 0.098626 0.100000
0.740709 0.736842 0.740217 0.742105
0.179576 0.178947 0.791683 0.771053
0.407239 0.410526 0.600252 0.607895
0.199336 0.200000 0.518886 0.526316
0.515219 0.515789 0.175736 0.184211
0.449732 0.447368 0.687024 0.684211
0.748579 0.747368 0.535993 0.536842
LD LDt VD VDt
0.484062 0.470162 0.423927 0.423022
0.488685 0.497361 0.496395 0.497361
0.453732 0.458831 0.392965 0.397360
0.432653 0.435286 0.478636 0.470162
0.378363 0.383886 0.411828 0.416754
0.407509 0.410391 0.392063 0.390681
0.478157 0.481227 0.502805 0.502625
0.494530 0.492042 0.475284 0.458831
0.509187 0.502625 0.402089 0.410391
0.485661 0.481227 0.461590 0.458831
iteration: 50 cost:0.000232 Vcost:0.000224 Tcost:0.000...
LM LMt VM VMt
0.367346 0.373684 0.235653 0.236842
0.209654 0.207895 0.171722 0.171053
0.604618 0.600000 0.099006 0.100000
0.743582 0.736842 0.744392 0.742105
0.178933 0.178947 0.791612 0.771053
0.408166 0.410526 0.602023 0.607895
0.199570 0.200000 0.520355 0.526316
0.516361 0.515789 0.176643 0.184211
0.449575 0.447368 0.688787 0.684211
0.752213 0.747368 0.536243 0.536842
LD LDt VD VDt
0.483705 0.470162 0.424064 0.423022
0.488929 0.497361 0.496503 0.497361
0.454274 0.458831 0.393785 0.397360
0.434048 0.435286 0.478984 0.470162
0.378421 0.383886 0.412202 0.416754
0.407249 0.410391 0.392203 0.390681
0.478246 0.481227 0.502693 0.502625
0.494766 0.492042 0.474781 0.458831
0.509062 0.502625 0.403209 0.410391
0.486368 0.481227 0.461834 0.458831
iteration: 60 cost:0.000210 Vcost:0.000205 Tcost:0.000...
LM LMt VM VMt
0.366058 0.373684 0.235057 0.236842
0.208510 0.207895 0.170865 0.171053
0.602064 0.600000 0.098755 0.100000
0.742149 0.736842 0.742560 0.742105
0.177733 0.178947 0.789410 0.771053
0.407253 0.410526 0.601609 0.607895
0.199376 0.200000 0.519358 0.526316
0.515446 0.515789 0.176571 0.184211
0.447728 0.447368 0.687723 0.684211
0.750639 0.747368 0.534266 0.536842
LD LDt VD VDt
0.482640 0.470162 0.423653 0.423022
0.488271 0.497361 0.495709 0.497361
0.453780 0.458831 0.393898 0.397360
0.434582 0.435286 0.478282 0.470162
0.378029 0.383886 0.412282 0.416754
0.406536 0.410391 0.391785 0.390681
0.477663 0.481227 0.501770 0.502625
0.494150 0.492042 0.473625 0.458831
0.508028 0.502625 0.403545 0.410391
0.486331 0.481227 0.461154 0.458831
iteration: 70 cost:0.000192 Vcost:0.000189 Tcost:0.000...
LM LMt VM VMt
0.366551 0.373684 0.235460 0.236842
0.209194 0.207895 0.171263 0.171053
0.602385 0.600000 0.098299 0.100000
0.740920 0.736842 0.740973 0.742105
0.176912 0.178947 0.785770 0.771053
0.407912 0.410526 0.602037 0.607895
0.199937 0.200000 0.519677 0.526316
0.515620 0.515789 0.177606 0.184211
0.448260 0.447368 0.687646 0.684211
0.748277 0.747368 0.534288 0.536842
LD LDt VD VDt
0.482442 0.470162 0.423972 0.423022
0.488732 0.497361 0.495760 0.497361
0.454396 0.458831 0.394567 0.397360
0.435656 0.435286 0.477990 0.470162
0.378217 0.383886 0.412567 0.416754
0.406743 0.410391 0.392037 0.390681
0.477821 0.481227 0.501831 0.502625
0.494534 0.492042 0.473336 0.458831
0.508283 0.502625 0.404500 0.410391
0.486492 0.481227 0.461490 0.458831
iteration: 80 cost:0.000179 Vcost:0.000176 Tcost:0.000...
LM LMt VM VMt
0.367097 0.373684 0.235862 0.236842
0.208833 0.207895 0.170683 0.171053
0.602723 0.600000 0.098402 0.100000
0.741796 0.736842 0.743590 0.742105
0.177261 0.178947 0.785572 0.771053
0.408356 0.410526 0.602654 0.607895
0.199423 0.200000 0.520444 0.526316
0.516455 0.515789 0.177881 0.184211
0.448164 0.447368 0.687853 0.684211
0.750466 0.747368 0.534466 0.536842
LD LDt VD VDt
0.482320 0.470162 0.424270 0.423022
0.489234 0.497361 0.495827 0.497361
0.454468 0.458831 0.395204 0.397360
0.436486 0.435286 0.477985 0.470162
0.378481 0.383886 0.413047 0.416754
0.406856 0.410391 0.392030 0.390681
0.477929 0.481227 0.501519 0.502625
0.494597 0.492042 0.473069 0.458831
0.508128 0.502625 0.405127 0.410391
0.486929 0.481227 0.461416 0.458831
iteration: 90 cost:0.000169 Vcost:0.000166 Tcost:0.000...
LM LMt VM VMt
0.366988 0.373684 0.236175 0.236842
0.208779 0.207895 0.170821 0.171053
0.602531 0.600000 0.098847 0.100000
0.740340 0.736842 0.742411 0.742105
0.177404 0.178947 0.783984 0.771053
0.409128 0.410526 0.603074 0.607895
0.199686 0.200000 0.520541 0.526316
0.516704 0.515789 0.178554 0.184211
0.448392 0.447368 0.687279 0.684211
0.749017 0.747368 0.534648 0.536842
LD LDt VD VDt
0.481418 0.470162 0.423920 0.423022
0.488865 0.497361 0.495262 0.497361
0.453951 0.458831 0.395242 0.397360
0.436351 0.435286 0.476913 0.470162
0.378167 0.383886 0.412811 0.416754
0.406544 0.410391 0.391529 0.390681
0.477354 0.481227 0.500639 0.502625
0.494082 0.492042 0.472009 0.458831
0.507442 0.502625 0.405065 0.410391
0.486284 0.481227 0.460876 0.458831
iteration: 100 cost:0.000160 Vcost:0.000166 Tcost:0.000...
LM LMt VM VMt
0.369301 0.373684 0.238464 0.236842
0.211108 0.207895 0.173110 0.171053
0.604930 0.600000 0.100630 0.100000
0.742970 0.736842 0.745455 0.742105
0.179242 0.178947 0.785821 0.771053
0.411218 0.410526 0.605378 0.607895
0.202172 0.200000 0.523012 0.526316
0.518761 0.515789 0.181217 0.184211
0.451301 0.447368 0.689549 0.684211
0.752027 0.747368 0.536521 0.536842
LD LDt VD VDt
0.481579 0.470162 0.424403 0.423022
0.489570 0.497361 0.495860 0.497361
0.454504 0.458831 0.395883 0.397360
0.436988 0.435286 0.476772 0.470162
0.378446 0.383886 0.413225 0.416754
0.406999 0.410391 0.391708 0.390681
0.477788 0.481227 0.501076 0.502625
0.494758 0.492042 0.472035 0.458831
0.508106 0.502625 0.405687 0.410391
0.486670 0.481227 0.461307 0.458831
TM TMt
0.439529 0.436842
0.642913 0.639474
0.772218 0.768421
0.184144 0.184211
0.168227 0.157895
0.326834 0.328947
0.306608 0.307895
0.626106 0.618421
0.640100 0.642105
0.874542 0.873684
TD TDt
0.511883 0.512989
0.401670 0.403928
0.494831 0.502625
0.411236 0.410391
0.504640 0.512989
0.469669 0.475727
0.469352 0.464531
0.406509 0.403928
0.411623 0.410391
0.492071 0.481227
real 94m54.800s
user 79m21.916s
sys 14m48.856s
}}
**全体の幅285、高さ50の場合 [#kf6e283f]
#pre{{
Start Data Load
Data Setting
Setting Layer
MNIST Digit
# nclass : 10 row : 50 col : 285 #
Training data : ndata 50000
Validation data : ndata 4000
Test data : ndata 8000
Parameters
eta : 0.01 epoch : 100 A : 0.9 batch_size : 100 #
### conv_layer ###
# kernel: (64, 5, 15) output_size: (64, 46, 46) act_fun...
# stride: [1, 6] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (3, 3) output_size: (64, 15, 15) ignore_border: T...
# stride: None padding: (0, 0) act_func: False dropo...
### conv_layer ###
# kernel: (64, 3, 3) output_size: (64, 13, 13) act_func...
# stride: [1, 1] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (2, 2) output_size: (64, 6, 6) ignore_border: Tru...
# stride: None padding: (0, 0) act_func: False dropo...
### Fully_Conected_Layer ###
# input: 2304 output: 1024 iniW: -0.01 - 0.01 act_func: ...
### Detector ###
# input: 1024 output: 2 iniWv: 0 - 0.5 iniWm: 0 - 0.5 dr...
iteration: 0 Lcost:0.712819 Vcost:0.712262
LM LMt VM VMt
0.119311 0.080702 0.118604 0.512281
0.122844 0.861404 0.118067 0.342105
0.115383 0.815789 0.119438 0.384211
0.119259 0.407018 0.117567 0.387719
0.121355 0.089474 0.122917 0.340351
0.116543 0.807018 0.122672 0.356140
0.119233 0.303509 0.114185 0.550877
0.122478 0.178947 0.119092 0.124561
0.125327 0.887719 0.114498 0.142105
0.121215 0.098246 0.115548 0.719298
LD LDt VD VDt
1.059973 0.345396 1.060063 0.345396
1.061560 0.318990 1.058241 0.340279
1.058228 0.414644 1.059846 0.329806
1.058074 0.313442 1.058442 0.379288
1.060147 0.388429 1.061110 0.313442
1.058281 0.410391 1.060452 0.329806
1.058248 0.318990 1.056417 0.418854
1.062828 0.355409 1.058366 0.397360
1.061586 0.355409 1.056614 0.379288
1.060555 0.365148 1.057548 0.374634
Start Training
iteration: 1 cost:0.124232 Vcost:0.023372 Tcost:0.022...
LM LMt VM VMt
0.153680 0.080702 0.500693 0.512281
0.768619 0.861404 0.336452 0.342105
0.931429 0.815789 0.349253 0.384211
0.406636 0.407018 0.371415 0.387719
0.133984 0.089474 0.357110 0.340351
0.854853 0.807018 0.304380 0.356140
0.310934 0.303509 0.555906 0.550877
0.165277 0.178947 0.135206 0.124561
0.824841 0.887719 0.146835 0.142105
0.134991 0.098246 0.694764 0.719298
LD LDt VD VDt
0.347334 0.345396 0.370154 0.345396
0.394268 0.318990 0.364141 0.340279
0.409865 0.414644 0.363356 0.329806
0.362555 0.313442 0.376474 0.379288
0.349830 0.388429 0.360611 0.313442
0.401141 0.410391 0.360938 0.329806
0.360469 0.318990 0.385414 0.418854
0.359914 0.355409 0.353999 0.397360
0.400006 0.355409 0.356954 0.379288
0.349693 0.365148 0.383936 0.374634
iteration: 2 cost:0.016417 Vcost:0.009285 Tcost:0.009...
LM LMt VM VMt
0.092214 0.080702 0.494959 0.512281
0.864403 0.861404 0.341210 0.342105
0.871225 0.815789 0.347276 0.384211
0.390239 0.407018 0.378966 0.387719
0.100980 0.089474 0.353169 0.340351
0.822190 0.807018 0.310617 0.356140
0.323317 0.303509 0.553160 0.550877
0.167782 0.178947 0.125902 0.124561
0.888168 0.887719 0.132919 0.142105
0.101684 0.098246 0.690694 0.719298
LD LDt VD VDt
0.343272 0.345396 0.358965 0.345396
0.376414 0.318990 0.354385 0.340279
0.388519 0.414644 0.354696 0.329806
0.346712 0.313442 0.382817 0.379288
0.357680 0.388429 0.344859 0.313442
0.378544 0.410391 0.350594 0.329806
0.347443 0.318990 0.405343 0.418854
0.369293 0.355409 0.367636 0.397360
0.380164 0.355409 0.369378 0.379288
0.353657 0.365148 0.375821 0.374634
iteration: 3 cost:0.008920 Vcost:0.004448 Tcost:0.004...
LM LMt VM VMt
0.089928 0.080702 0.501690 0.512281
0.871110 0.861404 0.336237 0.342105
0.863116 0.815789 0.361102 0.384211
0.389940 0.407018 0.380128 0.387719
0.093307 0.089474 0.354247 0.340351
0.820133 0.807018 0.322298 0.356140
0.326629 0.303509 0.543323 0.550877
0.162525 0.178947 0.116501 0.124561
0.926949 0.887719 0.124404 0.142105
0.096042 0.098246 0.707885 0.719298
LD LDt VD VDt
0.342414 0.345396 0.348925 0.345396
0.362065 0.318990 0.343006 0.340279
0.396631 0.414644 0.346316 0.329806
0.334558 0.313442 0.384915 0.379288
0.364573 0.388429 0.332271 0.313442
0.379850 0.410391 0.340432 0.329806
0.334022 0.318990 0.416908 0.418854
0.369348 0.355409 0.377282 0.397360
0.370745 0.355409 0.377342 0.379288
0.356643 0.365148 0.383133 0.374634
iteration: 4 cost:0.003790 Vcost:0.002997 Tcost:0.003...
LM LMt VM VMt
0.091467 0.080702 0.522886 0.512281
0.886552 0.861404 0.343852 0.342105
0.882613 0.815789 0.375352 0.384211
0.403012 0.407018 0.394336 0.387719
0.092938 0.089474 0.354808 0.340351
0.841430 0.807018 0.335765 0.356140
0.327743 0.303509 0.555279 0.550877
0.169493 0.178947 0.120075 0.124561
0.932859 0.887719 0.128876 0.142105
0.103056 0.098246 0.726280 0.719298
LD LDt VD VDt
0.341299 0.345396 0.344152 0.345396
0.353621 0.318990 0.338312 0.340279
0.406453 0.414644 0.340136 0.329806
0.327988 0.313442 0.386064 0.379288
0.368304 0.388429 0.324354 0.313442
0.385605 0.410391 0.334445 0.329806
0.325547 0.318990 0.421172 0.418854
0.365881 0.355409 0.382915 0.397360
0.364956 0.355409 0.381448 0.379288
0.358773 0.365148 0.385780 0.374634
iteration: 5 cost:0.002601 Vcost:0.002032 Tcost:0.002...
LM LMt VM VMt
0.086351 0.080702 0.510713 0.512281
0.875041 0.861404 0.332466 0.342105
0.854308 0.815789 0.367567 0.384211
0.393344 0.407018 0.384489 0.387719
0.085735 0.089474 0.341892 0.340351
0.817138 0.807018 0.328408 0.356140
0.314911 0.303509 0.539486 0.550877
0.164440 0.178947 0.118200 0.124561
0.913473 0.887719 0.127069 0.142105
0.100227 0.098246 0.708850 0.719298
LD LDt VD VDt
0.341470 0.345396 0.341766 0.345396
0.348947 0.318990 0.336581 0.340279
0.408317 0.414644 0.336991 0.329806
0.324685 0.313442 0.386583 0.379288
0.371070 0.388429 0.321087 0.313442
0.386237 0.410391 0.331574 0.329806
0.321629 0.318990 0.422028 0.418854
0.363478 0.355409 0.387143 0.397360
0.361560 0.355409 0.384262 0.379288
0.360458 0.365148 0.383751 0.374634
iteration: 10 cost:0.001097 Vcost:0.001193 Tcost:0.001...
LM LMt VM VMt
0.080075 0.080702 0.506964 0.512281
0.860828 0.861404 0.333891 0.342105
0.827171 0.815789 0.376301 0.384211
0.395684 0.407018 0.388408 0.387719
0.080552 0.089474 0.335281 0.340351
0.794183 0.807018 0.338496 0.356140
0.306702 0.303509 0.531424 0.550877
0.165791 0.178947 0.121257 0.124561
0.886653 0.887719 0.132696 0.142105
0.102764 0.098246 0.705657 0.719298
LD LDt VD VDt
0.341903 0.345396 0.341829 0.345396
0.338388 0.318990 0.339576 0.340279
0.414757 0.414644 0.334112 0.329806
0.321593 0.313442 0.389160 0.379288
0.378549 0.388429 0.319751 0.313442
0.392473 0.410391 0.331097 0.329806
0.319718 0.318990 0.421581 0.418854
0.358632 0.355409 0.395889 0.397360
0.357889 0.355409 0.389922 0.379288
0.365296 0.365148 0.381627 0.374634
iteration: 20 cost:0.000588 Vcost:0.000564 Tcost:0.000...
LM LMt VM VMt
0.080098 0.080702 0.511433 0.512281
0.871134 0.861404 0.337942 0.342105
0.823592 0.815789 0.385146 0.384211
0.401631 0.407018 0.390300 0.387719
0.086043 0.089474 0.337789 0.340351
0.801895 0.807018 0.348743 0.356140
0.307730 0.303509 0.541869 0.550877
0.170873 0.178947 0.122150 0.124561
0.896420 0.887719 0.138009 0.142105
0.107112 0.098246 0.717558 0.719298
LD LDt VD VDt
0.340496 0.345396 0.342568 0.345396
0.332845 0.318990 0.340935 0.340279
0.414311 0.414644 0.331317 0.329806
0.319338 0.313442 0.386933 0.379288
0.384130 0.388429 0.319207 0.313442
0.397721 0.410391 0.330752 0.329806
0.319261 0.318990 0.416569 0.418854
0.356235 0.355409 0.399611 0.397360
0.359167 0.355409 0.389901 0.379288
0.367878 0.365148 0.380503 0.374634
iteration: 30 cost:0.000435 Vcost:0.000484 Tcost:0.000...
LM LMt VM VMt
0.080725 0.080702 0.516455 0.512281
0.873076 0.861404 0.342167 0.342105
0.826951 0.815789 0.390604 0.384211
0.406500 0.407018 0.393401 0.387719
0.090447 0.089474 0.341794 0.340351
0.808074 0.807018 0.355818 0.356140
0.310147 0.303509 0.547109 0.550877
0.175695 0.178947 0.123029 0.124561
0.900580 0.887719 0.142605 0.142105
0.109702 0.098246 0.723483 0.719298
LD LDt VD VDt
0.340438 0.345396 0.343622 0.345396
0.329054 0.318990 0.341590 0.340279
0.413092 0.414644 0.330245 0.329806
0.318350 0.313442 0.386566 0.379288
0.388405 0.388429 0.318883 0.313442
0.398991 0.410391 0.331043 0.329806
0.319641 0.318990 0.415421 0.418854
0.356985 0.355409 0.401148 0.397360
0.359525 0.355409 0.389009 0.379288
0.369870 0.365148 0.379407 0.374634
iteration: 40 cost:0.000367 Vcost:0.000382 Tcost:0.000...
LM LMt VM VMt
0.077430 0.080702 0.509723 0.512281
0.865805 0.861404 0.336337 0.342105
0.818800 0.815789 0.385339 0.384211
0.401172 0.407018 0.387115 0.387719
0.088938 0.089474 0.337177 0.340351
0.801395 0.807018 0.351179 0.356140
0.303378 0.303509 0.538972 0.550877
0.173579 0.178947 0.119374 0.124561
0.894693 0.887719 0.140052 0.142105
0.106469 0.098246 0.717836 0.719298
LD LDt VD VDt
0.339420 0.345396 0.343303 0.345396
0.327219 0.318990 0.340810 0.340279
0.412254 0.414644 0.328841 0.329806
0.317306 0.313442 0.384778 0.379288
0.389440 0.388429 0.317776 0.313442
0.400017 0.410391 0.330338 0.329806
0.319165 0.318990 0.413069 0.418854
0.356025 0.355409 0.400047 0.397360
0.359889 0.355409 0.385929 0.379288
0.369441 0.365148 0.378221 0.374634
iteration: 50 cost:0.000318 Vcost:0.000322 Tcost:0.000...
LM LMt VM VMt
0.079142 0.080702 0.511292 0.512281
0.867320 0.861404 0.338803 0.342105
0.821324 0.815789 0.387300 0.384211
0.403620 0.407018 0.388232 0.387719
0.091709 0.089474 0.339579 0.340351
0.804973 0.807018 0.353276 0.356140
0.304513 0.303509 0.542928 0.550877
0.176736 0.178947 0.121641 0.124561
0.896684 0.887719 0.142519 0.142105
0.108263 0.098246 0.719739 0.719298
LD LDt VD VDt
0.339087 0.345396 0.343130 0.345396
0.325648 0.318990 0.340661 0.340279
0.411163 0.414644 0.328066 0.329806
0.316713 0.313442 0.383936 0.379288
0.390442 0.388429 0.317166 0.313442
0.400296 0.410391 0.330048 0.329806
0.319130 0.318990 0.412426 0.418854
0.355822 0.355409 0.399425 0.397360
0.359499 0.355409 0.384214 0.379288
0.369286 0.365148 0.376767 0.374634
iteration: 60 cost:0.000284 Vcost:0.000300 Tcost:0.000...
LM LMt VM VMt
0.077729 0.080702 0.510505 0.512281
0.865970 0.861404 0.338162 0.342105
0.819565 0.815789 0.386961 0.384211
0.402667 0.407018 0.387048 0.387719
0.090570 0.089474 0.339195 0.340351
0.804483 0.807018 0.352699 0.356140
0.302433 0.303509 0.542984 0.550877
0.175755 0.178947 0.119989 0.124561
0.896012 0.887719 0.141376 0.142105
0.106365 0.098246 0.719633 0.719298
LD LDt VD VDt
0.338998 0.345396 0.343179 0.345396
0.324392 0.318990 0.340440 0.340279
0.410532 0.414644 0.327504 0.329806
0.316182 0.313442 0.383249 0.379288
0.391154 0.388429 0.316597 0.313442
0.400632 0.410391 0.329683 0.329806
0.319050 0.318990 0.412305 0.418854
0.355575 0.355409 0.398725 0.397360
0.359534 0.355409 0.383025 0.379288
0.369142 0.365148 0.375815 0.374634
iteration: 70 cost:0.000262 Vcost:0.000275 Tcost:0.000...
LM LMt VM VMt
0.078567 0.080702 0.510107 0.512281
0.865997 0.861404 0.338764 0.342105
0.818469 0.815789 0.386978 0.384211
0.402240 0.407018 0.387352 0.387719
0.091683 0.089474 0.339292 0.340351
0.803862 0.807018 0.353049 0.356140
0.301789 0.303509 0.543373 0.550877
0.177417 0.178947 0.121069 0.124561
0.895266 0.887719 0.143113 0.142105
0.106815 0.098246 0.719367 0.719298
LD LDt VD VDt
0.339546 0.345396 0.343713 0.345396
0.323581 0.318990 0.340857 0.340279
0.410992 0.414644 0.327812 0.329806
0.316188 0.313442 0.383695 0.379288
0.392331 0.388429 0.316482 0.313442
0.401448 0.410391 0.330008 0.329806
0.319490 0.318990 0.413341 0.418854
0.356072 0.355409 0.398673 0.397360
0.359870 0.355409 0.382915 0.379288
0.369554 0.365148 0.375817 0.374634
iteration: 80 cost:0.000244 Vcost:0.000252 Tcost:0.000...
LM LMt VM VMt
0.078636 0.080702 0.511431 0.512281
0.867592 0.861404 0.340455 0.342105
0.820250 0.815789 0.388378 0.384211
0.403839 0.407018 0.388483 0.387719
0.091228 0.089474 0.341198 0.340351
0.806468 0.807018 0.355087 0.356140
0.303069 0.303509 0.545296 0.550877
0.177474 0.178947 0.120583 0.124561
0.897312 0.887719 0.142800 0.142105
0.106190 0.098246 0.721818 0.719298
LD LDt VD VDt
0.339490 0.345396 0.344050 0.345396
0.323106 0.318990 0.341196 0.340279
0.411145 0.414644 0.327802 0.329806
0.316197 0.313442 0.383599 0.379288
0.392286 0.388429 0.316455 0.313442
0.402222 0.410391 0.330304 0.329806
0.319810 0.318990 0.413728 0.418854
0.355833 0.355409 0.397904 0.397360
0.360113 0.355409 0.382081 0.379288
0.369132 0.365148 0.375499 0.374634
iteration: 90 cost:0.000229 Vcost:0.000257 Tcost:0.000...
LM LMt VM VMt
0.078458 0.080702 0.509208 0.512281
0.863847 0.861404 0.339710 0.342105
0.815271 0.815789 0.387022 0.384211
0.402081 0.407018 0.387611 0.387719
0.091647 0.089474 0.340198 0.340351
0.802075 0.807018 0.354367 0.356140
0.302119 0.303509 0.543400 0.550877
0.177882 0.178947 0.121087 0.124561
0.893654 0.887719 0.143465 0.142105
0.106029 0.098246 0.716744 0.719298
LD LDt VD VDt
0.339289 0.345396 0.343510 0.345396
0.322269 0.318990 0.341067 0.340279
0.410592 0.414644 0.327355 0.329806
0.315700 0.313442 0.382969 0.379288
0.392286 0.388429 0.316050 0.313442
0.402031 0.410391 0.330150 0.329806
0.319663 0.318990 0.412777 0.418854
0.355512 0.355409 0.397410 0.397360
0.359846 0.355409 0.381551 0.379288
0.368711 0.365148 0.374214 0.374634
iteration: 100 cost:0.000216 Vcost:0.000228 Tcost:0.000...
LM LMt VM VMt
0.079470 0.080702 0.511809 0.512281
0.868065 0.861404 0.341166 0.342105
0.819981 0.815789 0.388439 0.384211
0.403852 0.407018 0.389832 0.387719
0.092599 0.089474 0.341649 0.340351
0.806841 0.807018 0.356264 0.356140
0.303251 0.303509 0.547579 0.550877
0.179090 0.178947 0.121915 0.124561
0.897182 0.887719 0.144588 0.142105
0.106589 0.098246 0.721664 0.719298
LD LDt VD VDt
0.339644 0.345396 0.344078 0.345396
0.322173 0.318990 0.341247 0.340279
0.411333 0.414644 0.327503 0.329806
0.315765 0.313442 0.383123 0.379288
0.392782 0.388429 0.315967 0.313442
0.402884 0.410391 0.330358 0.329806
0.319771 0.318990 0.413943 0.418854
0.355689 0.355409 0.397381 0.397360
0.360294 0.355409 0.381490 0.379288
0.368783 0.365148 0.374564 0.374634
TM TMt
0.909971 0.896491
0.660288 0.659649
0.525536 0.521053
0.610740 0.607018
0.790808 0.787719
0.312694 0.308772
0.838794 0.842105
0.536332 0.536842
0.500565 0.498246
0.630944 0.629825
TD TDt
0.331172 0.318990
0.379741 0.374634
0.336575 0.340279
0.365679 0.365148
0.395563 0.397360
0.317239 0.313442
0.325185 0.324443
0.364692 0.365148
0.413024 0.418854
0.389331 0.388429
real 69m11.355s
user 58m54.672s
sys 9m41.976s
}}
**画像全体の幅190、高さ95の場合 [#a1e1f209]
#pre{{
Using gpu device 1: Tesla K20c
Start Data Load
Data Setting
Setting Layer
MNIST Digit
# nclass : 10 row : 95 col : 190 #
Training data : ndata 50000
Validation data : ndata 4000
Test data : ndata 8000
Parameters
eta : 0.01 epoch : 100 A : 0.9 batch_size : 100 #
### conv_layer ###
# kernel: (64, 5, 10) output_size: (64, 46, 46) act_fun...
# stride: [2, 4] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (3, 3) output_size: (64, 15, 15) ignore_border: T...
# stride: None padding: (0, 0) act_func: False dropo...
### conv_layer ###
# kernel: (64, 3, 3) output_size: (64, 13, 13) act_func...
# stride: [1, 1] iniW: -0.01 - 0.01 dropout_rate : 1.0 #
### Pool_layer ###
# ds: (2, 2) output_size: (64, 6, 6) ignore_border: Tru...
# stride: None padding: (0, 0) act_func: False dropo...
### Fully_Conected_Layer ###
# input: 2304 output: 1024 iniW: -0.01 - 0.01 act_func: ...
### Detector ###
# input: 1024 output: 2 iniWv: 0 - 0.5 iniWm: 0 - 0.5 dr...
iteration: 0 Lcost:0.378894 Vcost:0.381813
LM LMt VM VMt
0.080673 0.586842 0.091890 0.626316
0.092097 0.392105 0.081559 0.347368
0.081604 0.392105 0.083329 0.552632
0.073442 0.657895 0.092660 0.726316
0.080810 0.605263 0.091964 0.815789
0.091668 0.565789 0.092341 0.492105
0.095112 0.534211 0.085601 0.286842
0.089143 0.273684 0.080332 0.407895
0.095610 0.802632 0.091686 0.607895
0.095210 0.668421 0.094088 0.671053
LD LDt VD VDt
1.040256 0.628281 1.045557 0.502625
1.046503 0.518094 1.039922 0.656947
1.040901 0.644817 1.041857 0.640723
1.036377 0.695852 1.046017 0.458831
1.039435 0.703375 1.045313 0.533114
1.045332 0.416754 1.046227 0.390681
1.047490 0.403928 1.042155 0.619847
1.044224 0.542897 1.039955 0.668856
1.048193 0.528155 1.045639 0.538028
1.047514 0.470162 1.046403 0.429198
Start Training
iteration: 1 cost:0.053136 Vcost:0.015868 Tcost:0.015...
LM LMt VM VMt
0.603411 0.586842 0.632287 0.626316
0.387499 0.392105 0.369934 0.347368
0.421198 0.392105 0.583102 0.552632
0.697029 0.657895 0.751135 0.726316
0.686731 0.605263 0.830366 0.815789
0.551832 0.565789 0.497771 0.492105
0.521345 0.534211 0.307570 0.286842
0.246327 0.273684 0.436824 0.407895
0.846901 0.802632 0.610481 0.607895
0.678670 0.668421 0.631039 0.671053
LD LDt VD VDt
0.611984 0.628281 0.534740 0.502625
0.533035 0.518094 0.645756 0.656947
0.653455 0.644817 0.633945 0.640723
0.637173 0.695852 0.538165 0.458831
0.669650 0.703375 0.556049 0.533114
0.505989 0.416754 0.497527 0.390681
0.501342 0.403928 0.600240 0.619847
0.524088 0.542897 0.669964 0.668856
0.558273 0.528155 0.545677 0.538028
0.527588 0.470162 0.516969 0.429198
iteration: 2 cost:0.009099 Vcost:0.005477 Tcost:0.005...
LM LMt VM VMt
0.586297 0.586842 0.627719 0.626316
0.398542 0.392105 0.342284 0.347368
0.400709 0.392105 0.565496 0.552632
0.662460 0.657895 0.777861 0.726316
0.646822 0.605263 0.847363 0.815789
0.575555 0.565789 0.506218 0.492105
0.541364 0.534211 0.297501 0.286842
0.262251 0.273684 0.415255 0.407895
0.868280 0.802632 0.616294 0.607895
0.681512 0.668421 0.645517 0.671053
LD LDt VD VDt
0.627972 0.628281 0.503853 0.502625
0.510057 0.518094 0.670316 0.656947
0.666197 0.644817 0.649345 0.640723
0.680880 0.695852 0.491564 0.458831
0.717730 0.703375 0.519286 0.533114
0.457498 0.416754 0.446527 0.390681
0.451616 0.403928 0.627317 0.619847
0.536090 0.542897 0.689217 0.668856
0.522293 0.528155 0.527035 0.538028
0.482429 0.470162 0.467726 0.429198
iteration: 3 cost:0.004474 Vcost:0.003242 Tcost:0.002...
LM LMt VM VMt
0.569464 0.586842 0.604780 0.626316
0.387447 0.392105 0.338635 0.347368
0.392622 0.392105 0.546592 0.552632
0.639179 0.657895 0.741429 0.726316
0.612439 0.605263 0.814775 0.815789
0.573112 0.565789 0.491830 0.492105
0.530267 0.534211 0.288472 0.286842
0.261095 0.273684 0.414545 0.407895
0.833687 0.802632 0.604209 0.607895
0.662560 0.668421 0.631201 0.671053
LD LDt VD VDt
0.628981 0.628281 0.498169 0.502625
0.510085 0.518094 0.673180 0.656947
0.660917 0.644817 0.645673 0.640723
0.686436 0.695852 0.473655 0.458831
0.715070 0.703375 0.508567 0.533114
0.442534 0.416754 0.430859 0.390681
0.436304 0.403928 0.634998 0.619847
0.551464 0.542897 0.685105 0.668856
0.511537 0.528155 0.527912 0.538028
0.470377 0.470162 0.452642 0.429198
iteration: 4 cost:0.002871 Vcost:0.002389 Tcost:0.002...
LM LMt VM VMt
0.573152 0.586842 0.615530 0.626316
0.391550 0.392105 0.344729 0.347368
0.396765 0.392105 0.553207 0.552632
0.644288 0.657895 0.736261 0.726316
0.610777 0.605263 0.817992 0.815789
0.584445 0.565789 0.499591 0.492105
0.535918 0.534211 0.288006 0.286842
0.263690 0.273684 0.418951 0.407895
0.832475 0.802632 0.607238 0.607895
0.671249 0.668421 0.641334 0.671053
LD LDt VD VDt
0.630300 0.628281 0.498236 0.502625
0.512428 0.518094 0.673720 0.656947
0.658145 0.644817 0.645368 0.640723
0.688541 0.695852 0.465179 0.458831
0.713509 0.703375 0.506865 0.533114
0.436311 0.416754 0.423793 0.390681
0.429966 0.403928 0.635244 0.619847
0.557453 0.542897 0.681244 0.668856
0.509718 0.528155 0.530270 0.538028
0.466492 0.470162 0.445898 0.429198
iteration: 5 cost:0.002207 Vcost:0.002030 Tcost:0.001...
LM LMt VM VMt
0.577879 0.586842 0.629659 0.626316
0.397565 0.392105 0.344506 0.347368
0.394728 0.392105 0.555250 0.552632
0.654697 0.657895 0.742657 0.726316
0.615015 0.605263 0.828108 0.815789
0.597018 0.565789 0.514040 0.492105
0.546239 0.534211 0.285634 0.286842
0.263585 0.273684 0.417409 0.407895
0.834453 0.802632 0.613327 0.607895
0.684449 0.668421 0.655633 0.671053
LD LDt VD VDt
0.625413 0.628281 0.494537 0.502625
0.510390 0.518094 0.666013 0.656947
0.650036 0.644817 0.637380 0.640723
0.683808 0.695852 0.458824 0.458831
0.704666 0.703375 0.505779 0.533114
0.431103 0.416754 0.418459 0.390681
0.424597 0.403928 0.629588 0.619847
0.555025 0.542897 0.671909 0.668856
0.507115 0.528155 0.528365 0.538028
0.462551 0.470162 0.439832 0.429198
iteration: 10 cost:0.001017 Vcost:0.000977 Tcost:0.000...
LM LMt VM VMt
0.581829 0.586842 0.623290 0.626316
0.390425 0.392105 0.349787 0.347368
0.394476 0.392105 0.556750 0.552632
0.656735 0.657895 0.719098 0.726316
0.611477 0.605263 0.815657 0.815789
0.589952 0.565789 0.498390 0.492105
0.530805 0.534211 0.288817 0.286842
0.263029 0.273684 0.415288 0.407895
0.814105 0.802632 0.606656 0.607895
0.682475 0.668421 0.655820 0.671053
LD LDt VD VDt
0.628762 0.628281 0.495488 0.502625
0.517038 0.518094 0.663344 0.656947
0.648888 0.644817 0.639344 0.640723
0.686801 0.695852 0.452647 0.458831
0.709344 0.703375 0.518079 0.533114
0.421551 0.416754 0.409624 0.390681
0.417123 0.403928 0.627009 0.619847
0.552159 0.542897 0.670113 0.668856
0.517296 0.528155 0.534389 0.538028
0.461587 0.470162 0.430071 0.429198
iteration: 20 cost:0.000526 Vcost:0.000532 Tcost:0.000...
LM LMt VM VMt
0.577574 0.586842 0.624820 0.626316
0.386682 0.392105 0.351500 0.347368
0.391962 0.392105 0.557585 0.552632
0.652833 0.657895 0.715647 0.726316
0.609823 0.605263 0.807305 0.815789
0.585997 0.565789 0.495556 0.492105
0.525602 0.534211 0.291695 0.286842
0.272551 0.273684 0.410449 0.407895
0.804208 0.802632 0.599620 0.607895
0.678615 0.668421 0.659797 0.671053
LD LDt VD VDt
0.625934 0.628281 0.495509 0.502625
0.519359 0.518094 0.655328 0.656947
0.646335 0.644817 0.635024 0.640723
0.684950 0.695852 0.451689 0.458831
0.709137 0.703375 0.525784 0.533114
0.415382 0.416754 0.402801 0.390681
0.410866 0.403928 0.624274 0.619847
0.543873 0.542897 0.665696 0.668856
0.523977 0.528155 0.532522 0.538028
0.462404 0.470162 0.422745 0.429198
iteration: 30 cost:0.000368 Vcost:0.000376 Tcost:0.000...
LM LMt VM VMt
0.578604 0.586842 0.630098 0.626316
0.387107 0.392105 0.350803 0.347368
0.392524 0.392105 0.559950 0.552632
0.655146 0.657895 0.718114 0.726316
0.611519 0.605263 0.804848 0.815789
0.585320 0.565789 0.497504 0.492105
0.528500 0.534211 0.288993 0.286842
0.274186 0.273684 0.409815 0.407895
0.799884 0.802632 0.601318 0.607895
0.679689 0.668421 0.665528 0.671053
LD LDt VD VDt
0.627635 0.628281 0.498287 0.502625
0.520969 0.518094 0.652965 0.656947
0.646878 0.644817 0.634929 0.640723
0.686492 0.695852 0.453498 0.458831
0.709439 0.703375 0.530176 0.533114
0.414667 0.416754 0.400836 0.390681
0.409530 0.403928 0.624502 0.619847
0.542327 0.542897 0.664803 0.668856
0.526535 0.528155 0.533647 0.538028
0.465824 0.470162 0.422134 0.429198
iteration: 40 cost:0.000288 Vcost:0.000301 Tcost:0.000...
LM LMt VM VMt
0.578464 0.586842 0.629409 0.626316
0.386534 0.392105 0.350455 0.347368
0.392796 0.392105 0.559544 0.552632
0.657067 0.657895 0.719629 0.726316
0.612200 0.605263 0.805458 0.815789
0.580278 0.565789 0.495928 0.492105
0.526918 0.534211 0.289576 0.286842
0.275520 0.273684 0.410169 0.407895
0.799517 0.802632 0.599815 0.607895
0.677463 0.668421 0.666360 0.671053
LD LDt VD VDt
0.629098 0.628281 0.499440 0.502625
0.522053 0.518094 0.652871 0.656947
0.647849 0.644817 0.634972 0.640723
0.687576 0.695852 0.455070 0.458831
0.709446 0.703375 0.532969 0.533114
0.414024 0.416754 0.399319 0.390681
0.408610 0.403928 0.625932 0.619847
0.543147 0.542897 0.665398 0.668856
0.527585 0.528155 0.533367 0.538028
0.467712 0.470162 0.421619 0.429198
iteration: 50 cost:0.000237 Vcost:0.000248 Tcost:0.000...
LM LMt VM VMt
0.580535 0.586842 0.631652 0.626316
0.386479 0.392105 0.350954 0.347368
0.392308 0.392105 0.560184 0.552632
0.659371 0.657895 0.724966 0.726316
0.613801 0.605263 0.808934 0.815789
0.581525 0.565789 0.497744 0.492105
0.530098 0.534211 0.289121 0.286842
0.275713 0.273684 0.410535 0.407895
0.801573 0.802632 0.601846 0.607895
0.678608 0.668421 0.670939 0.671053
LD LDt VD VDt
0.628985 0.628281 0.499618 0.502625
0.521917 0.518094 0.652002 0.656947
0.647102 0.644817 0.634122 0.640723
0.687301 0.695852 0.456203 0.458831
0.708576 0.703375 0.534148 0.533114
0.413938 0.416754 0.398216 0.390681
0.408274 0.403928 0.625477 0.619847
0.543288 0.542897 0.664725 0.668856
0.527075 0.528155 0.532641 0.538028
0.468614 0.470162 0.421054 0.429198
iteration: 60 cost:0.000205 Vcost:0.000216 Tcost:0.000...
LM LMt VM VMt
0.582211 0.586842 0.632523 0.626316
0.387237 0.392105 0.350863 0.347368
0.392621 0.392105 0.560747 0.552632
0.661421 0.657895 0.725059 0.726316
0.613703 0.605263 0.808735 0.815789
0.580853 0.565789 0.497801 0.492105
0.531573 0.534211 0.289041 0.286842
0.274840 0.273684 0.410770 0.407895
0.799989 0.802632 0.603432 0.607895
0.677919 0.668421 0.671264 0.671053
LD LDt VD VDt
0.629655 0.628281 0.499980 0.502625
0.522172 0.518094 0.652110 0.656947
0.647388 0.644817 0.634694 0.640723
0.688026 0.695852 0.456899 0.458831
0.708702 0.703375 0.534711 0.533114
0.413957 0.416754 0.397482 0.390681
0.408171 0.403928 0.625421 0.619847
0.543930 0.542897 0.664983 0.668856
0.526369 0.528155 0.532881 0.538028
0.469235 0.470162 0.420664 0.429198
iteration: 70 cost:0.000181 Vcost:0.000193 Tcost:0.000...
LM LMt VM VMt
0.583888 0.586842 0.632974 0.626316
0.387566 0.392105 0.350734 0.347368
0.393625 0.392105 0.561644 0.552632
0.662764 0.657895 0.727408 0.726316
0.613940 0.605263 0.808803 0.815789
0.580671 0.565789 0.497717 0.492105
0.531937 0.534211 0.289669 0.286842
0.274760 0.273684 0.411518 0.407895
0.798534 0.802632 0.604518 0.607895
0.678639 0.668421 0.673072 0.671053
LD LDt VD VDt
0.629538 0.628281 0.499603 0.502625
0.521597 0.518094 0.651126 0.656947
0.646778 0.644817 0.634623 0.640723
0.688274 0.695852 0.457521 0.458831
0.708389 0.703375 0.534459 0.533114
0.413891 0.416754 0.396617 0.390681
0.407863 0.403928 0.624421 0.619847
0.543764 0.542897 0.664230 0.668856
0.525152 0.528155 0.532476 0.538028
0.469645 0.470162 0.420456 0.429198
iteration: 80 cost:0.000164 Vcost:0.000180 Tcost:0.000...
LM LMt VM VMt
0.585176 0.586842 0.633618 0.626316
0.389113 0.392105 0.350733 0.347368
0.394306 0.392105 0.562033 0.552632
0.665283 0.657895 0.728502 0.726316
0.614829 0.605263 0.811490 0.815789
0.580038 0.565789 0.498397 0.492105
0.532626 0.534211 0.290286 0.286842
0.275700 0.273684 0.411627 0.407895
0.799726 0.802632 0.605375 0.607895
0.678687 0.668421 0.673746 0.671053
LD LDt VD VDt
0.629888 0.628281 0.499839 0.502625
0.522219 0.518094 0.651548 0.656947
0.647470 0.644817 0.635354 0.640723
0.689210 0.695852 0.458319 0.458831
0.709058 0.703375 0.535309 0.533114
0.414112 0.416754 0.396455 0.390681
0.408115 0.403928 0.624767 0.619847
0.544916 0.542897 0.664543 0.668856
0.525060 0.528155 0.532770 0.538028
0.470183 0.470162 0.420589 0.429198
iteration: 90 cost:0.000150 Vcost:0.000163 Tcost:0.000...
LM LMt VM VMt
0.584068 0.586842 0.631341 0.626316
0.388430 0.392105 0.349543 0.347368
0.393942 0.392105 0.560084 0.552632
0.663871 0.657895 0.726275 0.726316
0.612336 0.605263 0.809609 0.815789
0.577741 0.565789 0.496983 0.492105
0.531157 0.534211 0.288987 0.286842
0.274497 0.273684 0.410959 0.407895
0.796365 0.802632 0.603852 0.607895
0.675484 0.668421 0.672015 0.671053
LD LDt VD VDt
0.629578 0.628281 0.499712 0.502625
0.522042 0.518094 0.651284 0.656947
0.647664 0.644817 0.635646 0.640723
0.689288 0.695852 0.458436 0.458831
0.708748 0.703375 0.535251 0.533114
0.413984 0.416754 0.395943 0.390681
0.407968 0.403928 0.624228 0.619847
0.544949 0.542897 0.664491 0.668856
0.524135 0.528155 0.532781 0.538028
0.470219 0.470162 0.420437 0.429198
iteration: 100 cost:0.000139 Vcost:0.000154 Tcost:0.000...
LM LMt VM VMt
0.584808 0.586842 0.630913 0.626316
0.388352 0.392105 0.349546 0.347368
0.393688 0.392105 0.559884 0.552632
0.664738 0.657895 0.726401 0.726316
0.612452 0.605263 0.810347 0.815789
0.575922 0.565789 0.495603 0.492105
0.530172 0.534211 0.288435 0.286842
0.273569 0.273684 0.410325 0.407895
0.796237 0.802632 0.604085 0.607895
0.674765 0.668421 0.671714 0.671053
LD LDt VD VDt
0.628972 0.628281 0.499166 0.502625
0.521738 0.518094 0.651440 0.656947
0.647735 0.644817 0.635768 0.640723
0.689102 0.695852 0.458296 0.458831
0.708290 0.703375 0.534775 0.533114
0.413587 0.416754 0.395224 0.390681
0.407509 0.403928 0.624111 0.619847
0.545070 0.542897 0.664366 0.668856
0.523196 0.528155 0.532401 0.538028
0.469903 0.470162 0.420046 0.429198
TM TMt
0.806992 0.813158
0.734635 0.723684
0.199785 0.200000
0.342636 0.347368
0.624296 0.618421
0.622018 0.621053
0.240377 0.242105
0.780148 0.771053
0.394160 0.394737
0.717617 0.713158
TD TDt
0.505623 0.507833
0.590286 0.593828
0.525625 0.523148
0.698166 0.695852
0.656419 0.652929
0.699810 0.703375
0.602667 0.598243
0.619667 0.619847
0.384726 0.383886
0.492185 0.497361
real 125m5.242s
user 106m16.908s
sys 17m42.440s
}}
ページ名:
![[PukiWiki]](image/blackuni3-80x80.png "[PukiWiki]")
